CN109143878B - Remote signaling message and SOE message processing method for multi-channel acquisition channel - Google Patents

Remote signaling message and SOE message processing method for multi-channel acquisition channel Download PDF

Info

Publication number
CN109143878B
CN109143878B CN201810883528.6A CN201810883528A CN109143878B CN 109143878 B CN109143878 B CN 109143878B CN 201810883528 A CN201810883528 A CN 201810883528A CN 109143878 B CN109143878 B CN 109143878B
Authority
CN
China
Prior art keywords
remote signaling
message
channel
soe
rtu
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810883528.6A
Other languages
Chinese (zh)
Other versions
CN109143878A (en
Inventor
吴任博
熊文
危国恩
孔海滨
王佳
于全喜
胡扬
谭军光
徐雯清
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Power Supply Bureau of Guangdong Power Grid Co Ltd
Original Assignee
Guangzhou Power Supply Bureau Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Power Supply Bureau Co Ltd filed Critical Guangzhou Power Supply Bureau Co Ltd
Priority to CN201810883528.6A priority Critical patent/CN109143878B/en
Publication of CN109143878A publication Critical patent/CN109143878A/en
Application granted granted Critical
Publication of CN109143878B publication Critical patent/CN109143878B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00—Systems controlled by a computer
    • G05B15/02—Systems controlled by a computer electric
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/06—Electricity, gas or water supply
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/51—Discovery or management thereof, e.g. service location protocol [SLP] or web services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/56—Provisioning of proxy services
    • H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching

Abstract

The invention relates to a remote signaling message and SOE message processing method, computer equipment and a computer storage medium of a multi-channel acquisition channel. The method comprises the following steps: acquiring initial data uploaded by a plurality of RTU channels through a front cluster of an SCADA system, and converging the initial data to a distributed publishing and subscribing raw data queue; distributing each message in the raw data queue to a plurality of preset channel consumption modules; distributing the remote signaling message to a remote signaling optimization module according to the type, and distributing the SOE message to an SOE optimization module; writing the acquired remote signaling message into a preset RTU real-time section key value database, judging whether a subsequent acquired value is reversed or not, judging whether the subsequent remote signaling is repeated or not through matching and filtering of a residual channel number queue, determining an optimal remote signaling message according to the non-reversed and non-repeated remote signaling message, and sending the optimal remote signaling message to a result queue; and filtering and matching according to the time mark of the SOE message, eliminating subsequent repetition, and sending the preferred SOE message to a result queue.

Description

Remote signaling message and SOE message processing method for multi-channel acquisition channel
Technical Field
The invention relates to the technical field of intelligent power grid dispatching control, in particular to a remote signaling message and SOE message processing method, computer equipment and a computer storage medium of a multi-channel acquisition channel.
Background
An SCADA (Supervisory Control And Data Acquisition) system plays an extremely important role in the scheduling Control of the smart grid, And the quality of acquired Data is related to the stability of the operation of the grid. With the expansion of the scale of the power grid, the structure is more and more complex, and the RTU multichannel transmission and preposed wide area acquisition technology becomes the key point of partial research on SCADA data acquisition.
When the traditional local-level power grid dispatching control system is used for processing RTU multi-source collection or wide-area collection, data of an on-duty channel is adopted in principle, but when RTU running in a transformer substation is abnormal or a transmission network is abnormal, collected data of all channels are possibly inconsistent, some important data (such as remote signaling deflection and SOE) can be transmitted through the non-on-duty channel and is leaked in the on-duty channel, and when a collection link scanner of SCADA is abnormal and a new on-duty channel needs to be selected due to the abnormality of the on-duty channel, the generated remote signaling deflection and SOE signals are easily lost, so that the accuracy of remote signaling data and SOE data used for SCADA calculation service is low easily.
Disclosure of Invention
Based on this, it is necessary to provide a method, a computer device, and a computer storage medium for processing remote signaling messages and SOE messages of multiple acquisition channels, aiming at the technical problem that the conventional scheme is easy to cause low accuracy of remote signaling data and SOE data for SCADA computing services.
A remote signaling message and SOE message processing method for a multi-channel acquisition channel comprises the following steps:
acquiring initial data uploaded by a plurality of RTU channels through a front cluster of an SCADA system, and converging the initial data to a distributed publishing and subscribing raw data queue;
distributing each message in the raw data queue to a plurality of preset channel consumption modules; the channel consumption module analyzes the message, distributes the remote signaling message to the remote signaling optimization module according to the type, and distributes the SOE message to the SOE optimization module;
the remote signaling optimization module writes the acquired remote signaling message into a preset RTU real-time section key value database, judges whether a subsequent acquisition value is reversed or not, judges whether the subsequent remote signaling is repeated or not through matching and filtering of a residual channel number queue, determines an optimal remote signaling message according to the non-reversed and non-repeated remote signaling message and sends the optimal remote signaling message to a result queue;
and the SOE optimization module filters and matches according to the time mark of the SOE message, eliminates subsequent repetition and sends the optimized SOE message to a result queue.
According to the method for processing the remote signaling messages and the SOE messages of the multi-channel acquisition channels, initial data uploaded by the multi-channel RTU channels are acquired through a front cluster of an SCADA system, the initial data are gathered to a distributed publishing and subscribing raw data queue, each message in the raw data queue is distributed to a plurality of preset channel consumption modules, the channel consumption modules are used for analyzing the messages, the remote signaling messages are distributed to remote signaling optimization modules according to types, and the SOE messages are distributed to SOE optimization modules, so that the remote signaling messages and the SOE messages are optimized, the determined remote signaling messages and the determined SOE messages are more complete, no repeated data exist, and the accuracy is higher.
In one embodiment, the collecting, by the front-end cluster of the SCADA system, the initial data uploaded by the multiple RTU channels, and the aggregating the initial data to the distributed publish-subscribe raw data queue includes:
defining an acquisition message structure: mes ═ is [ rtuNo, chanNo, ptAddress, ptValue, ptStatus, msTime, isSOE ], wherein RTU denotes RTU number, chanNo denotes channel number, ptAddress denotes measurement point number, ptValue denotes acquisition value, ptStatus denotes quality code, msTime denotes millisecond time, isSOE denotes SOE flag;
the method comprises the steps that a front cluster collects messages of a plurality of RTU channels, remote signaling messages are assembled according to the messages and a collected message structure, and the msTime attribute, the issoE attribute and the assembly message code number of the remote signaling messages are obtained;
and issuing the remote signaling message to a generation data queue according to the msTime attribute, the issoE attribute and the assembly message code number.
The remote signaling message can be accurately issued to the raw data queue.
As an embodiment, the process of writing the collected remote signaling message into a preset RTU real-time profile key value database, determining whether a subsequent collected value is reversed, performing matching filtering through a remaining channel number queue, determining whether subsequent remote signaling is repeated, determining a preferred remote signaling message according to the non-reversed and non-repeated remote signaling message, and sending the preferred remote signaling message to a result queue by the remote signaling optimization module includes:
s31, initializing an RTU real-time section key value database RTU-KV;
s32, a remote signaling message di in the consumer data queuemRetrieving the RTU-KV library according to the storage format of the acquired key values; wherein, the key value of the collection measuring point<key,value>The storage format (i.e., the collection key value storage format) includes the following:<"RTU number | measurement point number | channel number", collecting numerical value>；
S33, if the RTU-KV database has no remote signaling message di retrievedmWriting the key value into an RTU-KV library according to a collection key value storage format; if the remote signaling message di is retrieved from the RTU-KV librarymComparing whether the acquired remote signaling value is equal to the retrieved remote signaling value, maintaining the RTU-KV library according to the acquisition key value storage format when the acquired remote signaling value is unequal, and returning to the step S32 when the acquired remote signaling value is equal to the retrieved remote signaling value;
s34, searching a preset cache space HashMap by using a character string of a connection structure in a format of 'RTU number', 'measuring point number', 'collecting numerical value';
s35, if no record is retrieved in step S34, storing the remote signaling message in a key value storage format (cache format): writing the < "RTU number | measurement point number | acquisition value", { optTime, chanQueue } > into HashMap;
s36, if the record is searched in the step S34, taking the value of chanQueue and judging the telecommand message dimWhether the channel number in (1) is in chanQueue; wherein, chanQueue represents RTU residual channel number queue of remote signaling message, and the solving method is as follows:
a. reading an RTU number and a channel number chanNo in a remote signaling message;
b. taking all channel number sets chanSet according to RTU numbers;
c. chanQueue + (chanSet-chanNo) means that the set chanSet minus chanNo is added to the tail of the original chanQueue one by one.
S37, if the remote signaling message dimThe channel number in the channel is in chanQueue, the first found value in chanQueue is deleted, whether chanQueue is empty is judged, and if the chanQueue is empty, the telecommand message di in HashMap is clearedmCollecting the time front set in HashMapRecording and deleting, constructing a channel missing alarm according to the content recorded by the chanQueue, and submitting the channel missing alarm to a channel monitor; returning to step S32;
s38, if the remote signaling message dimIf the channel number in (1) is not in the chanQueue, the chanQueue is updated, and the remote signaling message di is sentmWriting the HashMap according to a cache format;
s39, transmitting the remote signaling message dimWhen writing in HashMap according to the cache format, the remote signaling message dimWriting into RTU-KV library according to preferred positioning key value storage format, and transmitting remote signaling message dimAnd issuing the result to the result queue after fitting, and returning to the step S32.
The embodiment can realize the optimization and the deduplication of the remote signaling message, so that the remote signaling message information issued to the result queue is more complete.
As one embodiment, the HashMap is a hash table based Map container.
The HashMap provided by the embodiment can improve the efficiency of corresponding data processing.
In one embodiment, the SOE optimization module filters the matching according to the timestamp of the SOE message to exclude subsequent repetitions, and the process of sending the optimized SOE message to the result queue includes:
s41, initializing an internal cache queue SoeQueue;
s42, m-th SOE message SOE of consumption to raw data queuemDetermining said soemJson;
s43, inquiring whether json has a matching record in SoeQueue;
s44, when no record exists in the step S43, json is inserted into the tail of the SoeQueue, and the soem is issued to the result queue;
s45, circularly searching head information head of SoeQueue, and clearing the head information head;
s46, when there is a record in step S43, soe is determinedmA retransmission message for a channel;
s47, m is updated to m +1, and the process returns to step S42.
The method and the device can perform SOE time scale filtering on the RTU real-time section key value database, and guarantee the validity and the integrity of the corresponding SOE message.
In one embodiment, the channel consumption module is a consumer of a data queue.
The channel consumption module is used as a consumer of a raw data queue, and can call a power grid regulation and control model cloud service interface to acquire channel number information, perform shunting and parallel processing, and provide a service of inputting messages for a remote signaling preferred component and an SOE preferred component.
In one embodiment, the process of allocating each message in the raw data queue to a preset plurality of channel consumption modules includes:
acquiring the number C of the channel consumption module deployment and the channel number chanNo of each RTU channel;
distributing the remote signaling message of the channel chanNo to a kth channel consumption module; where k is chanNo% C, and the symbol% represents a modulo calculation.
A computer device includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the computer program, the processor implements the remote signaling message and SOE message processing method of the multiple acquisition channels provided in any of the above embodiments.
According to the method for processing the remote signaling message and the SOE message of the multi-channel acquisition channel, the invention also provides computer equipment and a computer storage medium, which are used for realizing the method for processing the remote signaling message and the SOE message of the multi-channel acquisition channel through a program. The computer equipment and the computer storage medium can enable the determined remote signaling message and the SOE message to be more complete, have no repeated data and have higher accuracy.
Drawings
FIG. 1 is a flow chart of a method for handling remote signaling messages and SOE messages for multiple acquisition channels according to an embodiment;
FIG. 2 is a schematic diagram of pre-processing multi-channel data for a SCADA system according to an embodiment;
FIG. 3 is a block diagram of a computer system, according to one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the detailed description and specific examples, while indicating the scope of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention.
It should be noted that the terms "first \ second \ third" related to the embodiments of the present invention only distinguish similar objects, and do not represent a specific ordering for the objects, and it should be understood that "first \ second \ third" may exchange a specific order or sequence when allowed. It should be understood that the terms first, second, and third, as used herein, are interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in other sequences than those illustrated or otherwise described herein.
The terms "comprises" and "comprising," and any variations thereof, of embodiments of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or modules is not limited to the listed steps or modules but may alternatively include other steps or modules not listed or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
Reference herein to "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
Referring to fig. 1, fig. 1 is a flowchart of a remote signaling message and SOE message processing method of a multi-channel acquisition channel according to an embodiment, including:
s10, acquiring initial data uploaded by a plurality of RTU channels through a wide area front cluster of the SCADA system, and converging the initial data to a distributed publishing and subscribing raw data queue;
the initial data may include a remote signaling message and an SOE message; SOE messages in an electric power system represent a sequence of events recording system or a sequence of events recording resolution for recording the time when a fault occurs and the type of event. The raw data queue is a message queue service provided by a distributed, high-throughput and high-expandability publish-subscribe message system, and can realize aggregation of monitoring and collecting data. In this embodiment, the wide-area pre-acquisition aggregated raw data queue and the result queue processed by the optimizer may be defined by a Topic mode of Kafka deployed in a secure production area, so as to implement publishing and subscribing of high-throughput distributed messages. The theme definition of the raw data queue may be: the Topic of the result queue is defined as: Data-Topic.
S20, distributing each message in the raw data queue to a plurality of preset channel consumption modules; the channel consumption module analyzes the message, distributes the remote signaling message to the remote signaling optimization module according to the type, and distributes the SOE message to the SOE optimization module;
the channel consumption module is a consumer of the data queue, and can call a power grid regulation and control model cloud service interface to acquire channel number information, perform shunting and parallel processing, and provide input information for a remote signaling optimization process and an SOE optimization process. The SOE mentioned above indicates a sequential event recording system or a sequential event recording resolution for recording the time when the failure occurs and the type of event.
The process of allocating to the preset plurality of channel consumption modules may include: if C channel consumption modules are deployed, a consumer (channel consumption module) with the number k (0< ═ k < C) only processes the information collected by the channel with the number k ═ channel number% C (modulus calculation, channel number is unique integer number).
S30, the remote signaling optimization module writes the acquired remote signaling message into a preset RTU real-time section key value database, judges whether a subsequent acquisition value is reversed or not, judges whether the subsequent remote signaling is repeated or not through matching and filtering of a residual channel number queue, determines an optimal remote signaling message according to the non-reversed and non-repeated remote signaling message, and sends the optimal remote signaling message to a result queue;
the steps are remote signaling optimization processes, a remote signaling insurance algorithm can be adopted, RTU real-time section key value database RTU-KV and cache space HashMap are defined, and the HashMap caches the real-time section acquired by the RTU multi-channel and the residual channel number queue of the remote signaling RTU. The new message is compared with a real-time value stored by the RTU-KV through checking, and whether the acquired value of the measuring point is reversed or not is judged; if the message is the reversed message, matching and checking with a 'residual channel number queue' stored in the HashMap, identifying the message processed for the first time, and filtering the subsequent retransmission messages of other channels; and issuing the first processed message to a result queue.
The RTU real-time section key value database RTU-KV database is an RTU channel real-time section key value cache database and stores the latest record of the RTU multi-channel acquisition measuring point and the real-time section information of the record of the preferred location; collecting key value storage format of measuring point: < RTU number | measurement point number | channel number >, collecting numerical values >; selecting a key value storage format of the measurement point after the optimal positioning: < RTU number | collection Point number >, collect numerical value >.
The cache space HashMap is a Map container based on a hash table, and the key value storage format of the cache space HashMap may be: < "RTU number | measurement point number | acquisition value", { opt time, chanQueue } >, where opt time represents the operating seconds value time and chanQueue represents the telecommand RTU remaining channel number queue.
And S40, the SOE optimizing module filters and matches according to the time mark of the SOE message, eliminates subsequent repetition and sends the optimized SOE message to the result queue.
The steps are an SOE optimization process, a buffer message queue can be designed through SOE time scale filtering, and json character strings of '{' msTime ': millisecond time,' rtuNo ': RTU number,' ptAddress ': measurement point number }' analyzed from SOE signals collected within set time (such as 15 minutes) are buffered; analyzing the received new SOE message, and matching and checking with the content of the cache queue; filtering out SOE messages with the same record in the cache queue; and the new SOE is not in the buffer queue, and the message is stored in the tail of the buffer queue and is sent to the result queue. The result queue is a message queue service provided by a publish-subscribe message system, and can fit the cache remote signaling message and the SOE signal into a path of acquisition signal with higher acquisition precision, and the acquisition signal is provided for the SCADA calculation service subscription.
In the method for processing the remote signaling message and the SOE message of the multi-channel acquisition channel provided by this embodiment, initial data uploaded by the multi-channel RTU channel is acquired through a front cluster of the SCADA system, the initial data is gathered to a distributed publishing and subscribing raw data queue, each message in the raw data queue is distributed to a plurality of preset channel consumption modules, the channel consumption modules are used to analyze the messages, the remote signaling message is distributed to a remote signaling optimization module according to types, and the SOE message is distributed to an SOE optimization module, so as to implement optimization of the remote signaling message and the SOE message, so that the determined remote signaling message and the SOE message are more complete, no duplicate data exists, and the method has higher accuracy.
In one embodiment, the collecting, by the wide area pre-cluster of the SCADA system, the initial data uploaded by the multiple RTU channels, and the aggregating the initial data to the distributed publish-subscribe raw data queue includes:
s11, defining an acquisition message structure: mes ═ is [ rtuNo, chanNo, ptAddress, ptValue, ptStatus, msTime, isSOE ], wherein RTU denotes RTU number, chanNo denotes channel number, ptAddress denotes measurement point number, ptValue denotes acquisition value, ptStatus denotes quality code, msTime denotes millisecond time, isSOE denotes SOE flag; the rtuNo and the ptAddress can uniquely locate a measuring point (monitoring point) of equipment in a transformer substation, the chanNo number is globally unique, and the quality code is quality information transmitted by the RTU;
s12, the front-end cluster collects the messages of the multi-channel RTU channel, assembles the remote signaling message according to the message and the collected message structure, and acquires the msTime attribute, the issoE attribute and the assembly message code number of the remote signaling message;
and S13, issuing the remote signaling message to a generation data queue according to the msTime attribute, the issoE attribute and the assembly message code number.
Specifically, in step S12, the front-end cluster collects messages of the RTU multiple paths and may also collect wide-area messages forwarded by other systems, and assembles the messages according to the Mes structure (collected message structure) after parsing (handling two attributes of msTime and isSOE by classification): remote signaling msTime takes the millisecond time of operating system assembly (e.g., 1/1970); if the issoE is 0, the assembled remote signaling message code number is di; the msTime of the SOE takes the transmitted time scale value; if isSOE is 1, the assembled SOE message is numbered SOE. In the step S13, the remote signaling message may be issued to the production data queue according to di or soe of the assembly result.
The remote signaling message can be accurately issued to the raw data queue.
As an embodiment, the process of writing the collected remote signaling message into a preset RTU real-time profile key value database, judging whether a subsequent collection value is reversed, matching and filtering through a residual channel number queue, judging whether the subsequent remote signaling is repeated, determining a preferred remote signaling message according to the non-reversed and non-repeated remote signaling message, and sending the preferred remote signaling message to a result queue by the remote signaling optimization module includes:
s31, initializing an RTU real-time section key value database RTU-KV;
s32, a remote signaling message di in the consumer data queuem(dimisSOE ═ 0), retrieving the RTU-KV repository according to the collection key value storage format (i.e. the string of the connection structure of the key "RTU number | measurement point number | channel number"); the collection key value storage format comprises the following contents: RTU number | measurement point number | channel number;
s33, if the RTU-KV database has no remote signaling message di retrievedmWriting the key value into an RTU-KV library according to a collection key value storage format; if the remote signaling message di is retrieved from the RTU-KV librarymComparing whether the acquired remote signaling value is equal to the retrieved remote signaling value, maintaining the RTU-KV library according to the acquired key value storage format when the acquired remote signaling value is unequal, and returning to the step S32 to continue extracting subsequent remote signaling messages when the acquired remote signaling value is equal to the retrieved remote signaling value;
s34, retrieving a preset cache space HashMap according to the character string of the collection key value storage format connection structure;
s35, if no record is searched in the step S34, writing the remote signaling message into the HashMap according to a cache format; wherein the cache format is: < "RTU number | measurement point number | acquisition value", { optTime, chanQueue } >; the optTime represents the operation second value time, and the chanQueue represents the RTU residual channel number queue of the remote signaling message;
s36, if the record is searched in the step S34, taking the value of chanQueue and judging the telecommand message dimWhether the channel number in (1) is in chanQueue;
s37, if the remote signaling message dimThe channel number in the channel is in chanQueue, the first found value in chanQueue is deleted, whether chanQueue is empty is judged, and if the chanQueue is empty, the telecommand message di in HashMap is clearedm(specifically, relevant records of the remote signaling message dim in the HashMap are cleared), records before set time in the HashMap are collected and deleted, a channel missed alarm is constructed according to the content recorded by chanQueue, and the channel missed alarm is submitted to a channel monitor; returning to step S32; the set time may be set to 15 minutes;
s38, if the remote signaling message dimIf the channel number in (1) is not in the chanQueue, the chanQueue is updated (new chanQueue is calculated), and the remote signaling message di is sentmWriting the HashMap according to a cache format;
s39, transmitting the remote signaling message dimWhen the HashMap is written according to the cache format (namely the record of the remote signaling message dim maintains the HashMap), the remote signaling message di is written into the HashMapmWriting into RTU-KV library according to preferred positioning key value storage format, and transmitting remote signaling message dimAnd issuing the result to the result queue after fitting, and returning to the step S32.
The result queue is a message queue service provided by a publishing and subscribing message system, cache remote signaling data and SOE signals are fit into a path of acquisition signals with higher acquisition precision, and the acquisition signals are provided for SCADA calculation service subscription.
The embodiment can realize the optimization and the deduplication of the remote signaling message, so that the remote signaling message information issued to the result queue is more complete.
As one embodiment, the HashMap is a hash table based Map container.
The cache format corresponding to the HashMap may be: < "RTU number | measurement point number | acquisition value", { optTime, chanQueue } >, optTime being the operating seconds value time, chanQueue being the telecommand RTU remaining channel number queue. The chanQueue solution method is as follows:
a. reading an RTU number and a channel number chanNo in a remote signaling message;
b. taking all channel number sets chanSet according to RTU numbers;
c. chanQueue + (chanSet-chanNo) means that the set chanSet minus chanNo is added to the tail of the original chanQueue one by one.
The HashMap provided by the embodiment can improve the efficiency of corresponding data processing.
In one embodiment, the SOE optimization module filters matches according to the timestamp of the SOE message to exclude subsequent repetitions, and the process of sending the optimized SOE message to the result queue includes:
s41, initializing an internal cache queue SoeQueue;
s42, mth SOE message SOE consumed to Fert-Data-TopicmDetermining said soemJson; wherein Fert-Data-Topic represents the subject of the raw Data queue; the json may be:
json＝'{"msTime":soem.msTime,"rtuNo":soem.rtuNo,"ptAddress":soem.ptAddress}'；
s43, inquiring whether json has a matching record in SoeQueue;
s44, when no record exists in the step S43, json is inserted into the opposite tail of SoeQueue, and the soem is issued to Data-Topic; wherein the Data-Topic is the subject of the result queue;
s45, circularly searching the head of queue information head of SoeQueue, wherein soem, msTime-head, msTime >900000, and clearing the head of queue information;
s46, when there is a record in step S43, soe is determinedmA retransmission message for a channel; at this time, the retransmission message is not processed;
s47 updates m to m +1 (i.e., m is m +1), and the process returns to step S42 to consume the next message.
The method and the device can perform SOE time scale filtering on the RTU real-time section key value database, and guarantee the validity and the integrity of the corresponding SOE message.
In one embodiment, the channel consumption module is a consumer of a data queue.
The channel consumption module is used as a consumer of a 'raw data queue', and can call a power grid regulation and control model cloud service interface to acquire channel number information, perform shunting and parallel processing, and provide a service of inputting messages for a remote signaling preferred component and an SOE preferred component.
In one embodiment, the process of allocating each message in the raw data queue to a preset plurality of channel consumption modules includes:
acquiring the number C of the channel consumption module deployment and the channel number chanNo of each RTU channel;
distributing the remote signaling message of the channel chanNo to a kth channel consumption module; where k is chanNo% C, and the symbol% represents a modulo calculation.
The embodiment can realize the ordered distribution of each remote signaling message in the raw data queue.
Specifically, the channel consumption module may further perform the following data processing:
a, calling a service interface of a power grid regulation and control model, reading an RTU number set Rtu _ No required to be matched, and initializing a pre-correlation model;
b, consuming a message mes of Fert-Data-Topic;
c, reading an RTU number (mes. rtuNo) of mes, and judging whether the RTU is in Rtu _ No; if not, returning to the step a;
d, if the RTU is in Rtu _ No, deploying C channel consumption modules inside the optimizer, and numbering according to an integer k; wherein k is more than or equal to 0 and is less than C;
e, judging whether the value of chanNo% C (remainder calculation, generally, the channel number of the RTU is a continuous integer number) is k;
f, if the step e is yes, indicating that mes is matched with the pre-model, encapsulating the remote signaling into a message di, and issuing the message di to a remote signaling preferred component for processing; if the message is SOE, the message is packaged into a message SOE and is issued to an SOE preferred component for processing;
monitoring related preposed model change information, and maintaining a local model of a channel consumption module;
h, returning to execute the step b.
In one embodiment, the prepositive wide-area multi-channel data processing process of the SCADA system can be as shown in fig. 2, and the processing process involves a structure including a prepositive cluster S1, an acquisition channel S2, a wide-area prepositive acquisition aggregated raw data queue S3, a channel consumption module S4, a model service interface S5, a result queue S6, a remote signaling selection component S7, and an SOE selection component S8.
In the pre-cluster S1, the RTU of the transformer substation transmits station end data to different nodes in the pre-cluster through a multi-path acquisition channel, and the forwarding RTU transmits the forwarded message to different pre-nodes through two paths of channels; the preposed node analyzes the message, and then assembles the message according to the Mes structure: remote signaling msTime takes the millisecond time of operating system assembly (1/1970); issoE is 0, and the assembled remote signaling message code number is di; the msTime of the SOE takes the transmitted time mark value, the issoE is 1, and the code number of the assembled SOE message is SOE;
the acquisition channel S2 can represent communication channels in various forms, and information acquired from different security areas is gathered to a raw data queue of a large security production area;
in the above steps, the raw data queue S3 and the result queue S6 are collected and aggregated in the wide area pre-stage, and the result queue processed by the optimizer is defined by a Topic mode of Kafka deployed in a secure production area, so as to implement publishing and subscribing of high-throughput distributed messages. The topic of the raw data queue is defined as: the Topic of the result queue is defined as: Data-Topic;
the channel consumption module S4 can perform data processing related to the channel consumption module;
the remote signaling selecting component S7 can perform remote signaling message optimization;
the SOE preference component S8 described above may perform the preference of the SOE message.
In the embodiment, a remote signaling insurance algorithm and an SOE time scale filtering algorithm are adopted to realize the filtering and complementation of the multi-channel collected signals, so that the signals are ensured not to be lost and repeated; the remote signaling message can be processed in a passive contact mode, the relay contact is switched to be low-level or high-level signals through a remote signaling terminal board and then sent to an RTU, and the signals are transmitted immediately after being generated without time marks; the SOE is a sequence of events record with a time stamp to facilitate post-hoc analysis.
FIG. 3 is a block diagram of a computer system 1000 upon which embodiments of the present invention may be implemented. The computer system 1000 is only one example of a suitable computing environment for the invention and is not intended to suggest any limitation as to the scope of use of the invention. The computer system 1000 includes a processor 1010, a memory 1020, and a system bus 1022. It should be noted that other computer systems, including more or less subsystems than computer system 1000, can also be suitable for use with the invention. As described in detail above, a computer system 1000 suitable for use with the present invention is capable of performing the operations specified for the remote signaling message and SOE message processing methods for multiple acquisition channels. Thus, implementations of the invention are not limited to any specific combination of hardware circuitry and software.
Based on the above examples, in one embodiment, there is also provided a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the method for processing the remote signaling message and the SOE message of the multiple acquisition channels according to any one of the above embodiments.
The computer equipment realizes accurate selection of the remote signaling message and the SOE message through the computer program running on the processor.
It will be understood by those skilled in the art that all or part of the processes in the methods of the embodiments described above may be implemented by a computer program to instruct associated hardware, where the program may be stored in a non-volatile computer-readable storage medium, and, as in the embodiments of the present invention, the program may be stored in the storage medium of a computer system and executed by at least one processor in the computer system, so as to implement the processes of the embodiments including the methods for processing a telecommand message and an SOE message of a multi-channel acquisition channel as described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
Accordingly, in an embodiment, there is also provided a computer storage medium having a computer program stored thereon, wherein the program is executed by a processor to implement the method for processing the remote signaling message and the SOE message of any one of the multiple acquisition channels in the above embodiments.
The computer storage medium can enable the determined remote signaling message and the SOE message to be more complete through the stored computer program, does not have repeated data, and has higher accuracy.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (6)

1. A remote signaling message and SOE message processing method for a multi-channel acquisition channel is characterized by comprising the following steps:
acquiring initial data uploaded by a plurality of RTU channels through a front cluster of an SCADA system, and converging the initial data to a distributed publishing and subscribing raw data queue; further comprising: defining an acquisition message structure: mes ═ is [ rtuNo, chanNo, ptAddress, ptValue, ptStatus, msTime, isSOE ], wherein RTU denotes RTU number, chanNo denotes channel number, ptAddress denotes measurement point number, ptValue denotes acquisition value, ptStatus denotes quality code, msTime denotes millisecond time, isSOE denotes SOE flag; the method comprises the steps that a front cluster collects messages of the multi-channel RTU channel, remote signaling messages are assembled according to the messages and a collected message structure, and the msTime attribute, the issoE attribute and the assembly message code number of the remote signaling messages are obtained; issuing the remote signaling message to a data generation queue according to the msTime attribute, the issoE attribute and the assembly message code number;
distributing each message in the raw data queue to a plurality of preset channel consumption modules; the channel consumption module analyzes the message, distributes the remote signaling message to the remote signaling optimization module according to the type, and distributes the SOE message to the SOE optimization module;
the remote signaling optimization module writes the acquired remote signaling message into a preset RTU real-time section key value database, judges whether a subsequent acquisition value is reversed or not, judges whether the subsequent remote signaling is repeated or not through matching and filtering of a residual channel number queue, determines an optimized remote signaling message according to the unreversed and unrepeated remote signaling message and sends the optimized remote signaling message to a result queue; further comprising: s31, initializing an RTU real-time section key value database RTU-KV; s32, a remote signaling message di in the consumer data queuemRetrieving the RTU-KV library according to the storage format of the acquired key values; the collection key value storage format comprises the following contents: RTU number | measurement point number | channel number; s33, if the RTU-KV database has no remote signaling message di retrievedmWriting the key value into an RTU-KV library according to a collection key value storage format; if the remote signaling message di is retrieved from the RTU-KV librarymComparing whether the acquired remote signaling value is equal to the retrieved remote signaling value, maintaining the RTU-KV library according to the acquisition key value storage format when the acquired remote signaling value is unequal, and returning to the step S32 when the acquired remote signaling value is equal to the retrieved remote signaling value; s34, retrieving a preset cache space HashMap according to the character string of the collection key value storage format connection structure; s35, if no record is searched in the step S34, writing the remote signaling message into the HashMap according to a cache format; s36, if the record is searched in the step S34, taking the value chanQueue and judging the telecommand message dimWhether the channel number in (1) is in chanQueue; wherein chanQueue represents a remote signaling messageRTU residual channel number queue; s37, if the remote signaling message dimThe channel number in the channel is in chanQueue, the first found value in chanQueue is deleted, whether chanQueue is empty is judged, and if the chanQueue is empty, the telecommand message di in HashMap is clearedmCollecting records before set time in the HashMap, deleting the records, constructing a channel missing alarm according to the content recorded by chanQueue, and submitting the channel missing alarm to a channel monitor; returning to step S32; s38, if the remote signaling message dimIf the channel number in (1) is not in the chanQueue, the chanQueue is updated, and the remote signaling message di is sentmWriting the HashMap according to a cache format; s39, transmitting the remote signaling message dimWhen writing in HashMap according to the cache format, the remote signaling message dimWriting the RTU-KV library according to the preferred positioning key value storage format and sending the remote signaling message dimThe result is issued to a result queue after fitting, and the step S32 is returned;
the SOE optimization module filters and matches according to the time scale of the SOE message, eliminates subsequent repetition and sends the optimized SOE message to a result queue; further comprising: s41, initializing an internal cache queue SoeQueue; s42, m-th SOE message SOE of consumption to raw data queuemDetermining said soemJson; s43, inquiring whether json has a matching record in SoeQueue; s44, when no record is recorded in the step S43, json is inserted into the queue tail of SoeQueue and issued soemGiving a result queue; s45, circularly searching head information head of SoeQueue, and clearing the head information head; s46, when there is a record in step S43, soe is determinedmA retransmission message for a channel; s47, m is updated to m +1, and the process returns to step S42.
2. The method for processing the remote signaling messages and the SOE messages through the multi-channel acquisition channel according to claim 1, wherein the HashMap is a Map container based on a hash table.
3. The method of claim 1, wherein the channel consuming module is a consumer of a data queue.
4. The method of claim 1, wherein the process of distributing each message in the raw data queue to a plurality of preset channel consumption modules comprises:
acquiring the number C of the channel consumption module deployment and the channel number chanNo of each RTU channel;
distributing the remote signaling message of the channel chanNo to a kth channel consumption module; where k is chanNo% C, and the symbol% represents a modulo calculation.
5. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executing the computer program implements a method of telecommand message and SOE message processing for multiple acquisition channels according to any one of claims 1 to 4.
6. A computer storage medium on which a computer program is stored, the program, when executed by a processor, implementing a method for remote signaling messages and SOE messages processing for multiple acquisition channels according to any one of claims 1 to 4.
CN201810883528.6A 2018-08-06 2018-08-06 Remote signaling message and SOE message processing method for multi-channel acquisition channel Active CN109143878B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810883528.6A CN109143878B (en) 2018-08-06 2018-08-06 Remote signaling message and SOE message processing method for multi-channel acquisition channel

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810883528.6A CN109143878B (en) 2018-08-06 2018-08-06 Remote signaling message and SOE message processing method for multi-channel acquisition channel

Publications (2)

Publication Number Publication Date
CN109143878A CN109143878A (en) 2019-01-04
CN109143878B true CN109143878B (en) 2020-01-03

Family

ID=64791671

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810883528.6A Active CN109143878B (en) 2018-08-06 2018-08-06 Remote signaling message and SOE message processing method for multi-channel acquisition channel

Country Status (1)

Country Link
CN (1) CN109143878B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110417898B (en) * 2019-07-31 2022-02-22 拉扎斯网络科技（上海）有限公司 Data transmission method, device, client, electronic equipment and storage medium

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101989938A (en) * 2009-08-04 2011-03-23 上海市电力公司 Filtration system and method of mis-telecommand scheduling end of transformer substation
CN102412625B (en) * 2011-11-14 2013-10-09 航天科工深圳（集团）有限公司 Remote signaling data acquisition method and device
CN103236745A (en) * 2013-05-07 2013-08-07 国家电网公司 Distinguishing method of misreported remote signaling and correct remote signaling of transformer substation
CN103312040A (en) * 2013-07-02 2013-09-18 国家电网公司 Control method for improving reliability of AVC (Automatic Voltage Control) system of electric power monitoring center
CN103578043B (en) * 2013-10-30 2017-02-01 广东电网公司电力科学研究院 Device, method and system for processing power grid data
JP2016226164A (en) * 2015-05-29 2016-12-28 株式会社日立製作所 Power system monitoring control system and power system monitoring control method
CN106602716B (en) * 2015-10-15 2019-08-06 中国电力科学研究院 A kind of statistical method of the remote signalling accuracy based on electrical power distribution automatization system
CN105630455B (en) * 2016-01-29 2018-10-02 山东鲁能智能技术有限公司 The data queue of multi-data source is stored with sequence controlling method and system

Also Published As

Publication number Publication date
CN109143878A (en) 2019-01-04

Similar Documents

Publication Publication Date Title
US5745693A (en) System for gathering and reporting real time data from an IDNX communications network
CN109918349A (en) Log processing method, device, storage medium and electronic device
CN106940677A (en) One kind application daily record data alarm method and device
CN103942210A (en) Processing method, device and system of mass log information
CN110795428A (en) Time sequence data storage method and time sequence database applied to industrial Internet of things
CN108399186A (en) A kind of collecting method and device
CN103702053A (en) Video storage and search method and system as well as monitoring system
CN103178998A (en) Test and control data transmission method and device
CN109391629A (en) Track traffic synthetic monitoring system data processing method
CN104636477B (en) The De-weight method of push list before a kind of information push
CN102937984B (en) A kind of collect the system of data, client and method
CN105159925B (en) A kind of data-base cluster data distributing method and system
CN109191023A (en) A kind of power grid warning information immediate processing method and device
CN109143878B (en) Remote signaling message and SOE message processing method for multi-channel acquisition channel
CN113472858B (en) Buried point data processing method and device and electronic equipment
CN114489477A (en) Decentralized distributed storage method based on block chain
CN114138680A (en) Data construction method, data query method, data test method, electronic device, and storage medium
CN105939364A (en) Intelligent message push method and system
CN111538772B (en) Data exchange processing method and device, electronic equipment and storage medium
CN111798655B (en) Operation data minute-level acquisition method suitable for power Internet of things platform area
CN116016117A (en) Network equipment operation and maintenance data acquisition method and system, electronic equipment and storage medium
CN111625517B (en) New energy real-time data processing method and device based on change storage
CN108170825A (en) Distributed energy data monitoring cleaning method based on cloud platform
CN114297211A (en) Data online analysis system, method, equipment and storage medium
CN106372121A (en) Server and data processing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20200917

Address after: 510620 Tianhe District, Guangzhou, Tianhe South Road, No. two, No. 2, No.

Patentee after: Guangzhou Power Supply Bureau of Guangdong Power Grid Co.,Ltd.

Address before: 510620 Tianhe District, Guangzhou, Tianhe South Road, No. two, No. 2, No.

Patentee before: GUANGZHOU POWER SUPPLY Co.,Ltd.

TR01 Transfer of patent right