CN112865311A - Method and device for monitoring message bus of power system - Google Patents
Method and device for monitoring message bus of power system Download PDFInfo
- Publication number
- CN112865311A CN112865311A CN202110053151.3A CN202110053151A CN112865311A CN 112865311 A CN112865311 A CN 112865311A CN 202110053151 A CN202110053151 A CN 202110053151A CN 112865311 A CN112865311 A CN 112865311A
- Authority
- CN
- China
- Prior art keywords
- message
- node
- information
- monitoring
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00001—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by the display of information or by user interaction, e.g. supervisory control and data acquisition systems [SCADA] or graphical user interfaces [GUI]
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00002—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by monitoring
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00006—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00006—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment
- H02J13/00016—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment using a wired telecommunication network or a data transmission bus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0677—Localisation of faults
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/069—Management of faults, events, alarms or notifications using logs of notifications; Post-processing of notifications
Abstract
The invention discloses a method and a device for monitoring a message bus of a power system, wherein the method comprises the following steps: each node collects and converges message monitoring information from a message bus; monitoring information display of the converged messages on each node; and each node performs off-disk storage on the message monitoring information. The device comprises components corresponding to the steps of the method. The invention enhances the monitoring capability of the message bus and improves the process monitoring level by constructing a panoramic real-time monitoring system facing the message registration state, the message subscription information, the message queue accumulation information, the node message transmission rate and the data traffic.
Description
Technical Field
The present invention relates to a method and an apparatus for monitoring a message bus, and more particularly, to a method and an apparatus for monitoring a message bus of a power system.
Background
With the continuous expansion of the scale of the power grid in China, the mixed operation of extra-high voltage alternating current and direct current and the large-scale centralized access of new energy, the national power grid gradually forms a pattern of repeated development of a main transmission network and a local transmission and distribution network which take extra-high voltage as a core. Due to the rapid development of the power grid and the formation of a large-scale interconnected power grid, the characteristics of the power grid are changed from a regional mode to a global mode, the power grid operation and dispatching control have the characteristics of data density, communication density and calculation density, and the power grid regulation and control work faces serious challenges. With the rapid development of an extra-high voltage alternating current-direct current hybrid power grid and the large-scale influx of new energy, the operation pressure of the power grid is continuously conducted to a dispatching operation link, a dispatching automation master station system is used as a core support system for power grid operation control and dispatching production management, is a center for gathering and processing various power grid data, and the potential problems of the dispatching automation master station system are highlighted day by day and become a huge hidden danger threatening the safe operation of a large power grid.
After the 2009 intelligent power grid dispatching control system is released, the system is widely applied to dispatching control centers with provinces and above 32 provinces and more than one hundred local dispatches, and the system is developed based on basic software such as a domestic server, a domestic general operating system, a database and the like. The message bus plays a role in message management, effectively supports applications such as data acquisition, data processing, accident inversion and public service, and realizes rapid message transmission on demand. The bus accumulates a great deal of experience in the long-term operation process of the dispatching automation system, and is also subject to the examination of various accidents and special conditions, the problem of weak bus monitoring means gradually emerges, the bus data transmission lacks powerful supervision and visual display, the unreliable monitoring data is provided for operation and maintenance personnel to carry out on-duty patrol, and the problem occurring in the message transmission cannot be reflected timely and intuitively. How to find the reasons of secondary system abnormity and positioning system abnormity in time and ensure the stable data transmission of the dispatching automation master station system is a problem which needs to be solved urgently to ensure the safe and stable operation of the power grid.
At present, in the field of computer networks, there are embedded system message bus monitoring related implementations directly based on hardware devices. For example, in chinese patent application No. 200710067178.8, an alarm management device for an embedded monitoring system based on a message bus is disclosed, which performs effective monitoring and data storage on an external alarm source connected to an embedded digital video system, and completes the linkage processing of the embedded digital video monitoring system on different alarm information. For another example, in chinese patent application No. 201610446984.5, a monitoring system and method for a message bus are disclosed, where the message bus is implemented by hardware devices and provides normalization processing and alarm management functions. However, the two monitoring technologies are both oriented to embedded system message buses directly based on hardware equipment, the buses are solidified in a memory chip or a single chip microcomputer, the software and hardware relations are tightly combined, the monitoring technologies are oriented to specific bottom application, and modification and secondary development are not supported. The message bus of the middleware layer of the general operating system has high requirements on universality, portability and iterability, and no effective monitoring means aiming at the field exists at present. Therefore, the capacity of dealing with the sudden fault abnormality in the field is obviously insufficient, and meanwhile, the detailed and perfect log record is lacked, the historical operating state is difficult to be checked and traced, and the difficulty is brought to fault analysis and positioning.
Disclosure of Invention
The purpose of the invention is as follows: aiming at the problems, a method and a device for monitoring a message bus of a power system are provided to realize the monitoring of the message bus of a middleware layer of a general operating system, and construct a panoramic real-time monitoring system facing to a message registration state, message subscription information, message queue accumulation information, node message transmission rate and data traffic, thereby enhancing the monitoring capability of the message bus and improving the monitoring level of the process.
The technical scheme is as follows: in one aspect, the present disclosure is directed to a power system message bus monitoring method. The method comprises the following steps: each node collects and converges message monitoring information from a message bus; monitoring information display of the converged messages on each node; and each node performs off-disk storage on the message monitoring information.
Further, the step of collecting and aggregating the message monitoring information from the message bus by each node specifically comprises: initializing a shared memory and a lock, and acquiring a local host name and a node ID of a current node and managing a registration process; then judging whether the current node is set as a service end node or a client node in the configuration file, and if the current node is the service end node, creating a service end thread, a message synchronization service end thread and a message synchronization client thread; if the service end node is the service end node, a message synchronization client thread is created.
Further, the server thread includes: calling a service registration interface to register a service, issuing the service by using a request/response model, then processing the service request in a callback function, judging whether a node to be inquired by the service request is a current node or not by the callback function, calling a local inquiry function if the node is the current node, and inquiring in a buffer area if the node is the current node; and selecting a corresponding interface through the operation code and the retrieval item during query, and splicing the query result into a response message to be returned.
Further, the message synchronization server thread includes: calling an initialization function to initialize a server, then registering an event on a file descriptor and placing the event in an event table, monitoring and detecting the occurrence of an I/O event on the file descriptor, returning the number of the I/O event by an interface, and returning the corresponding file descriptor and the event type through output parameters; traversing all I/O events, judging connection properties through file descriptors in the events, if the I/O events received by the monitoring socket represent that a new client applies for connection, receiving connection and registering the client in an event table; if the I/O event received by the socket is not monitored, the connected client side sends data, and the monitoring information synchronized from other nodes is received at the moment; in the process of receiving monitoring information synchronized from other nodes, a synchronization message needs to be received three times, the first time is to receive a synchronization message header and carry out validity check and update node operation state information, the second time is to receive the number of the monitoring information and obtain the length of the synchronization message, the third time is to receive and analyze the content of the synchronization message, and the analysis process is mainly to put the flow, subscription and queue of the synchronization message into corresponding containers in a memory respectively, including the flow information, channel subscription information and message queue information of all nodes.
Further, the message synchronization client thread comprises: establishing a message synchronization client request thread for each server node, and completing initialization of the client and connection with a server in the thread; then reading the flow information, subscription information and message queue information of the node from the shared memory, writing the flow information, subscription information and message queue information into a cache, and copying the corresponding monitoring information of the node into a synchronous message body; and finally, sending three synchronous messages, wherein any one of the three synchronous messages is failed to reconnect the server so as to keep the consistency of the receiving and sending orders, and the client periodically pushes monitoring information to the server, and the period is acquired by the configuration file.
Further, the displaying of the message monitoring information on each node includes: displaying the running state monitoring information, the message flow statistical information and the node monitoring detail information of the current node on each node; the operation state monitoring information includes: whether the second level, the minute level and the hour level of each node have the message receiving and sending, whether the message queues applied by each node have the message accumulation condition and whether the abnormal node exists or not; the abnormal node is a node which does not generate message interaction with other nodes within the minute-level time granularity; the message traffic statistics include: counting the message sending flow, the message receiving flow and the total message receiving and sending flow of each node message bus from the second-level time dimension, the minute-level time dimension and the hour-level time dimension; the node monitoring detail information includes: and one or more items of domain names, state names, channel names and time granularities are designated as retrieval conditions to obtain information obtained after detailed information query is carried out on the sending message traffic or the receiving message traffic.
Further, the step of performing the off-disk storage on the message monitoring information by each node comprises the following steps: important monitoring information is stored in a file system in a log-type disc-falling mode for later backtracking and tracing; the log file records some key data in the program running process, comprehensively records the running information of starting, quitting and faults of the message bus, and records the key information of message sending failure, packet loss retransmission and repeated message filtering.
In another aspect, the present disclosure is directed to a power system message bus monitoring apparatus. The device includes: the component is used for collecting and converging message monitoring information from the message bus; a component for monitoring aggregated messages for information presentation; and the component is used for performing disk-dropping storage on the message monitoring information.
Has the advantages that: compared with the prior art:
1. the invention sets different threads for different nodes, and can realize the monitoring of the message bus of the middleware layer of the general operating system, thereby better dealing with the sudden failure abnormity, improving the capability of troubleshooting and tracing the historical running state, and being beneficial to the failure analysis and positioning.
2. Aiming at the problems that a power grid dispatching control system lacks of statistics, integration and analysis functions of monitoring information, does not provide a corresponding interface, cannot realize visual and visual message and service monitoring, lacks of detailed and perfect log recording and the like, a panoramic message real-time monitoring system is constructed for monitoring the running state of a message bus in the whole system, including message registration information, message subscription information, message accumulation information, message flow information and the like, and statistical analysis is carried out according to multiple dimensions such as 'domain', 'state', 'channel' and the like on the basis of the information, the running state of system messages is accurately evaluated, part of important monitoring information is stored into a file system in a log mode, the investigation and the tracing of historical running states are ensured, and fault analysis and accurate positioning are facilitated.
3. The message monitoring technology obviously enhances the bus monitoring capability of the power grid regulation and control system, improves the process monitoring level, provides comprehensive and visual state information for data transmission and interaction of the power grid regulation and control system, and is beneficial to ensuring safe and stable operation of the power grid.
Drawings
FIG. 1 is a schematic view of a message bus monitoring hierarchy in the bus monitoring method of the present invention.
Detailed Description
The invention is further described with reference to the following figures and specific examples.
The invention develops overall design by taking message bus monitoring oriented to a dispatching automation master station system as a target. Firstly, researching key monitoring indexes such as message transmission flow/accumulation and the like based on the flow characteristics of message bus transmission, and researching and realizing a message bus multidimensional monitoring technology by adopting a centralized structured index information collection method; secondly, a computable efficient log disk-falling format is designed, and monitoring data such as message transmission, message subscription and the like are stored with extremely low resource overhead; finally, a data structure and a statistical algorithm of key monitoring indexes are provided, and the information accumulation/transmission abnormal information is captured by combining with the information bus high-timeliness analysis technology, so that the whole-process fine monitoring of the information transmission is realized, and powerful support is provided for the stable operation of the dispatching automation master station system.
Message bus monitoring technical point
Description of functions
The message monitoring module mainly provides the following functions:
a) and collecting monitoring information of the message. The message monitoring information of the node is obtained by reading the shared memory mode, and the message monitoring information of other nodes is synchronized to the monitoring service center node (the monitoring service center is specified in the configuration file) by a TCP mode.
b) A message monitoring service. Message monitoring services include message traffic monitoring, message classification statistics (by time period and node), message accumulation monitoring, subscription information monitoring, and the like.
c) And (5) message monitoring and displaying. The display mode is divided into interface display and terminal command line display.
(II) hierarchical design
The message bus monitoring module is designed as shown in fig. 1 in a layered design, each layer solves a specific problem, and the lower layer provides data and services for the upper layer.
a) A data acquisition layer: the message monitoring information of the node and other nodes is included, and the content comprises sending, receiving, subscribing, accumulating and the like of the message. The message monitoring information of the node is acquired by accessing the shared memory, and the message monitoring information of other nodes is acquired by a network.
b) Data buffer layer: and providing data for the data processing layer, wherein the data comprises the whole system data and the data of each node. In order to improve the interface access efficiency, the data buffer layer provides classification and calculation functions, so that the interface can directly read the latest calculation result without calculation during access.
c) A data processing layer: the data is returned in an interface mode, and the data is called in a callback function of a service bus, and 6 kinds of services such as sending, receiving, subscribing, accumulating, counting, node running states and the like of the message are provided (the message counting is used for realizing functions such as summarizing and sequencing, and the node running states are used for detecting and diagnosing whether the message bus function of a certain node is normal or not).
d) A data display layer: the message bus monitoring interface and the client tool are provided for users, operation and maintenance and developers to use.
e) A log storage layer: the method mainly records information of starting, exiting, faults and the like of a message bus, records key information of message sending failure, packet loss retransmission, repeated message filtering and the like, and has an automatic log file expiration deleting function.
(III) detailed description
1) Collection and aggregation of monitoring information
Firstly, initializing a shared memory and a lock, acquiring a local host name and a node ID, managing a registration process and the like. And then judging whether the current node is set as a service end node in the configuration file, if so, creating a service end thread, a message synchronization service end thread and a message synchronization client thread, and otherwise, creating a client synchronization thread.
The service end thread calls a service registration interface registration service, issues a service by using a request/response model, processes the service request in a callback function, and the callback function judges whether a node to be inquired by the service request is a current node or not, calls a local inquiry function if the node is the current node, and inquires in a buffer area if the node is the current node. And selecting a corresponding interface through the operation code and the retrieval item during query, and splicing the query result into a response message to be returned.
The message synchronization client thread firstly establishes a message synchronization client request thread for each server node, and completes initialization of the client and connection with the server in the thread; then reading the flow information, subscription information and message queue information of the node from the shared memory, writing the flow information, subscription information and message queue information into a cache, and copying the corresponding monitoring information of the node into a synchronous message body; and finally, sending three synchronous messages, wherein any one of the three synchronous messages is failed to reconnect the server so as to keep the consistency of the receiving and sending orders, and the client periodically pushes monitoring information to the server, and the period is acquired by the configuration file.
The message synchronization server thread firstly calls an initialization function to initialize the server, then registers the event on the file descriptor and puts the event in an event table, when monitoring and detecting the occurrence of the I/O event on the file descriptor, the interface returns the number of the I/O event, and the corresponding file descriptor and the event type are returned through the output parameters. Traversing all I/O events, judging connection properties through file descriptors in the events, if the I/O events received by the monitoring socket represent that a new client applies for connection, receiving connection and registering the client in an event table; if the I/O event received by the socket is not monitored, the I/O event represents that the connected client side sends data, and the monitoring information synchronized from other nodes is received at the moment. In the process, a synchronization message is required to be received three times, wherein the first time is to receive a synchronization message header, carry out validity check on the synchronization message header and update node running state information, the second time is to receive the number of monitoring information and obtain the length of the synchronization message, and the third time is to receive and analyze the content of the synchronization message, and the analysis process is mainly to respectively put the flow, subscription and queue contents of the synchronization message into corresponding containers in a memory, including flow information of all nodes, channel subscription information and message queue information.
2) Monitoring information presentation
a) Operating status overview interface
The interface is mainly used for monitoring whether the second-level, the minute-level and the hour-level of each node have the message receiving and sending or not and whether the message queues applied by each node have the message accumulation or not in a macroscopic view. The interface provides a function of displaying only abnormal nodes, and if any node does not have message interaction with other nodes within the time granularity of minute level, the node is regarded as a possible abnormal node. The interface provides a function of selecting nodes through a pull-down menu, and if a specific node is not selected, all nodes in the system are displayed in a default mode.
b) Message flow statistics interface
The interface respectively counts the message sending flow, the message receiving flow and the total message receiving and sending flow of each node message bus from the second-level, the minute-level and the hour-level time dimensions.
The interface provides query functions according to different time granularities and supports node selection through a pull-down menu, and if a specific node is not selected, all nodes in the system are displayed in a default mode.
c) Node monitoring detail interface
The interface can specify one or more items of domain names, state names, channel names and time granularities as retrieval conditions to carry out detailed information query on the sending message traffic or the receiving message traffic. Meanwhile, process subscription information and process message queue accumulation information of any node in the system are inquired.
3) Monitoring information falling plate
Important monitoring information is stored in a file system in a log-type disk drop mode for later backtracking and tracing. The log file records some key data in the program running process, comprehensively records running information such as starting, quitting, faults and the like of the message bus, records key information such as message sending failure, packet loss retransmission, repeated message filtering and the like, can backtrack the running state of the program through the log file, analyzes the reason of the running error of the program, and is convenient for maintenance and troubleshooting. Meanwhile, the running time of the current program can be checked according to the time information in the log file and used as reference data for system maintenance or other work.
The automatic creation and timed deletion of the message log are provided, and the over-expired log function is prevented, so that the log file is too large or occupies too much disk space. The log file is stored for 30 days, and is automatically deleted after 30 days. A special thread is designed to periodically check the log file status for deleting expired log files and creating new log files.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Finally, it should be noted that: although the present invention has been described in detail with reference to the above embodiments, the interaction between the control node and the edge computing node, the feedback information content collection and the online scheduling method in the present invention are applicable to all systems, and it should be understood by those skilled in the art that: modifications and equivalents may be made to the embodiments of the invention without departing from the spirit and scope of the invention, which is to be covered by the claims.
Claims (10)
1. A power system message bus monitoring method, comprising:
each node collects and converges message monitoring information from a message bus;
monitoring information display of the converged messages on each node;
and each node performs off-disk storage on the message monitoring information.
2. The method for monitoring the message bus of the power system according to claim 1, wherein the step of collecting and aggregating the message monitoring information from the message bus by each node specifically comprises: initializing a shared memory and a lock, and acquiring a local host name and a node ID of a current node and managing a registration process; then judging whether the current node is set as a service end node or a client node in the configuration file, and if the current node is the service end node, creating a service end thread, a message synchronization service end thread and a message synchronization client thread; if the service end node is the service end node, a message synchronization client thread is created.
3. The power system message bus monitoring method of claim 2, wherein the service-side thread comprises: calling a service registration interface to register a service, issuing the service by using a request/response model, then processing the service request in a callback function, judging whether a node to be inquired by the service request is a current node or not by the callback function, calling a local inquiry function if the node is the current node, and inquiring in a buffer area if the node is the current node; and selecting a corresponding interface through the operation code and the retrieval item during query, and splicing the query result into a response message to be returned.
4. The power system message bus monitoring method of claim 2, wherein the message synchronization server thread comprises: calling an initialization function to initialize a server, then registering an event on a file descriptor and placing the event in an event table, monitoring and detecting the occurrence of an I/O event on the file descriptor, returning the number of the I/O event by an interface, and returning the corresponding file descriptor and the event type through output parameters; traversing all I/O events, judging connection properties through file descriptors in the events, if the I/O events received by the monitoring socket represent that a new client applies for connection, receiving connection and registering the client in an event table; if the I/O event received by the socket is not monitored, the connected client side sends data, and the monitoring information synchronized from other nodes is received at the moment; in the process of receiving monitoring information synchronized from other nodes, a synchronization message needs to be received three times, the first time is to receive a synchronization message header and carry out validity check and update node operation state information, the second time is to receive the number of the monitoring information and obtain the length of the synchronization message, the third time is to receive and analyze the content of the synchronization message, and the analysis process is mainly to put the flow, subscription and queue of the synchronization message into corresponding containers in a memory respectively, including the flow information, channel subscription information and message queue information of all nodes.
5. The power system message bus monitoring method of claim 2, wherein the message synchronization client thread comprises: establishing a message synchronization client request thread for each server node, and completing initialization of the client and connection with a server in the thread; then reading the flow information, subscription information and message queue information of the node from the shared memory, writing the flow information, subscription information and message queue information into a cache, and copying the corresponding monitoring information of the node into a synchronous message body; and finally, sending three synchronous messages, wherein any one of the three synchronous messages is failed to reconnect the server so as to keep the consistency of the receiving and sending orders, and the client periodically pushes monitoring information to the server, and the period is acquired by the configuration file.
6. The power system message bus monitoring method of claim 1, wherein presenting message monitoring information on each node comprises: displaying the running state monitoring information, the message flow statistical information and the node monitoring detail information of the current node on each node;
the operation state monitoring information includes: whether the second level, the minute level and the hour level of each node have the message receiving and sending, whether the message queues applied by each node have the message accumulation condition and whether the abnormal node exists or not; the abnormal node is a node which does not generate message interaction with other nodes within the minute-level time granularity;
the message traffic statistics include: counting the message sending flow, the message receiving flow and the total message receiving and sending flow of each node message bus from the second-level time dimension, the minute-level time dimension and the hour-level time dimension;
the node monitoring detail information includes: and one or more items of domain names, state names, channel names and time granularities are designated as retrieval conditions to obtain information obtained after detailed information query is carried out on the sending message traffic or the receiving message traffic.
7. The power system message bus monitoring method of claim 1, wherein the step of storing the message monitoring information by each node comprises: important monitoring information is stored in a file system in a log-type disc-falling mode for later backtracking and tracing; the log file records some key data in the program running process, comprehensively records the running information of starting, quitting and faults of the message bus, and records the key information of message sending failure, packet loss retransmission and repeated message filtering.
8. An electric power system message bus monitoring device provided at each of a client node and a server node, comprising:
the component is used for collecting and converging message monitoring information from the message bus;
a component for monitoring aggregated messages for information presentation;
and the component is used for performing disk-dropping storage on the message monitoring information.
9. The power system message bus monitoring device of claim 1, wherein the component for collecting and aggregating the message monitoring information from the message bus specifically comprises: initializing a shared memory and a lock, and acquiring a local host name and a node ID of a current node and managing a registration process; then judging whether the current node is set as a service end node or a client node in the configuration file, and if the current node is the service end node, creating a service end thread, a message synchronization service end thread and a message synchronization client thread; if the service end node is the service end node, a message synchronization client thread is created.
10. The power system message bus monitoring device of claim 9, wherein the service-side thread comprises: calling a service registration interface to register a service, issuing the service by using a request/response model, then processing the service request in a callback function, judging whether a node to be inquired by the service request is a current node or not by the callback function, calling a local inquiry function if the node is the current node, and inquiring in a buffer area if the node is the current node; and selecting a corresponding interface through the operation code and the retrieval item during query, and splicing the query result into a response message to be returned.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110053151.3A CN112865311B (en) | 2021-01-15 | 2021-01-15 | Method and device for monitoring message bus of power system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110053151.3A CN112865311B (en) | 2021-01-15 | 2021-01-15 | Method and device for monitoring message bus of power system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112865311A true CN112865311A (en) | 2021-05-28 |
| CN112865311B CN112865311B (en) | 2022-11-01 |
Family
ID=76006517
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110053151.3A Active CN112865311B (en) | 2021-01-15 | 2021-01-15 | Method and device for monitoring message bus of power system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112865311B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114422333A (en) * | 2021-12-27 | 2022-04-29 | 广西壮族自治区公众信息产业有限公司 | Message consumption method and system based on message middleware backpressure |
| CN115102278A (en) * | 2022-06-16 | 2022-09-23 | 国网信息通信产业集团有限公司 | Distributed photovoltaic power quality configuration monitoring system and method |
| CN115348160A (en) * | 2022-07-15 | 2022-11-15 | 深圳手回科技集团有限公司 | Backtracking data storage method and device and computer equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040205048A1 (en) * | 2003-03-28 | 2004-10-14 | Pizzo Michael J. | Systems and methods for requesting and receiving database change notifications |
| CN102238105A (en) * | 2010-04-28 | 2011-11-09 | 捷讯研究有限公司 | System and method for distributing messages to an electronic device based on communications between devices |
| CN102360310A (en) * | 2011-09-28 | 2012-02-22 | 中国电子科技集团公司第二十八研究所 | Multitask process monitoring method and system in distributed system environment |
| CN110515938A (en) * | 2019-05-09 | 2019-11-29 | 北京科东电力控制系统有限责任公司 | Data convergence storage method, equipment and storage medium based on KAFKA messaging bus |
-
2021
- 2021-01-15 CN CN202110053151.3A patent/CN112865311B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040205048A1 (en) * | 2003-03-28 | 2004-10-14 | Pizzo Michael J. | Systems and methods for requesting and receiving database change notifications |
| CN102238105A (en) * | 2010-04-28 | 2011-11-09 | 捷讯研究有限公司 | System and method for distributing messages to an electronic device based on communications between devices |
| CN102360310A (en) * | 2011-09-28 | 2012-02-22 | 中国电子科技集团公司第二十八研究所 | Multitask process monitoring method and system in distributed system environment |
| CN110515938A (en) * | 2019-05-09 | 2019-11-29 | 北京科东电力控制系统有限责任公司 | Data convergence storage method, equipment and storage medium based on KAFKA messaging bus |
Non-Patent Citations (1)
| Title |
|---|
| 孙超等: "电力大数据多元数据采集监视技术研究与应用", 《计算机技术与发展》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114422333A (en) * | 2021-12-27 | 2022-04-29 | 广西壮族自治区公众信息产业有限公司 | Message consumption method and system based on message middleware backpressure |
| CN114422333B (en) * | 2021-12-27 | 2023-11-10 | 广西壮族自治区公众信息产业有限公司 | Message consumption method and system based on message middleware back pressure |
| CN115102278A (en) * | 2022-06-16 | 2022-09-23 | 国网信息通信产业集团有限公司 | Distributed photovoltaic power quality configuration monitoring system and method |
| CN115102278B (en) * | 2022-06-16 | 2024-01-23 | 国网信息通信产业集团有限公司 | Distributed photovoltaic power quality configuration monitoring system and method |
| CN115348160A (en) * | 2022-07-15 | 2022-11-15 | 深圳手回科技集团有限公司 | Backtracking data storage method and device and computer equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112865311B (en) | 2022-11-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112865311B (en) | Method and device for monitoring message bus of power system | |
| CN107302466B (en) | Big data analysis platform and method for dynamic loop monitoring system | |
| CN111077870A (en) | Intelligent OPC data real-time acquisition and monitoring system and method based on stream calculation | |
| CN111464336B (en) | High-concurrency data processing method and system based on electric power communication machine room | |
| CN108365985A (en) | A kind of cluster management method, device, terminal device and storage medium | |
| CN109783322A (en) | A kind of monitoring analysis system and its method of enterprise information system operating status | |
| CN107294764A (en) | Intelligent supervision method and intelligent monitoring system | |
| CN101296115B (en) | Telecommunication network multidimensional monitoring method | |
| CN113179173B (en) | Operation and maintenance monitoring system for expressway system | |
| CN112688819A (en) | Comprehensive management system for network operation and maintenance | |
| CN112749060A (en) | Power system service bus monitoring method | |
| CN110659180A (en) | Data center infrastructure management system based on cluster technology | |
| CN108182263A (en) | A kind of date storage method of data center's total management system | |
| CN114363222A (en) | Network equipment inspection method and system based on Netconf protocol | |
| CN114154035A (en) | Data processing system for dynamic loop monitoring | |
| CN109800133A (en) | A kind of method, one-stop monitoring alarm platform and the system of unified monitoring alarm | |
| CN105515192A (en) | Monitoring and early warning system and method for power transmission and transformation equipment load data access electric power system | |
| CN113076229A (en) | Universal enterprise-level information technology monitoring system | |
| CN112308731A (en) | Cloud computing method and system for multitask concurrent processing of acquisition system | |
| CN111913933A (en) | Power grid historical data management method and system based on unified support platform | |
| CN116594840A (en) | Log fault acquisition and analysis method, system, equipment and medium based on ELK | |
| CN111146868A (en) | Power communication machine room dynamic loop monitoring standardized access method and system | |
| CN115102828A (en) | Fault analysis method and device | |
| CN116016117A (en) | Network equipment operation and maintenance data acquisition method and system, electronic equipment and storage medium | |
| CN115130994A (en) | Digital city management system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |