CN110858850B - Comprehensive network management method, device and system for rail transit system - Google Patents
Comprehensive network management method, device and system for rail transit system Download PDFInfo
- Publication number
- CN110858850B CN110858850B CN201810967894.XA CN201810967894A CN110858850B CN 110858850 B CN110858850 B CN 110858850B CN 201810967894 A CN201810967894 A CN 201810967894A CN 110858850 B CN110858850 B CN 110858850B
- Authority
- CN
- China
- Prior art keywords
- data
- message
- network management
- message queue
- processing center
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000007726 management method Methods 0.000 title claims abstract description 142
- 238000000034 method Methods 0.000 claims abstract description 30
- 230000005540 biological transmission Effects 0.000 claims abstract description 15
- 238000012544 monitoring process Methods 0.000 claims description 26
- 238000004891 communication Methods 0.000 claims description 14
- 238000007405 data analysis Methods 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 2
- 238000012546 transfer Methods 0.000 claims 2
- 230000008878 coupling Effects 0.000 abstract description 5
- 238000010168 coupling process Methods 0.000 abstract description 5
- 238000005859 coupling reaction Methods 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 11
- 238000012545 processing Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 6
- 238000006424 Flood reaction Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L27/00—Central railway traffic control systems; Trackside control; Communication systems specially adapted therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L27/00—Central railway traffic control systems; Trackside control; Communication systems specially adapted therefor
- B61L27/70—Details of trackside communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/04—Network management architectures or arrangements
- H04L41/042—Network management architectures or arrangements comprising distributed management centres cooperatively managing the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Mechanical Engineering (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Computer Security & Cryptography (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention provides a rail transit system comprehensive network management method, a rail transit system comprehensive network management device and a rail transit system comprehensive network management system. The method is used for data transmission management between a subsystem network manager and a data processing center in a rail transit system, and comprises the following steps: receiving data uploaded by a subsystem network manager, and converting the data into normalized message data with a universal data mode; transmitting the normalized message data to a message queue middleware server; the message queue middleware server acquires the theme of the normalized message data and publishes the message data according to the theme; and sending the message data with the subscription theme in the message queue middleware server to the data processing center according to the subscription theme of the data processing center. The direct coupling of data between the data processing center and each subsystem network management is reduced, the stability of the whole comprehensive network management system is ensured, and the integrity of the data is ensured by utilizing the high availability of the message queue middleware.
Description
Technical Field
The invention relates to the technical field of rail transit, in particular to a rail transit system comprehensive network management method and device in a rail transit system comprehensive network management system and the rail transit system comprehensive network management system.
Background
The rail transit management system is a foundation for rail transit operation, and is used for managing each subsystem, equipment and the like in the rail transit system, and the rail transit management system can operate efficiently without errors, which is a basic requirement of the rail transit system. The rail transit system is a complex system, which includes a plurality of subsystems and a large number of system devices, and each subsystem often includes its own subsystem network manager, so the construction of the rail transit management system is very complex. Generally speaking, the rail transit management system may include an integrated network management system, the integrated network management system includes network management of each subsystem, a data processing center, an integrated network management center, and the like, and the integrated network management system performs unified management on the network management of each subsystem. This requires the comprehensive network management system to comprehensively grasp and centrally process the device status information and alarm information of each subsystem, and has high requirements for the communication and information processing capabilities of the comprehensive network management system.
In the existing technical scheme, each subsystem network manager is directly connected to a data processing center of a comprehensive network manager, and the comprehensive network manager data processing center is responsible for processing acquired device data information and storing final data in storage devices. Therefore, basic monitoring of the equipment state of each subsystem and storage of various information can be achieved, but when too many subsystems exist, or the number of equipment in the system is too large, and a large amount of real-time data are concurrent, it is difficult to ensure that no data is lost in the system, and the reliability of the system is difficult to ensure.
In addition, a large amount of data processing is disordered, and the situation that data received first is processed in a lagging mode and new data is covered by the lagging data may occur, so that errors occur in monitoring of the equipment state, and network management personnel are misled.
Disclosure of Invention
The present invention is directed to solving, at least to some extent, one of the technical problems in the related art described above. The comprehensive network management method for the rail transit system can ensure that data can be processed and stored in time and cannot be lost when a plurality of subsystem network managers send data.
In order to achieve the above object, an embodiment according to a first aspect of the present invention provides a method for integrated network management of a rail transit system, which is used for data transmission management between a subsystem network management and a data processing center in the rail transit system, and includes:
receiving data uploaded by a subsystem network manager, and converting the data into normalized message data with a universal data mode;
transmitting the normalized message data to a message queue middleware server;
the message queue middleware server acquires the theme of the normalized message data and publishes the message data according to the theme;
and sending the message data with the subscription theme in the message queue middleware server to the data processing center according to the subscription theme of the data processing center.
In some embodiments, the receiving data uploaded by the subsystem network manager and converting the data into normalized message data with a common data pattern includes:
receiving data uploaded by a subsystem network manager according to a first protocol, and analyzing according to the first protocol to obtain analyzed data;
converting the analyzed data into normalized message data with a general data mode according to a second protocol;
wherein the first protocol and the second protocol are different communication protocols.
In some embodiments, said transmitting said normalized message data to a message queue middleware server comprises:
and transmitting the normalized message data to the message queue middleware server according to the key value sequence by taking the identification marks of the network managers of all the subsystems as key values.
In some embodiments, the obtaining, by the message queue middleware server, a topic of the normalized message data, and publishing the message data according to the topic includes:
establishing a corresponding message queue for each subsystem network manager at the message queue middleware server,
and acquiring a source subsystem network manager of the message data, and publishing the message data to a message queue corresponding to the source subsystem network manager.
In some embodiments, the track traffic system integrated network management method further includes:
and periodically checking the messages in the message queue middleware server, and removing the messages meeting the preset discarding condition from each message queue.
In some embodiments, after sending the message data with the subscription topic in the message queue middleware server to the data processing center according to the subscription topic of the data processing center, the method further includes:
the data processing center stores the message data in a classified mode, temporary data in the message data are stored in a local database, and the equipment monitoring data are stored in a cloud database.
The rail transit system integrated network management method of the invention utilizes the two-layer separated structure mode of the data processing center of the integrated network management and the message queue middleware server, can reduce the direct coupling of data between the data processing center and each subsystem network management, and ensure the stability of the whole integrated network management system.
In order to achieve the above object, an embodiment according to a second aspect of the present invention provides a rail transit system integrated network management device for data transmission management between a subsystem network management and a data processing center in a rail transit system, which includes:
the interface adapter module is used for receiving data uploaded by a subsystem network manager, converting the data into normalized message data with a general data mode, and transmitting the normalized message data to a message queue middleware server;
and the message queue middleware server is used for acquiring the theme of the normalized message data, publishing the message data according to the theme and sending the message data with the subscription theme in the message queue middleware server to the data processing center according to the subscription theme of the data processing center.
In some embodiments, the receiving, by the interface adapter module, data uploaded by a subsystem network manager, and converting the data into normalized message data having a common data pattern includes:
receiving data uploaded by a subsystem network manager according to a first protocol, and analyzing according to the first protocol to obtain analyzed data;
converting the analyzed data into normalized message data with a general data mode according to a second protocol;
wherein the first protocol and the second protocol are different communication protocols.
In some embodiments, the interface adapter module transmitting the normalized message data to a message queue middleware server comprises:
and transmitting the normalized message data to the middleware server according to the key value sequence by taking the identification mark of each subsystem network manager as a key value.
In some embodiments, the obtaining, by the message queue middleware server, a topic of the normalized message data, and publishing the message data according to the topic includes:
establishing a corresponding message queue for each subsystem network manager at the message queue middleware server,
and acquiring a source subsystem network manager of the message data, and publishing the message data to a message queue corresponding to the source subsystem network manager.
In some embodiments, the message queue middleware server is further configured to:
and periodically checking the messages in the message queue middleware server, and removing the messages meeting the preset discarding condition from each message queue.
The rail transit system integrated network management device of the invention utilizes a two-layer separated structure mode of the integrated network management data processing center and the message queue middleware server, can reduce the direct coupling of data between the data processing center and each subsystem network management, ensures the stability of the whole integrated network management system, and in addition, ensures the integrity of the data by utilizing the high availability of the message queue middleware in the message queue middleware server, well solves the problem of message loss under unreliable network and the performance bottleneck under high concurrency condition, and the flow impact on the downstream integrated network management data processing center when the subsystem network management message floods out.
In order to achieve the above object, an embodiment according to a third aspect of the present invention provides a rail transit system integrated network management system, which includes a plurality of subsystem network managers, a data processing center, a database, and an integrated network management center, and further includes: according to any one of the rail transit system integrated network management devices in the embodiments of the second aspect of the present invention, the rail transit system integrated network management device is in communication connection with the plurality of subsystem network managers and the data processing center, and is used for data transmission management between the plurality of subsystem network managers and the data processing center.
In some embodiments, the data processing center is further configured to store the message data in a classified manner, store temporary data in the message data in a local database, and store the device monitoring data in a cloud database;
the comprehensive network management center is also used for acquiring the equipment monitoring data from the cloud database, and carrying out equipment monitoring, fault statistics and big data analysis.
The rail transit integrated network management system according to the embodiment of the third aspect of the present invention has similar beneficial effects to the methods and apparatuses of the first aspect and the second aspect, and details are not repeated.
Drawings
The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a schematic diagram of the working principle of a message queue based on a publish-subscribe schema;
fig. 2 is a block diagram of a comprehensive network management system of a rail transit system according to an embodiment of the present invention;
fig. 3 is a schematic flow chart of a rail transit system integrated network management method according to an embodiment of the present invention;
FIG. 4 is a diagram of a storage structure of a message queue according to one embodiment of the invention;
fig. 5 is a block diagram of a rail transit integrated network management system according to another embodiment of the present invention;
FIG. 6 is a block diagram of a message queue middleware server according to an embodiment of the present invention;
fig. 7 is a schematic diagram of the operation process of the integrated network management system of the rail transit system according to the embodiment of the invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
One of the reasons for various deficiencies in the prior art is that the processing center in such a scheme is directly connected with the network managers of the subsystems, and the data integrated network management processing center is required to have very strong concurrent processing capability, when the data processing center receives a large amount of real-time information and warning information of the device states of the subsystems, the data processing center of the integrated network management not only needs to match the data of the subsystems, but also needs to rapidly perform various processing and storage on the received data, and if the data cannot be processed in time, a large amount of data is accumulated in the server, which easily causes the problem of data loss.
In addition, after receiving the data, the integrated network management data processing center processes the data in sequence according to a method of first-come first-processed, but due to problems such as network transmission delay, previous data of a certain device may be received later, so that the later data covers the latest data, and thus, the device is enabled to monitor in real time and generate deviation.
The main technical ideas of the present disclosure include: and providing a message queue middleware server, wherein the message queue middleware server is provided with a message queue middleware, and the data which is required to be provided for the data processing center by each subsystem network manager is transferred through the message queue middleware server, so that each subsystem network manager is decoupled from the data processing center. Specifically, the message data of each subsystem network manager is not directly sent to the data processing center, but is sent to the message queue middleware server; the message queue middleware server acquires the theme of the message data and issues the message data according to the theme of the message data; and then, the message queue middleware server sequentially sends the message data in each message queue to the data center according to the subscription information of the subsystem network management data processing center. That is, the data processing center does not directly obtain data from the subsystem network management interface, but obtains data from the message queue middleware server.
Therefore, the two-layer separated structural mode of the integrated network management data processing center and the message queue middleware server is utilized, the direct coupling of data between the data processing center and each subsystem network management can be reduced, the stability of the whole integrated network management system is ensured, in addition, the high availability of the message queue middleware is utilized to ensure the integrity of the data, the problems of message loss under unreliable network and performance bottleneck under high concurrency are well solved, and the flow impact on the downstream integrated network management data processing center is caused when the subsystem network management message floods.
To facilitate an understanding of the present disclosure, a brief introduction will first be made to some basic concepts of message queuing techniques and the working principles of the publish-subscribe model. It is noted that in the present disclosure, various concepts related to message queuing techniques are referred to in a general sense in the art, and the following description is merely provided to facilitate an understanding of the present disclosure and should not be taken as limiting the full breadth and/or meaning of the various concepts.
Message producer (producer): the message is sent to a message queue.
Message consumer (consumer): a message is received from a message queue.
Message queue (queue): a first-in first-out message storage area. Messages are sent and received in sequence and once the message is consumed, the message is removed from the queue.
A message (message) is a data transmission unit in a message queue transmission mechanism, and a message is essentially a piece of data, which can be understood by one or more application programs and is an information carrier passed between the application programs.
Topic (topic): can be considered as an identification of the message. The producer of the message can add a topic to the message and publish the message to the message queue middleware according to the topic, and the message consumer subscribes to the required topic. In the art, the publish-subscribe model or such a mode of operation is sometimes also represented directly by topic. Mechanisms for sending a message to multiple subscribers may be supported through the topic and publish-subscribe models of the message.
Point-to-point/queue message queue model: a producer sends messages to a particular queue and a consumer receives messages from the queue. The producer and consumer of the message may not be running at the same time. Each successfully processed message is signed for acknowledgement (acknowledgement) by the message consumer. In this mode, each message is addressed to a message consumer.
Publish-subscribe message model: in a publish-subscribe model, a message producer may publish messages according to a particular message topic. A message consumer may be interested in receiving messages from a particular message topic and may obtain the corresponding message under that topic by subscribing to the topic of interest. Each message may have one or more topics, with each topic having 0, 1, or more subscribers. Under this model, publishers and subscribers can be decoupled from each other, not knowing each other about the existence of the other.
Referring to fig. 1, there is shown the working principle of a publish-subscribe model of a message queue, with the queue being set according to topic. And generating a message with a theme by a message producer, and publishing the message to a message queue corresponding to the theme. The messages in the message queue will be sent to all message consumers who subscribe to the message topic, such as message consumer 1 and message consumer 2. Thus, one message can be sent to multiple recipients.
The method and apparatus of embodiments of the present invention are described in detail below with reference to the accompanying drawings.
Fig. 2 is a schematic structural diagram of an integrated network management system of a rail transit system according to an embodiment of the present invention. The integrated network management system 10 includes a plurality of sub-system network managers 300, an integrated network management device 200, a data processing center 100, an integrated network management center 400, and a database 500. All parts of the system are in communication connection in a wired or wireless mode. The data generated by the plurality of subsystem webmasters 300 is sent to the integrated webmaster device 200, and then is processed by the integrated webmaster device 200 and sent to the data processing center.
First, referring to fig. 3, a method for integrated network management of a rail transit system from the perspective of the integrated network management device 200 will be described. Fig. 3 is a schematic flow chart of a rail transit system integrated network management method according to an embodiment of the present invention.
Referring to fig. 3, the integrated network management method for a rail transit system of the present invention is mainly used for data transmission management between a subsystem network manager and a data processing center in the rail transit system, and may include steps S110 to S140. In some embodiments, the rail transit system integrated network management method may further include steps S150 and S160.
S110, receiving data uploaded by a subsystem network manager, and converting the data into normalized message data with a universal data mode.
The subsystem network management of the rail transit system can comprise clock system network management, FAS (fire alarm system) system network management, broadcast system network management, video monitoring system network management, passenger service system network management and the like. The network management of each subsystem may use different protocols to communicate, and the uploaded data has different formats. Therefore, format conversion is required to facilitate uniform processing and storage by the data processing center.
For example, data uploaded by a subsystem network manager according to a first protocol can be received, and the data after being analyzed is obtained through analysis according to the first protocol; and converting the analyzed data into normalized message data with a general data mode according to a second protocol. Wherein the first protocol and the second protocol may be different communication protocols. The first protocol is typically determined based on the type of subsystem network management, while the second protocol is determined based on the communication and data requirements of the data processing center.
S120, transmitting the normalized message data to a message queue middleware server.
The normalized message data has a general data mode of the comprehensive network management system, and is convenient for operation in the subsequent data processing process. In order to make the data more orderly, the transmitting the normalized message data to the message queue middleware server may include sequentially sending the normalized message data to the middleware server with the identification of each subsystem network manager as a key value. Of course, the message data may be transmitted to the middleware server in other orders, for example, in the order of the reception time of the message data.
S130, the message queue middleware server obtains the theme of the normalized message data and publishes the message data according to the theme.
The message queue middleware works in a publish-subscribe mode, and can adopt various organization forms such as only setting one message queue or setting a plurality of message queues according to topics.
In order to ensure that data of the same subsystem is sent and received in sequence, the obtaining, by the message queue middleware server, a topic of the normalized message data, and publishing the message data according to the topic may include: and establishing a corresponding message queue for each subsystem network manager at the message queue middleware server, acquiring a source subsystem network manager of the message data, and publishing the message data to the message queue corresponding to the source subsystem network manager.
Fig. 4 is a schematic diagram of a storage structure of a message queue according to an embodiment of the present invention.
For example, in the rail transit integrated network management system, there are n sub-system network managers in total, and message queues M1, M2 to Mn are respectively established corresponding to each sub-system network manager. And each message queue Mp is used for storing message data from a subsystem network manager p, and p belongs to [1, n ], wherein p is a natural number. When new message data arrives at the message queue middleware server, the new message data is issued to the corresponding message queue according to the source of the new message data (for convenience of operation, the source subsystem network management of the message data can be taken as a subject of the message), and for example, the new message data can be issued according to the identification (ID value, such as 1 to n) sequence of the subsystem network management. Of course, the identification of the subsystem network management may be in other forms, such as letters or a combination of letters and numbers. The purpose of this embodiment is to use the identification as a reference for the message data transmission sequence, rather than setting priority to the corresponding subsystems. Therefore, the normalized message data takes the identification marks of the network managers of all the subsystems as key values, and data transmission is carried out according to the key values in a certain specified sequence. There is no special requirement for the ordering relation between the network managers of each own system.
The length of each message queue may be different, for example, the message queue M1 includes message data M11 to M1i, and the subjects of M11 to M1i are message data from the system network manager 1; message data M21 to M2j are included in the message queue M2, and the subjects of M21 to M2j are message data from the subsystem network manager 2; message data Mn1 to Mnk are included in the message queue Mn, and the subjects of Mn1 to Mnk are message data from the subsystem network manager n.
Through the construction mode of the message queues, the message data in each message queue can be ensured to be arranged according to the time sequence. Therefore, according to the working principle of the message queues, the message data in each message queue can be acquired by the data processing center according to the time sequence. The information and the instructions are ensured to be sent and received according to the sequence for the same subsystem network management, and the information and the instructions of different subsystem network management can be unordered.
Or, a corresponding message queue can be established according to the theme of the message data, and the method is suitable for the scene that the number of the message data themes is relatively determined and the data processing center has special requirements on a certain type of theme. At this time, the data processing center may be ranked according to a preset subscription topic priority, for example, a higher priority may be given to the topic corresponding to the real-time data. Correspondingly, when data are transmitted to the data processing center, the data of the high-priority theme are transmitted preferentially.
In addition, because the data processing center selects the subscribed topic according to the needs, there may be a case that data uploaded by some subsystem webmasters is not subscribed, and in order to avoid that the data which is not needed occupies system resources, periodic cleaning may be performed. For example, messages in the message queue middleware server may be periodically checked, and messages satisfying a preset discarding condition are removed from each message queue. For example, the preset discarding condition may be that none of the topics of the message is subscribed, the existence time of the message in the message queue middleware server is longer than a preset time threshold, for example, for temporary data exceeding 1 day or several days, non-temporary data exceeding 1 month or several months is not subscribed by the data processing center, that is, is cleared, and the like.
S140, according to the subscription theme of the data processing center, sending the message data with the subscription theme in the message queue middleware server to the data processing center.
The message queue middleware server and the data processing center can be arranged in machine rooms adjacent to each other in the geographic position, so that the transmission delay of message data is reduced. Or may be provided separately, as is not required by the present invention.
S150, the data processing center stores the message data in a classified mode, temporary data in the message data are stored in a local database, and equipment monitoring data are stored in a cloud database.
Temporary data often does not need to be saved for a long time, is stored in a local database to facilitate processing of the data, and is periodically deleted after processing is finished. Not occupying excessive resources. The device monitoring data may need to be stored for a long time, and other systems, such as a comprehensive network management center, may call the device monitoring data, so that a cloud database exists, which facilitates data sharing and also saves limited local storage resources.
And S160, the comprehensive network management center acquires the equipment monitoring data from the cloud database, and performs equipment monitoring, fault statistics and big data analysis.
The comprehensive network management center can acquire network management data of each subsystem from the cloud through the database access interface, and perform corresponding monitoring and fault processing according to the equipment monitoring data. With the increasing maturity of artificial intelligence and big data technology, the AI and big data method can be used to further analyze the equipment monitoring data, and obtain further information about equipment operation and maintenance.
By adopting the rail transit system comprehensive network management method, data output by the network management of each subsystem is not directly transmitted to the comprehensive network management data processing center, but is transmitted to the message queue middleware server, and the comprehensive network management data processing center does not directly acquire the data from the network management interface of the subsystem, but acquires the data from the message queue middleware.
The data processing center and the message queue middleware server are in a two-layer separated structural mode, so that direct coupling of data between the data processing center and each subsystem network manager can be reduced, the stability of the whole integrated network management system is ensured, in addition, the high availability of the message queue middleware in the message queue server is utilized to ensure the integrity of the data, the problems of message loss under unreliable network and performance bottleneck under high concurrency are well solved, and flow impact on a downstream integrated network management data processing center is caused when subsystem network management message floods flow out.
In order to implement the method in the embodiment of the first aspect, an embodiment of a second aspect of the present invention provides an integrated network management device for a rail transit system.
Implementations of the apparatus may include one or more computing devices including a processor and a memory having stored thereon an application comprising computer program instructions executable on the processor. The application program may be divided into a plurality of program modules for respective functions of the respective components of the system. The modules of the program are logically divided rather than physically, each program module may run on one or more computing devices, and one or more program modules may run on one computing device. The system of the present invention is described in detail below in terms of the functional logical division of program modules.
Referring to fig. 5, fig. 5 is a block diagram of a rail transit integrated network management system according to an embodiment of the present invention. Similar to the embodiment of fig. 3, the integrated network management system 20 includes a plurality of sub-system network managers 300, an integrated network management device 200, a data processing center 100, an integrated network management center 400, and a database 500. All parts of the system are in communication connection in a wired or wireless mode. The comprehensive network management device 200 is in communication connection with the plurality of subsystem network managers and the data processing center, and is used for data transmission management between the subsystem network managers and the data processing center in the rail transit system, and data generated by the plurality of subsystem network managers 300 are sent to the comprehensive network management device 200, processed by the comprehensive network management device 200 and then sent to the data processing center. The integrated network management device 200 further includes an interface adapter 210 and a message queue middleware server 220.
The interface adapter module 210 is configured to receive data uploaded by a subsystem network manager, convert the data into normalized message data with a general data mode, and transmit the normalized message data to a message queue middleware server.
The receiving, by the interface adapter module, data uploaded by a subsystem network manager, and converting the data into normalized message data having a general data pattern may include: receiving data uploaded by a subsystem network manager according to a first protocol, and analyzing according to the first protocol to obtain analyzed data; converting the analyzed data into normalized message data with a general data mode according to a second protocol; wherein the first protocol and the second protocol are different communication protocols.
The interface adapter module transmitting the normalized message data to a message queue middleware server comprises: and sending the normalized message data to the middleware server according to the key value sequence by taking the identification mark of each subsystem network manager as a key value.
The message queue middleware server 220 is configured to obtain a topic of the normalized message data, publish the message data according to the topic, and send the message data with the subscription topic in the message queue middleware server to the data processing center according to the subscription topic of the data processing center.
The obtaining, by the message queue middleware server, the theme of the normalized message data, and publishing the message data according to the theme may include: and establishing a corresponding message queue for each subsystem network manager at the message queue middleware server, acquiring a source subsystem network manager of the message data, and publishing the message data to the message queue corresponding to the source subsystem network manager.
In addition, the message queue middleware server is further configured to: and periodically checking the messages in the message queue middleware server, and removing the messages meeting the preset discarding condition from each message queue.
Fig. 6 is a block diagram of a message queue middleware server according to an embodiment of the present invention. The message queue middleware 220 may further include: a message receiving unit 221, a message queue configuration unit 222, a message queue storage unit 223, and a message sending unit 224.
A message receiving unit 221, configured to receive the normalized message data.
The message queue configuration unit 222 is configured to publish the message data to the corresponding message queue according to the topic of the message data.
A message queue storage unit 223 for storing each message queue.
And a message sending unit 224, configured to send the message data in each message queue to the data processing center according to the subscription information.
Wherein, the message queue can adopt the storage structure shown in fig. 4. And establishing different message queues according to the network management of the subsystem, and storing corresponding message data.
After the data processing center 100 obtains the subscribed message, it can process the data and store the message data in the database 500. The database 500 may include a local database and a cloud database, and the data processing center 100 may store the message data in a classified manner, store temporary data in the message data in the local database, and store the device monitoring data in the cloud database.
The integrated network management center 400 can acquire the device monitoring data from the cloud database, perform device monitoring and fault statistics and big data analysis, and acquire temporary data from a local database for data processing.
Referring to fig. 7, fig. 7 is a schematic diagram of an operation process of an integrated network management system of a rail transit system according to an embodiment of the present invention.
S201, the network manager of each subsystem generates corresponding subsystem data. For example, n subsystems including a clock system network manager, a broadcast system network manager, etc.
S202, the interface adapter module is matched and communicated with each subsystem network manager to receive subsystem data, for example, a first protocol is adopted.
S203, the received subsystem data is converted into normalized message data and sent to the message queue middleware server.
S204, in the message queue middleware server, n queues are respectively established according to n different subsystems, and message data from the different subsystems are placed into the corresponding queues.
S205, the data processing center reserves messages from the message queue middleware server in a mode of subscribing topics, and obtains the messages from the message queue middleware when the corresponding subscribed topic messages arrive.
And S206, analyzing the message. For example, message data may be classified, temporal data and device monitoring data may be separated, and the like.
And S207, storing the message data into a database. For example, the temporary data may be stored in a local database and the device monitoring data may be stored in a cloud database according to the classification of the data.
S208, the comprehensive network management center obtains data from the database and realizes various comprehensive network management functions according to the obtained data.
The specific implementation of each component or module of the integrated network management device of the rail transit system of the present invention can refer to the corresponding method embodiment, and is not described herein again.
It should be noted that in the description of this specification, any process or method description in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and that the scope of the preferred embodiments of the present invention includes additional implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
It will be understood by those skilled in the art that all or part of the steps carried by the method implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and the program, when executed, includes one or a combination of the steps of the method embodiments.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means two or more, for example, two, three, etc., unless specifically defined otherwise.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (11)
1. A rail transit system comprehensive network management method is used for data transmission management between a subsystem network management and a data processing center in a rail transit system, and is characterized in that the subsystem network management in the rail transit system comprises a clock system network management, an FAS system network management, a broadcasting system network management, a video monitoring system network management and a passenger service system network management, a message queue middleware server is arranged between the subsystem network management and the data processing center in the rail transit system, and the message queue middleware server and the data processing center are arranged in a machine room adjacent to each other in a geographical position, and the method comprises the following steps:
receiving data uploaded by a subsystem network manager, and converting the data into normalized message data with a universal data mode;
transmitting the normalized message data to a message queue middleware server, wherein the message queue middleware server is provided with a message queue middleware to transfer data which is required to be provided for a data processing center by each subsystem network manager;
the message queue middleware server acquires the theme of the normalized message data and publishes the message data according to the theme; the message queue middleware server obtains the theme of the normalized message data and publishes the message data according to the theme, and the method comprises the following steps: establishing a corresponding message queue for each subsystem network manager in the message queue middleware server, acquiring a source subsystem network manager of message data, and publishing the message data to a message queue corresponding to the source subsystem network manager, wherein each message data in each message queue is arranged according to a time sequence, and the message data in each message queue is acquired by a data processing center according to the time sequence;
and sending the message data with the subscription theme in the message queue middleware server to the data processing center according to the subscription theme of the data processing center.
2. The rail transit system integrated network management method according to claim 1, wherein the receiving of the data uploaded by the subsystem network management and the conversion of the data into normalized message data having a general data pattern comprises:
receiving data uploaded by a subsystem network manager according to a first protocol, and analyzing according to the first protocol to obtain analyzed data;
converting the analyzed data into normalized message data with a general data mode according to a second protocol;
wherein the first protocol and the second protocol are different communication protocols.
3. The rail transit system integrated network management method according to claim 1, wherein the transmitting the normalized message data to a message queue middleware server comprises:
and transmitting the normalized message data to the message queue middleware server according to the key value sequence by taking the identification marks of the network managers of all the subsystems as key values.
4. The rail transit system integrated network management method according to claim 1, further comprising:
and periodically checking the messages in the message queue middleware server, and removing the messages meeting the preset discarding condition from each message queue.
5. The rail transit system integrated network management method according to claim 1, wherein after sending the message data with the subscription theme in the message queue middleware server to the data processing center according to the subscription theme of the data processing center, the method further comprises:
the data processing center stores the message data in a classified mode, temporary data in the message data are stored in a local database, and the equipment monitoring data are stored in a cloud database.
6. A rail transit system comprehensive network management device is used for data transmission management between a subsystem network management and a data processing center in a rail transit system, and is characterized in that the subsystem network management in the rail transit system comprises a clock system network management, an FAS system network management, a broadcasting system network management, a video monitoring system network management and a passenger service system network management, a message queue middleware server is arranged between the subsystem network management and the data processing center in the rail transit system, and the message queue middleware server and the data processing center are arranged in a machine room adjacent to each other in a geographical position, and the rail transit system comprehensive network management device comprises:
the interface adapter module is used for receiving data uploaded by a subsystem network manager, converting the data into normalized message data with a general data mode, and transmitting the normalized message data to a message queue middleware server;
the message queue middleware server is used for acquiring the theme of the normalized message data, publishing the message data according to the theme and sending the message data with the subscription theme in the message queue middleware server to the data processing center according to the subscription theme of the data processing center, wherein the message queue middleware server is provided with the message queue middleware to transfer the data which is required to be provided for the data processing center by each subsystem webmaster; the message queue middleware server obtains the theme of the normalized message data and publishes the message data according to the theme, and the method comprises the following steps: and establishing a corresponding message queue for each subsystem network manager at the message queue middleware server, acquiring a source subsystem network manager of the message data, and publishing the message data to the message queue corresponding to the source subsystem network manager, wherein all the message data in each message queue are arranged according to a time sequence, and the message data in each message queue is acquired by a data processing center according to the time sequence.
7. The rail transit system integrated network management device of claim 6, wherein the interface adapter module receives data uploaded by a subsystem network manager, converts the data into normalized message data with a general data mode, and comprises:
receiving data uploaded by a subsystem network manager according to a first protocol, and analyzing according to the first protocol to obtain analyzed data;
converting the analyzed data into normalized message data with a general data mode according to a second protocol;
wherein the first protocol and the second protocol are different communication protocols.
8. The rail transit system integrated network management device of claim 6, wherein the interface adapter module transmitting the normalized message data to a message queue middleware server comprises:
and transmitting the normalized message data to the message queue middleware server according to the key value sequence by taking the identification marks of the network managers of all the subsystems as key values.
9. The rail transit system integrated network management device according to claim 6, wherein the message queue middleware server is further configured to:
and periodically checking the messages in the message queue middleware server, and removing the messages meeting the preset discarding condition from each message queue.
10. A rail transit system integrated network management system, including a plurality of subsystem network management, data processing center, database and integrated network management center of communication connection, characterized by, also include: the rail transit system integrated network management device according to any one of claims 6 to 9, wherein the rail transit system integrated network management device is in communication connection with the plurality of subsystem network managers and the data processing center, and is used for data transmission management between the plurality of subsystem network managers and the data processing center.
11. The rail transit system integrated network management system of claim 10,
the data processing center is also used for classifying and storing the message data, storing temporary data in the message data in a local database, and storing the equipment monitoring data in a cloud database;
the comprehensive network management center is also used for acquiring the equipment monitoring data from the cloud database, and carrying out equipment monitoring, fault statistics and big data analysis.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810967894.XA CN110858850B (en) | 2018-08-23 | 2018-08-23 | Comprehensive network management method, device and system for rail transit system |
| PCT/CN2019/102064 WO2020038447A1 (en) | 2018-08-23 | 2019-08-22 | Integrated network management method and apparatus for rail traffic system, and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810967894.XA CN110858850B (en) | 2018-08-23 | 2018-08-23 | Comprehensive network management method, device and system for rail transit system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110858850A CN110858850A (en) | 2020-03-03 |
| CN110858850B true CN110858850B (en) | 2022-04-15 |
Family
ID=69592823
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810967894.XA Active CN110858850B (en) | 2018-08-23 | 2018-08-23 | Comprehensive network management method, device and system for rail transit system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110858850B (en) |
| WO (1) | WO2020038447A1 (en) |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111510474B (en) * | 2020-03-26 | 2023-09-29 | 中国平安人寿保险股份有限公司 | Data transmission method based on message middleware and related equipment |
| CN111615079B (en) * | 2020-05-12 | 2022-07-22 | 江苏中车数字科技有限公司 | Rail vehicle and ground wireless communication method |
| CN111831458B (en) * | 2020-06-11 | 2024-04-26 | 武汉烽火技术服务有限公司 | High-concurrency high-decoupling data processing method and data center system |
| CN111930835B (en) * | 2020-07-16 | 2022-11-22 | 广州运达智能科技有限公司 | Intelligent operation and maintenance big data management system and method for urban rail transit |
| CN112308824B (en) * | 2020-10-21 | 2023-01-20 | 中国铁道科学研究院集团有限公司 | Curve radius classification identification method and device based on track geometric detection data |
| CN112583933B (en) * | 2020-12-25 | 2023-02-24 | 高新现代智能系统股份有限公司 | Parameter operation method, device, equipment and storage medium |
| CN112711594A (en) * | 2021-01-15 | 2021-04-27 | 科技谷（厦门）信息技术有限公司 | Rail transit data integration method |
| CN112882846B (en) * | 2021-02-19 | 2024-02-09 | 深圳市云网万店科技有限公司 | Data processing method and device for message queue, computer equipment and storage medium |
| CN112835768A (en) * | 2021-02-25 | 2021-05-25 | 紫光云技术有限公司 | Real-time monitoring resource measurement data method based on ceilometer |
| CN113190524A (en) * | 2021-04-21 | 2021-07-30 | 武汉卓尔信息科技有限公司 | Industrial big data acquisition method and system |
| CN113282420A (en) * | 2021-06-07 | 2021-08-20 | 新奥数能科技有限公司 | Method and device for edge service alarm |
| CN113609070B (en) * | 2021-07-28 | 2023-01-24 | 中国国家铁路集团有限公司 | Cooperative acquisition method, device and system for dynamic detection data of railway line |
| CN113722123B (en) * | 2021-08-26 | 2024-05-14 | 许继集团有限公司 | Cross-system multi-type data forwarding transmission method and system |
| CN113810489A (en) * | 2021-09-14 | 2021-12-17 | 广东三水合肥工业大学研究院 | Industrial internet control system and method |
| CN116016089A (en) * | 2021-10-20 | 2023-04-25 | 北京京诚鼎宇管理系统有限公司 | Metallurgical equipment data processing method, device and system |
| CN115242768A (en) * | 2022-06-30 | 2022-10-25 | 南京南瑞继保电气有限公司 | Data forwarding method and device for subway comprehensive monitoring system and storage medium |
| CN116353664A (en) * | 2023-02-28 | 2023-06-30 | 西门子交通技术(北京)有限公司 | Automatic rail train protection system and readable storage medium |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101150443B (en) * | 2007-10-17 | 2011-08-24 | 中兴通讯股份有限公司 | Processing method for telecommunication network management message |
| CN101867500B (en) * | 2010-05-21 | 2012-05-30 | 浙江工业大学 | Method and system for realizing embedded type common plug-and-play device status monitoring adaptive network structure |
| CN102497279B (en) * | 2011-11-11 | 2014-06-04 | 青岛海信网络科技股份有限公司 | Component management method applicable to tract traffic comprehensive monitoring system |
| US9009352B1 (en) * | 2012-03-28 | 2015-04-14 | Emc Corporation | Transformation of common information model messages |
| CN102904868B (en) * | 2012-06-27 | 2017-08-08 | 中兴通讯股份有限公司 | A kind of track traffic centralized alarm system and method |
| CN102938731B (en) * | 2012-11-22 | 2015-01-21 | 北京锐易特软件技术有限公司 | Exchange and integration device and method based on proxy cache adaptation model |
| CN103559120A (en) * | 2013-11-13 | 2014-02-05 | 北京网秦天下科技有限公司 | Log recording method and server |
| CN104484735B (en) * | 2014-11-20 | 2018-01-09 | 上海富欣智能交通控制有限公司 | Track traffic synthetic maintenance management information delivery system |
| CN105703986A (en) * | 2016-03-22 | 2016-06-22 | 重庆邮电大学 | Middleware-technology-based intelligent household equipment interconnection and intercommunication method |
| CN108134746B (en) * | 2017-12-19 | 2021-11-19 | 深圳交控科技有限公司 | Method and device for processing rail transit data |
-
2018
- 2018-08-23 CN CN201810967894.XA patent/CN110858850B/en active Active
-
2019
- 2019-08-22 WO PCT/CN2019/102064 patent/WO2020038447A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020038447A1 (en) | 2020-02-27 |
| CN110858850A (en) | 2020-03-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110858850B (en) | Comprehensive network management method, device and system for rail transit system | |
| CN106452819B (en) | Data acquisition system and data acquisition method | |
| CN111737329A (en) | Unified data acquisition platform for rail transit | |
| CN107800554B (en) | Data acquisition method, device and system | |
| US8478714B2 (en) | Integrated distribution management system channel adapter | |
| CN112671697B (en) | Data processing method, device and system of comprehensive monitoring system | |
| CN111970195B (en) | Data transmission method and streaming data transmission system | |
| CN113596150B (en) | Message pushing method, device, computer equipment and storage medium | |
| CN105592122A (en) | Cloud platform monitoring method and cloud platform monitoring system | |
| CN109756552B (en) | Passenger information system message distribution method and device and passenger information system | |
| CN111147403B (en) | Message processing method and device, storage medium and electronic device | |
| CN111131348A (en) | Internet of vehicles system and operation method thereof | |
| CN105260426A (en) | Big data based airplane comprehensive health management system and method | |
| CN117424638B (en) | Network slice management method, device and storage medium based on satellite-ground fusion | |
| TWI448975B (en) | Dispersing-type algorithm system applicable to image monitoring platform | |
| CN110245120B (en) | Stream type computing system and log data processing method thereof | |
| CN109639545B (en) | Lightweight bus arrangement method of multi-satellite measurement and control platform system | |
| US20230073566A1 (en) | Intelligent telematics data synchronization | |
| CN111049846A (en) | Data processing method and device, electronic equipment and computer readable storage medium | |
| CN115473858A (en) | Data transmission method and streaming data transmission system | |
| CN111385237A (en) | Rail transit data transmission method, device and system based on wide area network | |
| US8464276B1 (en) | Channel monitoring in a messaging-middleware environment | |
| CN112437146B (en) | Equipment state synchronization method, device and system | |
| CN113407611B (en) | Data integration distribution platform and system | |
| CN114398299B (en) | Data processing method of four-core cooperative measurement and control processor and processor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |