CN110048912B - Photoelectric cross-layer network monitoring system, data processing method and device - Google Patents
Photoelectric cross-layer network monitoring system, data processing method and device Download PDFInfo
- Publication number
- CN110048912B CN110048912B CN201910343542.1A CN201910343542A CN110048912B CN 110048912 B CN110048912 B CN 110048912B CN 201910343542 A CN201910343542 A CN 201910343542A CN 110048912 B CN110048912 B CN 110048912B
- Authority
- CN
- China
- Prior art keywords
- data
- data packet
- layer network
- band
- programmable switch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
- H04B10/07—Arrangements for monitoring or testing transmission systems; Arrangements for fault measurement of transmission systems
- H04B10/075—Arrangements for monitoring or testing transmission systems; Arrangements for fault measurement of transmission systems using an in-service signal
- H04B10/079—Arrangements for monitoring or testing transmission systems; Arrangements for fault measurement of transmission systems using an in-service signal using measurements of the data signal
- H04B10/0791—Fault location on the transmission path
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
- H04B10/07—Arrangements for monitoring or testing transmission systems; Arrangements for fault measurement of transmission systems
- H04B10/075—Arrangements for monitoring or testing transmission systems; Arrangements for fault measurement of transmission systems using an in-service signal
- H04B10/079—Arrangements for monitoring or testing transmission systems; Arrangements for fault measurement of transmission systems using an in-service signal using measurements of the data signal
- H04B10/0793—Network aspects, e.g. central monitoring of transmission parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Environmental & Geological Engineering (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The application provides a photoelectricity cross-layer network monitoring system, includes: the system comprises an optical network monitoring module, a programmable switch and a data analysis module; the optical network monitoring module is used for acquiring optical layer network state information and sending the acquired optical layer network state information to the programmable switch; the programmable switch is used for collecting the state information of the electric layer network and inserting the collected state information of the electric layer network and the state information of the received optical layer network into the in-band telemetering data packet; and the data analysis module is used for capturing the in-band telemetering data packet from the data forwarding pipeline of the programmable switch, and analyzing and processing the captured in-band telemetering data packet to obtain the state information of the photoelectric cross-layer network. The photoelectric cross-layer network monitoring system can realize the monitoring of the state of the photoelectric cross-layer network.
Description
Technical Field
The present application relates to the field of network monitoring technologies, and in particular, to a photoelectric cross-layer network monitoring system, a data processing method, and an apparatus.
Background
With the continuous progress of computer technology, networks are continuously and rapidly developed, the network scale becomes more and more complex, the network form becomes more and more novel, and for example, the application of an optical-electrical cross-layer network combining an electrical network and an optical network is more and more extensive.
As the network scale becomes more and more complex and the probability of problems occurring in the network becomes more and more, the necessity of monitoring the network becomes higher and higher, and a corresponding monitoring system corresponding to the above-mentioned photoelectric cross-layer network is still lacking at present.
Disclosure of Invention
Based on the above requirements, the present application provides a photoelectric cross-layer network monitoring system, a data processing method, and an apparatus, which can implement monitoring on a photoelectric cross-layer network.
An optoelectronic cross-layer network monitoring system, comprising:
the system comprises an optical network monitoring module, a programmable switch and a data analysis module;
the optical network monitoring module is used for acquiring optical layer network state information and sending the acquired optical layer network state information to the programmable switch;
the programmable switch is used for collecting the state information of the electric layer network and inserting the collected state information of the electric layer network and the received optical layer network state information into the in-band telemetering data packet;
and the data analysis module is used for capturing the in-band telemetering data packet from the data forwarding pipeline of the programmable switch, and analyzing and processing the captured in-band telemetering data packet to obtain the state information of the photoelectric cross-layer network.
Optionally, the optical network monitoring module includes:
the optical equipment detector is used for collecting optical layer network state information;
and the optical equipment detector agent is used for sending the optical layer network state information collected by the optical equipment detector to the programmable switch and storing the optical layer network state information in a local database.
Optionally, the programmable switch includes:
the optical layer telemetry sub-module is used for receiving optical layer network state information and inserting the optical layer network state information into an in-band telemetry data packet in a data forwarding pipeline of the programmable switch;
and the electric layer telemetry sub-module is used for inserting the electric layer network state information acquired by the programmable switch into an in-band telemetry data packet in a data forwarding pipeline of the programmable switch.
Optionally, the programmable switch further comprises:
and the in-band telemetry proxy submodule is used for carrying out external sampling and internal polling sampling of in-band telemetry data packets and carrying out collection and combination of in-band telemetry data aiming at a data forwarding pipeline of the programmable switch.
Optionally, the data analysis module includes:
the data packet collection module is used for grabbing in-band telemetry data packets from a data forwarding pipeline of the programmable switch;
and the in-band telemetry analysis module is used for analyzing the in-band telemetry data packet captured by the data packet collection module to obtain the state information of the photoelectric cross-layer network.
A data processing method, which is applied to the programmable switch of the above-mentioned optoelectronic cross-layer network monitoring system, the method includes:
selecting an in-band telemetry data packet from the data stream;
inserting an in-band telemetry data field into the in-band telemetry data packet;
and copying the in-band telemetry data packet inserted with the in-band telemetry data domain to obtain two data packets, wherein one data packet is used as a photoelectric cross-layer network monitoring data packet, and the other data packet is forwarded to the client after the in-band telemetry data domain is removed.
Optionally, the selecting an inband telemetry packet from a data stream includes:
selecting a data stream needing in-band telemetry from the data streams;
and selecting the in-band telemetry data packet from the selected data stream needing in-band telemetry according to the token distributed by the in-band telemetry decision device.
Optionally, the method further includes:
forwarding packets in the data stream that are not selected as in-band telemetry packets to a particular data port.
A data processing apparatus, applied to the programmable switch of the foregoing optoelectronic cross-layer network monitoring system, the apparatus comprising:
a packet selection unit for selecting an in-band telemetry packet from the data stream;
a data field insertion unit for inserting an in-band telemetry data field into the in-band telemetry data packet;
and the data packet processing unit is used for copying the in-band telemetering data packet inserted with the in-band telemetering data domain to obtain two data packets, wherein one data packet is used as a photoelectric cross-layer network monitoring data packet, and the other data packet is forwarded to the client after the in-band telemetering data domain is removed.
Optionally, the packet selecting unit includes:
the first selection unit is used for selecting a data stream needing in-band telemetry from the data streams;
and the second selection unit is used for selecting the in-band telemetry data packet from the selected data stream needing in-band telemetry according to the token distributed by the in-band telemetry decision device.
Optionally, the apparatus further comprises:
and the data forwarding unit is used for forwarding the data packets which are not selected as the in-band telemetry data packets in the data stream to a specific data port.
According to the photoelectric cross-layer network monitoring system, the optical network monitoring module is arranged to collect optical layer network state information, meanwhile, the programmable switch is used for collecting optical layer network state information, the programmable switch is arranged to extract a data packet from a data forwarding assembly line to serve as an in-band telemetering data packet, and the optical layer network state information and the electric layer network state information are inserted into the in-band telemetering data packet. And a data analysis module of the system can capture the in-band telemetering data packet from a data forwarding pipeline of the programmable switch for analysis, thereby determining the state of the photoelectric cross-layer network. Therefore, the photoelectric cross-layer network monitoring system can monitor the state of the photoelectric cross-layer network.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only the embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an optoelectronic cross-layer network monitoring system provided in an embodiment of the present application;
FIG. 2 is a schematic diagram of an in-band telemetry packet according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of an optoelectronic cross-layer network configured with an optoelectronic cross-layer network monitoring system according to an embodiment of the present application;
fig. 4 is a schematic flowchart of a data processing method according to an embodiment of the present application;
fig. 5 is a schematic diagram of a data transmission processing process according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present application.
Detailed Description
The main technical content of the embodiment of the application is that an In-band network Telemetry (INT) technology is introduced into monitoring of a photoelectric cross-layer network, an efficient fault positioning system is provided for the photoelectric cross-layer network, and not only can electric layer network faults be monitored, but also optical layer network faults can be monitored.
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application discloses a photoelectric cross-layer network monitoring system, as shown in fig. 1, the system includes:
the system comprises an optical network monitoring module 1, a programmable switch 2 and a data analysis module 3;
the optical network monitoring module 1 is configured to collect optical layer network state information and send the collected optical layer network state information to the programmable switch 2;
specifically, the Optical electrical cross-layer network monitoring system provided in the embodiment of the present application has a characteristic of monitoring a cross-layer network in real time, and an Optical network monitoring module 1 is arranged in the system, as shown in fig. 1, the Optical network monitoring module includes an Optical device detector (OCM) and an Optical device detector agent inside.
The optical device detector OCM is configured to collect optical layer network state information, for example, collect an optical signal-to-noise ratio of an optical layer network, and send the collected optical layer network state information to the optical device detection agent.
And the optical equipment detection agent is used for sending the optical layer network state information acquired by the optical equipment detector OCM to the programmable switch 2.
Meanwhile, a local database is also provided inside the optical network monitoring module 1. The optical equipment detection agent sends the optical layer network state information collected by the optical equipment detector OCM to the programmable switch 2, and simultaneously backups and stores the optical layer network state information in a local database.
The programmable switch 2 is used for acquiring the state information of the electric layer network and inserting the acquired state information of the electric layer network and the state information of the received optical layer network into an in-band telemetering data packet in a data forwarding pipeline;
specifically, the programmable switch 2 may monitor the state of the electrical layer network, that is, collect the state information of the electrical layer network.
If a data forwarding pipeline is provided in the programmable switch 2, the programmable switch 2 may process a data packet in the data forwarding pipeline, and insert the electrical layer network state information collected by itself and the optical layer network state information sent by the optical network monitoring module 1 into an in-band telemetry data packet in the data forwarding pipeline.
The in-band telemetry data packet refers to a data packet which is selected from data packets of a data forwarding pipeline and used for carrying in-band telemetry information.
Referring to fig. 1, the programmable switch 2 described above includes an optical layer telemetry sub-module and an electrical layer telemetry sub-module. The optical layer telemetry sub-module is used for receiving optical layer network state information sent by the optical network monitoring module 1 and inserting the optical layer network state information into an in-band telemetry data packet in a data forwarding pipeline of the programmable switch 2 under the control of the programmable switch 2.
And the electrical layer telemetry sub-module is used for inserting the electrical layer network state information acquired by the programmable switch 2 into an in-band telemetry data packet in a data forwarding pipeline of the programmable switch 2 under the control of the programmable switch 2.
It can be understood that the programmable switch 2 inserts the cross-layer network state into the in-band telemetry data packet as an in-band telemetry data domain through data processing pipeline, that is, a data forwarding pipeline, specifically, inserts the optical-layer network state information uploaded by the lower-layer optical network monitoring module 1 and the electrical-layer network state information acquired by itself as independent data domains into the load of the in-band telemetry data packet through the optical-layer telemetry sub-module and the electrical-layer telemetry sub-module, and implements in-band collection of the photoelectric cross-layer network state information.
Further, as shown in fig. 1, the programmable switch 2 also includes an in-band telemetry proxy sub-module therein, which is used for performing external sampling and internal polling sampling of in-band telemetry packets, and performing collection and combination of in-band telemetry data for the data forwarding pipeline of the programmable switch 2.
Specifically, the in-band telemetry proxy sub-module is mainly used for extracting a data packet from a data forwarding pipeline as an in-band telemetry data packet and distributing network state information insertion for the extracted in-band telemetry data packet.
The in-band telemetry sub-module can greatly save network bandwidth overhead brought by in-band telemetry on the premise of accurately monitoring the network state in real time through two sampling steps of external sampling and internal polling sampling.
Wherein, the first round of sampling is external sampling, and the mechanism can extract 1 from the data packets of the data forwarding pipeline of the programmable exchanger every N to be the in-band telemetry INT data packet, thereby realizing sampling with sampling rate of 1/N. The first round of sampling eliminates the need for each packet to be an INT packet, which results in a significant savings in network bandwidth in high rate end-to-end data communications. As the bandwidth of 10Gbps is popular in the recent data center, when the time interval between two longest ethernet frames on the transmission link is 1.2us, the probability that the network status changes within 1.2us is very small, and therefore, it is not necessary to collect the network status for each data packet. In the embodiment of the application, unnecessary data packet collection is avoided and the number of INT data packets is reduced through the first sampling.
The second round of sampling is called internal polling sampling, and the mechanism can dispersedly insert the network state collected by each hop of programmable switch into a plurality of INT data packets obtained by the first round of sampling, such as when the network state collected by a certain hop of programmable switch is: congestion level of the electrical layer, queuing delay, link utilization, and optical signal-to-noise ratio and energy of the optical layer, these network states can be inserted into multiple INT packets in sequence and in a round robin manner. At the moment, each INT data packet only carries one network state, so that the phenomenon that the length of the data packet is too long and the load of the network bandwidth is increased due to the fact that too many INT data fields are inserted is avoided.
It will be appreciated that the embodiments of the present application perform two rounds of sampling to determine INT packets by configuring the in-band telemetry sub-module described above, and to determine the distribution of multiple network states within each determined INT packet.
In the embodiment of the present invention, the processing procedure of the programmable switch 2 realizes a more flexible optoelectronic cross-layer INT system, and the traditional INT system abandons the design of making INT for all data packets, but selects to make INT for only a part of data packets, thereby saving network bandwidth.
It should be noted that the above embodiments of the present application exemplarily describe the general operation process of the programmable switch 2 of the optoelectronic cross-layer network monitoring system proposed in the present application. When the photoelectric cross-layer network monitoring system provided by the embodiment of the application is applied to each network node, the photoelectric cross-layer network monitoring system positioned at the hop network node is formed by combining the optical network monitoring module 1 and the data analysis module 3 on the basis of the programmable switch of the hop network node. With this system layout, there may be adaptive changes in the operation of the programmable switches 2 located in different optoelectronic cross-layer network monitoring systems.
When communication data flows through each hop of programmable switch of a communication network, based on the photoelectric cross-layer network monitoring system provided by the embodiment of the application, the programmable switch in the system inserts network state information into a data packet of the flowing data. Illustratively, referring to fig. 2, when the programmable switch 2 inserts the network status information into the In-band Telemetry INT packet, the ip.tos field is used to identify each INT (In-band network Telemetry) packet, the INT header includes an INT data stack and an INT information field, and the INT data stack is organized by the INT data field inserted at each hop In a stack manner. Each INT data field contains INT data collected by each hop programmable switch. The INT information field indicates how many INT data fields are added to the INT data packet and how many hops of identification information such as the programmable switch are passed through.
And the data analysis module 3 is configured to capture an in-band telemetry data packet from a forwarding pipeline of the programmable switch 2, and analyze and process the captured in-band telemetry data packet to obtain optoelectronic cross-layer network state information.
Specifically, the data analysis module 3 is responsible for capturing an in-band telemetry INT data packet from a data forwarding pipeline of the programmable switch 2 on the host side, and obtaining a complete real-time photoelectric cross-layer network state through analysis of the INT data packet.
Referring to fig. 1, the data analysis module 3 specifically includes a data packet collection module and an in-band telemetry parsing module.
The data packet collection module is used for capturing an in-band telemetry data packet from a data forwarding pipeline of the programmable switch 2;
and the in-band telemetering analysis module is used for analyzing the in-band telemetering data packet captured by the data packet collection module to obtain the state information of the photoelectric cross-layer network.
In order to improve the performance of the data analysis module 3, the embodiment of the application further adds a cache sub-module to the data analysis module 3, and the cache sub-module caches the collected in-band telemetry INT data packets and then delivers the data packets to the in-band telemetry INT analysis module for processing, so that the performance loss caused by the mismatch between the data packet collection speed and the analysis speed is made up.
Furthermore, the embodiment of the application also configures a database for the data analysis module 3, and the network state can be stored and conveniently inquired as historical data.
It should be noted that, because the optoelectronic cross-layer network monitoring system provided in the embodiment of the present application may be a system configured based on programmable switches of different network nodes, when data flows through the programmable switches of each hop of the network, the programmable switch 2 of the monitoring system inserts a plurality of INT data fields, but in order to save network bandwidth and avoid an excessively long INT data packet, the system only allows two INT data to be added in each hop, if a plurality of network states need to be monitored at a certain hop, the system will sequentially insert a plurality of network states into a plurality of INT data packets, and a complete network state is obtained in the data analysis module 3 by analyzing and combining the INT data of the plurality of INT data packets. In order to be able to resolve the network state per hop without problems, the global identification of the programmable switch per hop must be included in both INT data fields.
As can be seen from the above description, in the photoelectric cross-layer network monitoring system provided in the embodiment of the present application, optical layer network state information is acquired by setting the optical network monitoring module, at the same time, layer network state information is acquired by using the programmable switch, and the programmable switch is set to extract a data packet from the data forwarding pipeline as an in-band telemetry data packet, and insert the optical layer network state information and the electrical layer network state information into the in-band telemetry data packet. And a data analysis module of the system can capture the in-band telemetering data packet from a data forwarding pipeline of the programmable switch for analysis, thereby determining the state of the photoelectric cross-layer network. Therefore, the photoelectric cross-layer network monitoring system can monitor the state of the photoelectric cross-layer network.
Furthermore, it can be also clear from the introduction of the above embodiments that the photoelectric cross-layer network monitoring system provided in the embodiment of the present application implements flexibility of network state monitoring by a sampling manner, and saves network bandwidth load while monitoring a cross-layer network state in real time.
The system can greatly save the network bandwidth expense brought by INT on the premise of accurately monitoring the network state in real time through two-round sampling. The first round of sampling is called external sampling, and the mechanism can extract 1 from every N data packets transmitted as INT data packets, thereby realizing sampling with a sampling rate of 1/N. The first round of sampling eliminates the need for each packet to be an INT packet, which provides a significant savings in network bandwidth in high rate end-to-end data communications. As the bandwidth of 10Gbps is popular in the recent data center, when the time interval between two longest ethernet frames on the transmission link is 1.2us, the probability of the network status changing within 1.2us is very small, and therefore, the collection of the network status per packet is unnecessary.
The second round of sampling is referred to as internal polling sampling, and this mechanism can insert the network state collected by each hop of the programmable switch into a plurality of INT packets, for example, when the network state collected by a certain hop of the programmable switch is: congestion level of the electrical layer, queuing delay, link utilization, optical signal-to-noise ratio and energy of the optical layer, and these network states can be inserted into each INT data packet in sequence and in a round-robin and distributed manner. At the moment, each INT data packet only carries one network state, so that the phenomenon that the length of the data packet is too long and the load of the network bandwidth is increased due to the fact that too many INT data fields are inserted is avoided.
The flexible photoelectric cross-layer network monitoring system can enable a network administrator to dynamically change the sampling rate of external sampling during operation, and therefore greater flexibility is added to the system. By dynamically adjusting the sampling rate during operation, a network administrator can reduce the network bandwidth load as much as possible according to requirements on the premise of ensuring correct collection of the network state.
Corresponding to the above photoelectric cross-layer network monitoring system, another embodiment of the present application further discloses a data processing method applied to the programmable switch in the above photoelectric cross-layer network monitoring system.
It should be noted that, referring to fig. 3, a large number of programmable switch nodes exist in the optoelectronic cross-layer network, and the optoelectronic cross-layer network monitoring system provided in the embodiment of the present application is based on each hop of programmable switch node in the network, and a monitoring system including a programmable switch, an optical network monitoring module, and a data analysis module is set up to monitor the entire optoelectronic cross-layer network.
It can be understood that when network data is transmitted in the above-mentioned optoelectronic cross-layer network, the network data sequentially passes through data processing pipeline of the multi-hop programmable switch, and based on the data forwarding pipeline of each hop programmable switch, the transmission process from the information source client to the destination client is realized. In view of the need for network status monitoring, the insertion of network status information is performed by the optoelectronic cross-layer network monitoring system of the programmable switch as data flows through each hop of the programmable switch.
The data processing method of the programmable switch suitable for the photoelectric cross-layer network monitoring system provided by the embodiment of the application is a method for respectively processing data by the programmable switch of the photoelectric cross-layer network monitoring system at each node position of a transmission path according to the transmission process of the data from a source client to a target client.
It should be noted that, the roles of the switches in the network may change at any time, and a switch at a certain position may serve as an ingress switch during the current data transmission, and may serve as an intermediate node switch or an egress switch during the next data transmission. The data processing processes of the switches cannot be completely exhaustively introduced under various conditions, so that the embodiment of the application only takes a single data transmission process as an example, when data flows through each node switch, the switch processes the data, and when the positions of the nodes where the switches are located are different, the data processing process can be adaptively adjusted within the range of the processing process shown in the data processing method disclosed by the embodiment of the application.
Referring to fig. 4, a data processing method provided in the embodiment of the present application includes:
s401, selecting an in-band telemetry data packet from a data stream;
specifically, referring to the schematic diagram of the data transmission processing process shown in fig. 5, when a data packet leaves the source client and arrives at the data packet processing pipeline of the ingress switch, an in-band telemetry INT data packet is selected from the data stream of the data packet processing pipeline so as to insert the status information of the optical network.
Firstly, a programmable exchanger selects a data stream needing in-band telemetering from the data stream;
referring to fig. 5, after a data stream enters a Packet processing pipeline of an ingress switch, the data stream first enters a parser, where the data Packet is parsed into multiple Packet metadata, specific metadata, such as network layer information and transport layer information of the data Packet, is matched in a Match-forward flow Table (Match-Action Table), and a data stream requiring in-band telemetry INT is determined according to a matching result.
The data stream which needs to be subjected to the in-band telemetry INT enters the next step of processing, and the data stream which does not need to be subjected to the in-band telemetry INT directly enters the repeater and is forwarded to the specific data port.
And then, the programmable switch selects the in-band telemetry data packet from the selected data stream needing in-band telemetry according to the token distributed by the in-band telemetry decision device.
Referring also to fig. 5, the data packet of the data stream that needs to be processed with the in-band telemetry INT enters the INT selector, and whether the data packet is an INT data packet is determined according to the Token data (Token) distributed by the INT decider.
For example, when a packet is assigned a Token with a value of 0, it is not an INT packet, and if a Token with a value of 1 is assigned, it becomes an INT packet. And for the data packet which is not selected as the INT data packet, the data packet directly enters the repeater and is forwarded to a specific data port.
S402, inserting an in-band telemetry data domain into the in-band telemetry data packet;
specifically, as shown in fig. 5, when a packet is selected as an INT packet, the INT adder is entered, various types of INT data fields allocated in the INT agent of the programmable switch are added, and forwarded.
When a data Packet leaves an entrance switch and enters a data Packet processing pipeline of an intermediate node switch, the data Packet enters an analyzer firstly, the data Packet is analyzed into a plurality of Packet metadata, specific metadata is matched in a Match-Action Table to judge whether the data Packet is an INT data Packet or not, and if the data Packet is not the INT data Packet, the data Packet directly enters the repeater and is forwarded to a specific data port.
And if the INT data packet is an INT data packet, the INT data packet enters an INT adder, and INT data fields collected by different types of INT agents, such as queue information of an electrical layer switch, noise information of an optical layer switch and the like, are inserted and are forwarded to a specific data port through a repeater.
And S403, copying the in-band telemetry data packet inserted with the in-band telemetry data domain to obtain two data packets, wherein one data packet is used as a photoelectric cross-layer network monitoring data packet, and the other data packet is forwarded to the client after the in-band telemetry data domain is removed.
Specifically, as shown in fig. 5, after a Packet reaches a Packet processing pipeline of the egress switch, the Packet enters the parser first, the Packet is parsed into multiple Packet metadata, and specific metadata is matched in the Match-Action Table (Match forwarding flow Table) to determine whether the Packet is an INT Packet, and if not, the Packet directly enters the repeater and is forwarded to a specific data port.
If the data packet is an INT data packet, the data packet enters an INT adder, and different types of INT data fields received by an INT agent are inserted, wherein the different types of INT data fields comprise queue information of an electrical layer switch and noise signals of an optical layer switch.
As can be seen from the above description, in the network monitoring system at each network node according to the embodiment of the present application, when a data packet sequentially flows through the ingress switch, the intermediate node switch, and the egress switch, the INT data packet is identified and an INT data field is added to the INT data packet according to the descriptions in the steps S401 and S402.
After the INT data packet enters the egress switch, since the packet data needs to be sent to the destination client in the next step and the network state information carried in the INT data packet needs to be collected, the INT data packet entering the egress switch is subjected to the copy processing in step S403 in the embodiment of the present application.
Specifically, after an INT data packet enters a packet processing pipeline of an egress switch and is inserted into an INT data field, the embodiment of the present application copies an in-band telemetry data packet into which an in-band telemetry data field is inserted to obtain two data packets, where one data packet is used as a photoelectric cross-layer network monitoring data packet, enters a repeater and is forwarded to a data collector, and is used to analyze and determine a network state; and the other data packet is forwarded to the client after the in-band telemetry data domain added by each hop of programmable switch and the modification of the original data domain of the data packet by each hop of programmable switch are removed, so that normal data communication is ensured.
As can be seen from the above description, the data processing method provided in the embodiments of the present application is applied to programmable switches of an optoelectronic cross-layer network monitoring system disposed at different network nodes, and when a data packet flows through each programmable switch node in a transmission process, an in-band telemetry data packet is selected from a data stream, and an in-band telemetry data domain is inserted into the in-band telemetry data packet; for the data packet which is not selected as the in-band telemetry data packet, directly forwarding the data packet to a specific data port; and finally, copying the in-band telemetry data packet inserted with the in-band telemetry data domain to obtain two data packets, wherein one data packet is used as an optoelectronic cross-layer network monitoring data packet, and the other data packet is forwarded to the client after the in-band telemetry data domain is removed. The data processing process flexibly inserts the in-band telemetering data domain into the data packet of the photoelectric cross-layer network, and realizes the acquisition of network state information on the basis of not influencing normal data communication, namely the monitoring of the network state.
Corresponding to the above data processing method, another embodiment of the present application further discloses a data processing apparatus, as shown in fig. 6, the apparatus includes:
a packet selection unit 100 for selecting an in-band telemetry packet from the data stream;
a data field insertion unit 110 for inserting an in-band telemetry data field into the in-band telemetry data packet;
and the data packet processing unit 120 is configured to copy the in-band telemetry data packet into which the in-band telemetry data field is inserted to obtain two data packets, where one data packet is used as the photoelectric cross-layer network monitoring data packet, and the other data packet is forwarded to the client after the in-band telemetry data field is removed.
The data processing device can be applied to the programmable switch of the photoelectric cross-layer network monitoring system disclosed by any embodiment of the application. The photoelectric cross-layer network monitoring system disclosed by the embodiment of the application is a monitoring system which is built based on a programmable switch in a network node, when network data are transmitted in a network, the network data can pass through the programmable switch node of the network, namely, the photoelectric cross-layer network monitoring system located at each network node, at the moment, the data processing device in the programmable switch can process the data, and the monitoring function of the photoelectric cross-layer network monitoring system on the network data is realized.
It should be particularly noted that the operation content of each unit of the data processing apparatus disclosed in the embodiment of the present application is to perform corresponding processing on data for different data transmission phases. For example, the packet selecting unit 100 is configured to select an in-band telemetry packet from a data stream when data arrives at an ingress switch; the data field insertion unit 110 inserts an in-band telemetry data field into the in-band telemetry data packet when data arrives at the ingress switch, the intermediate node switch, and the egress switch; the data packet processing unit 120 is mainly configured to copy the in-band telemetry data packet inserted with the in-band telemetry data domain to obtain two data packets when the data packet enters the egress switch, where one data packet is used as the optoelectronic cross-layer network monitoring data packet, and the other data packet is forwarded to the client after the in-band telemetry data domain is removed.
It can be understood that the network node location where the programmable switch is located changes according to the change of the data transmission task, and for a certain programmable switch, it may be used as an ingress switch during the current data transmission, and may be used as an egress switch or an intermediate node switch during the next data transmission. When the positions of the network nodes where the programmable switch where the data processing apparatus is located are different, each unit of the programmable switch may adaptively select to operate or not operate. For example, when the programmable switch in which the data processing apparatus is located in a certain data transmission process is used as an ingress switch, the packet processing unit 120 may not be operated, and when the data processing apparatus is used as an egress switch, the packet processing unit 120 may be operated, but the packet selecting unit 100 may not be operated. When the data processing device participates in various data transmission tasks at the same time, all the functional units can work at the same time according to requirements, namely, corresponding processing is executed aiming at various data transmission tasks at the same time.
The embodiment of the present application only exemplarily introduces the functions of each unit of the data processing apparatus, and whether each unit works specifically or not can be flexibly selected in practical application.
Optionally, another embodiment of the present application further discloses that the packet selecting unit 100 includes:
the device comprises a first selection unit, a second selection unit and a third selection unit, wherein the first selection unit is used for selecting a data stream needing in-band telemetry from the data streams;
and the second selection unit is used for selecting the in-band telemetry data packet from the selected data stream needing in-band telemetry according to the token distributed by the in-band telemetry decision device.
Optionally, another embodiment of the present application further discloses that the apparatus further includes:
and the data forwarding unit is used for forwarding the data packets which are not selected as the in-band telemetry data packets in the data stream to a specific data port.
Specifically, please refer to the contents of the above method embodiments for the specific working contents of each unit in the above data processing apparatus embodiments, which are not described herein again.
While, for purposes of simplicity of explanation, the foregoing method embodiments have been described as a series of acts or combination of acts, it will be appreciated by those skilled in the art that the present application is not limited by the order of acts or acts described, as some steps may occur in other orders or concurrently with other steps in accordance with the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
It should be noted that, in this specification, each embodiment is described in a progressive manner, and each embodiment focuses on differences from other embodiments, and portions that are the same as and similar to each other in each embodiment may be referred to. For the device-like embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The steps in the method of the embodiments of the present application may be sequentially adjusted, combined, and deleted according to actual needs.
The modules and sub-modules in the device and the terminal in the embodiments of the application can be combined, divided and deleted according to actual needs.
In the several embodiments provided in the present application, it should be understood that the disclosed terminal, apparatus and method may be implemented in other manners. For example, the above-described terminal embodiments are merely illustrative, and for example, the division of a module or a sub-module is only one logical division, and there may be other divisions when the terminal is actually implemented, for example, a plurality of sub-modules or modules may be combined or integrated into another module, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.
The modules or sub-modules described as separate parts may or may not be physically separate, and parts that are modules or sub-modules may or may not be physical modules or sub-modules, may be located in one place, or may be distributed over a plurality of network modules or sub-modules. Some or all of the modules or sub-modules can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, each functional module or sub-module in the embodiments of the present application may be integrated into one processing module, or each module or sub-module may exist alone physically, or two or more modules or sub-modules may be integrated into one module. The integrated modules or sub-modules can be implemented in the form of hardware, and can also be implemented in the form of software functional modules or sub-modules.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the technical solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software unit executed by a processor, or in a combination of the two. The software cells may be located in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. An optoelectronic cross-layer network monitoring system, comprising:
the system comprises an optical network monitoring module, a programmable switch and a data analysis module;
the optical network monitoring module is used for acquiring optical layer network state information and sending the acquired optical layer network state information to the programmable switch;
the programmable switch is used for collecting the state information of the electric layer network and inserting the collected state information of the electric layer network and the state information of the received optical layer network into the in-band telemetering data packet;
the data analysis module is used for capturing an in-band telemetering data packet from a data forwarding pipeline of the programmable switch, and analyzing and processing the captured in-band telemetering data packet to obtain state information of the photoelectric cross-layer network;
the programmable switch includes:
the in-band telemetry proxy submodule is used for carrying out external sampling and internal polling sampling of in-band telemetry data packets and carrying out collection and combination of in-band telemetry data aiming at a data forwarding pipeline of the programmable switch; wherein the external samples are first round samples, and the external samples extract 1 packet from every N packets of a data forwarding pipeline of the programmable switch to form an in-band telemetry data packet; the internal polling samples are a second round of samples that insert the network state collected by the programmable switch per hop discretely into the plurality of in-band telemetry packets resulting from the first round of samples.
2. The system of claim 1, wherein the optical network monitoring module comprises:
the optical equipment detector is used for collecting optical layer network state information;
and the optical equipment detector agent is used for sending the optical layer network state information collected by the optical equipment detector to the programmable switch and storing the optical layer network state information into a local database.
3. The system of claim 1, wherein the programmable switch further comprises:
the optical layer telemetry sub-module is used for receiving optical layer network state information and inserting the optical layer network state information into an in-band telemetry data packet in a data forwarding pipeline of the programmable switch;
and the electric layer telemetry sub-module is used for inserting the electric layer network state information acquired by the programmable switch into an in-band telemetry data packet in a data forwarding pipeline of the programmable switch.
4. The system of claim 3, wherein the programmable switch further comprises:
and the in-band telemetry proxy submodule is used for carrying out external sampling and internal polling sampling of in-band telemetry data packets and carrying out collection and combination of in-band telemetry data aiming at a data forwarding pipeline of the programmable switch.
5. The system of claim 1, wherein the data analysis module comprises:
the data packet collection module is used for grabbing an in-band telemetry data packet from a data forwarding pipeline of the programmable switch;
and the in-band telemetry analysis module is used for analyzing the in-band telemetry data packet captured by the data packet collection module to obtain the photoelectric cross-layer network state information.
6. A data processing method, applied to a programmable switch of an optoelectronic cross-layer network monitoring system according to any one of claims 1 to 5, the method comprising:
selecting an in-band telemetry data packet from the data stream;
inserting an in-band telemetry data field into the in-band telemetry data packet;
and copying the in-band telemetry data packet inserted with the in-band telemetry data domain to obtain two data packets, wherein one data packet is used as an optoelectronic cross-layer network monitoring data packet, and the other data packet is forwarded to the client after the in-band telemetry data domain is removed.
7. The method of claim 6, wherein selecting the in-band telemetry packet from the data stream comprises:
selecting a data stream needing in-band telemetry from the data streams;
and selecting the in-band telemetry data packet from the selected data stream needing in-band telemetry according to the token distributed by the in-band telemetry decision device.
8. The method of claim 6, further comprising:
forwarding packets in the data stream that are not selected as in-band telemetry packets to a particular data port.
9. A data processing apparatus, applied to a programmable switch of an optoelectronic cross-layer network monitoring system according to any one of claims 1 to 5, the apparatus comprising:
a packet selection unit for selecting an in-band telemetry packet from the data stream;
a data field insertion unit for inserting an in-band telemetry data field into the in-band telemetry data packet;
and the data packet processing unit is used for copying the in-band telemetering data packet inserted with the in-band telemetering data domain to obtain two data packets, wherein one data packet is used as a photoelectric cross-layer network monitoring data packet, and the other data packet is forwarded to the client after the in-band telemetering data domain is removed.
10. The apparatus of claim 9, wherein the packet selecting unit comprises:
the device comprises a first selection unit, a second selection unit and a third selection unit, wherein the first selection unit is used for selecting a data stream needing in-band telemetry from the data streams;
and the second selection unit is used for selecting the in-band telemetry data packet from the selected data stream needing in-band telemetry according to the token distributed by the in-band telemetry decision device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910343542.1A CN110048912B (en) | 2019-04-26 | 2019-04-26 | Photoelectric cross-layer network monitoring system, data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910343542.1A CN110048912B (en) | 2019-04-26 | 2019-04-26 | Photoelectric cross-layer network monitoring system, data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110048912A CN110048912A (en) | 2019-07-23 |
| CN110048912B true CN110048912B (en) | 2022-07-15 |
Family
ID=67279595
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910343542.1A Active CN110048912B (en) | 2019-04-26 | 2019-04-26 | Photoelectric cross-layer network monitoring system, data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110048912B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112187442A (en) * | 2020-09-30 | 2021-01-05 | 中国科学技术大学 | Telemetry data analysis system and method based on privacy protection |
| CN112994970B (en) * | 2021-01-28 | 2022-07-29 | 北京邮电大学 | In-band network telemetry INT method and system based on capture and arrangement |
| CN113676376B (en) * | 2021-08-20 | 2022-12-13 | 北京交通大学 | In-band network telemetry method based on clustering |
| CN114422213B (en) * | 2021-12-31 | 2023-07-25 | 南京邮电大学 | INT-based abnormal flow detection method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101309113A (en) * | 2008-07-11 | 2008-11-19 | 烽火通信科技股份有限公司 | Optical and electrical combined monitoring apparatus and method in optical transmitting network |
| CN202998129U (en) * | 2012-12-11 | 2013-06-12 | 吴建进 | Integrated photoelectric acquisition equipment |
| CN105515993A (en) * | 2015-11-26 | 2016-04-20 | 西安空间无线电技术研究所 | Photoelectric hybrid exchange internal path mapping method |
| CN109672591A (en) * | 2019-01-21 | 2019-04-23 | 中国科学技术大学 | The method of the sampling band network telemetering of real-time programmable |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10341748B2 (en) * | 2017-07-05 | 2019-07-02 | Infinera Corporation | Packet-optical in-band telemetry (POINT) framework |
-
2019
- 2019-04-26 CN CN201910343542.1A patent/CN110048912B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101309113A (en) * | 2008-07-11 | 2008-11-19 | 烽火通信科技股份有限公司 | Optical and electrical combined monitoring apparatus and method in optical transmitting network |
| CN202998129U (en) * | 2012-12-11 | 2013-06-12 | 吴建进 | Integrated photoelectric acquisition equipment |
| CN105515993A (en) * | 2015-11-26 | 2016-04-20 | 西安空间无线电技术研究所 | Photoelectric hybrid exchange internal path mapping method |
| CN109672591A (en) * | 2019-01-21 | 2019-04-23 | 中国科学技术大学 | The method of the sampling band network telemetering of real-time programmable |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110048912A (en) | 2019-07-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110048912B (en) | Photoelectric cross-layer network monitoring system, data processing method and device | |
| JP4774357B2 (en) | Statistical information collection system and statistical information collection device | |
| EP1742416B1 (en) | Method, computer readable medium and system for analyzing and management of application traffic on networks | |
| US8089895B1 (en) | Adaptive network flow analysis | |
| US9531620B2 (en) | Control plane packet traffic statistics | |
| JP4341413B2 (en) | PACKET TRANSFER APPARATUS HAVING STATISTICS COLLECTION APPARATUS AND STATISTICS COLLECTION METHOD | |
| EP2081321A2 (en) | Sampling apparatus distinguishing a failure in a network even by using a single sampling and a method therefor | |
| US8149705B2 (en) | Packet communications unit | |
| US8310942B2 (en) | Flow statistics aggregation | |
| CN113676376B (en) | In-band network telemetry method based on clustering | |
| CN101026505A (en) | Method and apparatus for monitoring malicious traffic in communication networks | |
| CN103782546A (en) | Network-wide flow monitoring in split architecture networks | |
| JP4988632B2 (en) | Packet relay device and traffic monitoring system | |
| CN111314179B (en) | Network quality detection method, device, equipment and storage medium | |
| JP2005277804A (en) | Information relaying apparatus | |
| JP2005508593A (en) | System and method for realizing routing control of information in network | |
| CN103444132A (en) | Network system, and switching method | |
| CN108011865A (en) | SDN flow paths method for tracing, apparatus and system based on flowing water print and stochastical sampling | |
| CN111817917B (en) | Deep packet inspection method, device, server and storage medium | |
| Rewaskar et al. | Testing the scalability of overlay routing infrastructures | |
| WO2022270767A1 (en) | Device for generating and managing information bundle for intelligent network management system, and method of same | |
| WO2022270766A1 (en) | Device and method for automatic packet analysis-based intelligent network management | |
| JP2008135871A (en) | Network monitoring system, network monitoring method, and network monitoring program | |
| KR101364090B1 (en) | System and method for traffic account between each ISPs using identification number of ISP network | |
| KR20090000994A (en) | Quality of each service management method and system in total ip network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |