US9270396B2 - Method and apparatus for providing timing analysis for packet streams over packet carriers - Google Patents
Method and apparatus for providing timing analysis for packet streams over packet carriers Download PDFInfo
- Publication number
- US9270396B2 US9270396B2 US13/861,187 US201313861187A US9270396B2 US 9270396 B2 US9270396 B2 US 9270396B2 US 201313861187 A US201313861187 A US 201313861187A US 9270396 B2 US9270396 B2 US 9270396B2
- Authority
- US
- United States
- Prior art keywords
- timestamp
- arrival
- buffer
- circuit
- offset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/28—Flow control; Congestion control in relation to timing considerations
- H04L47/283—Flow control; Congestion control in relation to timing considerations in response to processing delays, e.g. caused by jitter or round trip time [RTT]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04J—MULTIPLEX COMMUNICATION
- H04J3/00—Time-division multiplex systems
- H04J3/02—Details
- H04J3/06—Synchronising arrangements
- H04J3/0635—Clock or time synchronisation in a network
- H04J3/0638—Clock or time synchronisation among nodes; Internode synchronisation
- H04J3/0647—Synchronisation among TDM nodes
- H04J3/065—Synchronisation among TDM nodes using timestamps
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04J—MULTIPLEX COMMUNICATION
- H04J3/00—Time-division multiplex systems
- H04J3/02—Details
- H04J3/14—Monitoring arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
- H04L47/62—Queue scheduling characterised by scheduling criteria
- H04L47/621—Individual queue per connection or flow, e.g. per VC
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
- H04L47/62—Queue scheduling characterised by scheduling criteria
- H04L47/6245—Modifications to standard FIFO or LIFO
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04J—MULTIPLEX COMMUNICATION
- H04J3/00—Time-division multiplex systems
- H04J3/02—Details
- H04J3/06—Synchronising arrangements
- H04J3/062—Synchronisation of signals having the same nominal but fluctuating bit rates, e.g. using buffers
- H04J3/0632—Synchronisation of packets and cells, e.g. transmission of voice via a packet network, circuit emulation service [CES]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0631—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
- H04L41/064—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis involving time analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/10—Active monitoring, e.g. heartbeat, ping or trace-route
- H04L43/106—Active monitoring, e.g. heartbeat, ping or trace-route using time related information in packets, e.g. by adding timestamps
Definitions
- the exemplary embodiment(s) of the present invention relates to communications network. More specifically, the exemplary embodiment(s) of the present invention relates to timing analysis relating to packet streams.
- a network environment typically includes various network devices, such as routers, line modules, hubs, and/or switches, for delivery of digital information via conventional network transporting formats such as packets and frames.
- Packets, packet frames, data streams, and/or data traffics typically travel from source devices to destination devices via one or more packet switched networks (“PSNs”) or networks.
- PSNs packet switched networks
- Information pertaining to the transfer of data packet(s) and/or frame(s) through the network(s) is usually embedded within the packet and/or frame itself.
- Each packet for instance, traveling through multiple nodes via one or more communications networks such as Internet and/or Ethernet, can typically be handled independently from other packets in a packet stream or traffic.
- Each node which may include routing, switching, and/or bridging engines processes incoming packets or frames, and determines where the packet(s) or frame(s) should be forwarded.
- CES circuit emulation service
- T1 is a digital carrier signal that transmits digital signal with a data rate of about 1.544 megabits per second.
- T1 for example, contains twenty four digital channels and requires a network device having digital connection(s).
- E1 which is similar to T1, is used for digital transmission with a data rate of about 2.048 megabits per second.
- E1 has 32 channels at the speed of 64 Kbps per channel.
- a CES carrier typically does not know the content of data stream that the carrier transports, as well as timing characteristics associated with the data stream.
- timing characteristics associated with the data stream.
- it is usually difficult to debug because without invasive debugging techniques, it is often hard to ascertain the root of the problem.
- Such invasive procedure(s) can render outage(s) of network service to all connected customers, invasive procedure(s) typically is the last option to debug the problems.
- TDM time-division multiplexing
- SAToP Structure-Agnostic TDM over Packet
- CESoPSN circuit emulation service over PSN link(s)
- TDM data streams generated at one endpoint of SAToP can fail due to unpredictable reasons, such as incorrect device configuration, network congestion, circuit overloading, and the like. Note that incorrect or inaccurate timing configuration at one endpoint circuit could cause the other far-end circuit to fail.
- the timing analyzer receives a data packet traveling across a circuit emulation service (“CES”) circuit such as T1 or E1 circuit.
- CES circuit emulation service
- the arrival timestamp is stored in a timestamp buffer in accordance with a first-in first-out (“FIFO”) storage sequence.
- FIFO first-in first-out
- the timing analyzer can also be configured to generate timing reports on-demand based on generated offset(s).
- FIG. 1 is a block diagram illustrating a network configuration using a timing analyzer configured to improve network performance in accordance with one embodiment of the present invention
- FIG. 2 is a block diagram illustrating a network device having an ingress element, egress element, and timing analyzer in accordance with one embodiment of the present invention
- FIG. 3 is a flowchart illustrating a process able to identify timing offsets in accordance with one embodiment of the present invention
- FIG. 4 is a flowchart illustrating a process capable of identifying timing wandering over a period of time in accordance with one embodiment of the present invention
- FIG. 5 is a logic block diagram illustrating timing analyzer using a timestamp buffer in accordance with one embodiment of the present invention.
- FIG. 6 is a flowchart illustrating a process of timing analyzer using a timestamp buffer in accordance with one embodiment of the present invention.
- Exemplary embodiment(s) of the present invention is described herein in the context of a method, device, and apparatus for enhancing overall network performance by providing timing analysis to packets traveling through T1 or E1 carriers.
- system or “device” is used generically herein to describe any number of components, elements, sub-systems, devices, packet switch elements, packet switches, access switches, routers, networks, computer and/or communication devices or mechanisms, or combinations of components thereof.
- computer includes a processor, memory, and buses capable of executing instruction wherein the computer refers to one or a cluster of computers, personal computers, workstations, mainframes, or combinations of computers thereof.
- IP communication network means any type of network having an access network that is able to transmit data in a form of packets or cells, such as ATM (Asynchronous Transfer Mode) type, on a transport medium, for example, the TCP/IP or UDP/IP type.
- ATM cells are the result of decomposition (or segmentation) of packets of data, IP type, and those packets (here IP packets) comprise an IP header, a header specific to the transport medium (for example UDP or TCP) and payload data.
- the IP network may also include a satellite network, a DVB-RCS (Digital Video Broadcasting-Return Channel System) network, providing Internet access via satellite, or an SDMB (Satellite Digital Multimedia Broadcast) network, a terrestrial network, a cable (xDSL) network or a mobile or cellular network (GPRS/EDGE, or UMTS (where applicable of the MBMS (Multimedia Broadcast/Multicast Services) type, or the evolution of the UMTS known as LTE (Long Term Evolution), or DVB-H (Digital Video Broadcasting-Handhelds)), or a hybrid (satellite and terrestrial) network.
- a satellite network a DVB-RCS (Digital Video Broadcasting-Return Channel System) network, providing Internet access via satellite, or an SDMB (Satellite Digital Multimedia Broadcast) network, a terrestrial network, a cable (xDSL) network or a mobile or cellular network (GPRS/EDGE, or UMTS (where applicable of the MBMS (Multimedia Broad
- Embodiment(s) of the present invention discloses a timing analyzer capable of providing timing analysis over one or more network circuits.
- the timing analyzer in one aspect, is configured to receive a data packet traveling across a circuit emulation service (“CES”) circuit such as T1 or E1 circuit. After generating an arrival timestamp associated with the data packet, the arrival timestamp is stored in a timestamp buffer based on a first-in first-out (“FIFO”) storage sequence.
- the timestamp buffer can be a FIFO shift register.
- an offset is generated or calculated by comparing between the arrival timestamp and the oldest timestamp.
- a timing report which can be demanded in real time, can be generated based on the offset. In one aspect, an alarm is raised if the offset falls outside of a predefined range of limits.
- FIG. 1 is a block diagram 100 illustrating a network configuration using a timing analyzer configured to improve network performance in accordance with one embodiment of the present invention.
- Diagram 100 includes a PSN, MPLS network 102 (or cloud), two nodes 104 - 106 , and two regional networks 156 - 158 .
- Interfaces 108 - 110 can be Ethernet interfaces that are used to bridge and/or transfer data packets and/or frames between nodes 104 and 106 via PSN 102 . It should be noted that the underlying concept of the exemplary embodiment(s) of the present invention would not change if one or more blocks (or elements or connections) were added to or removed from diagram 100 .
- PSN or MPLS 102 which may be situated between Data Link Layer and Network Layer, is a global based communications network capable of providing data transfer between circuit-based systems (or clients) and packet-based systems (or clients).
- PSN or MPLS 102 hereinafter referred to as PSN 102 , is able to handle various types of data format, such as IP, ATM, SDH, SONET, TDM, and/or Ethernet data streams. Note that the concept of embodiment(s) of the network configuration would not alter if PSN 102 is replaced with another types of global communications network(s), such as Wide Area Network(s) (“WAN”), Internet, Metro Ethernet Network (“MEN”), Metropolitan Area Network (“MAN”), and the like.
- WAN Wide Area Network
- MEN Metro Ethernet Network
- MAN Metropolitan Area Network
- a CES circuit network is a regional and/or private network system since CES links are used to dedicate CES services to a group of known customers.
- CES networks 156 - 158 are circuit-based switching networks, usually based on SONET/PDH/SDH technologies.
- Frame-based CES networking technologies are also capable of transmitting multiple signals simultaneously over a single transmission path using, for instance, an interleaving time-slot mechanism.
- the interleaving timing-slot mechanism for example, packs multiple data streams with each stream having a speed of 64 kilobits per second (“Kbps”) per channel such as a T1 channel.
- Kbps kilobits per second
- T1 has a capacity of 1.544 Mbps
- E1 has a capacity of 2.048 Mbps.
- CES networks 156 - 158 may include other networks, such as MEN, MAN, WAN, and/or a combination of MEN, MAN, LAN, and/or WAN.
- CES To transport CES data packets/frames through a PSN such as Internet, CES provides TDM services to customers (or providers) by emulating TDM circuits over a PSN.
- TDM services include Plesiochronous Digital Hierarchy (“PDH”), Synchronous Optical Network (“SONET”), and/or Synchronous Digital Hierarchy (“SDH”) services.
- PDH includes T1 and E1 lines while SONET/SDH includes STS-1, STS-3, et cetera.
- a CES circuit for example, is a point-to-point link and facilitates a data flow between a circuit-switching network and a packet-switching network.
- a time domain for example, is divided into multiple time slots wherein each time slot is designated to transport one bit stream.
- CES technologies are migrating to the world of packet network(s).
- node 104 is a network device capable of receiving data from a circuit 152 (or CES) and routing data onto a circuit 150 .
- Node 104 which can be a router, a switch, a bridge, or a combination of router, switch, and/or bridge, includes a timing analyzer 160 , an egress element 122 and an ingress element 120 wherein elements 120 - 122 are coupled to network 156 and PSN 102 .
- Ingress element 120 is capable of receiving CES data stream or frames with a reference clock 140 over connection 112 .
- Reference clock 140 provides a clock frequency used to clock data onto a bus or connection 112 .
- ingress element 120 After receipt of CES data stream, ingress element 120 (CES ⁇ PSN IWF) forwards or routes received data stream(s) to its destination via a CES circuit 150 through PSN 102 .
- Egress element 122 receives CES data stream or packets via a CES circuit 152 through PSN 102 .
- Egress element 122 in one embodiment, includes a clock domain management capable of characterizing and/or recovering reference clock from a data stream received. The data stream is subsequently forwarded by egress element 122 to its destination using recovered clock frequency 146 via connection 118 . It should be noted that node 104 may include additional ingress and/or egress element(s).
- node 106 is a network device capable of receiving data from a circuit 150 (or CES) and routing data onto a circuit 152 .
- node 106 can be a router, a switch, a bridge, or a combination of router, switch, and/or bridge.
- Node 106 includes a timing analyzer 162 , an egress element 132 and an ingress element 130 wherein elements 130 - 132 are coupled to network 158 and PSN 102 .
- Ingress element 130 receives CES data stream or data frames having a reference clock 142 via connection 114 .
- Reference clock 142 provides a clock frequency used to clock data onto a bus or connection 114 .
- ingress element 130 After receipt of CES data stream, ingress element 130 performs CES ⁇ PSN IWF and forwards the data stream to its destination via CES circuit 152 across PSN 102 .
- Egress element 132 receives the CES data stream via CES circuit 150 across PSN 102 .
- Egress element 132 in one embodiment, includes a clock domain management capable of characterizing and/or recovering reference clock from the received data stream. The data stream is forwarded by egress element 132 to its destination using recovered clock frequency 144 over connection 116 . It should be noted that node 106 can include additional ingress and/or egress element(s).
- Egress element 122 or 132 includes PSN and CES interworking function including adaptive clock recovery feature(s).
- the PSN and CES interworking function includes a clock domain management capable of selecting or recovering a clock frequency used to clock data stream onto a bus or connection 118 .
- the clock domain management uses usage rate of a traffic buffer such as a jitter buffer to recover the reference clock.
- Ingress element 120 or 130 includes CES and PSN interworking function(s) capable of receiving data frames over bus 112 or 114 clocked by reference clock frequency 140 or 142 , respectively.
- Timing analyzer 160 or 162 is used to analyze timing characteristics of data packet(s) traveling through a PSN. Timing analyzer 160 , for example, is able to inform user or carrier that certain circuits have failed or is about to fail because of timing offsets or timing wander over a period of time. An advantage of using timing analyzer 160 or 162 is that it allows a user or vendor to correct potential timing related problem(s) in accordance with timing offsets before the network fails.
- FIG. 2 is a block diagram 200 illustrating a network device having an ingress element, egress element, and timing analyzer in accordance with one embodiment of the present invention.
- Diagram 200 includes PSN 202 , jitter buffer 204 , timestamp buffer 206 , ingress element 208 , controller 210 , egress element 212 , timing analyzer 220 , and offset component 216 .
- Block 218 indicates output of TDM streams or packets timed at an output rate or egress rate.
- Ingress element 208 in one embodiment, includes at least a portion of timing analyzer 220 . It should be noted that the underlying concept of the exemplary embodiment(s) of the present invention would not change if one or more blocks (or elements or connections) were added to or removed from diagram 200 .
- Timing analyzer 220 which can be a hardware, software, firmware, or combination of hardware, software, and firmware components, includes timestamp buffer 206 , portion of ingress element 208 , and portion of offset component 216 .
- Timestamp buffer 206 is a storage buffer able to store timestamps relating to packets arrival times. For example, if timestamp buffer 206 has 16,384 entries of storage space for storing 16,384 timestamps, timestamp buffer 206 is capable of holding 16,384 timestamps wherein the oldest timestamp is the arrival time of a packet that is received 16,384 packets ago.
- Timestamp buffer 206 is a FIFO shift register or a circular buffer capable of storing a predefined number of timestamps (i.e., 16,384 of timestamps) which are used to determine deviation of packet arrival rate from PSN 202 . It should be noted that the 16,384 entries in timestamp buffer 206 is an arbitrary number, and it can be adjusted based on the applications.
- Deviation of packet arrival rate is represented by offsets.
- the offsets are calculated by stored timestamps versus current timestamps. Depending on the applications, deviation can indicate potential problems or timing related errors within the network. Note that a portion of timestamps or offsets may be used to determine rate change or time adjustment over a period of time when packets are reconstructed into TDM data for transmission.
- Jitter buffer 204 which is a temporary storage device or shift register, is able to accumulate a predetermined number of packets or SAToP packets.
- the stored packets are queued in jitter buffer 204 according to sequence numbers of the queued packets before they are being routed.
- the predetermined number of SAToP packets that can be stored in jitter buffer 204 is selected in such a way that jitter buffer 204 will not be empty due to certain predefined network conditions. For example, a predefined network condition may be selected in response to reducing certain network impairments such as jitter and/or wander.
- CES includes a number of variants, such as SAToP and CESoPSN.
- Ingress rate calculation block 230 of ingress element 208 includes a monitor component, stamp generator, offset calculator, and timing comparator. While the monitor component monitors incoming packets or SAToP packets from PSN 202 , the stamp generator generates a timestamp each time a packet or SAToP packet arrives from PSN 202 . After logging a newly generated timestamp in one of 16,384 entries of timestamp buffer 206 , the offset calculator calculates time difference between the arrival time of the most recent packet and the arrival time of the oldest packet indicated by timestamp buffer 206 .
- the offset calculator is able to generate an offset based on PPM by comparing between the most recent arrival time of a packet and the arrival time of a packet arrived 16,348 packets ago.
- the timing comparator provides a deviation or divergence value from the result of comparison between the offset and an ideal time range (or a range of acceptable limits).
- the ideal time for a TDM frequency can be 1,544,000 bits per second over a T1 carrier.
- the ideal time for a TDM frequency can be 2,048,000 bits per second over an E1 carrier.
- a range of acceptable limits in one embodiment, can be plus (+) or minus ( ⁇ ) 25 PPM. For instance, if the deviation value is less than +/ ⁇ 25 PPM, the current timing is basically acceptable and timing adjustments are not needed. If the deviation value, however, is greater than +/ ⁇ 25 PPM, the current timing may need to be adjusted depending on the applications. Note that the range of +/ ⁇ 25 PPM is an exemplary range, and the range can change based on the applications.
- timing analyzer 220 is configured to facilitate timing reconstruction of a TDM stream based on the arrival rate of packets.
- Egress rate calculation block 232 which can be part of egress element 212 , is able to clock outbound SAToP packet as it is sent for reconstruction into TDM data.
- Block 232 is also capable of calculating time difference between the most recently generated timestamp and a timestamp stored in midway in the circular buffer (i.e., 8,174 packets ago).
- Adaptive rate control mechanism 236 takes rate calculations from block 232 and block 230 to generate an outbound rate for sending TDM data stream. It should be noted that adjusting egress rate should occur slowly over time as oppose to the changing rate of ingress rate which can occur more rapidly. Slow changing over egress rate, in one example, prevents transient conditions on PSN 202 from being reflected in the egress data clock rate.
- Offset component 216 is an offset processing module which is configured to activate a set of predefined actions based on the result of comparison between the offset and the range of acceptable limits. For example, offset component 216 may raise an alarm if the offset falls outside of the range of acceptable limits. Also, a log of lock rate may be entered in a local memory or record when the offset fall within the range of limits. Moreover, offset component 216 may send a warning message to a service provider or customer indicating certain device(s) may be incorrectly configured, congested, overloading, or the like. Also, offset component 216 can be configured to assist adaptive rate control mechanism 236 to adjust egress clock rate for outgoing TDM streams.
- ingress rate calculation block 230 upon receipt of a packet A or SAToP packet A from PSN 202 , ingress rate calculation block 230 generates a timestamp A which is associated with arrival time of the packet A. As the packet A reaches to jitter buffer 204 for queuing, block 230 retrieves the oldest timestamp stored in timestamp buffer 206 and compares the oldest timestamp with timestamp A. Note that if timestamp buffer 206 has 16,384 entries and it is full, the oldest timestamp indicates the arrival time associated with a packet that is 16,384 packets ago. An offset is calculated based on the oldest timestamp and timestamp A. Based on the result of offset in view of a predefined range of limits, offset component 216 takes a set of predefined actions which will reduce overall device or system failure(s).
- Timing analyzer 220 in a router is that it is able to facilitate timing reconstruction of TDM stream based on the arrival rate of packets across PSN 202 .
- a router takes a packet or packets as they arrive and store them in jitter buffer 204 . After recording timestamps associated with packets as they arrive, the router measures the stored timestamps over time and calculates offsets based on arrival times of packets. For example, a PSN may transmit one (1) packet per one (1) millisecond (“ms”) or packets arrive one (1) ms apart. If, for instance, packets arrive a little faster from PSN side, the TDM stream should also leave a little faster on the TDM side.
- ms millisecond
- the router reconstructs the egress rate on the TDM side in accordance with the speed of arriving packets on the PSN side.
- Timing analyzer 220 provides non-invasive diagnostic information to identify issue(s) or potential failure(s) quickly without the use of third-party test equipments and/or intrusive diagnosis methods.
- a router able to provide SAToP data stream via PSN 202 , employs various hardware such as chips and/or chipsets capable of running CES or SAToP protocol.
- the router using a set of timing tables and timing algorithm is able to reconstruct timing of the T1 or E1 signal traveling over its pathways.
- the microcode and its supervisory code can calculate the timing for T1 or E1 circuit.
- An application code of router compares the offset to a set of user-definable criteria and raises an alarm when any of the circuits fall outside of the desirable range limits. It should be noted that a report or status relating to recorded offsets can be generated on-demand.
- timing analyzer 220 provides an automated way to analyze timing characteristics of T1 or E1 circuits traveling over SAToP or CESoPSN.
- timing analyzer removes the need for external equipment to analyze the timing.
- FIG. 3 is a flowchart 300 illustrating a process able to identify timing offsets in accordance with one embodiment of the present invention.
- Flowchart 300 illustrates thresholds that can be checked instantaneously and do not require stored PPM data.
- the process checks to see if the ingress PPM is outside some predefined range. If the ingress PPM is within the predefined range or limits, the process indicates that the ingress rate is similar to the expected T1 or E1 nominal rate. For example, the ingress PPM is not to exceed +/ ⁇ 5 PPM of T1 nominal rate or predefined limits. If, however, the ingress PPM exceeds the predefined range of limits (or some other predefined customer value), the process proceeds to block 304 .
- the process logs an anomaly status in a log or record, and raises an alarm to warn administrator(s) about potential error or failure.
- the process examines whether the egress rate has converged in view of ingress rate. Note that under the normal operation, the egress rate should converge to meet the ingress rate at a predefined time period. If the egress rate has converged, the process proceeds to block 308 . For instance, the egress rate has converged if egress rate is within 1 to 5 PPM of ingress rate. At block 308 , the process notes the convergence in a log to indicate a rate lock. Otherwise, the process logs the instances where the rate did not converge in a timely manner. Alternatively, the process may also record duration for rate to reach the rate lock.
- an ingress rate can be quickly determined according to the rate at which packets arrive from the PSN side.
- the egress rate is generally adjusted slowly over time to match the ingress rate. In other words, once the system is stable and if network conditions remain stable, neither egress rate nor ingress rate should fluctuate widely over time until device and/or circuit(s) failure occurs.
- FIG. 4 is a flowchart 400 illustrating a process capable of identifying timing wandering over a period of time in accordance with one embodiment of the present invention.
- Flowchart 400 is based on thresholds that cannot be checked until measurements are collected and offsets are calculated.
- the process checks to see where the wander which is indicated by PPM exceeds a predefined wander threshold. Note that the wander threshold is for the T1 or E1 signal. If the offset which may be indicated by PPM does not exceed the wander threshold, the process proceeds to the next block. Otherwise, the process proceeds to block 404 .
- a peak-to-peak range of PPM is measured. If the measurement is greater than expected limits such as +5 PPM, an anomaly is logged and an alarm is subsequently raised.
- the process checks to see whether the change of ingress rate is greater than the thresholds. If the change is greater than the thresholds, the process, at block 408 , predicts that according to recent arrival rate jump, a device change or failure may have occurred. The process notes the change in ingress rate and records lost rate lock in a log when a rate change or jump is detected.
- the process exams to see whether egress rate has diverged over time. If the divergence is true which means that the egress rate has changed unexpectedly regardless of the ingress rate, the process proceeds to block 412 . It should be noted that if the PPM calculated exceeds the threshold, an alarm, for example, is raised. At block 412 , the process may predict certain internal error(s) or potential failure(s) in the router itself. The anomaly is subsequently noted in the log. It should be noted that if PPMs are off too much, an alarm is set off. Note that PPM of offset falls outside of threshold may indicate device failing, inaccurate device configuration, bad circuit connection, congestion, damages, loading, and the like.
- FIG. 5 is a logic block diagram 500 illustrating timing analyzer using a timestamp buffer 510 within a router in accordance with one embodiment of the present invention.
- Diagram 500 includes a T1 (or E1) circuit 502 , packet 504 , timestamp 506 , clock 508 , timestamp buffer 510 , and a range of limits 518 .
- the T1 circuit 502 can be a CES or SAToP capable of transmitting data. It should be noted that the underlying concept of the exemplary embodiment(s) of the present invention would not change if one or more blocks (or elements or connections) were added to or removed from diagram 500 .
- the timing analyzer stamps or generates a timestamp 506 in accordance with a local clock 508 .
- the timing analyzer retrieves oldest timestamp 516 from the bottom of the stack or buffer 510 .
- Oldest timestamp 516 is the oldest timestamp in timestamp buffer 510 such as the timestamp for a packet that is 16,384 packets ago.
- Block 520 compares timestamps 506 and 516 and generates an offset based on the result of the comparison.
- the offset in one embodiment, is represented by PPM.
- Block 522 compares the offset with a range of limits 518 which is a set of predefined limitations. The result of the comparison is stored in a log 530 . If the result indicates that the offset falls outside of the range of limits 518 , an alarm is raised and broadcasted via gate logic 524 .
- Block 532 coupled to log 530 , is capable of generating a report on-demand based on the information in log 530 .
- the exemplary aspect of the present invention includes various processing steps, which will be described below.
- the steps of the aspect may be embodied in machine or computer executable instructions.
- the instructions can be used to cause a general purpose or special purpose system, which is programmed with the instructions, to perform the steps of the exemplary aspect of the present invention.
- the steps of the exemplary aspect of the present invention may be performed by specific hardware components that contain hard-wired logic for performing the steps, or by any combination of programmed computer components and custom hardware components.
- FIG. 6 is a flowchart 600 illustrating a process of timing analyzer using a timestamp buffer in accordance with one embodiment of the present invention.
- a process capable of generating timing offsets associated with a network circuit receives a first data packet traveling across a first CES circuit.
- the first data packet is received from a T1 carrier which is configured to support SAToP or CESoPSN circuit.
- the first data packet travels across an E1 carrier via a first CES circuit.
- a first arrival timestamp or first timestamp associated with the first data packet is obtained. For example, a timestamp is generated at the time when the first data packet is received at the port of the network device. Alternatively, the process is able to extract an embedded timestamp from the first data packet if the packet contains its own timestamp.
- the first arrival timestamp is stored in a first timestamp buffer based on a FIFO storage sequence.
- the first arrival timestamp is stored in a circular buffer containing a predefined number of entries for storing timestamps. For example, the process is able to identify one of 16,384 storage entries as the next storage entry for storing the first arrival timestamp.
- the FIFO storage sequence allows a packet arrival time to be temporary saved in the buffer for time duration of the next 16,384 packets. When the 16,385 packet is received, the oldest timestamp is discarded or shifted out of queue to make room for the new arrival. Note that the total storage capacity of a timestamp buffer can change based on the applications.
- the oldest arrival timestamp in the first timestamp buffer is identified.
- the process is able to retrieve the earliest stored content from the first timestamp buffer.
- the first timestamp buffer is a shift register, and the earliest stored content in the first timestamp buffer will be shifted out as soon as the new timestamp arrives.
- a first offset is generated by comparing between the first arrival timestamp and the oldest timestamp.
- the process generates PPM data to represent the first offset based on the result of comparison between the first arrival timestamp and the oldest timestamp.
- the implementation of comparison or calculation will not start until the timestamp buffer is filled.
- an on-demand report is produced in response to the first offset.
- the process is capable of setting or raising an alert when the first offset is greater than a predefined PPM limits.
- the predefined PPM can have a range between +25 PPM and ⁇ 25 PPM.
- a warning message is sent when the first offset falls outside of a predefined range.
- rate lock status is recorded in a log when the first offset falls within a predefined range.
- the process is further capable of receiving a second data packet traveling across a first CES circuit. Upon obtaining a second arrival timestamp associated with the second data packet, the second arrival timestamp is stored in the first timestamp buffer based on a FIFO storage sequence.
- the process is capable of receiving a third data packet traveling across a second CES circuit.
- the third arrival timestamp is stored in a second timestamp buffer based on a FIFO storage sequence.
- a third offset is generated by comparing between the third arrival timestamp and the oldest arrival timestamp of the second timestamp buffer.
- a second timing report can also be generated in response to the third offset.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Description
Claims (18)
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/861,187 US9270396B2 (en) | 2013-04-11 | 2013-04-11 | Method and apparatus for providing timing analysis for packet streams over packet carriers |
US15/006,955 US9794182B2 (en) | 2013-04-11 | 2016-01-26 | Methods and apparatus for providing timing analysis for packet streams over packet carriers |
US15/700,810 US10164890B2 (en) | 2013-04-11 | 2017-09-11 | Methods and apparatus for providing timing analysis for packet streams over packet carriers |
US16/231,506 US10749810B2 (en) | 2013-04-11 | 2018-12-22 | Methods and apparatus for providing timing analysis for packet streams over packet carriers |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/861,187 US9270396B2 (en) | 2013-04-11 | 2013-04-11 | Method and apparatus for providing timing analysis for packet streams over packet carriers |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/006,955 Continuation US9794182B2 (en) | 2013-04-11 | 2016-01-26 | Methods and apparatus for providing timing analysis for packet streams over packet carriers |
Publications (2)
Publication Number | Publication Date |
---|---|
US20140307746A1 US20140307746A1 (en) | 2014-10-16 |
US9270396B2 true US9270396B2 (en) | 2016-02-23 |
Family
ID=51686777
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/861,187 Active 2034-04-22 US9270396B2 (en) | 2013-04-11 | 2013-04-11 | Method and apparatus for providing timing analysis for packet streams over packet carriers |
US15/006,955 Active US9794182B2 (en) | 2013-04-11 | 2016-01-26 | Methods and apparatus for providing timing analysis for packet streams over packet carriers |
US15/700,810 Active US10164890B2 (en) | 2013-04-11 | 2017-09-11 | Methods and apparatus for providing timing analysis for packet streams over packet carriers |
US16/231,506 Active US10749810B2 (en) | 2013-04-11 | 2018-12-22 | Methods and apparatus for providing timing analysis for packet streams over packet carriers |
Family Applications After (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/006,955 Active US9794182B2 (en) | 2013-04-11 | 2016-01-26 | Methods and apparatus for providing timing analysis for packet streams over packet carriers |
US15/700,810 Active US10164890B2 (en) | 2013-04-11 | 2017-09-11 | Methods and apparatus for providing timing analysis for packet streams over packet carriers |
US16/231,506 Active US10749810B2 (en) | 2013-04-11 | 2018-12-22 | Methods and apparatus for providing timing analysis for packet streams over packet carriers |
Country Status (1)
Country | Link |
---|---|
US (4) | US9270396B2 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110677188A (en) * | 2019-09-23 | 2020-01-10 | 四川安迪科技实业有限公司 | Dynamic adjusting method, sending method and device for air interface speed limit of satellite communication |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106254278A (en) * | 2016-08-31 | 2016-12-21 | 武汉绿色网络信息服务有限责任公司 | A kind of method controlling single user bandwidth under load-balancing environment |
US10411986B2 (en) | 2017-07-26 | 2019-09-10 | Aviat U.S., Inc. | Distributed radio transparent clock over a wireless network |
US10868623B2 (en) | 2017-07-26 | 2020-12-15 | Aviat U.S., Inc. | Airframe timestamping technique for point-to-point radio links |
WO2019091587A1 (en) * | 2017-11-13 | 2019-05-16 | Telefonaktiebolaget Lm Ericsson (Publ) | Method and apparatus for managing transport of delay-sensitive packets |
US11368412B2 (en) * | 2020-07-31 | 2022-06-21 | Avago Technologies International Sales Pte. Limited | Power throttle for network switches |
US20230207138A1 (en) * | 2021-12-23 | 2023-06-29 | GE Precision Healthcare LLC | Online monitoring of clinical data drifts |
US12101240B2 (en) * | 2022-02-24 | 2024-09-24 | Marvell Israel (M.I.S.L) Ltd. | Dynamic one-step/two-step timestamping per packet in network devices |
US11924318B2 (en) | 2022-02-24 | 2024-03-05 | Marvell Israel (M.I.S.L) Ltd. | Timestamping for multiple synchronization domains in a network device |
US12107671B2 (en) | 2022-02-24 | 2024-10-01 | Marvell Israel (M.I.S.L) Ltd. | Timestamping over media independent interfaces |
US12074693B2 (en) | 2022-02-24 | 2024-08-27 | Marvell Israel (M.I.S.L) Ltd. | Dynamic one-step/two-step timestamping per packet in network devices |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6246684B1 (en) * | 1997-12-24 | 2001-06-12 | Nortel Networks Limited | Method and apparatus for re-ordering data packets in a network environment |
US20050168590A1 (en) * | 2003-10-31 | 2005-08-04 | Kddi Media Will Corporation | Video analyzer and video error detector |
US20070019547A1 (en) * | 1999-08-19 | 2007-01-25 | Nokia Inc. | Jitter buffer for a circuit emulation service over an internal protocol network |
US20080001742A1 (en) * | 2006-06-30 | 2008-01-03 | Frederic Bauchot | System For Facilitating The Handling Of Goods Based On Containers Equipped With An RFID Tag |
US20120221881A1 (en) * | 2009-11-20 | 2012-08-30 | Webb Iii Charles Albert | Method, system and computer program product for measuring a communication from a first device to a second device |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
MX9603336A (en) * | 1994-02-17 | 1997-05-31 | Micrilor Inc | A high-data-rate wireless local-area network. |
AU2002241645A1 (en) * | 2000-12-14 | 2002-06-24 | Powerhouse Technology, Inc. | Circuit switched cellulat network to internet calling |
US7733781B2 (en) * | 2006-04-24 | 2010-06-08 | Broadcom Corporation | Distributed congestion avoidance in a network switching system |
US20080003941A1 (en) * | 2006-06-30 | 2008-01-03 | Microsoft Corporation | VoIP two-way broadcasting |
US20080123649A1 (en) * | 2006-07-20 | 2008-05-29 | Via Technologies, Inc. | Systems and methods for broadcast storm control |
US7899738B2 (en) * | 2007-09-17 | 2011-03-01 | Chicago Mercantile Exchange, Inc. | Volume control for mass quote messages |
US7907535B2 (en) * | 2007-11-26 | 2011-03-15 | Alcatel-Lucent Usa Inc. | Anomaly detection and diagnosis using passive monitoring |
WO2012104981A1 (en) * | 2011-01-31 | 2012-08-09 | 富士通株式会社 | Traffic data integration method and device |
-
2013
- 2013-04-11 US US13/861,187 patent/US9270396B2/en active Active
-
2016
- 2016-01-26 US US15/006,955 patent/US9794182B2/en active Active
-
2017
- 2017-09-11 US US15/700,810 patent/US10164890B2/en active Active
-
2018
- 2018-12-22 US US16/231,506 patent/US10749810B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6246684B1 (en) * | 1997-12-24 | 2001-06-12 | Nortel Networks Limited | Method and apparatus for re-ordering data packets in a network environment |
US20070019547A1 (en) * | 1999-08-19 | 2007-01-25 | Nokia Inc. | Jitter buffer for a circuit emulation service over an internal protocol network |
US20050168590A1 (en) * | 2003-10-31 | 2005-08-04 | Kddi Media Will Corporation | Video analyzer and video error detector |
US20080001742A1 (en) * | 2006-06-30 | 2008-01-03 | Frederic Bauchot | System For Facilitating The Handling Of Goods Based On Containers Equipped With An RFID Tag |
US20120221881A1 (en) * | 2009-11-20 | 2012-08-30 | Webb Iii Charles Albert | Method, system and computer program product for measuring a communication from a first device to a second device |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110677188A (en) * | 2019-09-23 | 2020-01-10 | 四川安迪科技实业有限公司 | Dynamic adjusting method, sending method and device for air interface speed limit of satellite communication |
CN110677188B (en) * | 2019-09-23 | 2021-05-28 | 四川安迪科技实业有限公司 | Dynamic adjusting method, sending method and device for air interface speed limit of satellite communication |
Also Published As
Publication number | Publication date |
---|---|
US10749810B2 (en) | 2020-08-18 |
US10164890B2 (en) | 2018-12-25 |
US20140307746A1 (en) | 2014-10-16 |
US20160142329A1 (en) | 2016-05-19 |
US20190140963A1 (en) | 2019-05-09 |
US9794182B2 (en) | 2017-10-17 |
US20170373981A1 (en) | 2017-12-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10749810B2 (en) | Methods and apparatus for providing timing analysis for packet streams over packet carriers | |
US11095384B2 (en) | Re-timing a packetized radio flow to clean noise induced by packet delay variation of a packet network | |
US9906457B2 (en) | Operations, administration and management fields for packet transport | |
JP5646090B2 (en) | Traceroute_delay diagnostic command | |
Phemius et al. | Monitoring latency with openflow | |
US8427963B2 (en) | Method and system for analyzing and qualifying routes in packet networks | |
US20190116096A1 (en) | Protection switching systems and methods in a packet network based on signal degrade | |
US9451500B2 (en) | Conditional routing technique | |
EP2781056B1 (en) | Measurement on a data flow in a communication network | |
JP4854029B2 (en) | Uninterruptible packet switching device | |
EP2604001B1 (en) | Distributed connectivity verification protocol redundancy | |
US11102273B2 (en) | Uplink performance management | |
Schweitzer et al. | Merging SONET and Ethernet communications for power system applications | |
US7158721B2 (en) | Performance monitoring of multiple channels in an automatic protection switched network | |
WO2008095390A1 (en) | An equipment for detecting the line fault of the pseudo wire emulation and a method thereof | |
Roesler et al. | Proving viability of line current differential over packet switched networks | |
US8964525B1 (en) | Methods and apparatus for enhancing fault management using inter-working between PPP and ethernet | |
Ramadža et al. | Network performance monitoring within MPLS traffic engineering enabled networks | |
Jesus et al. | MPLS networks for inter substation communication for current differential protection applications in digital substations | |
Koh | Next-generation techniques to protect and secure realtime IP media transport | |
US8416813B1 (en) | Methods and apparatus for clocking domain discovery in multi-domain networks | |
US20230388252A1 (en) | Providing high assurance of end-to-end cpri circuit in a high jitter packet based fronthaul network | |
WO2005050933A1 (en) | Point-to-point route monitoring in a packet-based core network | |
EP2781064B1 (en) | Conditional routing technique | |
Komisarczuk et al. | Effect of rerouting on NGN VoIP quality |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: TELLABS OPERATIONS INC, ILLINOIS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SASAK, ANTHONY L;REEL/FRAME:030200/0279 Effective date: 20130411 |
|
AS | Assignment |
Owner name: TELECOM HOLDING PARENT LLC, CALIFORNIA Free format text: ASSIGNMENT FOR SECURITY - - PATENTS;ASSIGNORS:CORIANT OPERATIONS, INC.;TELLABS RESTON, LLC (FORMERLY KNOWN AS TELLABS RESTON, INC.);WICHORUS, LLC (FORMERLY KNOWN AS WICHORUS, INC.);REEL/FRAME:034484/0740 Effective date: 20141126 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: CERBERUS BUSINESS FINANCE, LLC, AS COLLATERAL AGEN Free format text: SECURITY INTEREST;ASSIGNOR:CORIANT OPERATIONS, INC.;REEL/FRAME:040775/0533 Effective date: 20161227 Owner name: CERBERUS BUSINESS FINANCE, LLC, AS COLLATERAL AGENT, NEW YORK Free format text: SECURITY INTEREST;ASSIGNOR:CORIANT OPERATIONS, INC.;REEL/FRAME:040775/0533 Effective date: 20161227 |
|
AS | Assignment |
Owner name: TELECOM HOLDING PARENT LLC, CALIFORNIA Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION NUMBER 10/075,623 PREVIOUSLY RECORDED AT REEL: 034484 FRAME: 0740. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT FOR SECURITY --- PATENTS;ASSIGNORS:CORIANT OPERATIONS, INC.;TELLABS RESTON, LLC (FORMERLY KNOWN AS TELLABS RESTON, INC.);WICHORUS, LLC (FORMERLY KNOWN AS WICHORUS, INC.);REEL/FRAME:042980/0834 Effective date: 20141126 |
|
AS | Assignment |
Owner name: WICHORUS, LLC (FORMERLY KNOWN AS WICHORUS, INC.), ILLINOIS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:CERBERUS BUSINESS FINANCE, LLC;REEL/FRAME:047725/0653 Effective date: 20181001 Owner name: CORIANT OPERATIONS, INC. (FORMERLY KNOWN AS TELLABS OPERATIONS, INC.), ILLINOIS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:CERBERUS BUSINESS FINANCE, LLC;REEL/FRAME:047725/0653 Effective date: 20181001 Owner name: CORIANT OPERATIONS, INC. (FORMERLY KNOWN AS TELLAB Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:CERBERUS BUSINESS FINANCE, LLC;REEL/FRAME:047725/0653 Effective date: 20181001 Owner name: WICHORUS, LLC (FORMERLY KNOWN AS WICHORUS, INC.), Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:CERBERUS BUSINESS FINANCE, LLC;REEL/FRAME:047725/0653 Effective date: 20181001 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |