WO2011078995A1 - Increasing transmission rate to a remote device - Google Patents

Increasing transmission rate to a remote device Download PDF

Info

Publication number
WO2011078995A1
WO2011078995A1 PCT/US2010/060517 US2010060517W WO2011078995A1 WO 2011078995 A1 WO2011078995 A1 WO 2011078995A1 US 2010060517 W US2010060517 W US 2010060517W WO 2011078995 A1 WO2011078995 A1 WO 2011078995A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
delays
congestion
remote device
previously transmitted
Prior art date
Application number
PCT/US2010/060517
Other languages
French (fr)
Inventor
Nandita Dukkipati
Sangtae Ha
Vijaynarayanan Subramanian
Flavio Giovanni Bonomi
Original Assignee
Cisco Technology, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cisco Technology, Inc. filed Critical Cisco Technology, Inc.
Priority to EP10839994.0A priority Critical patent/EP2517032A4/en
Priority to IN3918DEN2012 priority patent/IN2012DN03918A/en
Priority to CN201080059420.7A priority patent/CN102667510B/en
Publication of WO2011078995A1 publication Critical patent/WO2011078995A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/28—Flow control; Congestion control in relation to timing considerations
    • H04L47/283—Flow control; Congestion control in relation to timing considerations in response to processing delays, e.g. caused by jitter or round trip time [RTT]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/0001—Systems modifying transmission characteristics according to link quality, e.g. power backoff
    • H04L1/0002—Systems modifying transmission characteristics according to link quality, e.g. power backoff by adapting the transmission rate
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/12—Arrangements for detecting or preventing errors in the information received by using return channel
    • H04L1/16—Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
    • H04L1/18—Automatic repetition systems, e.g. Van Duuren systems
    • H04L1/1825—Adaptation of specific ARQ protocol parameters according to transmission conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/12—Arrangements for detecting or preventing errors in the information received by using return channel
    • H04L1/16—Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
    • H04L1/18—Automatic repetition systems, e.g. Van Duuren systems
    • H04L1/1867—Arrangements specially adapted for the transmitter end
    • H04L1/187—Details of sliding window management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/20—Arrangements for detecting or preventing errors in the information received using signal quality detector
    • H04L1/205—Arrangements for detecting or preventing errors in the information received using signal quality detector jitter monitoring
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/19—Flow control; Congestion control at layers above the network layer
    • H04L47/193—Flow control; Congestion control at layers above the network layer at the transport layer, e.g. TCP related
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/27—Evaluation or update of window size, e.g. using information derived from acknowledged [ACK] packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/163—In-band adaptation of TCP data exchange; In-band control procedures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/12—Arrangements for detecting or preventing errors in the information received by using return channel
    • H04L1/16—Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
    • H04L1/18—Automatic repetition systems, e.g. Van Duuren systems
    • H04L1/1809—Selective-repeat protocols
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/50—Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate

Definitions

  • the present disclosure relates generally to communicating information with remote device over a network.
  • Transmission Control Protocol is used extensively in networks, such as the Internet, to reliably communicate information between devices. This reliability is based on the sender receiving acknowledgements from the receiver in response to successfully receiving packets. The performance of TCP also depends upon whether or not
  • the sender TCP In response to an acknowledgment, the sender TCP slowly increases the rate at which it sends packets. Conversely, if the sender TCP does not receive such an acknowledgement for a sent packet, it decreases, such as by half, its rate of packet transmission based on the assumption that the packet was lost due to network congestion. Note, the sender TCP will continue slowly increasing its transmission rate of packets in response to receiving an acknowledgement of a sent packet.
  • One embodiment includes an apparatus, comprising one or more processing elements and memory configured to communicate information with a remote device over a network, which includes: in response to a detected loss of previously transmitted information by the apparatus, increasing the rate of transmission of information by the apparatus in response to attributing the detected loss of previously transmitted information as not being caused by congestion.
  • this communication of information is performed using
  • TCP Transmission Control Protocol
  • said attributing of the detected loss of previously transmitted information as not being caused by congestion includes measuring a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and an acknowledgement received by the apparatus corresponding to said sent information.
  • said attributing of the detected loss of previously transmitted information as not being caused by congestion includes estimating that queuing delays within the network between the apparatus and the remote device have not increased therefore not causing the detected loss.
  • a current queuing delay is determined based on a minimum of measured roundtrip delays, an average of measured roundtrip delays, and/or a median, smooth-filtered maximum of measured roundtrip delays.
  • FIG. 1 illustrates a network operating according to one embodiment
  • FIG. 2 illustrates an apparatus or component used in one embodiment
  • FIG. 3 illustrates a process performed in one embodiment
  • FIG. 4 illustrates a process performed in one embodiment
  • FIG. 5 illustrates a process performed in one embodiment
  • FIGs. 6A-B illustrate a process performed in one embodiment. DETAILED DESCRIPTION
  • Embodiments described herein include various elements and limitations, with no one element or limitation contemplated as being a critical element or limitation. Each of the claims individually recites an aspect of the invention in its entirety. Moreover, some embodiments described may include, but are not limited to, inter alia, systems, networks, integrated circuit chips, embedded processors, ASICs, methods, and computer-readable media containing instructions. One or multiple systems, devices, components, etc. may comprise one or more embodiments, which may include some elements or limitations of a claim being performed by the same or different systems, devices, components, etc.
  • a processing element may be a general processor, task- specific processor, or other implementation for performing the corresponding processing.
  • the embodiments described hereinafter embody various aspects and configurations within the scope and spirit of the invention, with the figures illustrating exemplary and non- limiting configurations.
  • computer-readable media and means for performing methods and processing block operations e.g., a processor and memory or other apparatus configured to perform such operations
  • apparatus is used consistently herein with its common definition of an appliance or device.
  • first, second, etc. are typically used herein to denote different units (e.g., a first element, a second element). The use of these terms herein does not necessarily connote an ordering such as one unit or event occurring or coming before another, but rather provides a mechanism to distinguish between particular units.
  • the phrases "based on x" and “in response to x” are used to indicate a minimum set of items "x” from which something is derived or caused, wherein “x” is extensible and does not necessarily describe a complete list of items on which the operation is performed, etc.
  • the phrase “coupled to” is used to indicate some level of direct or indirect connection between two elements or devices, with the coupling device or devices modifying or not modifying the coupled signal or communicated information.
  • the term “or” is used herein to identify a selection of one or more, including all, of the conjunctive items.
  • transitional term "comprising,” which is synonymous with “including,” “containing,” or “characterized by,” is inclusive or open-ended and does not exclude additional, unrecited elements or method steps.
  • the term “particular machine,” when recited in a method claim for performing steps, refers to a particular machine within the 35 USC ⁇ 101 machine statutory class.
  • the rate of transmitting information to a remote device in response to attributing a detected loss of previous information sent to the remote device as not being a result of network congestion.
  • the rate of transmission of information in response to a detected loss of previously transmitted information by an apparatus communicating with a remote device (e.g., using TCP), is increased by the apparatus in response to attributing the detected loss of previously transmitted information as not being caused by congestion.
  • This attribution of the packet loss is typically determined based on roundtrip delays between sent information and received corresponding acknowledgments, which may be used directly or indirectly, such as by estimating network queuing delays based on the measured roundtrip delays.
  • One embodiment includes an apparatus, comprising: one or more processing elements and memory configured to communicate information with a remote device over a network; wherein said communication with the remote device includes, in response to a detected loss of previously transmitted information by the apparatus: increasing the rate of transmission of information by the apparatus in response to attributing the detected loss of previously transmitted information as not being caused by congestion.
  • said communication of information is performed using Transmission Control Protocol (TCP), and wherein said attributing of the detected loss of previously transmitted information as not being caused by congestion includes measuring a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and an acknowledgement received by the apparatus corresponding to said sent information.
  • TCP Transmission Control Protocol
  • said communication using TCP with the remote device includes a loss recovery phase of said TCP communications triggered by the detected loss of previously transmitted information, with the loss recovery phase including performing active congestion control, with said active congestion control including said increasing the rate of transmission of information by the apparatus in response to attributing said detected loss of previously transmitted information as not being caused by congestion based on a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and an acknowledgement received by the apparatus corresponding to said sent information; and wherein the loss recovery phase includes reducing the rate of transmission of information by the apparatus in response to attributing said detected loss of previously transmitted information as being caused by congestion.
  • communication using TCP with the remote device includes using a congestion window (cwnd) for reacting to network conditions; and wherein said increasing the rate of transmission of information includes increasing the congestion window (cwnd); and wherein said reducing the rate of transmission includes decreasing the congestion window (cwnd).
  • said attributing the detected loss of previously transmitted information as not being caused by congestion based on a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and an acknowledgement received by the apparatus corresponding to said sent information includes determining a plurality of queuing delays based on the plurality of measured roundtrip delays and said attributing said detected loss of previously transmitted information as not being caused by congestion based on the plurality of queuing delays.
  • said attributing the detected loss of previously transmitted information as not being caused by congestion based on a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and an acknowledgement received by the apparatus corresponding to said sent information includes determining a plurality of queuing delays based on the plurality of measured roundtrip delays and said attributing said detected loss of previously transmitted information as not being caused by congestion based on the plurality of queuing delays.
  • a current queuing delay is determined based on a minimum of a plurality of said measured roundtrip delays and one or more of said measured roundtrip delays.
  • the current queuing delay is determined based on a difference of said one or more of said measured roundtrip delays with said minimum of a plurality of said measured roundtrip delays. In one embodiment, the current queuing delay is determined based on an average of a plurality of said measured roundtrip delays, a minimum of a plurality of said measured roundtrip delays, and a median, smooth-filtered maximum of a plurality of said measured roundtrip delays.
  • said attributing of the detected loss of previously transmitted information as not being caused by congestion includes estimating that queuing delays within the network between the apparatus and the remote device have not increased therefore not causing the detected loss.
  • said communication of information is performed using Transmission Control Protocol (TCP).
  • TCP Transmission Control Protocol
  • a current queuing delay of said queuing delays is determined based on a difference of one or more measured roundtrip delays with a minimum of a plurality of measured roundtrip delays.
  • a current queuing delay of said queuing delays is determined based on an average of a plurality of a plurality of measured roundtrip delays, a minimum of a plurality of the plurality of measured roundtrip delays, and a median, smooth-filtered maximum of a plurality of the plurality of measured roundtrip delays.
  • On embodiment includes a method, comprising: communicating, by a particular apparatus, with a remote device over a network; wherein said communication with the remote device includes, in response to a detected loss of previously transmitted
  • information by the particular apparatus increasing the rate of transmission of information by the particular apparatus in response to attributing said detected loss of previously transmitted information as not being caused by congestion based on a current queuing delay determined based on measured roundtrip delays between information sent from the particular apparatus to the remote device and an acknowledgement received by the particular apparatus corresponding to said sent information.
  • said communicating with the remote device over the network includes using Transmission Control Protocol (TCP).
  • TCP Transmission Control Protocol
  • communicating using TCP with the remote device includes using a congestion window (cwnd) for reacting to network conditions; and wherein said increasing the rate of transmission of information includes increasing the congestion window (cwnd); and wherein said decreasing the rate of transmission of information includes decreasing the congestion window (cwnd).
  • TCP Transmission Control Protocol
  • One embodiment includes determining the current queuing delay based on a minimum of a plurality of said measured roundtrip delays and one or more of said measured roundtrip delays.
  • One embodiment includes determining the current queuing delay based on a difference of said one or more of said measured roundtrip delays with said minimum of a plurality of said measured roundtrip delays.
  • One embodiment includes determining the current queuing delay based on an average of a plurality of said measured roundtrip delays, a minimum of a plurality of said measured roundtrip delays, and a median, smooth-filtered maximum of a plurality of said measured roundtrip delays.
  • in response to the detected loss of previously transmitted information by the particular apparatus decreasing the rate of transmission of information by the particular apparatus in response to attributing said detected loss of previously transmitted information as being caused by congestion based on the current queuing delay.
  • said attributing said detected loss of previously transmitted information as not being caused by congestion based on the current queuing delay includes determining that an average queuing delay is not greater than a previously determined average queuing delay not including the current queuing delay.
  • One embodiment includes: in response to the detected loss of previously transmitted information by the particular apparatus: decreasing the rate of transmission of information by the particular apparatus in response to attributing said detected loss of previously transmitted information as being caused by congestion based on the current queuing delay.
  • One embodiment includes an apparatus, comprising: one or more processing elements and memory configured to communicate using Transmission Control Protocol (TCP) with a remote device over a network; wherein said communication using TCP with the remote device includes using a congestion window (cwnd) for reacting to network conditions; wherein said communication with the remote device using TCP includes characterizing the roundtrip delay between the apparatus and the remote device based on measured roundtrip delay for a plurality of sent information and corresponding received acknowledgements; and wherein said communication with the remote device using TCP includes: in response to an identified loss of particular information sent to the remote device and a determination based on said maintained characterization of the roundtrip delay, increasing the congestion window (cwnd).
  • the determination based on said maintained characterization of the roundtrip delay distinguishes between information loss due to network congestion and information loss due to another cause.
  • FIG. 1 illustrates a network operating according to one embodiment.
  • network device 101 e.g., apparatus, router, switch, computer, personal device, etc.
  • network device 103 is configured to communicate information, such as, but not limited to, using Transmission Control Protocol, with network device 103 across network 102.
  • Network device 101 is configured to increase its rate of transmission of information despite sent information be lost, in response to attributing the loss of information as not being congestion related.
  • prior TCP implementation will decrease its rate of transmission of information for any cause, or at least not increasing its rate of transmission in response to a packet loss.
  • network device 103 is also configured to increase its rate of transmission of information despite sent information be lost, in response to attributing the loss of information as not being congestion related.
  • FIG. 2 is block diagram of an apparatus or component 200 used in one embodiment associated with the rate of transmitting information to a remote device in response to attributing a detected loss of previous information sent to the remote device as not being a result of network congestion.
  • system or component 200 performs one or more processes corresponding to one of the flow diagrams illustrated or otherwise described herein.
  • apparatus or component 200 includes one or more processing elements 201 , memory 202, storage device(s) 203, specialized component(s) 205
  • apparatus or component 200 corresponds to, or is part of, network device 101 of FIG. 1.
  • apparatus or component 200 may include more or less elements.
  • the operation of apparatus or component 200 is typically controlled by processing element(s) 201 using memory 202 and storage device(s) 203 to perform one or more tasks or processes.
  • Memory 202 is one type of computer-readable/computer-storage medium, and typically comprises random access memory (RAM), read only memory (ROM), flash memory, integrated circuits, and/or other memory components.
  • RAM random access memory
  • ROM read only memory
  • flash memory integrated circuits
  • Memory 202 typically stores computer-executable instructions to be executed by processing element(s) 201 and/or data which is manipulated by processing element(s) 201 for implementing functionality in accordance with an embodiment.
  • Storage device(s) 203 are another type of computer-readable medium, and typically comprise solid state storage media, disk drives, diskettes, networked services, tape drives, and other storage devices. Storage device(s) 203 typically store computer-executable instructions to be executed by processing element(s) 201 and/or data which is manipulated by processing element(s) 201 for implementing functionality in accordance with an embodiment.
  • FIG. 3 illustrates a process performed in one embodiment. Processing begins with process block 300.
  • the apparatus starts communicating with a remote device, such as, but not limited, using TCP.
  • a remote device such as, but not limited, using TCP.
  • process block 303 in response to identifying a loss of sent information (e.g., based on received
  • process block 311 (described hereinafter). Otherwise, as determined in process block 305, in light of no detected loss of information, if the rate of sending information should be increased, then in process block 306, it is increased; otherwise, in process block 308, the current rate of transmitting information is maintained.
  • process block 311 as determined therein such as, but not limited to, based on estimates of queuing delays in the network, and/or measured roundtrip delays between sending of information and receiving corresponding acknowledgements: if the loss of information is not attributed to congestion in the network, then in process block 314, the rate of transmission of the information is increased; otherwise, in process block 312, the rate of transmission of the information is typically decreased or sometimes maintained. Processing of the flow diagram of FIG. 3 returns to process block 303.
  • FIG. 4 illustrates a process performed in one embodiment. Processing begins with process block 400.
  • the apparatus communicates with a remote device, such as, but not limited to using Transmission Control Protocol, (TCP), including measuring roundtrip delays between information sent and corresponding received acknowledgements.
  • TCP Transmission Control Protocol
  • process block 404 in response to a detected loss of previously transmitted information by the apparatus: increasing the rate of transmission of information by the apparatus (e.g., increasing a congestion window) in response to attributing the detected loss of previously transmitted information as not being caused by congestion based on a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and corresponding acknowledgements received by the apparatus (e.g., directly, determining one or more queuing delays determined therefrom such based on minimum, average and/or median, smooth-filtered maximum of roundtrip delays).
  • process block 406 Processing of the flow diagram of FIG. 4 is complete as illustrated by process block 406.
  • FIG. 5 illustrates a process performed in one embodiment. Processing begins with process block 500, and in process block 502, the apparatus receives an acknowledgement for information previously sent. As determined in process block 505, in response to identifying a loss of transmitted data (e.g., based on some number of received
  • the apparatus enters a loss recovery phase of TCP communications (510), which includes process blocks 512-518.
  • the apparatus determines whether or not to attribute the packet loss to congestion based on measured roundtrip delays of information sent and corresponding acknowledgement received.
  • One embodiment uses these roundtrip delays directly, possibly in combination with other information.
  • these roundtrip delays are used to estimate queuing delays, which are used to identify whether or not to attribute the packet loss to congestion in the network.
  • a queuing delay is determined based on an average of measured roundtrip delays, a minimum of measured roundtrip delays, and/or a median, smooth-filtered maximum of measured roundtrip delays.
  • the apparatus implements fast recovery, which typically includes decreasing the rate of transmission of information (e.g., decreasing a congestion window (cwnd), or setting cwnd to the TCP slow-start threshold value (ssthresh)). Otherwise, in process block 516, in response to attributing the loss of transmitted information as not being caused by congestion in the network, the rate of transmission of information is increased (e.g., increasing a congestion window (cwnd)).
  • fast recovery typically includes decreasing the rate of transmission of information (e.g., decreasing a congestion window (cwnd), or setting cwnd to the TCP slow-start threshold value (ssthresh)).
  • a congestion window is greater than a threshold value
  • the rate of transmission is increased (e.g., a congestion window (cwnd) is increased). Otherwise, in process block 524, the apparatus implements TCP slow start. Processing of the flow diagram of FIG. 5 is complete as indicated by process block 529.
  • FIGs. 6A and 6B illustrate a process performed in one embodiment. As shown, this process is described using pseudo code using BIC-TCP (e.g., typically implemented in Linux). Note, known functions, such as bictcp_recalc_ssthresh() and bictcp_update(), and bictcp_reset(), and/or known variables or other items in known implementation of TCP may be referenced.
  • BIC-TCP e.g., typically implemented in Linux.
  • known functions such as bictcp_recalc_ssthresh() and bictcp_update(), and bictcp_reset(), and/or known variables or other items in known implementation of TCP may be referenced.
  • Code 601 illustrates Initialization, wherein variables are initialized and blast_reset() 613 is performed.
  • This code includes initializing a low threshold variable y L and high threshold variable y H for providing a band for identifying whether or not to attribute a packet loss to network congestion (as described hereinafter).
  • Code 602 illustrates On_each_ACK, which is performed in response to each received TCP acknowledgement to maintain some statistics about measured roundtrip and/or queuing delays.
  • Variable dMin is used to maintain a lowest measured roundtrip time;
  • sRTT is set a median, smooth-filtered maximum of the measured roundtrip delays;
  • dMax maintains the maximum median, smooth-filtered maximum of the measured roundtrip delays; and sumRTT and cntRTT are maintained for calculating an average of the measured roundtrip delays.
  • Code 603 illustrates At_the_start_of_each_RTT_round, which resets variables maintained for each round of roundtrip times maintained.
  • Code 604 illustrates Packet_loss, which is performed in response to a packet loss to recalculate the ssthresh variable (e.g., perform TCP slow start, such as in process block 524 of FIG. 5).
  • Code 605 illustrates Fast_Recovery_for_each_ACK:, which is performed in response to an identified packet loss (e.g., process blocks 512-518 of FIG. 5).
  • loss_predictor() 608 (FIG. 6B) determines whether or not to attribute the packet loss to congestion, and in response to attributing the packet loss as not due to congestion, the congestion window (cwnd) continues to be evolved (e.g., increased to increase the rate of transmission of information).
  • Code 606 illustrates Timeout, which is performed in response to a TCP timeout in order to reset the TCP code accordingly.
  • Code 607 illustrates recalc_ssthresh(), which is performed to recalculate the slow start threshold value, with this calculation being different if the packet loss is attributed to network congestion or not to network congestion.
  • Code 608 illustrates loss_predictor(), which determines whether to attribute a packet loss to network congestion or not to network congestion. As shown, if the average queuing delay (e.g., average roundtrip delay minus minimum observed roundtrip delay) is lower than a predetermined low threshold value amount of the longest queuing delay (e.g., longest roundtrip delay minus minimum roundtrip delay), then attribute the packet loss as not being related to network congestion. Also, if the average queuing delay is greater than a predetermined high threshold value amount of the longest queuing delay, then attribute the packet loss as being related to network congestion. Further, inside this band defined by the low and high threshold variables times the longest queuing delay, loss_predictor() determines to attribute the packet loss to congestion if the average queuing delay is currently increasing; else it attributes the packet loss as not being due to congestion.
  • the average queuing delay e.g., average roundtrip delay minus minimum observed roundtrip delay
  • a predetermined low threshold value amount of the longest queuing delay e
  • Code 609 illustrates median_filter(RTT) used to median filter a measured roundtrip time based on multiple history values.
  • RTT median_filter
  • One embodiment uses more and/or different history values, which may change the accuracy (possibly increasing) of loss_predictor().
  • Code 610 illustrates avg_delay() used to determine the average queuing delay (e.g., the average roundtrip delay minus the minimum measured roundtrip delay).
  • Code 61 1 illustrates low_threshold() used to determine the predetermined low threshold value amount of the longest queuing delay.
  • Code 612 illustrates high_threshold() used to determine the predetermined high threshold value amount of the longest queuing delay.
  • Code 613 illustrates blast_reset() used to reset the BIC TCP process and initialize some variables.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Quality & Reliability (AREA)
  • Computer Security & Cryptography (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

In response to a detected loss of previously transmitted information by an apparatus communicating with a remote device (e.g., using TCP), the rate of transmission of information is increased by the apparatus in response to attributing the detected loss of previously transmitted information as not being caused by congestion. This attribution of the packet loss is typically determined based on roundtrip delays between sent information and received corresponding acknowledgments, which may be used directly or indirectly, such as by estimating network queuing delays based on the measured roundtrip delays.

Description

INCREASING TRANSMISSION RATE TO A REMOTE DEVICE
FIELD OF THE INVENTION
The present disclosure relates generally to communicating information with remote device over a network.
BACKGROUND OF THE INVENTION
The communications industry is rapidly changing to adjust to emerging
technologies and ever increasing customer demand. This customer demand for new applications and increased performance of existing applications is driving communications network and system providers to employ networks and systems having greater speed and capacity (e.g., greater bandwidth). In trying to achieve these goals, a common approach taken by many communications providers is to use packet switching technology.
Transmission Control Protocol (TCP) is used extensively in networks, such as the Internet, to reliably communicate information between devices. This reliability is based on the sender receiving acknowledgements from the receiver in response to successfully receiving packets. The performance of TCP also depends upon whether or not
acknowledgements are received for sent packets. In response to an acknowledgment, the sender TCP slowly increases the rate at which it sends packets. Conversely, if the sender TCP does not receive such an acknowledgement for a sent packet, it decreases, such as by half, its rate of packet transmission based on the assumption that the packet was lost due to network congestion. Note, the sender TCP will continue slowly increasing its transmission rate of packets in response to receiving an acknowledgement of a sent packet. SUMMARY OF THE INVENTION
Disclosed are, inter alia, methods, apparatus, computer-storage media, mechanisms, and means associated with the rate of transmitting information to a remote device in response to attributing a detected loss of previous information sent to the remote device as not being a result of network congestion. One embodiment includes an apparatus, comprising one or more processing elements and memory configured to communicate information with a remote device over a network, which includes: in response to a detected loss of previously transmitted information by the apparatus, increasing the rate of transmission of information by the apparatus in response to attributing the detected loss of previously transmitted information as not being caused by congestion.
In one embodiment, this communication of information is performed using
Transmission Control Protocol (TCP), and wherein said attributing of the detected loss of previously transmitted information as not being caused by congestion includes measuring a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and an acknowledgement received by the apparatus corresponding to said sent information. In one embodiment, said attributing of the detected loss of previously transmitted information as not being caused by congestion includes estimating that queuing delays within the network between the apparatus and the remote device have not increased therefore not causing the detected loss. In one embodiment, a current queuing delay is determined based on a minimum of measured roundtrip delays, an average of measured roundtrip delays, and/or a median, smooth-filtered maximum of measured roundtrip delays.
BRIEF DESCRIPTION OF THE DRAWINGS
The appended claims set forth the features of the invention with particularity. The invention, together with its advantages, may be best understood from the following detailed description taken in conjunction with the accompanying drawings of which:
FIG. 1 illustrates a network operating according to one embodiment;
FIG. 2 illustrates an apparatus or component used in one embodiment;
FIG. 3 illustrates a process performed in one embodiment;
FIG. 4 illustrates a process performed in one embodiment;
FIG. 5 illustrates a process performed in one embodiment; and
FIGs. 6A-B illustrate a process performed in one embodiment. DETAILED DESCRIPTION
Disclosed are, inter alia, methods, apparatus, computer-storage media,
mechanisms, and means associated with the rate of transmitting information to a remote device in response to attributing a detected loss of previous information sent to the remote device as not being a result of network congestion. Embodiments described herein include various elements and limitations, with no one element or limitation contemplated as being a critical element or limitation. Each of the claims individually recites an aspect of the invention in its entirety. Moreover, some embodiments described may include, but are not limited to, inter alia, systems, networks, integrated circuit chips, embedded processors, ASICs, methods, and computer-readable media containing instructions. One or multiple systems, devices, components, etc. may comprise one or more embodiments, which may include some elements or limitations of a claim being performed by the same or different systems, devices, components, etc. A processing element may be a general processor, task- specific processor, or other implementation for performing the corresponding processing. The embodiments described hereinafter embody various aspects and configurations within the scope and spirit of the invention, with the figures illustrating exemplary and non- limiting configurations. Note, computer-readable media and means for performing methods and processing block operations (e.g., a processor and memory or other apparatus configured to perform such operations) are disclosed and are in keeping with the extensible scope and spirit of the invention. Note, the term "apparatus" is used consistently herein with its common definition of an appliance or device.
Note, the steps, connections, and processing of signals and information illustrated in the figures, including, but not limited to any block and flow diagrams and message sequence charts, may typically be performed in the same or in a different serial or parallel ordering and/or by different components and/or processes, threads, etc., and/or over different connections and be combined with other functions in other embodiments, unless this disables the embodiment or a sequence is explicitly or implicitly required (e.g., for a sequence of read the value, process said read value - the value must be obtained prior to processing it, although some of the associated processing may be performed prior to, concurrently with, and/or after the read operation). Also note, nothing described or referenced in this document is admitted as prior art to this application unless explicitly so stated. The term "one embodiment" is used herein to reference a particular embodiment, wherein each reference to "one embodiment" may refer to a different embodiment, and the use of the term repeatedly herein in describing associated features, elements and/or limitations does not establish a cumulative set of associated features, elements and/or limitations that each and every embodiment must include, although an embodiment typically may include all these features, elements and/or limitations. In addition, the terms "first," "second," etc. are typically used herein to denote different units (e.g., a first element, a second element). The use of these terms herein does not necessarily connote an ordering such as one unit or event occurring or coming before another, but rather provides a mechanism to distinguish between particular units. Moreover, the phrases "based on x" and "in response to x" are used to indicate a minimum set of items "x" from which something is derived or caused, wherein "x" is extensible and does not necessarily describe a complete list of items on which the operation is performed, etc. Additionally, the phrase "coupled to" is used to indicate some level of direct or indirect connection between two elements or devices, with the coupling device or devices modifying or not modifying the coupled signal or communicated information. Moreover, the term "or" is used herein to identify a selection of one or more, including all, of the conjunctive items. Additionally, the transitional term "comprising," which is synonymous with "including," "containing," or "characterized by," is inclusive or open-ended and does not exclude additional, unrecited elements or method steps. Finally, the term "particular machine," when recited in a method claim for performing steps, refers to a particular machine within the 35 USC § 101 machine statutory class.
Disclosed are, inter alia, methods, apparatus, computer-storage media,
mechanisms, and means associated with the rate of transmitting information to a remote device in response to attributing a detected loss of previous information sent to the remote device as not being a result of network congestion. In one embodiment, in response to a detected loss of previously transmitted information by an apparatus communicating with a remote device (e.g., using TCP), the rate of transmission of information is increased by the apparatus in response to attributing the detected loss of previously transmitted information as not being caused by congestion. This attribution of the packet loss is typically determined based on roundtrip delays between sent information and received corresponding acknowledgments, which may be used directly or indirectly, such as by estimating network queuing delays based on the measured roundtrip delays.
One embodiment includes an apparatus, comprising: one or more processing elements and memory configured to communicate information with a remote device over a network; wherein said communication with the remote device includes, in response to a detected loss of previously transmitted information by the apparatus: increasing the rate of transmission of information by the apparatus in response to attributing the detected loss of previously transmitted information as not being caused by congestion.
In one embodiment, said communication of information is performed using Transmission Control Protocol (TCP), and wherein said attributing of the detected loss of previously transmitted information as not being caused by congestion includes measuring a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and an acknowledgement received by the apparatus corresponding to said sent information.
In one embodiment, said communication using TCP with the remote device includes a loss recovery phase of said TCP communications triggered by the detected loss of previously transmitted information, with the loss recovery phase including performing active congestion control, with said active congestion control including said increasing the rate of transmission of information by the apparatus in response to attributing said detected loss of previously transmitted information as not being caused by congestion based on a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and an acknowledgement received by the apparatus corresponding to said sent information; and wherein the loss recovery phase includes reducing the rate of transmission of information by the apparatus in response to attributing said detected loss of previously transmitted information as being caused by congestion. In one embodiment, communication using TCP with the remote device includes using a congestion window (cwnd) for reacting to network conditions; and wherein said increasing the rate of transmission of information includes increasing the congestion window (cwnd); and wherein said reducing the rate of transmission includes decreasing the congestion window (cwnd). In one embodiment, said attributing the detected loss of previously transmitted information as not being caused by congestion based on a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and an acknowledgement received by the apparatus corresponding to said sent information includes determining a plurality of queuing delays based on the plurality of measured roundtrip delays and said attributing said detected loss of previously transmitted information as not being caused by congestion based on the plurality of queuing delays.
In one embodiment, said attributing the detected loss of previously transmitted information as not being caused by congestion based on a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and an acknowledgement received by the apparatus corresponding to said sent information includes determining a plurality of queuing delays based on the plurality of measured roundtrip delays and said attributing said detected loss of previously transmitted information as not being caused by congestion based on the plurality of queuing delays. In one embodiment, a current queuing delay is determined based on a minimum of a plurality of said measured roundtrip delays and one or more of said measured roundtrip delays. In one embodiment, the current queuing delay is determined based on a difference of said one or more of said measured roundtrip delays with said minimum of a plurality of said measured roundtrip delays. In one embodiment, the current queuing delay is determined based on an average of a plurality of said measured roundtrip delays, a minimum of a plurality of said measured roundtrip delays, and a median, smooth-filtered maximum of a plurality of said measured roundtrip delays.
In one embodiment, said attributing of the detected loss of previously transmitted information as not being caused by congestion includes estimating that queuing delays within the network between the apparatus and the remote device have not increased therefore not causing the detected loss. In one embodiment, said communication of information is performed using Transmission Control Protocol (TCP). In one embodiment, a current queuing delay of said queuing delays is determined based on a difference of one or more measured roundtrip delays with a minimum of a plurality of measured roundtrip delays. In one embodiment, a current queuing delay of said queuing delays is determined based on an average of a plurality of a plurality of measured roundtrip delays, a minimum of a plurality of the plurality of measured roundtrip delays, and a median, smooth-filtered maximum of a plurality of the plurality of measured roundtrip delays.
On embodiment includes a method, comprising: communicating, by a particular apparatus, with a remote device over a network; wherein said communication with the remote device includes, in response to a detected loss of previously transmitted
information by the particular apparatus: increasing the rate of transmission of information by the particular apparatus in response to attributing said detected loss of previously transmitted information as not being caused by congestion based on a current queuing delay determined based on measured roundtrip delays between information sent from the particular apparatus to the remote device and an acknowledgement received by the particular apparatus corresponding to said sent information.
In one embodiment, in response to the detected loss of previously transmitted information by the particular apparatus: decreasing the rate of transmission of information by the particular apparatus in response to attributing said detected loss of previously transmitted information as being caused by congestion based on the current queuing delay. In one embodiment, said communicating with the remote device over the network includes using Transmission Control Protocol (TCP). In one embodiment, communicating using TCP with the remote device includes using a congestion window (cwnd) for reacting to network conditions; and wherein said increasing the rate of transmission of information includes increasing the congestion window (cwnd); and wherein said decreasing the rate of transmission of information includes decreasing the congestion window (cwnd). One embodiment includes determining the current queuing delay based on a minimum of a plurality of said measured roundtrip delays and one or more of said measured roundtrip delays. One embodiment includes determining the current queuing delay based on a difference of said one or more of said measured roundtrip delays with said minimum of a plurality of said measured roundtrip delays. One embodiment includes determining the current queuing delay based on an average of a plurality of said measured roundtrip delays, a minimum of a plurality of said measured roundtrip delays, and a median, smooth-filtered maximum of a plurality of said measured roundtrip delays. In one embodiment, in response to the detected loss of previously transmitted information by the particular apparatus: decreasing the rate of transmission of information by the particular apparatus in response to attributing said detected loss of previously transmitted information as being caused by congestion based on the current queuing delay. In one embodiment, said attributing said detected loss of previously transmitted information as not being caused by congestion based on the current queuing delay includes determining that an average queuing delay is not greater than a previously determined average queuing delay not including the current queuing delay. One embodiment includes: in response to the detected loss of previously transmitted information by the particular apparatus: decreasing the rate of transmission of information by the particular apparatus in response to attributing said detected loss of previously transmitted information as being caused by congestion based on the current queuing delay.
One embodiment includes an apparatus, comprising: one or more processing elements and memory configured to communicate using Transmission Control Protocol (TCP) with a remote device over a network; wherein said communication using TCP with the remote device includes using a congestion window (cwnd) for reacting to network conditions; wherein said communication with the remote device using TCP includes characterizing the roundtrip delay between the apparatus and the remote device based on measured roundtrip delay for a plurality of sent information and corresponding received acknowledgements; and wherein said communication with the remote device using TCP includes: in response to an identified loss of particular information sent to the remote device and a determination based on said maintained characterization of the roundtrip delay, increasing the congestion window (cwnd). In one embodiment, the determination based on said maintained characterization of the roundtrip delay distinguishes between information loss due to network congestion and information loss due to another cause.
Expressly turning to the figures, FIG. 1 illustrates a network operating according to one embodiment. As shown, network device 101 (e.g., apparatus, router, switch, computer, personal device, etc.) is configured to communicate information, such as, but not limited to, using Transmission Control Protocol, with network device 103 across network 102. Network device 101 is configured to increase its rate of transmission of information despite sent information be lost, in response to attributing the loss of information as not being congestion related. Typically, prior TCP implementation will decrease its rate of transmission of information for any cause, or at least not increasing its rate of transmission in response to a packet loss. Note, in one embodiment, network device 103 is also configured to increase its rate of transmission of information despite sent information be lost, in response to attributing the loss of information as not being congestion related.
FIG. 2 is block diagram of an apparatus or component 200 used in one embodiment associated with the rate of transmitting information to a remote device in response to attributing a detected loss of previous information sent to the remote device as not being a result of network congestion. In one embodiment, system or component 200 performs one or more processes corresponding to one of the flow diagrams illustrated or otherwise described herein.
In one embodiment, apparatus or component 200 includes one or more processing elements 201 , memory 202, storage device(s) 203, specialized component(s) 205
(e.g., optimized hardware such as for performing operations, etc.), and interface(s) 207 for communicating information (e.g., sending and receiving packets, user-interfaces, displaying information, etc.), which are typically communicatively coupled via one or more communications mechanisms 209, with the communications paths typically tailored to meet the needs of the application. In one embodiment apparatus or component 200 corresponds to, or is part of, network device 101 of FIG. 1.
Various embodiments of apparatus or component 200 may include more or less elements. The operation of apparatus or component 200 is typically controlled by processing element(s) 201 using memory 202 and storage device(s) 203 to perform one or more tasks or processes. Memory 202 is one type of computer-readable/computer-storage medium, and typically comprises random access memory (RAM), read only memory (ROM), flash memory, integrated circuits, and/or other memory components. Memory 202 typically stores computer-executable instructions to be executed by processing element(s) 201 and/or data which is manipulated by processing element(s) 201 for implementing functionality in accordance with an embodiment. Storage device(s) 203 are another type of computer-readable medium, and typically comprise solid state storage media, disk drives, diskettes, networked services, tape drives, and other storage devices. Storage device(s) 203 typically store computer-executable instructions to be executed by processing element(s) 201 and/or data which is manipulated by processing element(s) 201 for implementing functionality in accordance with an embodiment.
FIG. 3 illustrates a process performed in one embodiment. Processing begins with process block 300. In process block 302, the apparatus starts communicating with a remote device, such as, but not limited, using TCP. As determined in process block 303, in response to identifying a loss of sent information (e.g., based on received
acknowledgements), then processing proceeds to process block 311 (described hereinafter). Otherwise, as determined in process block 305, in light of no detected loss of information, if the rate of sending information should be increased, then in process block 306, it is increased; otherwise, in process block 308, the current rate of transmitting information is maintained. Continuing with process block 311 , as determined therein such as, but not limited to, based on estimates of queuing delays in the network, and/or measured roundtrip delays between sending of information and receiving corresponding acknowledgements: if the loss of information is not attributed to congestion in the network, then in process block 314, the rate of transmission of the information is increased; otherwise, in process block 312, the rate of transmission of the information is typically decreased or sometimes maintained. Processing of the flow diagram of FIG. 3 returns to process block 303.
FIG. 4 illustrates a process performed in one embodiment. Processing begins with process block 400. In process block 402, the apparatus communicates with a remote device, such as, but not limited to using Transmission Control Protocol, (TCP), including measuring roundtrip delays between information sent and corresponding received acknowledgements. In process block 404, in response to a detected loss of previously transmitted information by the apparatus: increasing the rate of transmission of information by the apparatus (e.g., increasing a congestion window) in response to attributing the detected loss of previously transmitted information as not being caused by congestion based on a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and corresponding acknowledgements received by the apparatus (e.g., directly, determining one or more queuing delays determined therefrom such based on minimum, average and/or median, smooth-filtered maximum of roundtrip delays). Processing of the flow diagram of FIG. 4 is complete as illustrated by process block 406.
FIG. 5 illustrates a process performed in one embodiment. Processing begins with process block 500, and in process block 502, the apparatus receives an acknowledgement for information previously sent. As determined in process block 505, in response to identifying a loss of transmitted data (e.g., based on some number of received
acknowledgments allowing the identification of lost data), the apparatus enters a loss recovery phase of TCP communications (510), which includes process blocks 512-518.
In process block 512, the apparatus determines whether or not to attribute the packet loss to congestion based on measured roundtrip delays of information sent and corresponding acknowledgement received. One embodiment uses these roundtrip delays directly, possibly in combination with other information. In one embodiment, these roundtrip delays are used to estimate queuing delays, which are used to identify whether or not to attribute the packet loss to congestion in the network. In one embodiment, a queuing delay is determined based on an average of measured roundtrip delays, a minimum of measured roundtrip delays, and/or a median, smooth-filtered maximum of measured roundtrip delays. As determined in process block 515, if the loss of information was attributed to congestion in the network, then in process block 518, the apparatus implements fast recovery, which typically includes decreasing the rate of transmission of information (e.g., decreasing a congestion window (cwnd), or setting cwnd to the TCP slow-start threshold value (ssthresh)). Otherwise, in process block 516, in response to attributing the loss of transmitted information as not being caused by congestion in the network, the rate of transmission of information is increased (e.g., increasing a congestion window (cwnd)).
Continuing, as determined in process block 520, if a congestion window is greater than a threshold value, then in process block 522, the rate of transmission is increased (e.g., a congestion window (cwnd) is increased). Otherwise, in process block 524, the apparatus implements TCP slow start. Processing of the flow diagram of FIG. 5 is complete as indicated by process block 529.
FIGs. 6A and 6B illustrate a process performed in one embodiment. As shown, this process is described using pseudo code using BIC-TCP (e.g., typically implemented in Linux). Note, known functions, such as bictcp_recalc_ssthresh() and bictcp_update(), and bictcp_reset(), and/or known variables or other items in known implementation of TCP may be referenced.
Code 601 illustrates Initialization, wherein variables are initialized and blast_reset() 613 is performed. This code includes initializing a low threshold variable yL and high threshold variable yH for providing a band for identifying whether or not to attribute a packet loss to network congestion (as described hereinafter).
Code 602 illustrates On_each_ACK, which is performed in response to each received TCP acknowledgement to maintain some statistics about measured roundtrip and/or queuing delays. Variable dMin is used to maintain a lowest measured roundtrip time; sRTT is set a median, smooth-filtered maximum of the measured roundtrip delays; dMax maintains the maximum median, smooth-filtered maximum of the measured roundtrip delays; and sumRTT and cntRTT are maintained for calculating an average of the measured roundtrip delays.
Code 603 illustrates At_the_start_of_each_RTT_round, which resets variables maintained for each round of roundtrip times maintained.
Code 604 illustrates Packet_loss, which is performed in response to a packet loss to recalculate the ssthresh variable (e.g., perform TCP slow start, such as in process block 524 of FIG. 5).
Code 605 illustrates Fast_Recovery_for_each_ACK:, which is performed in response to an identified packet loss (e.g., process blocks 512-518 of FIG. 5). Note, loss_predictor() 608 (FIG. 6B) determines whether or not to attribute the packet loss to congestion, and in response to attributing the packet loss as not due to congestion, the congestion window (cwnd) continues to be evolved (e.g., increased to increase the rate of transmission of information).
Code 606 illustrates Timeout, which is performed in response to a TCP timeout in order to reset the TCP code accordingly.
Code 607 illustrates recalc_ssthresh(), which is performed to recalculate the slow start threshold value, with this calculation being different if the packet loss is attributed to network congestion or not to network congestion.
Code 608 illustrates loss_predictor(), which determines whether to attribute a packet loss to network congestion or not to network congestion. As shown, if the average queuing delay (e.g., average roundtrip delay minus minimum observed roundtrip delay) is lower than a predetermined low threshold value amount of the longest queuing delay (e.g., longest roundtrip delay minus minimum roundtrip delay), then attribute the packet loss as not being related to network congestion. Also, if the average queuing delay is greater than a predetermined high threshold value amount of the longest queuing delay, then attribute the packet loss as being related to network congestion. Further, inside this band defined by the low and high threshold variables times the longest queuing delay, loss_predictor() determines to attribute the packet loss to congestion if the average queuing delay is currently increasing; else it attributes the packet loss as not being due to congestion.
Code 609 illustrates median_filter(RTT) used to median filter a measured roundtrip time based on multiple history values. One embodiment uses more and/or different history values, which may change the accuracy (possibly increasing) of loss_predictor(). Code 610 illustrates avg_delay() used to determine the average queuing delay (e.g., the average roundtrip delay minus the minimum measured roundtrip delay).
Code 61 1 illustrates low_threshold() used to determine the predetermined low threshold value amount of the longest queuing delay.
Code 612 illustrates high_threshold() used to determine the predetermined high threshold value amount of the longest queuing delay.
Code 613 illustrates blast_reset() used to reset the BIC TCP process and initialize some variables.
In view of the many possible embodiments to which the principles of our invention may be applied, it will be appreciated that the embodiments and aspects thereof described herein with respect to the drawings/figures are only illustrative and should not be taken as limiting the scope of the invention. For example, and as would be apparent to one skilled in the art, many of the process block operations can be re-ordered to be performed before, after, or substantially concurrent with other operations. Also, many different forms of data structures could be used in various embodiments. The invention as described herein contemplates all such embodiments as may come within the scope of the following claims and equivalents thereof.

Claims

CLAIMS What is claimed is:
1. An apparatus, comprising:
one or more processing elements and memory configured to communicate information with a remote device over a network;
wherein said communication with the remote device includes, in response to a detected loss of previously transmitted information by the apparatus: increasing the rate of transmission of information by the apparatus in response to attributing the detected loss of previously transmitted information as not being caused by congestion.
2. The apparatus of claim 1, wherein said communication of information is performed using Transmission Control Protocol (TCP), and wherein said attributing of the detected loss of previously transmitted information as not being caused by congestion includes measuring a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and an acknowledgement received by the apparatus corresponding to said sent information.
3. The apparatus of claim 2, wherein said communication using TCP with the remote device includes a loss recovery phase of said TCP communications triggered by the detected loss of previously transmitted information, with the loss recovery phase including performing active congestion control, with said active congestion control including said increasing the rate of transmission of information by the apparatus in response to attributing said detected loss of previously transmitted information as not being caused by congestion based on a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and an acknowledgement received by the apparatus corresponding to said sent information; and wherein the loss recovery phase includes reducing the rate of transmission of information by the apparatus in response to attributing said detected loss of previously transmitted information as being caused by congestion.
4. The apparatus of claim 3, wherein communication using TCP with the remote device includes using a congestion window (cwnd) for reacting to network conditions; and wherein said increasing the rate of transmission of information includes increasing the congestion window (cwnd); and wherein said reducing the rate of transmission includes decreasing the congestion window (cwnd).
5. The apparatus of claim 3, wherein said attributing the detected loss of previously transmitted information as not being caused by congestion based on a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and an acknowledgement received by the apparatus corresponding to said sent information includes determining a plurality of queuing delays based on the plurality of measured roundtrip delays and said attributing said detected loss of previously transmitted information as not being caused by congestion based on the plurality of queuing delays.
6. The apparatus of claim 2, wherein said attributing the detected loss of previously transmitted information as not being caused by congestion based on a plurality of measured roundtrip delays between information sent from the apparatus to the remote device and an acknowledgement received by the apparatus corresponding to said sent information includes determining a plurality of queuing delays based on the plurality of measured roundtrip delays and said attributing said detected loss of previously transmitted information as not being caused by congestion based on the plurality of queuing delays.
7. The apparatus of claim 6, wherein a current queuing delay is determined based on a minimum of a plurality of said measured roundtrip delays and one or more of said measured roundtrip delays.
8. The apparatus of claim 7, wherein the current queuing delay is determined based on a difference of said one or more of said measured roundtrip delays with said minimum of a plurality of said measured roundtrip delays.
9. The apparatus of claim 6, wherein the current queuing delay is determined based on an average of a plurality of said measured roundtrip delays, a minimum of a plurality of said measured roundtrip delays, and a median, smooth-filtered maximum of a plurality of said measured roundtrip delays.
10. The apparatus of claim 1, wherein said attributing of the detected loss of previously transmitted information as not being caused by congestion includes estimating that queuing delays within the network between the apparatus and the remote device have not increased therefore not causing the detected loss.
1 1. The apparatus of claim 10, wherein said communication of information is performed using Transmission Control Protocol (TCP).
12. The apparatus of claim 10, wherein a current queuing delay of said queuing delays is determined based on a difference of one or more measured roundtrip delays with a minimum of a plurality of measured roundtrip delays.
13. The apparatus of claim 12, wherein a current queuing delay of said queuing delays is determined based on an average of a plurality of a plurality of measured roundtrip delays, a minimum of a plurality of the plurality of measured roundtrip delays, and a median, smooth-filtered maximum of a plurality of the plurality of measured roundtrip delays.
14. A method, comprising:
communicating, by a particular apparatus, with a remote device over a network; wherein said communication with the remote device includes, in response to a detected loss of previously transmitted information by the particular apparatus: increasing the rate of transmission of information by the particular apparatus in response to attributing said detected loss of previously transmitted information as not being caused by congestion based on a current queuing delay determined based on measured roundtrip delays between information sent from the particular apparatus to the remote device and an
acknowledgement received by the particular apparatus corresponding to said sent information.
15. The method of claim 14, including: in response to the detected loss of previously transmitted information by the particular apparatus: decreasing the rate of transmission of information by the particular apparatus in response to attributing said detected loss of previously transmitted information as being caused by congestion based on the current queuing delay.
16. The method of claim 15, wherein said communicating with the remote device over the network includes using Transmission Control Protocol (TCP).
17. The method of claim 16, wherein communicating using TCP with the remote device includes using a congestion window (cwnd) for reacting to network conditions; and wherein said increasing the rate of transmission of information includes increasing the congestion window (cwnd); and wherein said decreasing the rate of transmission of information includes decreasing the congestion window (cwnd).
18. The method of claim 14, including determining the current queuing delay based on a minimum of a plurality of said measured roundtrip delays and one or more of said measured roundtrip delays.
19. The method of claim 18, including determining the current queuing delay based on a difference of said one or more of said measured roundtrip delays with said minimum of a plurality of said measured roundtrip delays.
20. The method of claim 14, including determining the current queuing delay based on an average of a plurality of said measured roundtrip delays, a minimum of a plurality of said measured roundtrip delays, and a median, smooth-filtered maximum of a plurality of said measured roundtrip delays.
21. The method of claim 20, including: in response to the detected loss of previously transmitted information by the particular apparatus: decreasing the rate of transmission of information by the particular apparatus in response to attributing said detected loss of previously transmitted information as being caused by congestion based on the current queuing delay.
22. The method of claim 20, wherein said attributing said detected loss of previously transmitted information as not being caused by congestion based on the current queuing delay includes determining that an average queuing delay is not greater than a previously determined average queuing delay not including the current queuing delay.
23. The method of claim 22, including: in response to the detected loss of previously transmitted information by the particular apparatus: decreasing the rate of transmission of information by the particular apparatus in response to attributing said detected loss of previously transmitted information as being caused by congestion based on the current queuing delay.
24. An apparatus, comprising:
one or more processing elements and memory configured to communicate using Transmission Control Protocol (TCP) with a remote device over a network;
wherein said communication using TCP with the remote device includes using a congestion window (cwnd) for reacting to network conditions;
wherein said communication with the remote device using TCP includes characterizing the roundtrip delay between the apparatus and the remote device based on measured roundtrip delay for a plurality of sent information and corresponding received acknowledgements; and
wherein said communication with the remote device using TCP includes: in response to an identified loss of particular information sent to the remote device and a determination based on said maintained characterization of the roundtrip delay, increasing the congestion window (cwnd).
25. The apparatus of claim 24, wherein the determination based on said maintained characterization of the roundtrip delay distinguishes between information loss due to network congestion and information loss due to another cause.
PCT/US2010/060517 2009-12-25 2010-12-15 Increasing transmission rate to a remote device WO2011078995A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP10839994.0A EP2517032A4 (en) 2009-12-25 2010-12-15 Increasing transmission rate to a remote device
IN3918DEN2012 IN2012DN03918A (en) 2009-12-25 2010-12-15
CN201080059420.7A CN102667510B (en) 2009-12-25 2010-12-15 Increasing transmission rate to a remote device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12/647,426 US8625622B2 (en) 2009-12-25 2009-12-25 Increasing transmission rate to a remote device in response to attributing information loss as not being a result of network congestion
US12/647,426 2009-12-25

Publications (1)

Publication Number Publication Date
WO2011078995A1 true WO2011078995A1 (en) 2011-06-30

Family

ID=44187521

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2010/060517 WO2011078995A1 (en) 2009-12-25 2010-12-15 Increasing transmission rate to a remote device

Country Status (5)

Country Link
US (2) US8625622B2 (en)
EP (1) EP2517032A4 (en)
CN (1) CN102667510B (en)
IN (1) IN2012DN03918A (en)
WO (1) WO2011078995A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2527365A (en) * 2014-06-20 2015-12-23 Starleaf Ltd A telecommunication end-point device data transmission controller
GB2555755A (en) * 2014-06-20 2018-05-09 Starleaf Ltd A telecommuincation end-point device data transmission controller

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8625622B2 (en) 2009-12-25 2014-01-07 Cisco Technology, Inc. Increasing transmission rate to a remote device in response to attributing information loss as not being a result of network congestion
US8730799B2 (en) * 2010-03-03 2014-05-20 Akamai Technologies, Inc. Dynamic adjustment of receive window utilized by a transmitting device
CN104685486B (en) * 2012-08-27 2018-10-09 阿卡麦科技公司 Preventing TCP too fast becomes too cautious
EP2891293B1 (en) * 2012-08-29 2018-06-06 Universiteit Gent Method and device for scheduling data traffic
EP3135009B1 (en) 2014-04-23 2018-03-14 Bequant S.L. Method and apparatus for network congestion control based on transmission rate gradients
GB2525948B (en) * 2014-11-04 2017-01-04 Imagination Tech Ltd Packet loss and bandwidth coordination
EP3269174B1 (en) * 2015-06-26 2020-03-04 Hewlett-Packard Enterprise Development LP Transmissions of unicast frames to client devices
US11917501B2 (en) 2015-06-26 2024-02-27 Hewlett Packard Enterprise Development Lp Transmissions of unicast frames to client devices
MY193589A (en) * 2017-01-20 2022-10-19 Univ Putra Malaysia A method for controlling congestion in communication system
CN107907919B (en) * 2017-12-15 2024-01-26 合肥国为电子有限公司 Distributed seismic prospecting instrument cable testing platform and testing method thereof
US10637788B2 (en) * 2018-06-26 2020-04-28 International Business Machines Corporation Stability of delay-based congestion control in a computer network using an alpha-beta filter and round-trip-time predictor
CN109698794B (en) * 2019-01-21 2021-07-09 北京达佳互联信息技术有限公司 Congestion control method and device, electronic equipment and storage medium
US20230254229A1 (en) * 2022-02-09 2023-08-10 Mellanox Technologies, Ltd. Network delay estimation

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5974028A (en) * 1997-02-24 1999-10-26 At&T Corp. System and method for improving transport protocol performance in communication networks having lossy links
US20040218617A1 (en) * 2001-05-31 2004-11-04 Mats Sagfors Congestion and delay handling in a packet data network
US20040264370A1 (en) 2003-06-27 2004-12-30 Sang-Jun Moon Congestion control method and system for reducing a retransmission timeout count in a transmission control protocol
US20050201284A1 (en) * 2001-03-02 2005-09-15 Cheriton David R. TCP optimized single rate policer
US20060034286A1 (en) * 2004-07-29 2006-02-16 Koning G P High performance TCP for systems with infrequent ACK
US20060114830A1 (en) 2004-11-29 2006-06-01 Nec Corporation High-throughput communication system, communication terminal, session relay, and communication protocol

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2237264A1 (en) * 1998-05-08 1999-11-08 Northern Telecom Limited Receiver based congestion control
US7606164B2 (en) * 1999-12-14 2009-10-20 Texas Instruments Incorporated Process of increasing source rate on acceptable side of threshold
US7058723B2 (en) * 2000-03-14 2006-06-06 Adaptec, Inc. Congestion control for internet protocol storage
US6958997B1 (en) * 2000-07-05 2005-10-25 Cisco Technology, Inc. TCP fast recovery extended method and apparatus
AUPR688201A0 (en) * 2001-08-09 2001-08-30 University Of Melbourne, The An active queue management process
US7284047B2 (en) * 2001-11-08 2007-10-16 Microsoft Corporation System and method for controlling network demand via congestion pricing
US7355981B2 (en) * 2001-11-23 2008-04-08 Apparent Networks, Inc. Signature matching methods and apparatus for performing network diagnostics
WO2003088609A2 (en) * 2002-04-12 2003-10-23 Nokia Corporation System, device and method for improving throughput in a communication network, preferably a mobile ipv6-based network
US7296083B2 (en) * 2002-06-28 2007-11-13 Microsoft Corporation Method and system for measuring load and capacity on a variable capacity channel
US20040192312A1 (en) * 2002-07-16 2004-09-30 Jia-Ru Li Communication system for voice and data with wireless TCP server
DE60213623T2 (en) * 2002-12-09 2007-10-18 Tektronix International Sales Gmbh Circulation time estimation method and means by acknowledgment in a packet transmission system
WO2005002120A2 (en) * 2003-06-12 2005-01-06 California Institute Of Technology Method and apparatus for network congestion control
US8228952B2 (en) * 2003-08-22 2012-07-24 Imec Method for operating a telecom system
US20060114836A1 (en) * 2004-08-20 2006-06-01 Sofie Pollin Method for operating a combined multimedia -telecom system
JP2005167353A (en) * 2003-11-28 2005-06-23 Ntt Docomo Inc Transmitter device and program
US7397759B2 (en) * 2004-03-15 2008-07-08 Microsoft Corporation Response for spurious timeout
US7394762B2 (en) * 2004-04-21 2008-07-01 National University Of Ireland Maynooth Congestion control in data networks
FI20041528A0 (en) * 2004-11-26 2004-11-26 Nokia Corp Contextual profile for data communication
US8824429B2 (en) * 2005-08-19 2014-09-02 Riverbed Technology, Inc. Automatic estimation of node location based on trace information
US8817599B2 (en) * 2006-05-16 2014-08-26 Autonet Mobile, Inc. Mobile router with session proxy
ATE545245T1 (en) * 2006-12-18 2012-02-15 Ericsson Telefon Ab L M SCHEDULING AND QUEUE MANAGEMENT WITH ADAPTIVE QUEUE LATENCY
KR100846344B1 (en) * 2007-01-05 2008-07-15 삼성전자주식회사 Apparatus and method for reducing transmission control protocol latency in portable communication system
JP5146725B2 (en) * 2007-09-19 2013-02-20 日本電気株式会社 Communication apparatus and communication method
FR2933834A1 (en) * 2008-07-11 2010-01-15 Canon Kk METHOD FOR MANAGING DATA STREAM TRANSMISSION ON A TUNNEL TRANSPORT CHANNEL, TUNNEL HEAD, COMPUTER PROGRAM PRODUCT, AND CORRESPONDING STORAGE MEDIUM.
US8625622B2 (en) 2009-12-25 2014-01-07 Cisco Technology, Inc. Increasing transmission rate to a remote device in response to attributing information loss as not being a result of network congestion

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5974028A (en) * 1997-02-24 1999-10-26 At&T Corp. System and method for improving transport protocol performance in communication networks having lossy links
US20050201284A1 (en) * 2001-03-02 2005-09-15 Cheriton David R. TCP optimized single rate policer
US20040218617A1 (en) * 2001-05-31 2004-11-04 Mats Sagfors Congestion and delay handling in a packet data network
US20040264370A1 (en) 2003-06-27 2004-12-30 Sang-Jun Moon Congestion control method and system for reducing a retransmission timeout count in a transmission control protocol
US20060034286A1 (en) * 2004-07-29 2006-02-16 Koning G P High performance TCP for systems with infrequent ACK
US20060114830A1 (en) 2004-11-29 2006-06-01 Nec Corporation High-throughput communication system, communication terminal, session relay, and communication protocol

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2517032A4

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2527365A (en) * 2014-06-20 2015-12-23 Starleaf Ltd A telecommunication end-point device data transmission controller
US9398256B2 (en) 2014-06-20 2016-07-19 Starleaf Ltd Telecommunication end-point device data transmission controller
GB2555755A (en) * 2014-06-20 2018-05-09 Starleaf Ltd A telecommuincation end-point device data transmission controller
GB2527365B (en) * 2014-06-20 2018-09-12 Starleaf Ltd A telecommunication end-point device data transmission controller

Also Published As

Publication number Publication date
US20140112134A1 (en) 2014-04-24
EP2517032A1 (en) 2012-10-31
CN102667510B (en) 2015-04-01
US8625622B2 (en) 2014-01-07
US20110158253A1 (en) 2011-06-30
IN2012DN03918A (en) 2015-09-04
US9300589B2 (en) 2016-03-29
EP2517032A4 (en) 2014-03-12
CN102667510A (en) 2012-09-12

Similar Documents

Publication Publication Date Title
US9300589B2 (en) Increasing transmission rate to a remote device in response to attributing information loss as not being a result of network congestion
US11876714B2 (en) Method and apparatus for network congestion control based on transmission rate gradients
US7296206B2 (en) Communication device, transmission control method, and program product
JP3789120B2 (en) RTT measurement method for receiving side in TCP
US7940665B2 (en) Transparent optimization for transmission control protocol flow control
US8509067B2 (en) System and method for controlling network congestion
KR20120004961A (en) Maximizing bandwidth utilization in networks with high latencies and packet drops using transmission control protocol
US20070223529A1 (en) Methods and apparatus for estimating bandwidth of a data network
KR20020029744A (en) Method and device for determining a time-parameter
US20080219164A1 (en) Communication terminal which perform low-delay communication
US20060209838A1 (en) Method and system for estimating average bandwidth in a communication network based on transmission control protocol
KR100912178B1 (en) Congestion control method over wireless link
JPWO2010073979A1 (en) Communication quality monitoring apparatus, communication system, communication quality monitoring method and program thereof
US8793394B2 (en) Session relaying apparatus, session relay method, and session relay program
JP6145190B1 (en) Relay device, relay method, and relay program
JP2893398B1 (en) Congestion control method
JP2006005833A (en) Device, method and program for data communication, and recording medium
WO2006058212A2 (en) Methods and apparatus for estimating bandwidth of a data network
KR20050103543A (en) Packet sending rate decision method in tcp transmission control

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10839994

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 3918/DELNP/2012

Country of ref document: IN

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2010839994

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2010839994

Country of ref document: EP