USRE43668E1 - Method and apparatus for transmitting packets - Google Patents

Method and apparatus for transmitting packets Download PDF

Info

Publication number
USRE43668E1
USRE43668E1 US12/324,483 US32448308A USRE43668E US RE43668 E1 USRE43668 E1 US RE43668E1 US 32448308 A US32448308 A US 32448308A US RE43668 E USRE43668 E US RE43668E
Authority
US
United States
Prior art keywords
network
bit rate
state
audio
communication
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
US12/324,483
Inventor
Vladimir Pogrebinsky
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
OL Security LLC
Hanger Solutions LLC
Original Assignee
Karo Millennium JP LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Karo Millennium JP LLC filed Critical Karo Millennium JP LLC
Priority to US12/324,483 priority Critical patent/USRE43668E1/en
Assigned to KARO MILLENNIUM J.P., L.L.C. reassignment KARO MILLENNIUM J.P., L.L.C. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: VOCALTEC COMMUNICATIONS LTD.
Assigned to VOCALTEC COMMUNICATIONS LTD. reassignment VOCALTEC COMMUNICATIONS LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: POGREBINSKY, VLADIMIR
Application granted granted Critical
Publication of USRE43668E1 publication Critical patent/USRE43668E1/en
Assigned to OL SECURITY LIMITED LIABILITY COMPANY reassignment OL SECURITY LIMITED LIABILITY COMPANY MERGER (SEE DOCUMENT FOR DETAILS). Assignors: KARO MILLENNIUM J.P., L.L.C.
Anticipated expiration legal-status Critical
Assigned to HANGER SOLUTIONS, LLC reassignment HANGER SOLUTIONS, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: INTELLECTUAL VENTURES ASSETS 158 LLC
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/0001Systems modifying transmission characteristics according to link quality, e.g. power backoff
    • H04L1/0002Systems modifying transmission characteristics according to link quality, e.g. power backoff by adapting the transmission rate
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/0001Systems modifying transmission characteristics according to link quality, e.g. power backoff
    • H04L1/0015Systems modifying transmission characteristics according to link quality, e.g. power backoff characterised by the adaptation strategy
    • H04L1/0017Systems modifying transmission characteristics according to link quality, e.g. power backoff characterised by the adaptation strategy where the mode-switching is based on Quality of Service requirement
    • H04L1/0018Systems modifying transmission characteristics according to link quality, e.g. power backoff characterised by the adaptation strategy where the mode-switching is based on Quality of Service requirement based on latency requirement
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0896Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04JMULTIPLEX COMMUNICATION
    • H04J3/00Time-division multiplex systems
    • H04J3/02Details
    • H04J3/06Synchronising arrangements
    • H04J3/0635Clock or time synchronisation in a network
    • H04J3/0638Clock or time synchronisation among nodes; Internode synchronisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/64Hybrid switching systems
    • H04L12/6418Hybrid transport
    • H04L2012/6481Speech, voice
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/50Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate

Definitions

  • the present invention relates to methods and apparatus for transmitting multimedia in a communication network. More particularly, the present invention relates to methods and apparatus for transmitting data packets containing audio and video, over a communication network, for example the Internet.
  • Communication networks such as wide area networks (WAN) are commonly known, and perhaps the fastest growing of these is the Internet.
  • WAN wide area networks
  • multimedia transceiver enables users to transmit and receive audio, video and text over the Internet.
  • Internet telephony client allows for telephone calls over the Internet.
  • a user dials the telephone number of a recipient user via a computer keyboard or the like.
  • the Internet telephony client digitally samples the voice of one user, temporary stores the samples in a buffer, and packages the samples into a data packet or packets.
  • the data packet or packets is/are transmitted to a recipient user using an IP protocol.
  • the recipient user receives the data packet or packets, strips them of the protocol headers and converts the samples into voice. This method is also performed at the caller end of the internet connection pathway.
  • This Internet telephony client exhibits drawbacks in that the voice quality on both ends of the communication pathway is poor. Several methods have been attempted to improve this voice quality.
  • these methods typically involve always transmitting packets that are built based on the parameters that are necessary for insuring the audio quality at the receiving side. These parameters can be redundancy, packaging schemes and/or patterns and compression type and/or rate. These methods exhibited drawbacks in that they did not adjust for changing network conditions, whereby increases in the network load continued to result in poor audio quality.
  • the present invention overcomes the disadvantages of the prior art by accounting for the network conditions and transmitting audio, typically voice, in accordance with the sensed network condition. Specifically, the present invention allows for the detection of the network state and controlling of the bit rate transmission of a communication, in order to improve the media quality of recipient, for example, a multimedia call, in accordance with the detected network state such that the audio quality of the communication is improved when compared to that of the prior art.
  • the network includes a plurality of multimedia transceivers for sending and receiving multimedia communications such as audio and video, typically voice.
  • the method includes the steps of providing at least two predefined network states to be compared with a monitored network state, monitoring the network state, selecting one state of the at least two predefined network states in accordance with the monitored network state, sampling at least one type of media at a transmitter for providing at least one media sample, packaging network protocol parameters with the at least one media sample into a packet, and transmitting the packet over the network, wherein the number of media samples in the packet is in accordance with the predefined network state.
  • a different type of packaging enables transmission of different lengths of packets with accordance to the network state. This allows for a bit rate adjustment according to the network available band width and state (condition), for improving received media quality at the receiver.
  • the steps of providing at least two predefined states further includes the steps of analyzing the network in accordance with at least one type of received media communication, categorizing the network into at least two network states, these network states corresponding to the above described predefined network states, and for each network state, packaging sat least one media frame with at least one parameter.
  • the parameters are parameters for improving an audio quality of the receiver.
  • the invention also provides an apparatus for transmitting packets over a packed switch network.
  • the apparatus includes a means for providing at least two predefined network states and at least one predefined media constructing parameter such as a table in a memory.
  • the apparatus further includes a monitor for monitoring a network state, a selector for selecting at least one state of the at least two predefined network states in accordance with the monitored network state, a sampling means for providing samples of at least one media type, a packaging means for packaging communication protocol parameters with media samples for providing a packet, and a transmitter for transmitting the packet, that has been constructed in accordance with the detected network state.
  • FIG. 1 is a block diagram of illustrating the present invention
  • FIG. 2 is a detailed block diagram of a media transmitter in accordance with the present invention.
  • FIG. 3a is a diagram of a packet for a first protocol employed in the present invention.
  • FIG. 3b is a diagram of a packet for a second protocol employed in the present invention.
  • FIG. 4 is a table detailing audio packaging parameters in accordance with the network state
  • FIG. 5 is a flow chart of the method of the preferred embodiment of the invention.
  • FIG. 6 is a graph of bit rate versus frames per packet in accordance with the present invention.
  • FIG. 7 is a chart of actual bit ratios in accordance with the graph of FIG. 6 .
  • FIG. 1 details the present invention in operation with a packet switch network 1 for transmitting a data packet or packets.
  • the packet switch network can be a wide area network and for example, it could be the Internet.
  • Multimedia transceivers 2 - 5 for sending and receiving multimedia communications over the network 1 , are linked to the network 1 by conventional communication means. These communications typically involve multimedia calls, that include audio and video, generated by a transceiver, such as transceiver 5 to another transceiver, such as transceiver 4 over the network 1 .
  • Transceiver 5 Is exemplary of the other transceivers 2 - 4 . All of these transceivers 2 - 5 typically include a transmitter 6 and a receiver 7 .
  • the transmitter 6 typically includes an audio transmitter 8 (in combination with an audio bit rate controller 19 , as below, defines an audio channel), for transmitting audio packets over the network 1 and a video transmitter 9 (in combination with a video bit rate controller 20 , as below, defines a video channel), for transmitting video packets over the network 1 .
  • the receiver 7 may include audio and video receivers (not shown) for receiving media transmissions that include audio and video.
  • transceiver is a computer program such as INTERNET PHONE® from Vocal Tec Communications, Ltd, Herzelia, Israel, that uses a PENTIUM® or PENTIUM II® based personal computers (PCs), that includes audio and video cards and a network communication device or a modem to perform the invention.
  • a computer program such as INTERNET PHONE® from Vocal Tec Communications, Ltd, Herzelia, Israel, that uses a PENTIUM® or PENTIUM II® based personal computers (PCs), that includes audio and video cards and a network communication device or a modem to perform the invention.
  • PCs personal computers
  • FIG. 2 shows a block diagram of the transmitter 6 , as in communication with the network 1 .
  • the transmitter 6 includes the audio transmitter 8 , video transmitter 9 and a selecting means or selector 10 , for controlling bit rate between the audio 8 and video 9 transmitters, for transmission of packets (detailed below) over the network 1 .
  • the audio transmitter 8 includes an audio sampling device 11 , that samples the audio, such as voice from the user (U).
  • This audio sampling device 11 is operably coupled with a compressing means 12 , that communicates with a packaging means 13 .
  • the compressing means 12 includes a voice activity detector (VAD) 14 and an audio compressor 16 .
  • VAD voice activity detector
  • the voice activity detector 14 detects voice activity and transfers the voice samples to the audio compressor 15 .
  • the audio compressor 15 functions to compress voice samples and to provide at least one audio frame.
  • the packaging means 13 includes audio packaging means 16 , redundancy packaging means 17 and a Internet Protocol (IP) packaging means 18 .
  • the audio packaging means 16 serves to package compressed audio frames into a packet, while the redundancy packing means 17 is for packaging at least one redundant audio frame, corresponding to the packaged audio frame.
  • the IP packaging means 18 packages IP communication protocol parameters, for example, an IP protocol header, for providing a packet and transmitting this packet over the network 1 , typically the Internet, to the transceiver 4 .
  • This packaging is typically a packaging of audio frames in a single packet or multiple packets, as produced by the audio compressor 15 (and corresponding video compressor 24 , for video). Packaging into single or multiple packets typically involves using one or more (but at least one) communication protocol parameters, such as a number of frames per packet, redundancy or a redundancy scheme, for input to the IP packaging means 18 .
  • the video transmitter 9 includes a video sampling device 23 , a video compressor 24 and packaging means 25 .
  • the video sampling device 23 samples the video signal and inputs the video samples to the video compressor 24 .
  • the video compressor 24 compresses the video samples and provides at least one video frame.
  • the packaging means 25 package the video frame with the communication protocol headers, for example, IP protocol headers, to provide a packet or packets, that will be transmitted over the network 1 .
  • the selecting means or selector 10 includes media bit data controllers, here, an audio bit rate control device 19 and a video bit rate control device 20 and an allocator 21 . These media bit rate controllers control transmission speed and the network load in accordance with the monitored network state.
  • the allocator 21 is operably coupled to a network monitor 22 , that monitors the network 1 , for its condition, in real time, by receiving the network state, and at least one of the media bit rate controllers.
  • the network monitor 22 provides the network state to the selecting means 10 . This in turn allows the selecting means 10 to control the video compressor 24 for packaging constructing parameters with video samples to provide best video quality at the transceiver 4 . It also allows the allocator 21 in the selecting means 10 to select the monitored network state that is most similar to one predefined network state, from a series of network states, stored iii the allocator 21 .
  • the allocator 21 may also include a data storage device (for storing databases, data, and the like), a data processor, such as a microprocessor or other computing or data processing means. Also the data storage device and data processor could be within the selecting means 10 , external to the allocator 21 , and could also be external to the transmitter 6 .
  • the audio bit rate control device 19 or video bit rate control device 20 receives commands (in the form of data or signals) from the allocator 21 to raise or lower the respective bit rates (detailed below). Additionally, the audio bit rate control device 19 and video bit rate control device 20 include hardware and software for adjusting the bit rate transmission to the available bandwidth of network 1 .
  • a signal from the allocator 21 inputs control data to the audio bit rate controller 19 .
  • This audio bit rate controller 19 controls the audio compressor 15 , audio packaging means 16 and the redundancy packaging means 17 of the audio transmitter 8 , for packaging the parameters which result the best audio quality at the receiver 7 ( FIG. 1 ).
  • FIG. 3a is a description of a packet 50 with accordance with a real time protocol (RTP), RFC 1889 as described in Schulzrinne, et al.; “RTP: A Transport Protocol for Real-Time Applications”, Network Working Group, Standards Track RFC 1809, January 1996 (hereinafter, “Standards Track-RFC 1889”), available at http://www.ietf.org/rfc/rfc1889.txt, and incorporated by reference in its entirety herein.
  • the packet 50 includes a plurality of fields of 32 bits.
  • V Version field
  • P Padding field
  • X extension field
  • CC CSRC count field
  • M marker field
  • a payload type (PT) field 52 identifies the format of the RTP media data and determines its interpretation by an application.
  • a sequence number field 54 increments by one for each RTP data packet sent, and may used by the receiver to detect packet loss to restore packet sequence, the sequence number field 54 is 16 bits field.
  • a timestamp field 57 includes 32 bits and reflects the time of the sampling instant of the first byte of the present packet.
  • the sampling instant must be driven from a clock that increments monotonically and linearly in time to allow synchronization and jitter calculation of media samples.
  • a synchronization source identifier field 58 includes 32 bits and identifies the synchronization source.
  • the last field is a media field 59 which includes compressed media samples.
  • the compressed media samples may be audio or video samples.
  • a G.723 codec is used with a bit rate of 6400 bits per second.
  • the audio samples are arranged in frames. Each frame includes 240 audio samples which are compressed into 24 bytes wherein each byte includes 8 bits. The number of media frames may be varied in accordance with the monitored network state.
  • FIG. 3b is a description of a packet 70 with accordance to a real time protocol (RTP), RFC 2198, as described in Perkins et al.; “RTP Payload for Redundant Audio Data”, Network Working Group Standards Track RFC 2198, September 1997 (hereinafter, “Standards Track-RFC 2198”), available at http://www.letf.org/rfc/rfc2198.txt and incorporated by reference in its entirely herein.
  • the packet 70 includes a plurality of fields of 32 bits, and is detailed at page 8 of Standards Track-RFC 2198.
  • bits in the header 73 are specified as follows:
  • the next block in the header 73 is the timestamp offset block 75 , this block relative to the timestamp given in RTP header, as described in FIG. 3a .
  • the use of an unsigned offset implies that redundant date must be sent after the primary data, and is hence a time to be subtracted from the current timestamp to determine the timestamp of the data for which this block is the redundancy.
  • the next block is block length 76 , which indicates length in bytes of the corresponding data block excluding header.
  • the header for the primary (final) block comprises only a zero F bit, and the block payload type information PT-5 (block 74 b).
  • the final header is followed, immediately, by the data blocks, stored in the same order as the headers.
  • the choice of encodings used should reflect the bandwidth requirements of those encodings. It is expected that the redundant encoding shall use significantly less bandwidth that the primary encoding: the exception being the case where the primary is very low-bandwidth and has high processing requirement, in which case a copy of at least one audio or video frame, stored in the primary data block 71 may be used as the file redundant data 72 .
  • Network behavior is analyzed statistically and is based on detected network behaviors.
  • Network states are defined, where in each state, a set of constructing parameter for constructing the packet, needs to be determined.
  • Bit rate control is in accordance with the Table of FIG. 4 .
  • Table of FIG. 4 there are four predefined network states: Regular, Less, Delay, and Loss+D (Loss plus Delay), to which the actual detected network state is matched.
  • bit rates for transmission Within each network state are bit rates for transmission, and corresponding quality states or quality degrees for the network state at the bit rate.
  • quality states quality degrees
  • H high quality, the best quality state, transmitting one frame per packet and redundancy, wherein there is packet loss in the network
  • S sufficient quality, the second best quality state (quality degree), transmitting more than one audio frame in a packet
  • NS non-sufficient quality, the least quality of the three quality states, packet loss without redundancy.
  • This Table ( FIG. 4 ) was obtained by analyzing the network in accordance with a received audio communication, characterizing the network into at least two states, and for each network state, packaging a number of media frames in accordance with the network state.
  • the apparatus and systems detailed above perform methods for transmitting packets in accordance with the present invention. These methods improve on the prior art transmitting methods, for they provide superior audio quality at the receiving side.
  • An exemplary method, resulting in a transmission, such a multimedia call from transceiver 5 to transceiver 4 over the network 1 will be described now in accordance with FIG. 5 .
  • FIG. 5 there is shown the method of the present invention.
  • the method may be performed for example, to include stages of bit rate adjustment in accordance with the network state.
  • a first stage is a first or coarse adjustment of the bit rate, while the second stage is a second or fine adjustment of the bit rate.
  • This two stage bit rate adjustment is performed by algorithms.
  • a first algorithm is employed to detect the network state and perform a first or coarse adjustment of the bit rate in correspondence thereto.
  • a second algorithm serves to cause a second or fine bit rate adjustment, to increase or decrease bit rate upon detection of congestion in the network. 1 .
  • the bit rate having been subject to a first (coarse) adjustment, and a second (fine) adjustment, if necessary, is then allocated among the audio and video channels by the allocator 21 , such that the audio transmission is made with a proper bit rate allocated thereto in the preferred embodiment. It is preferred that this exemplary method be performed in intervals of 5 seconds.
  • the interval is at a time during the transmission of audio and video.
  • the first algorithm monitors the state of the network 1 , at step 204 , via the network monitor 22 .
  • the bit rate is an initial bit rate transmission, that is either a predetermined default rate, typically one set for a regular network state with sufficient quality audio, as in FIG. 4 in the Table, a bit rate of 12533 bits per second, corresponding to a network state of “Regular”, with a quality state (quality degree) of “S” denoting sufficient audio quality, or the bit rate of the previous transmission (the most recent interval).
  • This network state monitoring may be with an RTCP Protocol.
  • RTCP Protocol In accordance with that detailed in Standards Track-RFC 1889, that is part of an H.323 protocol.
  • a test packet may be transmitted over the network 1 , for example from transceiver 5 to transceiver 4 , and back to the transceiver 5 , to measure parameters, such as packet loss and round trip time (RTT) also known as round trip delay, the time it takes for a packet to travel from the sending transceiver through the network and back to the sending transceiver.
  • RTT round trip time
  • Packet loss and RTT are detailed in Standards Track-RFC 1889.
  • the monitoring is such that the network monitor 22 includes software and hardware for executing an algorithm able to detect at least two different network states. This monitoring is preferably continuous or at regular intervals, typically at time lengths of 5 seconds.
  • the network monitor 22 sends data corresponding to the network state to the allocator 21 , that activates data processing means in the allocator 21 or the body of the selecting means 10 that executes an algorithm for the audio, in accordance with the Table of FIG. 4 , where a G.723 codec is used.
  • This first algorithm is such that the network state, selected from four predetermined network states, is closest to title detected network state.
  • the network state is checked to see if it has changed, by the first algorithm, at step 206 .
  • the decision of network state change is done by detecting conditions at step 206 , are detailed as follows:
  • the network state should be changed to either “Regular” or “Delay”.
  • the network state should be changed to “Delay” or “Loss plus Delay”.
  • the network state has changed.
  • the changed network state is matched to one of the four predetermined network states, and hit rate adjustment is made in accordance with the Table of FIG. 4 , at step 208 , for the predetermined network state, to which the detected network state most closely corresponds.
  • the network monitor 22 signals the allocator 21 .
  • the algorithm attempts to achieve a quality state (quality degree) of at least Sufficient Quality or “S”. If the network state has not changed, this first bit rate adjustment is not made.
  • This first algorithm is such that it attempts to achieve at least Sufficient Quality or “S” for the audio, so as to avoid changes of bit rate if possible.
  • the “H” or High Quality state is a monitored transmission of a packet, that includes a single audio frame for packets via the IP communication protocol, for example, RFC 2198, if the transmission is made with redundancy, this redundant transmission includes at least one redundant packet over the network with packet loss.
  • the “S” or Sufficient Quality state is a monitored transmission of a packet, where 2-3 frames (audio) are packed into a packet via a protocol for redundancy (for example, RFC 2198), end redundancy is used when the network has packet loss. Other protocols, that help to overcome packet loss, such as forward error correction, are suitable for redundancy.
  • the “NS” or Non-sufficient Quality state is a monitored transmission of a packet via a protocol, for example, RFC 1889, that does not include the transmission of redundant packets, but results in packet loss in the transmission.
  • a second algorithm is employed to check (monitor) for network congestion level or delay. Congestion or delay is detected based on RTCP reports as sent from the network monitor 22 to the allocator 21 .
  • congestion is detected by analyzing three conditions, steps 220 , 222 and 224 . If any of these conditions exist, the algorithm is such that bit rate is decreased in a second or fine adjustment at step 226 , by a signal to the allocator 21 from the network monitor 22 . If a condition does not exist, this second algorithm moves to the next condition to see if it has been met. These conditions are as follows:
  • step 220 if YES, the bit rate is decreased (step 226 ), it NO, the next condition (step 222 ) is analyzed;
  • bit rate is increased, by a second or fine adjustment at step 232 in accordance with that detailed above.
  • Congestion may also be caused by lack of available bandwidth on the network, that serves to limit the bit rate.
  • bit rate will be adjusted in the manner of the second or fine adjustment, to select a network quality state “S” or “NS”, from “H” or “S” respectively, in accordance with the available network bandwidth.
  • the network quality state is preferably adjusted to allow for transmission of at least two media streams, typically audio and video. By transmitting at these lower quality states, particularly “NS”, transmission quality is being sacrificed in view of the available bandwidth.
  • bit rate has been increased at step 232 or if congestion existed in the network over the last 20 seconds
  • the allocator 21 having been signaled to adjust bit rate, with both first (coarse) and/or second (fine) adjustments, the second algorithm is now complete and the first algorithm is resumed.
  • the continuation of this first algorithm is such that the audio and video bit rate controls 19 , 20 respectively, are queried for the total bit rate between the audio and video channels, at step 240 .
  • the audio sampling device 2 and video sampling devise 23 respectively are sampled by the audio sampling device 2 and video sampling devise 23 respectively, in communication with their respective bit rate controllers 19 , 20 .
  • the allocator 21 includes hardware and software that can detect the total bit rate by querying the bit rate in the audio and video bit rate controllers 19 , 20 (as per the audio and video channels respectively) and combining the bit rates to find the total bit rate at step 240 . Accordingly, the alocator 21 will know the quality of the audio transmission in accordance with the Table of FIG. 4 .
  • the allocator 21 will know the total bit rate available, such that it can allocate bit rate between the audio and video bit rate controllers 19 , 20 , at step 242 . In making the allocation, priority will always be given to the audio channel, such that the minimum bit rate for the audio is in accordance with the bit rates of the table FIG. 4 .
  • a package can now be composed for transmission to transceiver 4 .
  • This package is constructed based on sending parameters, such as redundancy, of at least one frame with each redundant packet, indicated in the Table of FIG. 4 as “Redund” and the number of audio frames per packet, indicated in the Table of FIG. 4 as “FR ”.
  • FIG. 6 shows a chart of hit rate versus frames (of audio) per packet for transmissions with a redundancy or 1 (line 260 ) and transmissions without redundancy (line 261 ).
  • the chart of FIG. 7 details the actual bit rates for the transmissions with redundancy in accordance with line 260 and without redundancy in accordance with line 261 .
  • the redundant packet is preferably transmitted at a different protocol than the corresponding packet. For example, when the packet is transmitted in a first protocol, typically the RFC 1889, the redundant packet will be transmitted in a different protocol, typically RFC 2198.
  • the transmission is made. Monitoring continues for as long as desired, typically for the entire period of the transmission, with the above detailed method repeated (steps 204 to 242 ), over the course of the transmission. The repetition is typically in accordance with the monitoring periods for the network.
  • the entire apparatus disclosed above may be implimented on a data processor, such as a microprocessor (linked to a storage device).
  • client applications using these techniques may be implimented under WINDOWSTM OS in Pentium based Personal Computers (PCs) with sound and/or video cards for audio and video processing respectively.
  • PCs Personal Computers

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Quality & Reliability (AREA)
  • Multimedia (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Telephonic Communication Services (AREA)

Abstract

There is disclosed an apparatus and methods for adjusting of bit rate transmission in a communication network by monitoring the state of the network, detecting the state of the network and transmitting a multimedia call over the network in accordance with the network state detected. In accordance with the invention the network state is monitored with the bit rate adjusted in accordance with the network state detected. This results in a multimedia call with greatly improved audio quality.

Description

FIELD OF THE INVENTION
The present invention relates to methods and apparatus for transmitting multimedia in a communication network. More particularly, the present invention relates to methods and apparatus for transmitting data packets containing audio and video, over a communication network, for example the Internet.
BACKGROUND OF THE INVENTION
Communication networks, such as wide area networks (WAN), are commonly known, and perhaps the fastest growing of these is the Internet. One Internet application, known as multimedia transceiver, enables users to transmit and receive audio, video and text over the Internet. An example of this application, known as Internet telephony client, allows for telephone calls over the Internet.
In accordance with this Internet telephony client, a user dials the telephone number of a recipient user via a computer keyboard or the like. When the call is established between the users, the Internet telephony client digitally samples the voice of one user, temporary stores the samples in a buffer, and packages the samples into a data packet or packets. The data packet or packets is/are transmitted to a recipient user using an IP protocol. The recipient user receives the data packet or packets, strips them of the protocol headers and converts the samples into voice. This method is also performed at the caller end of the internet connection pathway.
This Internet telephony client exhibits drawbacks in that the voice quality on both ends of the communication pathway is poor. Several methods have been attempted to improve this voice quality.
At the sender end, these methods typically involve always transmitting packets that are built based on the parameters that are necessary for insuring the audio quality at the receiving side. These parameters can be redundancy, packaging schemes and/or patterns and compression type and/or rate. These methods exhibited drawbacks in that they did not adjust for changing network conditions, whereby increases in the network load continued to result in poor audio quality.
Moreover, when video communications were added to these already poor quality audio communications, the network load increased. This increase resulted in further delay noise and disturbance in audio, lowering its quality, and freezing of the video image.
SUMMARY OF THE INVENTION
The present invention overcomes the disadvantages of the prior art by accounting for the network conditions and transmitting audio, typically voice, in accordance with the sensed network condition. Specifically, the present invention allows for the detection of the network state and controlling of the bit rate transmission of a communication, in order to improve the media quality of recipient, for example, a multimedia call, in accordance with the detected network state such that the audio quality of the communication is improved when compared to that of the prior art.
In one aspect of the present invention, there is provided a method for transmitting packets over a packed switch network. The network includes a plurality of multimedia transceivers for sending and receiving multimedia communications such as audio and video, typically voice.
The method includes the steps of providing at least two predefined network states to be compared with a monitored network state, monitoring the network state, selecting one state of the at least two predefined network states in accordance with the monitored network state, sampling at least one type of media at a transmitter for providing at least one media sample, packaging network protocol parameters with the at least one media sample into a packet, and transmitting the packet over the network, wherein the number of media samples in the packet is in accordance with the predefined network state.
Advantageously, a different type of packaging enables transmission of different lengths of packets with accordance to the network state. This allows for a bit rate adjustment according to the network available band width and state (condition), for improving received media quality at the receiver.
In the preferred embodiment of the invention, the steps of providing at least two predefined states further includes the steps of analyzing the network in accordance with at least one type of received media communication, categorizing the network into at least two network states, these network states corresponding to the above described predefined network states, and for each network state, packaging sat least one media frame with at least one parameter. In this manner, the parameters are parameters for improving an audio quality of the receiver.
The invention also provides an apparatus for transmitting packets over a packed switch network is provided. The apparatus includes a means for providing at least two predefined network states and at least one predefined media constructing parameter such as a table in a memory. The apparatus further includes a monitor for monitoring a network state, a selector for selecting at least one state of the at least two predefined network states in accordance with the monitored network state, a sampling means for providing samples of at least one media type, a packaging means for packaging communication protocol parameters with media samples for providing a packet, and a transmitter for transmitting the packet, that has been constructed in accordance with the detected network state.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention will be described with reference to the accompanying drawings, wherein like reference numerals and/or characters identity corresponding or like components. In the drawings:
FIG. 1 is a block diagram of illustrating the present invention;
FIG. 2 is a detailed block diagram of a media transmitter in accordance with the present invention;
FIG. 3a is a diagram of a packet for a first protocol employed in the present invention;
FIG. 3b is a diagram of a packet for a second protocol employed in the present invention;
FIG. 4 is a table detailing audio packaging parameters in accordance with the network state;
FIG. 5 is a flow chart of the method of the preferred embodiment of the invention;
FIG. 6 is a graph of bit rate versus frames per packet in accordance with the present invention; and
FIG. 7 is a chart of actual bit ratios in accordance with the graph of FIG. 6.
DETAILED DESCRIPTION OF THE DRAWINGS
FIG. 1 details the present invention in operation with a packet switch network 1 for transmitting a data packet or packets. The packet switch network can be a wide area network and for example, it could be the Internet. Multimedia transceivers 2-5, for sending and receiving multimedia communications over the network 1, are linked to the network 1 by conventional communication means. These communications typically involve multimedia calls, that include audio and video, generated by a transceiver, such as transceiver 5 to another transceiver, such as transceiver 4 over the network 1.
Transceiver 5. Is exemplary of the other transceivers 2-4. All of these transceivers 2-5 typically include a transmitter 6 and a receiver 7. The transmitter 6 typically includes an audio transmitter 8 (in combination with an audio bit rate controller 19, as below, defines an audio channel), for transmitting audio packets over the network 1 and a video transmitter 9 (in combination with a video bit rate controller 20, as below, defines a video channel), for transmitting video packets over the network 1. The receiver 7 may include audio and video receivers (not shown) for receiving media transmissions that include audio and video. An example of such a transceiver is a computer program such as INTERNET PHONE® from Vocal Tec Communications, Ltd, Herzelia, Israel, that uses a PENTIUM® or PENTIUM II® based personal computers (PCs), that includes audio and video cards and a network communication device or a modem to perform the invention.
FIG. 2 shows a block diagram of the transmitter 6, as in communication with the network 1. The transmitter 6 includes the audio transmitter 8, video transmitter 9 and a selecting means or selector 10, for controlling bit rate between the audio 8 and video 9 transmitters, for transmission of packets (detailed below) over the network 1.
The audio transmitter 8 includes an audio sampling device 11, that samples the audio, such as voice from the user (U). This audio sampling device 11 is operably coupled with a compressing means 12, that communicates with a packaging means 13.
The compressing means 12 includes a voice activity detector (VAD) 14 and an audio compressor 16. The voice activity detector 14 detects voice activity and transfers the voice samples to the audio compressor 15. The audio compressor 15 functions to compress voice samples and to provide at least one audio frame.
The packaging means 13 includes audio packaging means 16, redundancy packaging means 17 and a Internet Protocol (IP) packaging means 18. The audio packaging means 16 serves to package compressed audio frames into a packet, while the redundancy packing means 17 is for packaging at least one redundant audio frame, corresponding to the packaged audio frame. The IP packaging means 18 packages IP communication protocol parameters, for example, an IP protocol header, for providing a packet and transmitting this packet over the network 1, typically the Internet, to the transceiver 4. This packaging is typically a packaging of audio frames in a single packet or multiple packets, as produced by the audio compressor 15 (and corresponding video compressor 24, for video). Packaging into single or multiple packets typically involves using one or more (but at least one) communication protocol parameters, such as a number of frames per packet, redundancy or a redundancy scheme, for input to the IP packaging means 18.
The video transmitter 9 includes a video sampling device 23, a video compressor 24 and packaging means 25. The video sampling device 23 samples the video signal and inputs the video samples to the video compressor 24. The video compressor 24 compresses the video samples and provides at least one video frame. The packaging means 25 package the video frame with the communication protocol headers, for example, IP protocol headers, to provide a packet or packets, that will be transmitted over the network 1.
The selecting means or selector 10 includes media bit data controllers, here, an audio bit rate control device 19 and a video bit rate control device 20 and an allocator 21. These media bit rate controllers control transmission speed and the network load in accordance with the monitored network state. The allocator 21 is operably coupled to a network monitor 22, that monitors the network 1, for its condition, in real time, by receiving the network state, and at least one of the media bit rate controllers. The network monitor 22 provides the network state to the selecting means 10. This in turn allows the selecting means 10 to control the video compressor 24 for packaging constructing parameters with video samples to provide best video quality at the transceiver 4. It also allows the allocator 21 in the selecting means 10 to select the monitored network state that is most similar to one predefined network state, from a series of network states, stored iii the allocator 21.
The allocator 21 may also include a data storage device (for storing databases, data, and the like), a data processor, such as a microprocessor or other computing or data processing means. Also the data storage device and data processor could be within the selecting means 10, external to the allocator 21, and could also be external to the transmitter 6. The audio bit rate control device 19 or video bit rate control device 20 receives commands (in the form of data or signals) from the allocator 21 to raise or lower the respective bit rates (detailed below). Additionally, the audio bit rate control device 19 and video bit rate control device 20 include hardware and software for adjusting the bit rate transmission to the available bandwidth of network 1.
A signal from the allocator 21 inputs control data to the audio bit rate controller 19. This audio bit rate controller 19 controls the audio compressor 15, audio packaging means 16 and the redundancy packaging means 17 of the audio transmitter 8, for packaging the parameters which result the best audio quality at the receiver 7 (FIG. 1).
FIG. 3a is a description of a packet 50 with accordance with a real time protocol (RTP), RFC 1889 as described in Schulzrinne, et al.; “RTP: A Transport Protocol for Real-Time Applications”, Network Working Group, Standards Track RFC 1809, January 1996 (hereinafter, “Standards Track-RFC 1889”), available at http://www.ietf.org/rfc/rfc1889.txt, and incorporated by reference in its entirety herein. The packet 50 includes a plurality of fields of 32 bits.
The first five fields, Version field (V), Padding field (P), extension field (X), CSRC count field (CC) and the marker field (M) are described in Standards Track-RFC 1889.
A payload type (PT) field 52 identifies the format of the RTP media data and determines its interpretation by an application.
A sequence number field 54 increments by one for each RTP data packet sent, and may used by the receiver to detect packet loss to restore packet sequence, the sequence number field 54 is 16 bits field.
A timestamp field 57 includes 32 bits and reflects the time of the sampling instant of the first byte of the present packet. The sampling instant must be driven from a clock that increments monotonically and linearly in time to allow synchronization and jitter calculation of media samples.
A synchronization source identifier field 58 includes 32 bits and identifies the synchronization source.
The last field is a media field 59 which includes compressed media samples. The compressed media samples may be audio or video samples. In a preferred embodiment, a G.723 codec is used with a bit rate of 6400 bits per second. The audio samples are arranged in frames. Each frame includes 240 audio samples which are compressed into 24 bytes wherein each byte includes 8 bits. The number of media frames may be varied in accordance with the monitored network state.
FIG. 3b is a description of a packet 70 with accordance to a real time protocol (RTP), RFC 2198, as described in Perkins et al.; “RTP Payload for Redundant Audio Data”, Network Working Group Standards Track RFC 2198, September 1997 (hereinafter, “Standards Track-RFC 2198”), available at http://www.letf.org/rfc/rfc2198.txt and incorporated by reference in its entirely herein. The packet 70 includes a plurality of fields of 32 bits, and is detailed at page 8 of Standards Track-RFC 2198.
The first five fields, Version field (V=2). Padding field (P), extension field (X), CSRC count field (CC=0), sequence number field, timestamp field and SSRC field and the marker field (M) are similar to those described for RFC 1889, in FIG. 3a above, and in Standards Track-RFC 1889.
The packets 70 containing a primary data block 71, and a single block of redundancy data 72 as defined in the Standards Track-RFC 2198 is illustrated.
The description of the other fields is as follows:
The bits in the header 73 (outlined in solid lines in FIG. 3b) are specified as follows:
The first bit in the header 73 indicates whether another header bock follows. If “1”, further header blocks such as block PT=7 (block 74a) follow, if “0” this is the last header block, such as block PT=5 (block 74b).
Block “PT=7” (block 74a) is the RTP payload type which may be audio or video and which compressed in primary data block 71.
The next block in the header 73 is the timestamp offset block 75, this block relative to the timestamp given in RTP header, as described in FIG. 3a. The use of an unsigned offset implies that redundant date must be sent after the primary data, and is hence a time to be subtracted from the current timestamp to determine the timestamp of the data for which this block is the redundancy.
The next block is block length 76, which indicates length in bytes of the corresponding data block excluding header. The header for the primary (final) block comprises only a zero F bit, and the block payload type information PT-5 (block 74b). The final header is followed, immediately, by the data blocks, stored in the same order as the headers.
The choice of encodings used should reflect the bandwidth requirements of those encodings. It is expected that the redundant encoding shall use significantly less bandwidth that the primary encoding: the exception being the case where the primary is very low-bandwidth and has high processing requirement, in which case a copy of at least one audio or video frame, stored in the primary data block 71 may be used as the file redundant data 72.
The use of multiple levels of redundancy is rarely necessary. However, in those cases which require it, the bandwidth required by each level of redundancy is expected to be significantly less than that of the previous level.
Network behavior is analyzed statistically and is based on detected network behaviors. Network states are defined, where in each state, a set of constructing parameter for constructing the packet, needs to be determined.
Bit rate control is in accordance with the Table of FIG. 4. In this table, there are four predefined network states: Regular, Less, Delay, and Loss+D (Loss plus Delay), to which the actual detected network state is matched. Within each network state are bit rates for transmission, and corresponding quality states or quality degrees for the network state at the bit rate. These quality states (quality degrees) are defined as follows: H=high quality, the best quality state, transmitting one frame per packet and redundancy, wherein there is packet loss in the network; S=sufficient quality, the second best quality state (quality degree), transmitting more than one audio frame in a packet; and NS=non-sufficient quality, the least quality of the three quality states, packet loss without redundancy. This Table (FIG. 4) was obtained by analyzing the network in accordance with a received audio communication, characterizing the network into at least two states, and for each network state, packaging a number of media frames in accordance with the network state.
The apparatus and systems detailed above perform methods for transmitting packets in accordance with the present invention. These methods improve on the prior art transmitting methods, for they provide superior audio quality at the receiving side. An exemplary method, resulting in a transmission, such a multimedia call from transceiver 5 to transceiver 4 over the network 1 will be described now in accordance with FIG. 5.
In FIG. 5, there is shown the method of the present invention. The method may be performed for example, to include stages of bit rate adjustment in accordance with the network state. A first stage is a first or coarse adjustment of the bit rate, while the second stage is a second or fine adjustment of the bit rate. This two stage bit rate adjustment, for example, is performed by algorithms.
A first algorithm is employed to detect the network state and perform a first or coarse adjustment of the bit rate in correspondence thereto. A second algorithm serves to cause a second or fine bit rate adjustment, to increase or decrease bit rate upon detection of congestion in the network. 1. The bit rate, having been subject to a first (coarse) adjustment, and a second (fine) adjustment, if necessary, is then allocated among the audio and video channels by the allocator 21, such that the audio transmission is made with a proper bit rate allocated thereto in the preferred embodiment. It is preferred that this exemplary method be performed in intervals of 5 seconds.
At step 202, the interval is at a time during the transmission of audio and video. The first algorithm monitors the state of the network 1, at step 204, via the network monitor 22. At this time, the bit rate is an initial bit rate transmission, that is either a predetermined default rate, typically one set for a regular network state with sufficient quality audio, as in FIG. 4 in the Table, a bit rate of 12533 bits per second, corresponding to a network state of “Regular”, with a quality state (quality degree) of “S” denoting sufficient audio quality, or the bit rate of the previous transmission (the most recent interval).
This network state monitoring may be with an RTCP Protocol. In accordance with that detailed in Standards Track-RFC 1889, that is part of an H.323 protocol. As part of the protocol, a test packet may be transmitted over the network 1, for example from transceiver 5 to transceiver 4, and back to the transceiver 5, to measure parameters, such as packet loss and round trip time (RTT) also known as round trip delay, the time it takes for a packet to travel from the sending transceiver through the network and back to the sending transceiver. Packet loss and RTT are detailed in Standards Track-RFC 1889.
The monitoring is such that the network monitor 22 includes software and hardware for executing an algorithm able to detect at least two different network states. This monitoring is preferably continuous or at regular intervals, typically at time lengths of 5 seconds.
Once the network state is detected (upon monitoring), the network monitor 22 sends data corresponding to the network state to the allocator 21, that activates data processing means in the allocator 21 or the body of the selecting means 10 that executes an algorithm for the audio, in accordance with the Table of FIG. 4, where a G.723 codec is used. This first algorithm is such that the network state, selected from four predetermined network states, is closest to title detected network state.
The network state is checked to see if it has changed, by the first algorithm, at step 206. The decision of network state change is done by detecting conditions at step 206, are detailed as follows:
1. If the measured packet loss is less than 3% and the present network state is “Loss” or “Loss plus Delay”, the network state should be changed to either “Regular” or “Delay”.
2. If the current network state is “Regular” or “Delay” and measured packet loss is greater then 5%, and network state should be changed to “Loss” or “Loss plus Delay”.
3. If the current network state is “Regular” or “Loss” and the measured round trip time (RTT) is greater then 1000 ms, the network state should be changed to “Delay” or “Loss plus Delay”.
4. When the current network state is “Delay” or “Loss plus Delay” and the measured RTT is less then 800 ms, the network state should be changed to “Regular” or “Loss”.
If any of the above conditions have been detected, the network state has changed. The changed network state is matched to one of the four predetermined network states, and hit rate adjustment is made in accordance with the Table of FIG. 4, at step 208, for the predetermined network state, to which the detected network state most closely corresponds. In making this first adjustment, the network monitor 22 signals the allocator 21. In making this adjustment, the algorithm attempts to achieve a quality state (quality degree) of at least Sufficient Quality or “S”. If the network state has not changed, this first bit rate adjustment is not made. This first algorithm is such that it attempts to achieve at least Sufficient Quality or “S” for the audio, so as to avoid changes of bit rate if possible.
Turning back to the table of FIG. 4, the quality states (quality degrees) are detailed. The “H” or High Quality state is a monitored transmission of a packet, that includes a single audio frame for packets via the IP communication protocol, for example, RFC 2198, if the transmission is made with redundancy, this redundant transmission includes at least one redundant packet over the network with packet loss. Similarly, the “S” or Sufficient Quality state is a monitored transmission of a packet, where 2-3 frames (audio) are packed into a packet via a protocol for redundancy (for example, RFC 2198), end redundancy is used when the network has packet loss. Other protocols, that help to overcome packet loss, such as forward error correction, are suitable for redundancy. Finally, the “NS” or Non-sufficient Quality state is a monitored transmission of a packet via a protocol, for example, RFC 1889, that does not include the transmission of redundant packets, but results in packet loss in the transmission.
Next, a second algorithm is employed to check (monitor) for network congestion level or delay. Congestion or delay is detected based on RTCP reports as sent from the network monitor 22 to the allocator 21. In this Algorithm, congestion is detected by analyzing three conditions, steps 220, 222 and 224. If any of these conditions exist, the algorithm is such that bit rate is decreased in a second or fine adjustment at step 226, by a signal to the allocator 21 from the network monitor 22. If a condition does not exist, this second algorithm moves to the next condition to see if it has been met. These conditions are as follows:
1. Is packet lose on RTT above 30% (step 220): if YES, the bit rate is decreased (step 226), it NO, the next condition (step 222) is analyzed;
2. Has packet loss increased, typically by a rise of at least 4%, less than 20 seconds after the bit rate was raised (step 222); if YES, the bit rate is decreased (step 226), if NO, the next condition (step 224) is analyzed; or
3. Has the average RTT increased more then 70 msecs in a short time, approximately 20 seconds (step 224); if YES, the bit rate is decreased (step 226), if NO, the next condition all three conditions do not exist and the algorithm continues.
When congestion in the network not detected, network congestion over the last 20 seconds is checked at stop 230. If it has not been detected, bit rate is increased, by a second or fine adjustment at step 232 in accordance with that detailed above.
Congestion may also be caused by lack of available bandwidth on the network, that serves to limit the bit rate. In this case, bit rate will be adjusted in the manner of the second or fine adjustment, to select a network quality state “S” or “NS”, from “H” or “S” respectively, in accordance with the available network bandwidth. The network quality state is preferably adjusted to allow for transmission of at least two media streams, typically audio and video. By transmitting at these lower quality states, particularly “NS”, transmission quality is being sacrificed in view of the available bandwidth.
If bit rate has been increased at step 232 or if congestion existed in the network over the last 20 seconds, the allocator 21, having been signaled to adjust bit rate, with both first (coarse) and/or second (fine) adjustments, the second algorithm is now complete and the first algorithm is resumed.
The continuation of this first algorithm is such that the audio and video bit rate controls 19, 20 respectively, are queried for the total bit rate between the audio and video channels, at step 240. During this step 240, at least one, and preferably both the audio and video channels, are sampled by the audio sampling device 2 and video sampling devise 23 respectively, in communication with their respective bit rate controllers 19, 20. The allocator 21 includes hardware and software that can detect the total bit rate by querying the bit rate in the audio and video bit rate controllers 19, 20 (as per the audio and video channels respectively) and combining the bit rates to find the total bit rate at step 240. Accordingly, the alocator 21 will know the quality of the audio transmission in accordance with the Table of FIG. 4. Also, in accordance with the Table of FIG. 4, the allocator 21 will know the total bit rate available, such that it can allocate bit rate between the audio and video bit rate controllers 19, 20, at step 242. In making the allocation, priority will always be given to the audio channel, such that the minimum bit rate for the audio is in accordance with the bit rates of the table FIG. 4.
With the bit rate now determined for the audio, and the video, if video is being transmitted as part of the multimedia call, a package can now be composed for transmission to transceiver 4. This package is constructed based on sending parameters, such as redundancy, of at least one frame with each redundant packet, indicated in the Table of FIG. 4 as “Redund” and the number of audio frames per packet, indicated in the Table of FIG. 4 as “FR
Figure USRE043668-20120918-P00001
”.
FIG. 6 shows a chart of hit rate versus frames (of audio) per packet for transmissions with a redundancy or 1 (line 260) and transmissions without redundancy (line 261). The chart of FIG. 7 details the actual bit rates for the transmissions with redundancy in accordance with line 260 and without redundancy in accordance with line 261. When a redundant packet is transmitted, the redundant packet is preferably transmitted at a different protocol than the corresponding packet. For example, when the packet is transmitted in a first protocol, typically the RFC 1889, the redundant packet will be transmitted in a different protocol, typically RFC 2198.
With the packets composed, the transmission is made. Monitoring continues for as long as desired, typically for the entire period of the transmission, with the above detailed method repeated (steps 204 to 242), over the course of the transmission. The repetition is typically in accordance with the monitoring periods for the network.
The entire apparatus disclosed above may be implimented on a data processor, such as a microprocessor (linked to a storage device). For example, client applications using these techniques may be implimented under WINDOWS™ OS in Pentium based Personal Computers (PCs) with sound and/or video cards for audio and video processing respectively.
While preferred embodiments of the present invention have been described so as to enable one of skill in the art to practice the present invention, the preceding description is exemplary only, and should not be used to limit the scope of the invention. The scope of the invention should be determined by the following claims.

Claims (22)

1. A method for transmitting packets over a packet switch network which includes a plurality of multimedia transceivers for sending and receiving multimedia communications, the method comprising the steps of:
providing at least two predefined network quality states;
monitoring said network to detect at least one network quality state;
selecting one quality state from the at least two predefined network quality states in accordance with said detected network quality state;
creating at least one packet by placing at least one audio or video sample and at least one network protocol parameter into a package in accordance with said selected network quality state; and
transmitting said packet over said network,
wherein said network quality states are state is selected from the group consisting of:
not sufficient quality;
sufficient quality; and
high quality.
2. The method of claim 1, wherein said not sufficient quality state is a monitored transmission of packets via a first protocol over said network which results in packet loss.
3. The method of claim 2, wherein said sufficient quality state is a monitored transmission of packet which includes at least two audio frames via a second protocol which includes at least one packet frame having at least one redundant frame over said network.
4. The method of claim 3, wherein said sufficient quality state is a monitored transmission of a packet which includes at least two audio frames via the first protocol over said network, which transmission result a packet loss.
5. The method of claim 1, wherein said high quality state is a monitored transmission of a packet which includes a single audio frame via the second protocol over said network, which transmission result a packet loss.
6. The method of claim 5, wherein said high quality state is a monitored transmission of a packet which includes a single audio frame, via said first protocol over said network.
7. The method of claim 1, wherein the step of selecting said quality state further includes the step of:
selecting a network the quality state in accordance with an available network bandwidth.
8. The method of claim 7, wherein the step of selecting comprises:
selecting a lower quality state from said presently selected quality state if available network bandwidth is decreased.
9. A method comprising:
matching, by a transmitter, a network state of a network to a corresponding one of a plurality of predefined network states;
selecting, by the transmitter, a bit rate for a communication, the bit rate being a one of a plurality of bit rates having been previously determined to result in at least a sufficient communication quality level at the matching predefined network state, wherein the sufficient communication quality level is higher than a non-sufficient communication quality level, and lower than a high communication quality level; and
transmitting, by the transmitter, a plurality of packets of the communication according to the selected bit rate.
10. The method of claim 9, further comprising:
determining, by the transmitter, communication quality levels at one or more of the plurality of bit rates for each of the plurality of predefined network states of a network; and
categorizing, by the transmitter, each of the determined network communication quality levels as belonging to one of a plurality of predefined communication quality levels including at least the sufficient communication quality level, the non-sufficient communication quality level, and the high communication quality level.
11. The method of claim 9, further comprising:
matching, by a transmitter, another network state of the network to another corresponding one of the plurality of predefined network states, the other network state occurring at a second time later than a first time of the network state;
selecting, by the transmitter, another bit rate for the communication, the other bit rate being another one of the plurality of bit rates having been previously determined to result in at least the sufficient communication quality level at the other matching predefined network state; and
transmitting, by the transmitter, another plurality of packets of the communication according to the other selected bit rate.
12. The method of claim 9, wherein said transmitting the plurality of packets of the communication according to the selected bit rate comprises controlling a level of compression of at least one audio and/or video sample of the communication in accordance with the selected bit rate.
13. The method of claim 9, wherein said transmitting the plurality of packets of communication according to the selected bit rate comprises selecting a number of audio and/or video samples to be placed into each of the plurality of packets according to the selected bit rate.
14. The method of claim 9, further comprising monitoring, by a monitor, the network for congestion and delay, and adjusting, by the transmitter, the selected bit rate based at least on the network's congestion and/or delay.
15. The method of claim 9, wherein said transmitting the plurality of packets of communication according to the selected bit rate comprises selecting a packet length for the plurality of packets according to the selected bit rate.
16. A system comprising:
a network monitor to match a network state of a network to a corresponding one of a plurality of predefined network states;
a selector coupled to the network monitor to select a bit rate for a communication, the bit rate being a one of a plurality of bit rates having been previously determined to result in at least a sufficient communication quality level at the matching predefined network state, wherein the sufficient communication quality level is higher than an insufficient communication quality level, and lower than a high communication quality level; and
an audio and/or video transmitter coupled to the selector to transmit a plurality of packets of the communication according to the selected bit rate.
17. The system of claim 16, wherein the selector is further configured to:
determine communication quality levels for each of the plurality of bit rates at one or more of the plurality of predefined network states of the network; and
categorize each of the determined communication quality levels according to one of a plurality of predefined communication quality levels including at least the sufficient communication quality level, the insufficient communication quality level, and the high communication quality level.
18. The system of claim 16, wherein the selector is further configured to:
match a subsequent network state of the network to another corresponding one of the plurality of predefined network states; and
select another bit rate for the communication, the other bit rate being another one of the plurality of bit rates having been previously determined to result in at least the sufficient communication quality level at the other matching predefined network state; and
transmit another plurality of packets of the communication according to the selected other bit rate.
19. The system of claim 16, wherein the audio and/or video transmitter is configured to control a level of compression of at least one audio and/or video sample of the communication in accordance with the selected bit rate.
20. The system of claim 16, wherein the audio and/or video transmitter is configured to select a number of audio and/or video samples to be placed into each of the plurality of packets according to the selected bit rate.
21. The system of claim 16, wherein the network monitor is further configured to monitor the network for congestion and delay, and the selector is configured to adjust the selected bit rate based at least on the network's congestion and/or delay.
22. The system of claim 16, wherein the audio or video transmitter is configured to select a packet length for the plurality of packets according to the selected bit rate.
US12/324,483 1999-02-02 2008-11-26 Method and apparatus for transmitting packets Expired - Lifetime USRE43668E1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/324,483 USRE43668E1 (en) 1999-02-02 2008-11-26 Method and apparatus for transmitting packets

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/241,857 US7142506B1 (en) 1999-02-02 1999-02-02 Method and apparatus for transmitting packets
US12/324,483 USRE43668E1 (en) 1999-02-02 2008-11-26 Method and apparatus for transmitting packets

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/241,857 Reissue US7142506B1 (en) 1999-02-02 1999-02-02 Method and apparatus for transmitting packets

Publications (1)

Publication Number Publication Date
USRE43668E1 true USRE43668E1 (en) 2012-09-18

Family

ID=22912448

Family Applications (2)

Application Number Title Priority Date Filing Date
US09/241,857 Ceased US7142506B1 (en) 1999-02-02 1999-02-02 Method and apparatus for transmitting packets
US12/324,483 Expired - Lifetime USRE43668E1 (en) 1999-02-02 2008-11-26 Method and apparatus for transmitting packets

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09/241,857 Ceased US7142506B1 (en) 1999-02-02 1999-02-02 Method and apparatus for transmitting packets

Country Status (2)

Country Link
US (2) US7142506B1 (en)
IL (1) IL134325A0 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120110162A1 (en) * 2010-11-02 2012-05-03 Net Power And Light, Inc. Method and system for resource-aware dynamic bandwidth control
US20120110163A1 (en) * 2010-11-02 2012-05-03 Net Power And Light, Inc. Method and system for data packet queue recovery
US20120207155A1 (en) * 2011-02-16 2012-08-16 Dell Products L.P. System and method for scalable, efficient, and robust system management communications via vendor defined extensions
US10170127B2 (en) 2014-07-08 2019-01-01 Samsung Electronics Co., Ltd. Method and apparatus for sending multimedia data

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070123251A1 (en) * 1996-10-23 2007-05-31 Riparius Ventures, Llc Remote internet telephony device
US6973091B1 (en) * 1999-10-04 2005-12-06 Hester Rex R Enabling quality voice communications from web page call control
US7099304B2 (en) 2000-09-05 2006-08-29 Flexiworld Technologies, Inc. Apparatus, methods and systems for anonymous communication
WO2003036889A1 (en) 2001-10-25 2003-05-01 Worldcom, Inc. Communication session quality indicator
DE60213196T2 (en) * 2002-02-13 2006-11-23 Matsushita Electric Industrial Co., Ltd., Kadoma Method for transmitting data packets using the protocols RTP and RTCP
FR2849733A1 (en) * 2003-01-02 2004-07-09 Thomson Licensing Sa DEVICE AND METHOD FOR ADJUSTING THE FLOW OF A CONTENT FLOW AND RELATED PRODUCTS
US20040170164A1 (en) * 2003-02-28 2004-09-02 Leblanc Wilfrid Quality of service (QOS) metric computation in voice over IP systems
US7333555B2 (en) * 2004-03-30 2008-02-19 Intel Corporation Device, system and method for wireless combined-signal communication
JP2008042290A (en) * 2006-08-02 2008-02-21 Fujitsu Ltd Exchange, exchange control program and exchange control method
DE102007029841B4 (en) * 2007-06-28 2011-12-22 Airbus Operations Gmbh Interactive information system for an aircraft
US8446452B2 (en) * 2008-11-07 2013-05-21 Magor Communications Corporation Video rate adaptation for congestion control
US8009560B2 (en) * 2008-12-31 2011-08-30 Microsoft Corporation Detecting and managing congestion on a shared network link
US8611337B2 (en) 2009-03-31 2013-12-17 Adobe Systems Incorporated Adaptive subscriber buffering policy with persistent delay detection for live audio streams
WO2011034090A1 (en) * 2009-09-18 2011-03-24 日本電気株式会社 Audio quality analyzing device, audio quality analyzing method, and program
CN101729320A (en) * 2009-12-14 2010-06-09 华为技术有限公司 Transmission control method, access device and transmission system
CN104061144A (en) * 2013-03-21 2014-09-24 北京康吉森自动化设备技术有限责任公司 Comprehensive compressor set controlling system and anti-surging controlling method thereof
IT201900022458A1 (en) * 2019-11-29 2021-05-29 Telecom Italia Spa Measurement of round-trip packet loss in a packet-switched communications network

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4771391A (en) * 1986-07-21 1988-09-13 International Business Machines Corporation Adaptive packet length traffic control in a local area network
US5313454A (en) * 1992-04-01 1994-05-17 Stratacom, Inc. Congestion control for cell networks
US5359593A (en) * 1993-08-26 1994-10-25 International Business Machines Corporation Dynamic bandwidth estimation and adaptation for packet communications networks
US5490168A (en) 1994-07-08 1996-02-06 Motorola, Inc. Method and system for automatic optimization of data throughput using variable packet length and code parameters
US5491513A (en) * 1993-06-16 1996-02-13 Intel Corporation Bit rate controller for encoding video signals
US5809110A (en) * 1996-01-31 1998-09-15 Dialogic Corporation Technique of controlling telephone calls
US6141448A (en) 1997-04-21 2000-10-31 Hewlett-Packard Low-complexity error-resilient coder using a block-based standard
US6269078B1 (en) 1997-04-04 2001-07-31 T. V. Lakshman Method and apparatus for supporting compressed video with explicit rate congestion control
US6298055B1 (en) 1998-10-26 2001-10-02 Cisco Technology, Inc. Early detection of in-band signals in a packet voice transmitter with reduced transmission delay
US6356545B1 (en) 1997-08-08 2002-03-12 Clarent Corporation Internet telephone system with dynamically varying codec
US6370163B1 (en) * 1998-03-11 2002-04-09 Siemens Information And Communications Network, Inc. Apparatus and method for speech transport with adaptive packet size
US6920150B1 (en) 1997-09-30 2005-07-19 Lucent Technologies Inc. Adaptive communications transcoding and error control

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4771391A (en) * 1986-07-21 1988-09-13 International Business Machines Corporation Adaptive packet length traffic control in a local area network
US5313454A (en) * 1992-04-01 1994-05-17 Stratacom, Inc. Congestion control for cell networks
US5491513A (en) * 1993-06-16 1996-02-13 Intel Corporation Bit rate controller for encoding video signals
US5359593A (en) * 1993-08-26 1994-10-25 International Business Machines Corporation Dynamic bandwidth estimation and adaptation for packet communications networks
US5490168A (en) 1994-07-08 1996-02-06 Motorola, Inc. Method and system for automatic optimization of data throughput using variable packet length and code parameters
US5809110A (en) * 1996-01-31 1998-09-15 Dialogic Corporation Technique of controlling telephone calls
US6269078B1 (en) 1997-04-04 2001-07-31 T. V. Lakshman Method and apparatus for supporting compressed video with explicit rate congestion control
US6141448A (en) 1997-04-21 2000-10-31 Hewlett-Packard Low-complexity error-resilient coder using a block-based standard
US6356545B1 (en) 1997-08-08 2002-03-12 Clarent Corporation Internet telephone system with dynamically varying codec
US6920150B1 (en) 1997-09-30 2005-07-19 Lucent Technologies Inc. Adaptive communications transcoding and error control
US6370163B1 (en) * 1998-03-11 2002-04-09 Siemens Information And Communications Network, Inc. Apparatus and method for speech transport with adaptive packet size
US6298055B1 (en) 1998-10-26 2001-10-02 Cisco Technology, Inc. Early detection of in-band signals in a packet voice transmitter with reduced transmission delay

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
Final Office Action, mailed Mar. 14, 2006, for U.S. Appl. No. 09/241,857, 10 pages.
Office Action, mailed Aug. 16, 2005, for U.S. Appl. No. 09/241,857, 10 pages.
Office Action, mailed Feb. 17, 2005, for U.S. Appl. No. 09/241,857, 5 pages.
Office Action, mailed Feb. 27, 2003, for U.S. Appl. No. 09/241,857, 5 pages.
Office Action, mailed Sep. 10, 2003, for U.S. Appl. No. 09/241,857, 5 pages.
Perkins et al., RTP Payload for Redundant Audio Data, Network Working Group, Standards Track RFC 2198, Sep. 1997 at www.ietf.org/rfc/rfc2189.txt.
Schulzrinne et al., RTP: A Transport Protocol for Real-Time Applications, Network Working Group, Standards Track RFC 1889, Jan. 1996 at www.ietf.org/rfc/rfc1889.txt.

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120110162A1 (en) * 2010-11-02 2012-05-03 Net Power And Light, Inc. Method and system for resource-aware dynamic bandwidth control
US20120110163A1 (en) * 2010-11-02 2012-05-03 Net Power And Light, Inc. Method and system for data packet queue recovery
US8458328B2 (en) * 2010-11-02 2013-06-04 Net Power And Light, Inc. Method and system for data packet queue recovery
US8667166B2 (en) * 2010-11-02 2014-03-04 Net Power And Light, Inc. Method and system for resource-aware dynamic bandwidth control
US9037706B2 (en) 2010-11-02 2015-05-19 Net Power And Light, Inc. Method and system for data packet queue recovery
US9825816B2 (en) 2010-11-02 2017-11-21 Wickr Inc. Method and system for resource-aware dynamic bandwidth control
US20120207155A1 (en) * 2011-02-16 2012-08-16 Dell Products L.P. System and method for scalable, efficient, and robust system management communications via vendor defined extensions
US9077761B2 (en) * 2011-02-16 2015-07-07 Dell Products L.P. System and method for scalable, efficient, and robust system management communications via vendor defined extensions
US10170127B2 (en) 2014-07-08 2019-01-01 Samsung Electronics Co., Ltd. Method and apparatus for sending multimedia data

Also Published As

Publication number Publication date
IL134325A0 (en) 2001-04-30
US7142506B1 (en) 2006-11-28

Similar Documents

Publication Publication Date Title
USRE43668E1 (en) Method and apparatus for transmitting packets
US7554922B2 (en) Method and system for providing adaptive bandwidth control for real-time communication
EP1372304B1 (en) Method, transmitter and receiver for adapting the encoding rate to a varying transport rate
US7295549B2 (en) Source and channel rate adaptation for VoIP
US7746780B2 (en) Adaptive estimation of multimedia data transmission rate in a data communication system
EP1159719B1 (en) Jitter buffer and methods for control of same
EP1346519B1 (en) System and method for a transmission rate controller
US7496040B2 (en) Roundtrip delay time measurement apparatus and method for variable bit rate multimedia data
US7920492B1 (en) Devices, softwares and methods for redundantly encoding a data stream for network transmission with adjustable redundant-coding delay
CA2353263C (en) Method and apparatus for transmitting data packets
US20020004841A1 (en) Communication apparatus and communication method
US20030063569A1 (en) Selecting an operational mode of a codec
CN108401128B (en) Congestion control method in video call
EP1187416B1 (en) Method and apparatus for transmitting data packets
KR20040096495A (en) Bit rate control method and device
Baldo et al. RTCP feedback based transmission rate control for 3G wireless multimedia streaming
US6970476B1 (en) Efficient header compression context update in packet communications
US6661793B1 (en) Method and apparatus for reconstructing media
EP1716672B1 (en) Method, apparatus and computer program product for controlling data packet transmissions
Narbutt et al. Adaptive playout buffering for audio/video transmission over the internet
Korhonen Adaptive multimedia streaming for heterogeneous networks
Huszák New methods for improving multimedia quality in IP networks

Legal Events

Date Code Title Description
AS Assignment

Owner name: KARO MILLENNIUM J.P., L.L.C., DELAWARE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:VOCALTEC COMMUNICATIONS LTD.;REEL/FRAME:025071/0079

Effective date: 20080710

AS Assignment

Owner name: VOCALTEC COMMUNICATIONS LTD., ISRAEL

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:POGREBINSKY, VLADIMIR;REEL/FRAME:026792/0950

Effective date: 19990404

FPAY Fee payment

Year of fee payment: 8

AS Assignment

Owner name: OL SECURITY LIMITED LIABILITY COMPANY, DELAWARE

Free format text: MERGER;ASSIGNOR:KARO MILLENNIUM J.P., L.L.C.;REEL/FRAME:037496/0024

Effective date: 20150826

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553)

Year of fee payment: 12

AS Assignment

Owner name: HANGER SOLUTIONS, LLC, GEORGIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INTELLECTUAL VENTURES ASSETS 158 LLC;REEL/FRAME:051486/0425

Effective date: 20191206