USRE44661E1 - Method for a cable modem to rapidly switch to a backup CMTS - Google Patents

Method for a cable modem to rapidly switch to a backup CMTS Download PDF

Info

Publication number
USRE44661E1
USRE44661E1 US11/636,725 US63672506A USRE44661E US RE44661 E1 USRE44661 E1 US RE44661E1 US 63672506 A US63672506 A US 63672506A US RE44661 E USRE44661 E US RE44661E
Authority
US
United States
Prior art keywords
cmts
cable modem
protection
service
working
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
US11/636,725
Inventor
Feisal Daruwalla
James R. Forster
Guenter E. Roeck
John T. Chapman
Joanna Qun Zang
Yong Lu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cisco Technology Inc
Original Assignee
Cisco Technology Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cisco Technology Inc filed Critical Cisco Technology Inc
Priority to US11/636,725 priority Critical patent/USRE44661E1/en
Application granted granted Critical
Publication of USRE44661E1 publication Critical patent/USRE44661E1/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/22Alternate routing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/28Routing or path finding of packets in data switching networks using route fault recovery
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16Error detection or correction of the data by redundancy in hardware
    • G06F11/20Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2002Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where interconnections or communication control functionality are redundant
    • G06F11/2005Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where interconnections or communication control functionality are redundant using redundant communication controllers

Definitions

  • This invention relates to digital cable network technology. More specifically, it relates to methods and apparatus that provide redundancy for critical headend components of digital cable networks.
  • Broadband access technologies such as cable, fiber optic, and wireless have made rapid progress in recent years. Recently there has been a convergence of voice and data networks which is due in part to US deregulation of the telecommunications industry. In order to stay competitive, companies offering broadband access technologies need to support voice, video, and other high-bandwidth applications over their local access networks. For networks that use a shared access medium to communicate between subscribers and the service provider (e.g., cable networks, wireless networks, etc.), providing reliable high-quality voice/video communication over such networks is not an easy task.
  • the service provider e.g., cable networks, wireless networks, etc.
  • a cable modem network or “cable plant” employs cable modems, which are an improvement of conventional PC data modems and provide high speed connectivity. Cable modems are therefore instrumental in transforming the cable system into a full service provider of video, voice and data telecommunications services. Digital data on upstream and downstream channels of the cable network is carried over radio frequency (“RF”) carrier signals. Cable modems convert digital data to a modulated RF signal for upstream transmission and convert a downstream RF signal to digital form. The conversion is done at a subscriber's home. At a cable modem termination system (“CMTS”) located at a head end of the cable network, the conversions are reversed.
  • CMTS cable modem termination system
  • the CMTS converts downstream digital data to a modulated RF signal, which is carried over the fiber and coaxial lines to the subscriber premises.
  • the cable modem then demodulates the RF signal and feeds the digital data to a computer.
  • the digital data is fed to the cable modem (from an associated PC for example), which converts it to a modulated RF signal.
  • the CMTS receives the upstream RF signal, it demodulates it and transmits the digital data to an external source.
  • FIG. 1 is a block diagram of a typical two-way hybrid fiber-coaxial (HFC) cable network system. It shows a head end 102 (essentially a distribution hub) which can typically service about 40,000 homes. Head end 102 contains a CMTS 104 that is needed when transmitting and receiving data using cable modems. Primary functions of the CMTS include (1) receiving signals from external sources 100 and converting the format of those signals, e.g., microwave signals to electrical signals suitable for transmission over the cable system; (2) providing appropriate Media Access Control (MAC) level packet headers for data received by the cable system, and (3) modulating and demodulating the data to and from the cable system.
  • MAC Media Access Control
  • Head end 102 (and CMTS 104 ) connects through pairs of fiber optic lines 106 (one line for each direction) to a series of fiber nodes 108 .
  • Each head end can support normally up to 80 fiber nodes.
  • Pre-HFC cable systems used coaxial cables and conventional distribution nodes. Since a single coaxial cable was capable of transmitting data in both directions, one coaxial cable ran between the head end and each distribution node. In addition, because cable modems were not used, the head end of pre-HFC cable systems did not contain a CMTS. Returning to FIG.
  • each of the fiber nodes 108 is connected by a coaxial cable 110 to two-way amplifiers or duplex filters 112 , which permit certain frequencies to go in one direction and other frequencies to go in the opposite direction (different frequency ranges are used for upstream and downstream paths).
  • Each fiber node 108 can normally service up to 500 subscribers.
  • Fiber node 108 , coaxial cable 110 , two-way amplifiers 112 , plus distribution amplifiers 114 along with trunk line 116 , and subscriber taps, i.e. branch lines 118 make up the coaxial distribution system of an HFC system.
  • Subscriber tap 118 is connected to a cable modem 120 .
  • Cable modem 120 is, in turn, connected to a subscriber computer 122 .
  • DOCSIS data over cable networks
  • the present invention provides a redundancy technique in a shared-access computer network to reduce delays experienced by various elements within the network which may be caused by equipment failure, software failure, or other network problems.
  • the invention provides a protection CMTS available to immediately service a cable modem should that modem's service from a working CMTS fail for any reason.
  • the cable modem may preregister with the protection CMTS well before the cutover becomes necessary.
  • the cable modem's registration with both the working CMTS and the protection CMTS preferably employs a single IP address, so that the cable modem need not obtain a new IP address during cutover.
  • the working CMTS and the protection CMTS should be designed or configured so that only the working CMTS injects a host route for the cable modem into the appropriate routing protocol. Only after cutover to the protection CMTS should the protection CMTS inject its host route.
  • the cable system can provide telephony service with fewer significant disruptions.
  • One aspect of the invention provides a method implemented on a protection CMTS for providing redundancy for a cable network having both a working CMTS and the protection CMTS.
  • the working CMTS provides normal service to a cable modem and the protection CMTS takes over service to the cable modem should service from the working CMTS fail.
  • the method may be characterized by the following sequence: (a) registering the cable modem before or after it registers with the working CMTS; and (b) assuming a protection state in which the protection CMTS can take over service of the cable modem should its service with the working CMTS fail.
  • the protection CMTS may first detect that the CMTS's service to the cable modem has failed before taking over service to the cable modem.
  • Registration generally requires that the protection CMTS have some knowledge of the cable modem so that it can facilitate any subsequent transition from the working CMTS to the protection CMTS.
  • Registration procedures may be specified by a communications standard such as DOCSIS for cable modems. Examples of registration operations include specifying such parameters as a transmission power, transmission time slots, and a transmission frequency at which the cable modem is to communicate with the protection CMTS (should the cable modem service from the working CMTS fail).
  • registration preferably also comprises noting an IP address for the cable modem, which IP address is used in communications between the cable modem and the working CMTS.
  • the protection CMTS may obtain the cable modem IP address in a communication from the cable modem or from the working CMTS.
  • the protection CMTS may periodically establishe communication with the cable modem to ensure that the protection path works properly.
  • Such communication may include instructions to the cable modem to adjust at least one of a transmission power and a transmission frequency at which the cable modem is to communicate with the protection CMTS should service with the working CMTS fail.
  • CMTS designed or configured to act as a protection CMTS.
  • CMTS may be characterized by the following features: (a) one or more processors; (b) memory in communication with at least one of the one or more processors; and (c) registration data for the cable modem, which data is provided in the memory.
  • the CMTS processors should be configured to store the registration data in the memory.
  • Such CMTS also should be configured such that it does not provide communication service to the cable modem unless the service from the working CMTS should fail. The content of the registration data depends upon the particular events associated with registration.
  • the registration data may include such information as a transmission power and a transmission frequency at which the cable modem is to communicate with the protection CMTS.
  • the registration data also includes an IP address for the cable modem, which IP address is used in communications between the cable modem and the working CMTS.
  • the CMTS is designed or configured to perform routing operations (i.e., it is a routing CMTS).
  • Yet another aspect of this invention pertains to cable modems that are configured to store registration parameters for both a working CMTS and a protection CMTS. Typically, such parameters are obtained by a registration method as outlined above.
  • Another aspect of the invention pertains to computer program products including a machine readable medium on which is stored program instructions for implementing a method as described above. Any of the methods of this invention may be represented as program instructions that can be provided on such computer readable media.
  • FIG. 1 is a block diagram depicting some of the principal components of a cable network that may be used with the present invention.
  • FIG. 2A is a block diagram depicting a cutover procedure using a 1:1 topology in accordance with an embodiment of this invention.
  • FIG. 2B is a block diagram depicting a cutover procedure using a 1:1 sparing topology in accordance with an embodiment of this invention.
  • FIG. 2C is a block diagram depicting a cutover procedure employing a 1:N topology in accordance with an embodiment of this invention.
  • FIG. 2D is a detailed block diagram of a cable network head-end implementing a 1:1 redundancy topology in accordance with an embodiment of this invention.
  • FIG. 2E is a detailed block diagram of an alternative head-end topology for 1:1 redundancy in accordance with this invention.
  • FIG. 3A is a process flow diagram depicting some operations employed within a cable network during registration of a cable modem in accordance with one embodiment of this invention.
  • FIG. 3B is an interaction diagram depicting the interactions of a cable modem, a working CMTS, and a provisioning server during registration of the cable modem in accordance with one embodiment of this invention.
  • FIG. 4 is a schematic diagram of a cable network illustrating registration of a cable modem with a working CMTS in accordance with an embodiment of this invention.
  • FIG. 5 illustrates a cutover procedure resulting from a failure on the path between the cable modem and the working CMTS.
  • FIG. 6 is a process flow diagram depicting some operations performed on a cable network during cutover in accordance with an embodiment of this invention.
  • FIG. 7 is an interaction diagram depicting the interactions of a cable modem, a working CMTS, and a protection CMTS during cutover in accordance with an embodiment of this invention.
  • FIG. 8A is a block diagram depicting a CMTS structure that may be employed with the present invention.
  • FIG. 8B is a block diagram depicting a cable modem structure that may be employed with the present invention.
  • FIG. 9 is a schematic illustration of a wireless network suitable for implementing the present invention.
  • FIGS. 2A-2E present various cable network topologies that may be used in implementing the present invention.
  • FIG. 2A depicts a network topology deemed “1:1” in which the network includes two CMTSs. Both are working CMTSs and both provide protection for the other. Thus, if one of the two CMTSs fails, the other one assumes the functions of the failed CMTS, while maintaining its own functions.
  • a cable network system 201 includes first and second cable modems 203 and 205 . Each connects to a separate CMTS. Specifically, modem 203 connects to a CMTS 207 via a downstream channel 56 and modem 205 connects to a CMTS 209 via a downstream channel 57 . Each connection is made through an HFC network 211 . Communications between the cable modems and external sources are made via a connection 200 .
  • FIG. 2A is greatly simplified.
  • a given CMTS or CMTS interface services many cable modems.
  • a single CMTS may handle one or more distribution networks within a cable plant.
  • cable modems 203 and 205 may represent groups of modems or an entire distribution network having numerous cable modems.
  • CMTS 207 is given the designation “W 1 ” for working group 1 . This means that it is responsible for handling communications with modem 203 and its peers.
  • CMTS 209 is designated “W 2 ,” as it serves needs of cable modem 205 and possibly many other modems.
  • the CMTSs serve additional roles.
  • CMTS 207 provides a protection path for CMTS 209
  • CMTS 209 provides a protection path for CMTS 207 .
  • CMTS 209 will take over responsibility for servicing cable modem 203 and its peers.
  • CMTS 209 fails, CMTS 207 will take over responsibility for cable modem 205 and its peers.
  • this invention is not limited to cases in which a working CMTS “fails.” It is also useful for cases where the user simply wants the modems to move to the protection CMTS while the user upgrades or services the working CMTS software, hardware, etc.
  • FIG. 2A illustrates the failure of CMTS 207 .
  • cable modem 203 can no longer communicate via CMTS 207 and therefore communicates through CMTS 209 . To accomplish this, communications to and from cable modem 203 take a different path through HFC network 211 . Further, cable modem 203 must shift from downstream channel 56 to channel 57 , the channel of CMTS 209 . Thus, in this example, cable modem 203 will tune to a different downstream frequency.
  • FIG. 2B depicts a 1 for 1 sparing topology.
  • a cable network 201 ′ includes a working CMTS 213 and a protection CMTS 215 .
  • Working CMTS provides service to cable modem 203 and cable modem 205 , both over channel 56 . This is depicted by the connection paths through HFC plant 211 .
  • protection CMTS 215 does not normally provide service to any cable modems. It remains available to take over in the case of a failure.
  • CMTS 215 takes over the role of CMTS 213 .
  • the cutover takes place rapidly. It may be necessary for the cable moderns to switch from channel 56 to channel 57 during the cutover, as shown.
  • CMTS 213 provides service to cable modem 203 over channel 56
  • CMTS 217 provides service to cable modem 205 over channel 57
  • CMTS 219 provides service to a cable modem 222 over channel 58
  • a protection CMTS 221 does not normally service any cable modems but is available to service any cable modem in case it needs to take over for a failed peer. Note that in the depicted topology, protection CMTS 221 is assigned downstream channel 59 .
  • protection CMTS 221 takes over its role.
  • cable modem 205 must begin communicating through protection CMTS 221 over channel 59 .
  • protection CMTS 221 would have to take over for it as well. The same is true for working CMTS 219 .
  • the cable network includes N+1 working CMTSs, and at least one of these working machines can provide protection for some or all of the other N machines.
  • This invention may employ multiple distinct CMTSs to provide redundancy as discussed in much of the discussion herein.
  • a single CMTS may provide both working and protection services.
  • separate line cards (or more generally interfaces) may provide the various functions.
  • one or more CMTS interfaces may provide the cutover protection and one or more interfaces may provide normal working service. In one embodiment, if one interface fails another one on the same CMTS can take over for it.
  • FIGS. 2D and 2E present detailed examples of head-end topologies employing a 1:1 service.
  • the cable network head-end 230 includes a first CMTS interface 232 and a second CMTS interface 234 .
  • These CMTS interfaces may be provided on a single CMTS chassis or on separate CMTSs.
  • each interface has one downstream port, labeled “DS,” and six upstream ports labeled “U 0 ”-“U 5 .”
  • Downstream signals from CMTS 232 are provided at an intermediate frequency. When the signal reaches an upconverter 236 , its frequency is increased to a level associated with cable channel 64 .
  • CMTS interface 232 services only those cable modems connected through fiber node 240 . Should CMTS interface 234 (which normally services fiber node 242 ) fail, however, CMTS 232 can take over service to the cable modems serviced via fiber node 242 .
  • CMTS interface 234 provides intermediate frequency downstream signals to an upconverter 244 .
  • upconverter 244 converts the intermediate frequency signal to an RF frequency signal corresponding to cable channel 65 . That downstream signal encounters a splitter 246 , which allows the downstream signal to be provided to either fiber node 240 , fiber node 242 , or both.
  • CMTS 234 services only those cable modems connected through fiber node 242 .
  • cable modems provide data on a specified upstream frequency band to fiber nodes 248 and 250 .
  • upstream data passing through fiber node 248 passes to CMTS interface 232 (via port “U 0 ”). If the upstream path to CMTS interface 232 is disrupted for any reason (e.g., CMTS interface 232 fails), that upstream data is provided to CMTS interface 234 .
  • a splitter 252 allows data from fiber node 248 to pass through to either interface 232 or interface 234 .
  • a splitter 254 allows upstream date from fiber node 250 to pass to either of interfaces 232 or 234 .
  • CMTS complementary metal-oxide-semiconductor
  • upstream ports on a CMTS interface may be configured to handle different ones of these upstream frequency bands.
  • This embodiment is illustrated in topology 230 by the use of upstream splitters 256 and 258 .
  • Upstream data passing through fiber node 250 may be carried on one of two possible frequency bands. One of these bands is handled by port U 1 on interfaces 232 and 234 . The other of these frequency bands is handled by ports U 2 of the interfaces.
  • a local feed 260 provides cable TV service to subscribers via fiber node 240 .
  • a local feed 262 provides cable TV service to subscribers via fiber node 242 .
  • FIG. 2E depicts a slightly different head-end topology ( 264 ), which accomplishes essentially the same results.
  • network elements that provide identical function to those depicted in FIG. 2D are given like reference numbers.
  • the upstream service with associated redundancy, is identical to that depicted in topology 230 of FIG. 2D .
  • each interface is capable of providing downstream data at either channel 64 or channel 65 (in the specific example).
  • CMTS interface 232 provides downstream data (on an intermediate frequency) to a splitter 266 .
  • splitter 266 directs all data to an upconverter 268 , which puts the data on a carrier frequency corresponding to cable channel 64 .
  • This data is then provided to downstream fiber node 240 , and then on to destination cable modems. If the downstream path from CMTS interface 234 should fail for any reason, interface 232 takes over responsibility for providing downstream data to those cable modems normally serviced by interface 234 .
  • upconverter 270 puts the data on a carrier frequency corresponding to cable channel 65 . That data is then directed to fiber node 242 and then on to the destination cable modems.
  • CMTS interface 234 provides a backup to interface 232 , as well.
  • downstream data passes from interface 234 to a splitter 272 .
  • splitter 272 directs all downstream traffic through an upconverter 274 which puts the data on a carrier corresponding to cable channel 64 . This data is then provided to fiber node 242 . If interface 234 should be called upon to cover for interface 232 , splitter 272 will direct the appropriate traffic to an upconverter 276 , which puts that data on a carrier frequency corresponding to cable channel 65 . This data is then provided to downstream fiber node 240 .
  • the protection afforded by this invention affects normal network operation at two stages.
  • the protection CMTS (or interface) is designated for a particular working CMTS (or interface).
  • this simply involves providing instructions for directing cable modems to the protection CMTS when their working paths fail.
  • Other procedures may include a modified registration process, in which the cable modem pre-registers with the protection CMTS.
  • the cable modem may obtain a network level address (e.g., an IP address) that is not part of the working CMTS interface subnet (or of the protection CMTS interface subnet).
  • a network level routing protocol may be affected during this first stage to limit propagation of the host route through the working CMTS.
  • the affected cable modem registers with the protection CMTS, possibly without requiring a new network level address.
  • the protection CMTS may also then begin to advertise the new host route to the cable modem.
  • CMTS complementary metal-oxide-semiconductor
  • the CM must use the conventional registration process to register with its protection CMTS after a failure on its working path, then it must obtain an IP address from the protection CMTS's subnet.
  • a PC or other machine behind the cable modem may have to reboot. Thus, service may be disrupted for a somewhat lengthy period of time. This may be unacceptable for some applications, where rapid cutover is required.
  • the cable modem may have had many previous connections with external nodes using its previous IP address and these external nodes would not immediately know of the IP address change. Regardless of this issue, DNS and/or a Call Agent will have to get involved. Note that a Call Agent is used to maintain a list of client IP addresses for use in setting up IP telephony calls.
  • a registering cable modem obtains its IP address from an address block that is not part of a CMTS interface IP subnet, but is likely on a an IP “supernet” shared among various CMTSs. Then when a cutover is required, the cable modem need not obtain a new IP address from a different address space.
  • Various protocols may be used to assign the CMTS-independent IP addresses.
  • a registering cable modem obtains its IP address from a Dynamic Host Configuration Protocol (DHCP) server configured to provide IP addresses from outside the address space of any CMTS interface.
  • DHCP Dynamic Host Configuration Protocol
  • This procedure has the benefit of allowing a cable modems to cutover from a failed path to a protection channel with minimal overhead.
  • the cable modem As the cable modem is already registered on the protection channel, it need not obtain a new IP address and go through the attendant time-consuming registration process. Hence service disruption is minimized. The time spent out of service is greatly reduced, connections and context are not necessarily lost, the host machine need not reboot, etc. Without these benefits, applications such as cable telephony may not be realized.
  • FIGS. 3A , 3 B, and 4 illustrate one set of procedures for registering a cable modem in accordance with an embodiment of this invention.
  • a flow chart is presented depicting generally the steps that a cable modem (and associated CMTSs) may go through to register on both the working CMTS a protection CMTS.
  • a process 301 begins at 303 with the cable modem submitting a registration request to a working CMTS.
  • the registration complies with the procedures required by the DOCSIS standard. Normally, this involves obtaining an IP address for the cable modem, obtaining “ranging” parameters such as upstream frequency, power and timing, etc.
  • the cable modem is assigned an IP address suitable for use with this invention.
  • an IP address is chosen so that that IP address can be used with both the working CMTS and the protection CMTS.
  • the IP address should be chosen from an address block that is not dedicated to either the working CMTS or the protection CMTS.
  • a cable network assigns IP addresses from an address block bound to a particular CMTS interface. Unfortunately, if that interface fails (or the path to it fails) then the IP address that has been assigned to the cable modem is no longer useful. As a consequence, the cable modem must obtain a different IP address if it is to communicate through a protection CMTS.
  • this embodiment of the present invention requires that the IP address that has been assigned to the cable modem during registration be selected from the address space lying outside the address blocks assigned to either the working CMTS or protection CMTS.
  • the working CMTS can determine the IP address that has been assigned to the cable modem. This is illustrated at 307 where the working CMTS notes the assigned cable modem IP address and injects the associated host route into the appropriate routing protocol.
  • the host route in this instance, specifies the route to the registering cable modem through the working CMTS.
  • the host route is preferably provided to one or more aggregation routers associated with the head-end of the cable network. This is depicted at 309 in process 301 . Because the host route specifics the working CMTS, and provision is made for having a protection CMTS take over for the working CMTS, the host route should not propagate beyond the head-end. Then, when the working CMTS fails and the protection CMTS takes over, the new host route can quickly replace the previous host route in the relevant routers.
  • the cable modem obtains the relevant registration parameters, including its IP address, and is also informed of the protection RF channel. See 311 .
  • the normal registration parameters include an upstream transmission frequency, an upstream transmission power, time slots for upstream transmission, etc.
  • the protection CMTS communicates via a different upstream RF channel than the working CMTS, it is necessary to inform the cable modem of the protection CMTS's upstream channel.
  • the cable modem re-registers on the protection channel with the protection CMTS. See 313 .
  • the cable modem will obtain the registration parameters for the protection CMTS and store them in preparation for an event that causes it to cutover. Note that this re-registration process does not assign a new IP address to the cable modem. Rather, the cable modem preserves the IP address that was assigned to it during registration on the working CMTS.
  • the protection CMTS recognizes the cable modem, but does not inject a host route for that cable modem into the routing protocol. If the upstream path to the working CMTS fails, and the switch over to the protection CMTS is required, the protection CMTS will rapidly accept the pre-registered cable modem. Until that time, however, the protection CMTS does not advertise its host route to the cable modem.
  • the protection CMTS After pre-registration, but before cutover, the protection CMTS remains in a “protection state” ready to take over service to the cable modem when it determines that the modem's working route has failed. While in the protection state, the protection CMTS may periodically ensure that it is ready to take over service to the cable modem. This may entail that the protection CMTS determine that the protection path still works. If communication can take place over the path, the protection CMTS may request that the cable modem change certain parameters to optimize communication if a cutover becomes necessary. As indicated, the transmission characteristics of a cable network path vary with temperature, load, mechanical conditions, etc. Thus, what were optimal transmission settings one day, may be far from optimal the next day.
  • the protection CMTS may periodically issue station maintenance opportunities to the cable modem.
  • the cable modem sends a ranging request message at a transmission power and frequency as specified by its stored parameters.
  • the protection CMTS detects the power, frequency, and timing of the ranging request. It determines how far these parameters vary from optimal, if at all, and sends a ranging response message instruction the cable modem to change its parameters as necessary.
  • the protection CMTS may also use a DOCSIS ping to determine whether the protection path works.
  • FIG. 3B presents an interaction diagram for cable network components used in a specific embodiment of the present invention. Again, this embodiment involves registration of a cable modem in a manner allowing rapid cut over to a protection CMTS if a working CMTS fails. As illustrated in FIG. 3B , the relevant components are a cable modem 321 , a working CMTS 323 , and a provisioning server 325 .
  • a new cable modem comes on line at 320 . It then sends a registration request ( 322 ) to working CMTS 323 .
  • working CMTS 323 requests an IP address for the cable modem from provisioning server 325 . See arrow 324 .
  • provisioning server 325 is running DHCP, which allows it to assign an IP address to cable modem 321 as indicated by operation 326 . Subsequently, provisioning server 325 forwards the IP address to working CMTS 323 . See arrow 328 .
  • Working CMTS 323 now has all the information it requires to complete registration of cable modem 321 . As part of the registration process, it records the assigned IP address of cable modem 321 . See operation 330 . Working CMTS 323 then forwards the IP address and registration information to cable modem 321 as indicated by arrow 332 . Concurrently, working CMTS 323 injects the host route for the cable modem into the relevant routing protocol. See operation 334 .
  • the cable network can begin pre-registering the cable modem on the protection CMTS.
  • this pre-registration process begins with provisioning server 325 informing cable modem 321 of the protection CMTS. As indicated in the discussion of FIG. 3A , this may involve informing the cable modem of the radio frequency channel for the protection CMTS. Regardless of the specifics, the operation of informing the cable modem is depicted by arrow 336 in FIG. 3B . After it has been informed in this manner, cable modem 321 initiates the registration procedure with the protection CMTS in a manner such as that described with reference to FIG. 3A .
  • provisioning server 325 serves various functions. It may normally be used to provide various telephony support services for VoIP. Server 325 may run on an arbitrary piece of hardware such as a Sun workstation or other Unix system, a Windows NT server and the like.
  • the provisioning server implements DHCP as well as other relevant functions for the cable network. For example, it may contain a list of MAC addresses for cable modems associated with various paying customers. Associated with this list is the type of service available to each cable modem. For example, those subscribers having telephony service will be identified. When a cable modem registers, the provisioning server will recognize that it is a telephony subscriber and therefore cause it to register on both the working and protection CMTSs.
  • FIG. 4 illustrates this process schematically.
  • a CMTS advertises routes to its cable modems by identifying its interface subnet(s) via the appropriate routing protocol.
  • the CMTS advertises only a very small chunk of address space, not normally associated with its interfaces. These addresses provide host routes or small chunks of address space including IP addresses assigned to the cable modems during registration. Note that when the advertised address space is so small as to identify only a single cable modem, that “chunk” of address space, as used in a routing protocol, is referred to as a “host route.”
  • CMTS may let its peer routers know that it handles an address space given by the subnet/255.255.255.0, for example. In other words, all cable modems that the CMTS handles have IP addresses falling within this address mask. Because the CMTS provides this address mask to its peers via a routing protocol, they know that if they have a packet destined for a node having IP address within the subnet, they should transmit the packet to the CMTS.
  • the CMTSs advertise specific host routes alone or in addition to their specific interface subnets.
  • an HFC network 400 supports various cable modems, including cable modems 401 , 403 , 405 and 407 . Each of these cable modems may be serviced by a separate fiber node, for example.
  • cable modem 401 has just registered and is obtaining its IP address from a provisioning server 409 .
  • provisioning server 409 is employing DHCP to assign IP addresses
  • a working CMTS 411 will serve the DHCP relay function. By performing this function, CMTS 411 gleans the IP address that has been assigned to cable modem 401 . It records this information.
  • Other procedures may be employed to assign IP addresses to cable modems coming on line. Preferably such procedure should allow for notifying working CMTS 411 of newly assigned IP addresses for its cable modems.
  • the head-end of the cable network includes multiple aggregation routers. These routers serve to facilitate communication between the cable network and external sources.
  • CMTS determines the IP address of newly registered cable modem 401 , it injects the host route for that cable modem into the routing protocols used by aggregation routers 413 and 415 , as illustrated.
  • This host route specifies that cable modem 401 can be reached through CMTS 411 .
  • Aggregation routers 413 and 415 are configured to limit propagation of this host route to routers within the head-end.
  • the working and protection CMTSs of this invention are routing CMTSs, and therefore participate in the necessary routing procedures.
  • One example of the hardware and software employed in such routing CMTSs is described below in connection with the description of FIG. 8A .
  • CMTSs on a cable plant connect to external networks via one or more higher-level aggregation routers (routers 413 and 415 in this example).
  • Each CMTS on the cable network is responsible for its own group of cable modems with associated host routes and address/mask.
  • Each of these CMTS advertises its portion of IP address space to the higher-level router(s).
  • a higher-level router in possession of this information then advertises to its peers via a routing protocol that it can handle packets having destination addresses falling within any of the host routes and address blocks of the underlying CMTSs.
  • provisioning server 409 is connected to HFC network 400 .
  • provisioning server 409 informs cable modem 401 of a protection CMTS.
  • a CMTS 417 serves as the protection CMTS for cable modem 401 .
  • CMTS 417 can communicate with provisioning server 409 and thereby use its services.
  • some technique is required for notifying the protection CMTS of the cable modem's IP address.
  • the first requires that the cable modem notify the protection CMTS of the IP address that it has obtained during an initial registration through the working CMTS. This notification may serve as a part of the DOCSIS registration process with the working CMTS.
  • the cable modem may or may not complete a complete registration (ranging and the like) with the protection CMTS. Regardless of the level of pre-registration, the protection CMTS can automatically advertise the host route to the cable modem, should the working path fail.
  • the cable modem separately registers through the protection CMTS (before or after it registers through the working CMTS) and obtains an IP address during registration.
  • This IP address is identical to the IP address that the cable modem obtains via the working CMTS.
  • the protection CMTS participates in the registration process, it records the cable modem's IP address. If DHCP is used, then the DHCP server will recognize that the cable modem requesting an IP address has already obtained such address and will merely assign the same address during the second registration.
  • a third approach requires that the working CMTS communicate the cable modem's IP address to the protection CMTS. This may be accomplished via a special protocol for communication between the working and protection CMTSs.
  • FIG. 5 schematically presents the working and protection paths that cable modem 401 may employ.
  • cable modem 401 normally communicates through CMTS 411 using downstream channel 56 .
  • Communications to and from external networks are routed through aggregation router 413 .
  • a redundant router 415 is provided to backup router 413 should it fail.
  • CMTS 411 fails (or some component on the path from CMTS 411 fails), cable modem 401 reconnects through protection CMTS 417 .
  • downstream communication from CMTS 417 is conducted over channel 57 .
  • traffic is routed through that CMTS and aggregation router 413 .
  • One event that must occur during the cutover is notification, via the appropriate routing protocol(s), that a new working CMTS (the protection CMTS) now provides access to the cable modems previously handled by a failed CMTS.
  • part of the cutover process requires that protection CMTS 417 inject its host route to cable modem 401 into the appropriate routing protocol.
  • this is a conventional process such as described above with reference to the working CMTS.
  • FIG. 6 presents a process flow diagram illustrating fault recovery steps in accordance with a specific embodiment of this invention. As shown, a process 602 beings at 604 with either the cable modem or the working CMTS detecting a failure. Various mechanisms for detecting such failures will be discussed below.
  • the cable modem loads, at 606 , its previously stored protection path parameters. These include, for example, the upstream and downstream frequency bands for communicating with the protection CMTS, the appropriate cable modem transmission power to the protection CMTS, the communications time slots allotted for the protection CMTS, etc. Then, at 608 , the cable modem connects to the protection CMTS and trims its parameters. Note that signal transmission properties vary nearly continually within a cable network. As a consequence, the parameters obtained during the pre-registration stage may no longer be optimal for communication with the protection CMTS. Trimming simply refers to the process of reoptimizing the transmission frequency, power, timing, etc. in light of current network conditions. In accordance with the DOCSIS protocol, trimming may be accomplished by the “ranging” process.
  • the cable modem After the cable modem confirms that the protection CMTS path is working (via ranging, for example), it announces to the protection CMTS that the path is in fact working. See block 610 . This announcement may take various forms; e.g., a maintenance ranging request. Thereafter, at 612 , the protection CMTS injects its host route into the routing protocol. If the working CMTS has not already stopped injecting its host route into the routing protocol, it now stops. The receiving aggregation router (or routers) aggregates the new host route in a manner that prevents propagation outside of the head-end. See 614 At this point, upstream packets are immediately successful, and, very soon thereafter after interior gateway protocol convergence, external packets now transit through the correct CMTS and reach the cable modem.
  • FIG. 7 provides an interaction diagram depicting the interaction of a cable modem 701 , a working CMTS 703 , and a protection CMTS 705 during cutover in accordance with a specific embodiment of this invention.
  • cable modem 701 detects a failure.
  • the working CMTS detects a failure. Either way, the device detecting the failure announces it to the other device. See arrow 711 .
  • cable modem 701 loads the protection CMTS parameters as indicated by arrow 713 . Using these parameters, it then attempts to reconnect with the protection CMTS 705 . See arrow 715 . Reconnection may involve sending a DOCSIS ranging request.
  • protection CMTS 705 Upon receipt of the appropriate connection request from cable modem 701 , protection CMTS 705 confirms that the cable modem is transmitting in a manner that allows the CMTS to service it. See arrow 717 . In a DOCSIS protocol, this procedure may involve confirming that the frequency, power and timing of a ranging request are appropriate. In any event, protection CMTS 705 replies to cable modem 701 as indicated by arrow 719 . Following the DOCSIS example, the reply will be a ranging response that includes any necessary changes to transmission frequency, power, and/or timing. When in receipt of this information, cable modem 701 can trim its parameters as appropriate. See 721 . Next, cable modem 701 announces that it is working as indicated by arrow 723 . At this point, the protection CMTS injects the new host route into the routing protocol as indicated at 725 .
  • the systems and methods of this invention may provide fail over protection when there is a detected failure.
  • failure may be an equipment failure (e.g., all operations of a CMTS cease), a circuit failure (e.g., on line card serving a subsection of the cable network fails), extreme noise (significant noise occurs over a wide frequency band and/or for an extended period of time), etc.
  • equipment failure e.g., all operations of a CMTS cease
  • circuit failure e.g., on line card serving a subsection of the cable network fails
  • extreme noise significant noise occurs over a wide frequency band and/or for an extended period of time
  • the following examples illustrate the range of possible failures.
  • a downstream circuit on a line card fails but upstream circuit continues to function. Even though the upstream route still functions, it may be most efficient to have the protection CMTS take over both upstream and downstream service.
  • a fiber node residing between a working CMTS and its cable modems fails.
  • CMTS In normal operation (according to a standard such as DOCSIS), there should be continual “chit chat” between the CMTS and its modems. These messages are often sent at the link or MAC level. In DOCSIS, the messages take the form of pings and/or ranging requests. These messages, which are sent at least about every 30 seconds, confirm that the upstream and downstream paths between cable modem and CMTS are operational. If the CMTS should go down or some part of the path between it and the cable should become inoperational, then the cable modem will recognize that it can no longer communicate. At that point, it may begin the cutover procedure. In another scenario, the downstream path is operational, the cable modem is operational, and the CMTS is operational. The upstream path, however, is inoperational.
  • the CMTS will recognize that it is not receiving messages from the cable modem. It may then infer that the upstream path has a problem and initiate the cutover to its protection CMTS. These examples illustrate that either the head end or the cable modems can initiate the cutover from a working to a protection path. This capability provides high system reliability.
  • the techniques of the present invention may be implemented on software and/or hardware.
  • they can be implemented in an operating system kernel, in a separate user process, in a library package bound into network applications, on a specially constructed machine, or on a network interface card.
  • the methods of the present invention are implemented in software such as an operating system or in an application running on an operating system.
  • a software or software/hardware hybrid system of this invention is preferably implemented on a general-purpose programmable machine selectively activated or reconfigured by a computer program stored in memory.
  • Such programmable machine may be a network device designed to handle network traffic.
  • Such network devices typically have multiple network interfaces.
  • One important class of device that may be used to implement the present invention is the cable modem termination system.
  • the CMTS is a “routing” CMTS, which handles at least some routing functions.
  • the CMTS may be a “bridging” CMTS, which handles only lower-level tasks.
  • FIG. 8A provides an example of some components of a CMTS that may be used to implement certain aspects of this invention.
  • a CMTS 804 provides functions on three network layers including a physical layer 832 , a Media Access Control (MAC) layer 830 , and a network layer 834 .
  • the physical layer is responsible for receiving and transmitting RF signals on the cable plant.
  • Hardware portions of the physical layer include a downstream modulator and transmitter 806 and an upstream demodulator and receiver 814 .
  • the physical layer also includes software 886 for driving the hardware components of the physical layer.
  • Upstream optical data signals (packets) arriving via an optical fiber node 810 are converted to electrical signals by a receiver 812 .
  • the upstream information packet (RF electrical signals) is demodulated by the demodulator/receiver 814 and then passed to MAC layer block 830 .
  • a primary purpose of MAC layer 830 is to encapsulate, with MAC headers, downstream packets and decapsulate, of MAC headers, upstream packets.
  • the encapsulation and decapsulation proceed as dictated by the above-mentioned DOCSIS standard for transmission of data or other information.
  • the MAC headers include addresses to specific modems or to a hub (if sent upstream) by a MAC layer block 830 in CMTS 804 .
  • the cable modems also include MAC addressing components. In the cable modems, these components encapsulate upstream data with a header containing the MAC address of the hub.
  • MAC layer block 830 includes a MAC hardware portion 804 and a MAC software portion 884 , which together serve the above-described functions.
  • MAC hardware portion 804 is distinct from the router's general-purpose microprocessor and is dedicated to performing some MAC layer functions.
  • Network layer block 834 includes switching software 882 for causing the upstream information packet to be switched to an appropriate data network interface on data network interface 802 .
  • the switching software within network layer 834 passes the packet to MAC layer 830 .
  • MAC block 804 then transmits information via a one-way communication medium to downstream modulator and transmitter 806 .
  • Downstream modulator and transmitter 806 takes the data (or other information) in a packet structure and converts it to modulated downstream frames, such as MPEG or ATM frames, on the downstream carrier using, for example, QAM 64 modulation (other methods of modulation can be used such as CDMA (Code Division Multiple Access) OFDM (Orthogonal Frequency Division Multiplexing), FSK (FREQ Shift Keying)).
  • the return data is likewise modulated using, for example, QAM 16 or QSPK.
  • Data from other services e.g. television
  • An optical converter 808 converts the modulated RF electrical signals to optical signals that can be received and transmitted via Fiber Node 810 to the cable modem hub.
  • CMTS may not include network layer 834 .
  • a CMTS device may include only a physical layer and a MAC layer, which are responsible for modifying a packet according to the appropriate standard for transmission of information over a cable modem network.
  • the network layer 834 of these alternate embodiments of CMTS devices may be included, for example, as part of a conventional router for a packet-switched network.
  • the network layer of the CMTS is configured as a cable line card coupled to a standard router that includes the physical layer block 832 and MAC layer block 830 . Using this type of configuration, the CMTS is able to send and/or receive IP packets to and from the data network interface 802 using switching software block 882 .
  • the data network interface 802 is an interface component between external data sources and the cable system.
  • the external data sources transmit data to the data network interface 802 via, for example, optical fiber, microwave link, satellite link, or through various media.
  • the data network interface includes hardware and software for interfacing to various networks such as, for example, Ethernet, ATM, frame relay, etc.
  • CMTS 804 includes a central hardware block 850 including one or more processors 855 and memory 857 . These hardware components interact with software and other hardware portions of the various layers within the CMTS. They provide general purpose computing power for much of the software.
  • Memory 857 may include, for example, I/O memory (e.g. buffers), program memory, shared memory, etc.
  • Hardware block 850 may physically reside with the other CMTS components.
  • the software entities 882 , 884 , and 886 are implemented as part of a network operating system running on hardware 850 .
  • the protective registration and cutover functions of this invention are implemented in software as part of the operating system. In FIG. 8A , such software may be part of MAC layer software 884 and/or the switching software 882 , or may be closely associated therewith. Of course, the registration and cutover logic could reside in hardware, software, or some combination of the two.
  • CMTS 804 The procedures employed by the working and protection CMTSs during registration and pre-registration are preferably performed at the MAC layer of the CMTS logic. Thus, in CMTS 804 , most of the registration operations would be performed by the hardware and software provided for MAC layer logic 830 . Associated with the registration are adjustments to the cable modem's transmission power and transmission frequency. To allow MAC layer logic 830 to implement such adjustments, it may use power readings (and sometimes frequency and signal to noise ratio readings) from an amplitude estimator 816 forming part of the physical layer logic 832 .
  • the operations associated with obtaining an IP address for cable modems are preferably implemented at the network layer lever 834 . As noted, this may involve the CMTS communicating with a DHCP server via data network interface 802 , for example.
  • network layer logic 834 is typically responsible for the operations required to inject host routes into the appropriate routing protocols.
  • FIG. 8B presents a block diagram of a cable modem 890 suitable for use with this invention.
  • modem 890 contains many logic blocks, hardware elements, and software elements similar to those of CMTS 804 .
  • a memory 857 ′ should be able to store registration parameters from both working and protection CMTSs. Note that rather than keeping track of information for all cable modems serviced by a CMTS interface, modem 890 need only keep track of its own parameter (e.g., power, frequency, time slots . . . ). Thus, the memory 857 ′ and processors 855 ′ need not have the storage and processing capacities of their counterparts in CMTS 804 .
  • interface 802 ′ connects to a PC or other node associated with the cable modem.
  • a module 806 ′ modulates and transmits upstream data and a module 814 ′ demodulates and receives downstream data.
  • the roles of these blocks are reversed at the CMTS, which sits at the other end of the cable network.
  • the downstream and upstream lines combine directly to a coaxial cable 892 .
  • the redundancy methods of this present invention may be implemented on various general purpose cable modem termination systems.
  • the systems of this invention may be specially configured CMTSs such as, for example, specially configured models in the uBR-7200 series of CMTSs available from Cisco Systems, Inc. of San Jose, Calif.
  • the methods of this invention may be implemented on a general-purpose network host machine such as a personal computer or workstation.
  • the invention may be at least partially implemented on a card (e.g., an interface card) for a network device or a general-purpose computing device.
  • FIG. 8A represents one specific CMTS architecture of the present invention, it is by no means the only CMTS architecture on which the present invention can be implemented.
  • CMTS complementary metal-oxide-semiconductor
  • network device may employ one or more memories or memory modules (e.g., memory 857 ) configured to store program instructions for the network operations and other functions of the present invention described herein.
  • the program instructions may specify an operating system and one or more applications, for example.
  • Such memory or memories may also be configured to store data structures or other specific non-program information described herein.
  • the present invention relates to machine-readable media that include program instructions, state information, etc. for performing various operations described herein.
  • machine-readable media include, but are not limited to, magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROM disks; magneto-optical media such as floptical disks; and hardware devices that are specially configured to store and perform program instructions, such as read-only memory devices (ROM) and random access memory (RAM).
  • ROM read-only memory devices
  • RAM random access memory
  • the invention may also be embodied in a carrier wave travelling over an appropriate medium such as airwaves, optical lines, electric lines, etc.
  • program instructions include both machine code, such as produced by a compiler, and files containing higher level code that may be executed by the computer using an interpreter.
  • CMTS-cable modem CM
  • Many of the terms and procedures presented here are described in detail in the DOCSIS standard, version 1.1, previously incorporated by reference.
  • a DCC-REQ may be transmitted by a CMTS to a CM to switch to the downstream channel that the CM is using.
  • the format of a DCC-REQ may be as shown in Figure below:
  • Action Code The appropriate Action Code; the CM may behave as follows
  • the DCC-REQ message may contain the following TLVs.
  • the DCC-REQ message must contain the following TLVs.
  • Downstream Frequency The downstream frequency which the CM is to switch to.
  • downstream frequency is not explicitly stated with the downstream frequency TLV, then the CM must choose a downstream frequency based upon the list of downsteam frequencies and their priorities that were provided during configuration. If the list does not exist, or the frequencies are not working, the CM must begin searching for a new downsteam.
  • the CMTS should provide each CM an Occasional Ranging opportunity with the Protect CMTS at least once every 24 hour period.
  • DCC-RSP Downstream Channel Change Response
  • An DCC-RSP must be transmitted by a CM to a CMTS in response to receiving a DCC-REQ if the DCC-REQ Action Code is a 0, 1, or 3. If DCC-REQ Action Code was a 0 or a 1, the CM must send a DCC-RSP after it has returned back from the Protect CMTS. If the DCC-REQ Action Code was a 3, the CM must send a DCC-RSP before it returns to the Working CMTS. If the DCC-REQ Action Code was a 2, the CM must not send a DCC-RSP.
  • the DCC-RSP message may contain:
  • Downstream Frequency The downstream frequency which the CM is to switch to.
  • the CM's config. file may contain the Backup Downstream Channel Set TLV. If present, the CM must send them in the Registration Request.
  • the Working CMTS should send a DCC-REQ with an Action Code of 0 to allow the CM to initialize with the Protect CMTS.
  • the CM registers with the Protect CMTS it follows the standard procedure with the exception of skipping:
  • the Registration Response must contain the following TLVs:
  • Modem Primary SID for Protect CMTS with the assigned primary SID if provided now or Initialization SID 0 if provided later during failure-over.
  • Modem IP Address for Protect CMTS with the same IP address if it can support or Initialization IP address of 0.0.0.0 if CM must invoke DHCP mechanisms to obtain an IP address later when failure.
  • the Protect CMTS must allocate a contention ranging opportunity with a region large enough to account for the variation in delays between any two CMs.
  • the Protect CMTS must allocate a contention ranging opportunity with region large enough to account for the variation in delays between any two CMs.
  • the CM If the CM is provisioned to run Baseline Privacy, the CM must skip it now, and initialize Baseline Privacy operations later during failure switch.
  • the Working CMTS must provide each CM an Occasional Ranging opportunity with the Protect CMTS at least once every 24 hour period by sending a DCC-REQ with an Action Code equal to 1. If the CMTS does not get DCC-RSP after T9 timeout, it must retry.
  • the CM When a CM performs Occasional Ranging with the Protect CMTS, the CM must send the RNG-REQ message using the Occasional Ranging SID. If the Occasional Ranging SID is equal to the Initialization SID 0, than the CM must use the ranging backoff parameter in the current MAP.
  • the Protect CMTS must allocate a contention ranging opportunity with a region large enough to account for the variation in delays between any two CM. The CM must finish Occasional Ranging within T9 timeout.
  • the CM may accumulate the adjustment of the ranging parameters with the Working CMTS, and apply it to the ranging parameters for the Protect CMTS to better estimate the CM's initial ranging parameters when switching to the Protect CMTS.
  • CM When a CM receives a DCC-REQ with Action Code 2 or when a CM detects downstream failure, the CM will Failure Switch using the following steps:
  • the Protect CMTS must allocate contention ranging opportunities with a region large enough to account for the variation in delays between any two CMs.
  • Type Length Value 29.1 1 0-7
  • More than one backup downstream channel may have the same priority.
  • the CM must scan for these channels from lowest to highest frequency.
  • Downstream Frequency The receive frequency to be used by the CM. This is the center frequency of the downstream channel in Hz stored as a 32-bit binary number. Downstream Frequency is the unique index of the Backup Downstream Channel Set.
  • the receive frequency must be a multiple of 62599 Hz
  • Downstream In-Active Timer Timer in msec that the CM uses to detect downstream failure before it switchs to the Protect CMTS. This timer should be a level timer based on the highest QoS the CM has.
  • Type Length Value 29.4 4 Downstream in-active timer
  • Modem Primary SID for Protect CMTS This is a 16-bit field of which the lower 14 bits define the SID with bits 14 and 15 defined to be 0.
  • the CM must send REG-REQ message containing this TLV with an Initialization SID 0.
  • Protect CMTS must send REG-RSP message containing this TLV with an assigned Primary SID if provided now or Initialization SID of 0 if provided later when a failure occurs.
  • Modem IP Address for Protect CMTS The IP address of the CM when it is in normal operation with the Protect CMTS. During initialization with the Protect CMTS, the CM must send REG-REQ message containing this TLV with its current IP address. The Protect CMTS must send a REG-RSP message containing this TLV with the same IP address if it can support the address, or the Initialization IP address of 0.0.0.0 if it cannot. If the CM receives 0.0.0.0, the CM must invoke DHCP mechanisms to obtain an IP address when it performs registration on the Protect CMTS.
  • Modem Occasional Ranging SID for Protect CMTS SID is a 16-bit field of which the lower 14 bits define the SID with bits 14 , 15 defined to be 0.
  • SID is a 16-bit field of which the lower 14 bits define the SID with bits 14 , 15 defined to be 0.
  • CMTS must send REG-RSP message contains this TLV.
  • CM do Occasional Ranging with Protect CMTS CM must send the RNG-REQ use this Occasional Ranging SID, if Occasional Ranging SID is Initialization SID 0, than use the ranging backoff in the current MAP.
  • Protect CMTS must allocate contention ranging opportunity with region large enough to account for the variation in delays between any two CMs, CM must finish Occasional Ranging within T9 timeout.
  • Type Length Value 29.7 4 SID
  • Modem Failure Ranging SID for Protect CMTS The SID is a 16-bit field of which the lower 14 bits define the SID with bits 14 and 15 defined to be 0.
  • the Protect CMTS must send a REG-RSP message containing this TLV.
  • the CM During failure switchover, when the CM does Failure Ranging with the Protect CMTS, the CM must send the RNG-REQ using this Failure Ranging SID.
  • the Protect CMTS must allocate a contention ranging opportunity with a region large enough to account for the variation in delays between any two CMs.
  • Type Length Value 29.8 4 SID
  • DOCSIS systems which are intended to be used for high availability applications such as voice or mission critical data need to be able to offer rundancy in equipment in order to protect from either CMTS failure of HFC plant failure.
  • the general approach that DOCSIS follows is to provide the CM access to two (or more) CMTS domains, and let the CM switch-over from the first CMTS, known as the Working CMTS, to the second CMTS, known as the Protect CMTS, when the CM determines there is a failure with the Working CMTS.
  • the CM In order to quickly switch the CM to from the Working CMTS to the Protect CMTS, the CM needs to pre-initialization and perform occasional ranging with the Protect CMTS.
  • the operation of the CM with the Protect CMTS can be classified as four states:
  • CM will partially initialize with the Protect CMTS.
  • the CM will perform occasional ranging with the Protect CMTS
  • the CM will perform final initialization with the Protect CMTS during failure
  • CM may not get a primary SID assigned
  • CM's current IP address may not be supported by the Protect CMTS;
  • CM must not initialize Baseline Privacy operations if the CM is provisioned to run Baseline Privacy.
  • the solution is for the CM to perform final initialization with Protect CMTS during failure.
  • the solution is to allocate a quick contention ranging opportunity to Modem Occasional Ranging SID for Protect CMTS. This is similar in concept to the Initial Maintenance IE.
  • CM must first does Failure Ranging which has the same problems as Occasional Ranging, than final initial with Protect CMTS.
  • the solution is to allocate a much more quicker contention ranging opportunity to Modem Failure Ranging SID for Protect CMTS. This is similiar in concept to the Initial Maintenance IE.
  • the CM must invoke DHCP mechanisms to obtain an IP address and must initialize Baseline Privacy operations if the CM is provisioned to run Baseline Privacy.
  • Protect CMTS may not support that many CMs at normal operation.
  • the solution is for the Protect CMTS to send the CM back to its Working CMTS or some other Working CMTS.
  • the technology of the present invention may be applied to any shared-access network having a plurality of hosts or nodes which share at least one channel for communicating with at least one “head-end” in the network.
  • shared-access networks include, in addition to cable networks, wireless networks, Ethernet, etc.
  • the plurality of nodes represents a plurality of cable modems that communicate with at least one CMTS at the centralized termination system using at least one shared-access upstream and downstream channel.
  • the methods and apparatus described above may be implemented on a protection device (e.g., a router) for providing redundancy in a network having (1) a working device (e.g., another router) that provides normal service to a host and (2) the protection device which takes over service to the host should service from the working device fail.
  • a protection device e.g., a router
  • Such general methods may include the following sequence: (a) pre-registering the host with the protection device before or after it registers with the working device; and (b) assuming a protection state in which the protection device can take over service of the host should its service with the working device fail.
  • Such methods (and associated apparatus) will be particularly valuable in the context of telephony service.
  • the plurality of nodes or hosts corresponds to the plurality of wireless nodes 950 which use at least one shared access channel to communicate with at least one access control system 922 located at the head end of the wireless system.
  • the wireless system includes a central termination system (or head end) 920 .
  • the head end includes a working access controller or access control system (ACS) 922 which communicates with a plurality of wireless nodes 950 , and coordinates access between each of the wireless nodes and the head end 920 .
  • the access controller 922 may include memory and at least one processor.
  • the function of the access controller 922 is analogous to that of the CMTS described above with respect to cable modem networks. It may serve as a router as well.
  • the head end 920 communicates with a plurality of wireless nodes 950 via any one of a plurality of wireless transmitting and receiving devices 910 .
  • the plurality of wireless transmitting and receiving devices 910 may include satellite base stations 902 , orbital satellites 906 , radio towers 904 , etc.
  • the head end 920 of the wireless computer system communicates with the plurality of nodes 950 via one or more downlink channels 907 and one or more uplink channels 909 .
  • Each downlink channel 907 is a broadcast-type channel utilized by the head end to communicate with an associated group of wireless nodes within the wireless network.
  • the uplink channel 909 is a shared-access channel, which is utilized by a group of wireless nodes (analogous to cable modems) to communicate with the head end 920 .
  • the working access controller 922 stores registration parameters for the various nodes that it services.
  • the access controller 922 may also store the IP addresses for nodes that it services while being backed up by a protection access controller 923 . These IP addresses are also stored by protection access controller 922 to allow a smooth transition in service should working access controller 922 fail.
  • the registration process and information is similar to that of the cable network CMTSs described above.
  • the technique of the present invention for cutover using a single IP address for both the working and protection access controllers may be implemented in wireless system 900 .
  • the wireless devices or nodes 950 may include any one of a number of wireless transmitting/receiving devices.
  • a satellite dish 952 may be used to communicate with the head end 920 via the uplink and downlink channels.
  • the satellite dish may, in turn, be connected to a local area network (LAN) 930 which, may be further connected to one or more computer systems 932 .
  • LAN local area network
  • Another wireless device may be a portable/wireless computer system 954 , which is able to transmit and receive information to the head end via uplink and downlink channels 907 and 909 .
  • Other wireless devices 956 may include, for example, wireless telephones, handheld computing devices, etc.
  • the uplink and downlink channels within the wireless system 900 are utilized in a manner similar to that of the upstream and downstream channels of a cable modem network, the above-described redundancy methods may easily be implemented in wireless system 900 using the detailed description of the present invention provided herein. Moreover, the technique of the present invention may be easily implemented in any computer network which uses shared access channels for communicating between a centralized computing system and one or more remote nodes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

A protection CMTS is available to immediately service a cable modem should that modem's service from a working CMTS fail for any reason. To speed the service transfer (cutover) from the working CMTS to the protection CMTS, the cable modem may preregister with the protection CMTS well before the cutover becomes necessary. The cable modem's registration with both the working CMTS and the protection CMTS preferably employs a single IP address, so that the cable modem need not obtain a new IP address during cutover. While the cable modem may register with both the working CMTS and the protection CMTS, the devices are designed or configured so that only the working CMTS injects a host route for the cable modem into the appropriate routing protocol. Only after cutover to the protection CMTS does the protection CMTS inject its host route.

Description

CROSS-REFERENCE TO RELATED APPLICATION
This invention is related to U.S. patent application Ser. No. 09/484,189, filed on the same day as this patent application, naming F. Daruwalla, J. Forster, G. Roeck, R. Woundy, and M. Thomas as inventors, and titled “ROUTING PROTOCOL BASED REDUNDANCY DESIGN FOR SHARED-ACCESS NETWORKS, and U.S. patent application Ser. No. 09/484,612, filed on the same day as this patent application, naming Joanna Qun Zang, Feisal Daruwalla, James R. Forster, Guenter E. Roeck, Joseph B. O'Donnell, John Chen and Mark Millet as inventors, and titled “CABLE NETWORK REDUNDANCY ARCHITECTURE.”That application is incorporated herein by reference in its entirety and for all purposes.
BACKGROUND OF THE INVENTION
This invention relates to digital cable network technology. More specifically, it relates to methods and apparatus that provide redundancy for critical headend components of digital cable networks.
Broadband access technologies such as cable, fiber optic, and wireless have made rapid progress in recent years. Recently there has been a convergence of voice and data networks which is due in part to US deregulation of the telecommunications industry. In order to stay competitive, companies offering broadband access technologies need to support voice, video, and other high-bandwidth applications over their local access networks. For networks that use a shared access medium to communicate between subscribers and the service provider (e.g., cable networks, wireless networks, etc.), providing reliable high-quality voice/video communication over such networks is not an easy task.
A cable modem network or “cable plant” employs cable modems, which are an improvement of conventional PC data modems and provide high speed connectivity. Cable modems are therefore instrumental in transforming the cable system into a full service provider of video, voice and data telecommunications services. Digital data on upstream and downstream channels of the cable network is carried over radio frequency (“RF”) carrier signals. Cable modems convert digital data to a modulated RF signal for upstream transmission and convert a downstream RF signal to digital form. The conversion is done at a subscriber's home. At a cable modem termination system (“CMTS”) located at a head end of the cable network, the conversions are reversed. The CMTS converts downstream digital data to a modulated RF signal, which is carried over the fiber and coaxial lines to the subscriber premises. The cable modem then demodulates the RF signal and feeds the digital data to a computer. On the return path, the digital data is fed to the cable modem (from an associated PC for example), which converts it to a modulated RF signal. Once the CMTS receives the upstream RF signal, it demodulates it and transmits the digital data to an external source.
FIG. 1 is a block diagram of a typical two-way hybrid fiber-coaxial (HFC) cable network system. It shows a head end 102 (essentially a distribution hub) which can typically service about 40,000 homes. Head end 102 contains a CMTS 104 that is needed when transmitting and receiving data using cable modems. Primary functions of the CMTS include (1) receiving signals from external sources 100 and converting the format of those signals, e.g., microwave signals to electrical signals suitable for transmission over the cable system; (2) providing appropriate Media Access Control (MAC) level packet headers for data received by the cable system, and (3) modulating and demodulating the data to and from the cable system.
Head end 102 (and CMTS 104) connects through pairs of fiber optic lines 106 (one line for each direction) to a series of fiber nodes 108. Each head end can support normally up to 80 fiber nodes. Pre-HFC cable systems used coaxial cables and conventional distribution nodes. Since a single coaxial cable was capable of transmitting data in both directions, one coaxial cable ran between the head end and each distribution node. In addition, because cable modems were not used, the head end of pre-HFC cable systems did not contain a CMTS. Returning to FIG. 1, each of the fiber nodes 108 is connected by a coaxial cable 110 to two-way amplifiers or duplex filters 112, which permit certain frequencies to go in one direction and other frequencies to go in the opposite direction (different frequency ranges are used for upstream and downstream paths). Each fiber node 108 can normally service up to 500 subscribers. Fiber node 108, coaxial cable 110, two-way amplifiers 112, plus distribution amplifiers 114 along with trunk line 116, and subscriber taps, i.e. branch lines 118, make up the coaxial distribution system of an HFC system. Subscriber tap 118 is connected to a cable modem 120. Cable modem 120 is, in turn, connected to a subscriber computer 122.
According to a current standard for transmission of data over cable networks (termed “DOCSIS”), there is no provision for any redundancy at the CMTS of the cable system. Therefore, a failure of the one of the CMTS will result in a service disruption or service outage of the cable modems relying upon the failed element. If a CMTS fails, for example, it may have to be repaired or replaced before service can resume. This means that service can be out for an extended period. From the perspective of the service provider and the end user, any type of disruption or delay in service is extremely undesirable.
This problem becomes particularly acute as broadband access technologies, including cable, move toward digital telephony (e.g., Voice over IP or “VoIP”). For these applications, rapid reliable cutover from a failed component becomes critical. If such technologies are to compete with analog telephony, a greatly improved protection/cutover technology is necessary.
SUMMARY OF THE INVENTION
To address these issues, the present invention provides a redundancy technique in a shared-access computer network to reduce delays experienced by various elements within the network which may be caused by equipment failure, software failure, or other network problems. The invention provides a protection CMTS available to immediately service a cable modem should that modem's service from a working CMTS fail for any reason. To speed the service transfer (cutover) from the working CMTS to the protection CMTS, the cable modem may preregister with the protection CMTS well before the cutover becomes necessary. The cable modem's registration with both the working CMTS and the protection CMTS preferably employs a single IP address, so that the cable modem need not obtain a new IP address during cutover. Further, to prevent routing conflicts, the working CMTS and the protection CMTS should be designed or configured so that only the working CMTS injects a host route for the cable modem into the appropriate routing protocol. Only after cutover to the protection CMTS should the protection CMTS inject its host route. By employing a redundancy system as described, the cable system can provide telephony service with fewer significant disruptions.
One aspect of the invention provides a method implemented on a protection CMTS for providing redundancy for a cable network having both a working CMTS and the protection CMTS. The working CMTS provides normal service to a cable modem and the protection CMTS takes over service to the cable modem should service from the working CMTS fail. The method may be characterized by the following sequence: (a) registering the cable modem before or after it registers with the working CMTS; and (b) assuming a protection state in which the protection CMTS can take over service of the cable modem should its service with the working CMTS fail. To effect a cutover, the protection CMTS may first detect that the CMTS's service to the cable modem has failed before taking over service to the cable modem.
Registration generally requires that the protection CMTS have some knowledge of the cable modem so that it can facilitate any subsequent transition from the working CMTS to the protection CMTS. Registration procedures may be specified by a communications standard such as DOCSIS for cable modems. Examples of registration operations include specifying such parameters as a transmission power, transmission time slots, and a transmission frequency at which the cable modem is to communicate with the protection CMTS (should the cable modem service from the working CMTS fail). As explained in more detail below, registration preferably also comprises noting an IP address for the cable modem, which IP address is used in communications between the cable modem and the working CMTS. The protection CMTS may obtain the cable modem IP address in a communication from the cable modem or from the working CMTS.
While in the protection state, the protection CMTS may periodically establishe communication with the cable modem to ensure that the protection path works properly. Such communication may include instructions to the cable modem to adjust at least one of a transmission power and a transmission frequency at which the cable modem is to communicate with the protection CMTS should service with the working CMTS fail.
Another aspect of this invention provides a CMTS designed or configured to act as a protection CMTS. Such CMTS may be characterized by the following features: (a) one or more processors; (b) memory in communication with at least one of the one or more processors; and (c) registration data for the cable modem, which data is provided in the memory. The CMTS processors should be configured to store the registration data in the memory. Such CMTS also should be configured such that it does not provide communication service to the cable modem unless the service from the working CMTS should fail. The content of the registration data depends upon the particular events associated with registration. For a DOCSIS registration, for example, the registration data may include such information as a transmission power and a transmission frequency at which the cable modem is to communicate with the protection CMTS. In preferred embodiments, the registration data also includes an IP address for the cable modem, which IP address is used in communications between the cable modem and the working CMTS. In many embodiments, the CMTS is designed or configured to perform routing operations (i.e., it is a routing CMTS).
Yet another aspect of this invention pertains to cable modems that are configured to store registration parameters for both a working CMTS and a protection CMTS. Typically, such parameters are obtained by a registration method as outlined above.
Another aspect of the invention pertains to computer program products including a machine readable medium on which is stored program instructions for implementing a method as described above. Any of the methods of this invention may be represented as program instructions that can be provided on such computer readable media.
These and other features and advantages of the invention will be presented below with reference to the associated drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram depicting some of the principal components of a cable network that may be used with the present invention.
FIG. 2A is a block diagram depicting a cutover procedure using a 1:1 topology in accordance with an embodiment of this invention.
FIG. 2B is a block diagram depicting a cutover procedure using a 1:1 sparing topology in accordance with an embodiment of this invention.
FIG. 2C is a block diagram depicting a cutover procedure employing a 1:N topology in accordance with an embodiment of this invention.
FIG. 2D is a detailed block diagram of a cable network head-end implementing a 1:1 redundancy topology in accordance with an embodiment of this invention.
FIG. 2E is a detailed block diagram of an alternative head-end topology for 1:1 redundancy in accordance with this invention.
FIG. 3A is a process flow diagram depicting some operations employed within a cable network during registration of a cable modem in accordance with one embodiment of this invention.
FIG. 3B is an interaction diagram depicting the interactions of a cable modem, a working CMTS, and a provisioning server during registration of the cable modem in accordance with one embodiment of this invention.
FIG. 4 is a schematic diagram of a cable network illustrating registration of a cable modem with a working CMTS in accordance with an embodiment of this invention.
FIG. 5 illustrates a cutover procedure resulting from a failure on the path between the cable modem and the working CMTS.
FIG. 6 is a process flow diagram depicting some operations performed on a cable network during cutover in accordance with an embodiment of this invention.
FIG. 7 is an interaction diagram depicting the interactions of a cable modem, a working CMTS, and a protection CMTS during cutover in accordance with an embodiment of this invention.
FIG. 8A is a block diagram depicting a CMTS structure that may be employed with the present invention.
FIG. 8B is a block diagram depicting a cable modem structure that may be employed with the present invention.
FIG. 9 is a schematic illustration of a wireless network suitable for implementing the present invention.
DETAILED DESCRIPTION THE PREFERRED EMBODIMENT
A. Topologies Examples
FIGS. 2A-2E present various cable network topologies that may be used in implementing the present invention. FIG. 2A depicts a network topology deemed “1:1” in which the network includes two CMTSs. Both are working CMTSs and both provide protection for the other. Thus, if one of the two CMTSs fails, the other one assumes the functions of the failed CMTS, while maintaining its own functions.
As shown in FIG. 2A, a cable network system 201 includes first and second cable modems 203 and 205. Each connects to a separate CMTS. Specifically, modem 203 connects to a CMTS 207 via a downstream channel 56 and modem 205 connects to a CMTS 209 via a downstream channel 57. Each connection is made through an HFC network 211. Communications between the cable modems and external sources are made via a connection 200.
Note that FIG. 2A is greatly simplified. Normally, a given CMTS or CMTS interface services many cable modems. For example, a single CMTS may handle one or more distribution networks within a cable plant. Thus, cable modems 203 and 205 may represent groups of modems or an entire distribution network having numerous cable modems.
CMTS 207 is given the designation “W1” for working group 1. This means that it is responsible for handling communications with modem 203 and its peers. Similarly, CMTS 209 is designated “W2,” as it serves needs of cable modem 205 and possibly many other modems. In accordance with this invention, the CMTSs serve additional roles. CMTS 207 provides a protection path for CMTS 209, while CMTS 209 provides a protection path for CMTS 207. Thus, if CMTS 207 fails or otherwise goes out of service, CMTS 209 will take over responsibility for servicing cable modem 203 and its peers. Likewise, if CMTS 209 fails, CMTS 207 will take over responsibility for cable modem 205 and its peers. Note that this invention is not limited to cases in which a working CMTS “fails.” It is also useful for cases where the user simply wants the modems to move to the protection CMTS while the user upgrades or services the working CMTS software, hardware, etc.
FIG. 2A illustrates the failure of CMTS 207. As shown, cable modem 203 can no longer communicate via CMTS 207 and therefore communicates through CMTS 209. To accomplish this, communications to and from cable modem 203 take a different path through HFC network 211. Further, cable modem 203 must shift from downstream channel 56 to channel 57, the channel of CMTS 209. Thus, in this example, cable modem 203 will tune to a different downstream frequency.
In another topology, deemed “1 for 1 sparing,” the network uses two CMTSs: one is a normal working CMTS intended to carry on the normally working functions of a CMTS and another is dedicated to providing protection. In this topology, the protection CMTS does not provide service until the working CMTS fails. It then takes over that machine's functions. FIG. 2B depicts a 1 for 1 sparing topology. As shown, a cable network 201′ includes a working CMTS 213 and a protection CMTS 215. Working CMTS provides service to cable modem 203 and cable modem 205, both over channel 56. This is depicted by the connection paths through HFC plant 211. Note that protection CMTS 215 does not normally provide service to any cable modems. It remains available to take over in the case of a failure.
Assume now that working CMTS 213 fails for some reason. Then, cable modems 203 and 205 cannot communicate through it. In the embodiment of FIG. 2B, CMTS 215 takes over the role of CMTS 213. Preferably, the cutover takes place rapidly. It may be necessary for the cable moderns to switch from channel 56 to channel 57 during the cutover, as shown.
In another embodiment, “1 for N sparing,” multiple working CMTSs are protected by a single protection CMTS. The protection CMTS does not provide cable service until one of the N working CMTSs fails. This network topology is depicted in FIG. 2C. As shown, a network 201″ includes three working CMTSs: a CMTS 213, a CMTS 217, and a CMTS 219. CMTS 213 provides service to cable modem 203 over channel 56, CMTS 217 provides service to cable modem 205 over channel 57, and CMTS 219 provides service to a cable modem 222 over channel 58. A protection CMTS 221 does not normally service any cable modems but is available to service any cable modem in case it needs to take over for a failed peer. Note that in the depicted topology, protection CMTS 221 is assigned downstream channel 59.
As shown in FIG. 2C, when one of the working CMTSs fails (CMTS 217 in this instance), protection CMTS 221 takes over its role. Here cable modem 205 must begin communicating through protection CMTS 221 over channel 59. Note that the service to cable modems 203 and 222 is not affected. If working CMTS 213 were to fail, protection CMTS 221 would have to take over for it as well. The same is true for working CMTS 219.
In yet another topology, deemed “1:N” service, the cable network includes N+1 working CMTSs, and at least one of these working machines can provide protection for some or all of the other N machines. These approaches have the benefit of making use of all resources during normal operation. That is, the protection CMTS does not sit idle as it must in the “sparing” embodiments. Normally it provides a working path for some of the network modems. However, when a protection/working CMTS is filling in for a failed CMTS, it may have a rather heavy load.
This invention may employ multiple distinct CMTSs to provide redundancy as discussed in much of the discussion herein. Alternatively, a single CMTS may provide both working and protection services. In this alternative embodiment, separate line cards (or more generally interfaces) may provide the various functions. Depending upon the network topology, one or more CMTS interfaces may provide the cutover protection and one or more interfaces may provide normal working service. In one embodiment, if one interface fails another one on the same CMTS can take over for it.
FIGS. 2D and 2E present detailed examples of head-end topologies employing a 1:1 service. The invention is by no means limited to these topologies. As shown in FIG. 2D, the cable network head-end 230 includes a first CMTS interface 232 and a second CMTS interface 234. These CMTS interfaces may be provided on a single CMTS chassis or on separate CMTSs. In this specific embodiment, each interface has one downstream port, labeled “DS,” and six upstream ports labeled “U0”-“U5.” Downstream signals from CMTS 232 are provided at an intermediate frequency. When the signal reaches an upconverter 236, its frequency is increased to a level associated with cable channel 64.
Signals passing downstream from upconverter 236 encounter a splitter 238 which directs them to either a first downstream fiber node 240 or a second downstream fiber node 242. During normal operation, CMTS interface 232 services only those cable modems connected through fiber node 240. Should CMTS interface 234 (which normally services fiber node 242) fail, however, CMTS 232 can take over service to the cable modems serviced via fiber node 242.
As shown, CMTS interface 234 provides intermediate frequency downstream signals to an upconverter 244. In the example shown, upconverter 244 converts the intermediate frequency signal to an RF frequency signal corresponding to cable channel 65. That downstream signal encounters a splitter 246, which allows the downstream signal to be provided to either fiber node 240, fiber node 242, or both. During normal operation, CMTS 234 services only those cable modems connected through fiber node 242.
Considering now the upstream signal, cable modems provide data on a specified upstream frequency band to fiber nodes 248 and 250. Normally, upstream data passing through fiber node 248 passes to CMTS interface 232 (via port “U0”). If the upstream path to CMTS interface 232 is disrupted for any reason (e.g., CMTS interface 232 fails), that upstream data is provided to CMTS interface 234. To this end, a splitter 252 allows data from fiber node 248 to pass through to either interface 232 or interface 234. Similarly, a splitter 254 allows upstream date from fiber node 250 to pass to either of interfaces 232 or 234.
For telephony applications, different cable modems communicating through a given fiber node may transmit at different frequency bands. Thus, different upstream ports on a CMTS interface may be configured to handle different ones of these upstream frequency bands. This embodiment is illustrated in topology 230 by the use of upstream splitters 256 and 258. Upstream data passing through fiber node 250 may be carried on one of two possible frequency bands. One of these bands is handled by port U1 on interfaces 232 and 234. The other of these frequency bands is handled by ports U2 of the interfaces.
Note that the head-end topology depicted in FIG. 2D is intended to provide full service to the cable network. Thus, a local feed 260 provides cable TV service to subscribers via fiber node 240. Similarly, a local feed 262 provides cable TV service to subscribers via fiber node 242.
FIG. 2E depicts a slightly different head-end topology (264), which accomplishes essentially the same results. In this Figure, network elements that provide identical function to those depicted in FIG. 2D are given like reference numbers. As shown, the upstream service, with associated redundancy, is identical to that depicted in topology 230 of FIG. 2D.
The downstream network topology is somewhat different, however. In this case, each interface is capable of providing downstream data at either channel 64 or channel 65 (in the specific example). As shown, CMTS interface 232 provides downstream data (on an intermediate frequency) to a splitter 266. During normal operation, splitter 266 directs all data to an upconverter 268, which puts the data on a carrier frequency corresponding to cable channel 64. This data is then provided to downstream fiber node 240, and then on to destination cable modems. If the downstream path from CMTS interface 234 should fail for any reason, interface 232 takes over responsibility for providing downstream data to those cable modems normally serviced by interface 234. It accomplishes this by providing downstream data to an upconverter to 270 (via splitter 266). Note that upconverter 270 puts the data on a carrier frequency corresponding to cable channel 65. That data is then directed to fiber node 242 and then on to the destination cable modems.
CMTS interface 234 provides a backup to interface 232, as well. As shown, downstream data passes from interface 234 to a splitter 272. During normal operation, splitter 272 directs all downstream traffic through an upconverter 274 which puts the data on a carrier corresponding to cable channel 64. This data is then provided to fiber node 242. If interface 234 should be called upon to cover for interface 232, splitter 272 will direct the appropriate traffic to an upconverter 276, which puts that data on a carrier frequency corresponding to cable channel 65. This data is then provided to downstream fiber node 240.
B. Two Stages of Cutover
Typically, the protection afforded by this invention affects normal network operation at two stages. In a first stage, the protection CMTS (or interface) is designated for a particular working CMTS (or interface). In the most trivial case, this simply involves providing instructions for directing cable modems to the protection CMTS when their working paths fail. Other procedures may include a modified registration process, in which the cable modem pre-registers with the protection CMTS. As explained, the cable modem may obtain a network level address (e.g., an IP address) that is not part of the working CMTS interface subnet (or of the protection CMTS interface subnet). Also, a network level routing protocol may be affected during this first stage to limit propagation of the host route through the working CMTS.
In a second stage, failure has occurred and cutover from the working to the protection device is required. Here the affected cable modem registers with the protection CMTS, possibly without requiring a new network level address. The protection CMTS may also then begin to advertise the new host route to the cable modem.
1. Stage 1—Establishing a Cutover Path
Typically, when a cable modem comes on line, it registers with the CMTS that will serve it. It is possible, in accordance with this invention, that a cable modem that has had its CMTS (or path to that CMTS) fail simply registers with a designated protection CMTS. Unfortunately, most cable modem registration protocols require that the CM obtain an IP address specific to its CMTS. This results because the addressing model assigns the cable modem an IP address that is part of the IP subnet of an associated interface (on the working CMTS).
If the CM must use the conventional registration process to register with its protection CMTS after a failure on its working path, then it must obtain an IP address from the protection CMTS's subnet. As part of this process, a PC or other machine behind the cable modem may have to reboot. Thus, service may be disrupted for a somewhat lengthy period of time. This may be unacceptable for some applications, where rapid cutover is required. Further, the cable modem may have had many previous connections with external nodes using its previous IP address and these external nodes would not immediately know of the IP address change. Regardless of this issue, DNS and/or a Call Agent will have to get involved. Note that a Call Agent is used to maintain a list of client IP addresses for use in setting up IP telephony calls.
One approach to speeding up the cutover process involves using cable modem IP addresses that are not part of any particular CMTS's interface subnet. Preferably, a registering cable modem obtains its IP address from an address block that is not part of a CMTS interface IP subnet, but is likely on a an IP “supernet” shared among various CMTSs. Then when a cutover is required, the cable modem need not obtain a new IP address from a different address space. Various protocols may be used to assign the CMTS-independent IP addresses. In one embodiment, a registering cable modem obtains its IP address from a Dynamic Host Configuration Protocol (DHCP) server configured to provide IP addresses from outside the address space of any CMTS interface. DHCP is described in RFC 2131, incorporated herein by reference for all purposes. Generally, in this protocol, the computer is told to ask the network—according to prescribed rules—for a temporary network address.
This procedure has the benefit of allowing a cable modems to cutover from a failed path to a protection channel with minimal overhead. As the cable modem is already registered on the protection channel, it need not obtain a new IP address and go through the attendant time-consuming registration process. Hence service disruption is minimized. The time spent out of service is greatly reduced, connections and context are not necessarily lost, the host machine need not reboot, etc. Without these benefits, applications such as cable telephony may not be realized.
FIGS. 3A, 3B, and 4 illustrate one set of procedures for registering a cable modem in accordance with an embodiment of this invention. Referring first to FIG. 3A, a flow chart is presented depicting generally the steps that a cable modem (and associated CMTSs) may go through to register on both the working CMTS a protection CMTS. As illustrated, a process 301 begins at 303 with the cable modem submitting a registration request to a working CMTS. In a specific embodiment, the registration complies with the procedures required by the DOCSIS standard. Normally, this involves obtaining an IP address for the cable modem, obtaining “ranging” parameters such as upstream frequency, power and timing, etc.
Next, at 305, the cable modem is assigned an IP address suitable for use with this invention. In this embodiment, an IP address is chosen so that that IP address can be used with both the working CMTS and the protection CMTS. Thus, the IP address should be chosen from an address block that is not dedicated to either the working CMTS or the protection CMTS. As explained above, under current practice a cable network assigns IP addresses from an address block bound to a particular CMTS interface. Unfortunately, if that interface fails (or the path to it fails) then the IP address that has been assigned to the cable modem is no longer useful. As a consequence, the cable modem must obtain a different IP address if it is to communicate through a protection CMTS. To avoid this problem, this embodiment of the present invention requires that the IP address that has been assigned to the cable modem during registration be selected from the address space lying outside the address blocks assigned to either the working CMTS or protection CMTS.
Because the working CMTS participates in the registration process, it can determine the IP address that has been assigned to the cable modem. This is illustrated at 307 where the working CMTS notes the assigned cable modem IP address and injects the associated host route into the appropriate routing protocol. The host route, in this instance, specifies the route to the registering cable modem through the working CMTS.
The host route is preferably provided to one or more aggregation routers associated with the head-end of the cable network. This is depicted at 309 in process 301. Because the host route specifics the working CMTS, and provision is made for having a protection CMTS take over for the working CMTS, the host route should not propagate beyond the head-end. Then, when the working CMTS fails and the protection CMTS takes over, the new host route can quickly replace the previous host route in the relevant routers.
Next, the cable modem obtains the relevant registration parameters, including its IP address, and is also informed of the protection RF channel. See 311. Note that the normal registration parameters include an upstream transmission frequency, an upstream transmission power, time slots for upstream transmission, etc.
Because the protection CMTS communicates via a different upstream RF channel than the working CMTS, it is necessary to inform the cable modem of the protection CMTS's upstream channel. With the contact information in hand, the cable modem re-registers on the protection channel with the protection CMTS. See 313. The cable modem will obtain the registration parameters for the protection CMTS and store them in preparation for an event that causes it to cutover. Note that this re-registration process does not assign a new IP address to the cable modem. Rather, the cable modem preserves the IP address that was assigned to it during registration on the working CMTS.
Finally, at 315, the protection CMTS recognizes the cable modem, but does not inject a host route for that cable modem into the routing protocol. If the upstream path to the working CMTS fails, and the switch over to the protection CMTS is required, the protection CMTS will rapidly accept the pre-registered cable modem. Until that time, however, the protection CMTS does not advertise its host route to the cable modem.
After pre-registration, but before cutover, the protection CMTS remains in a “protection state” ready to take over service to the cable modem when it determines that the modem's working route has failed. While in the protection state, the protection CMTS may periodically ensure that it is ready to take over service to the cable modem. This may entail that the protection CMTS determine that the protection path still works. If communication can take place over the path, the protection CMTS may request that the cable modem change certain parameters to optimize communication if a cutover becomes necessary. As indicated, the transmission characteristics of a cable network path vary with temperature, load, mechanical conditions, etc. Thus, what were optimal transmission settings one day, may be far from optimal the next day.
If the cable network uses DOCSIS, the protection CMTS may periodically issue station maintenance opportunities to the cable modem. In response, the cable modem sends a ranging request message at a transmission power and frequency as specified by its stored parameters. The protection CMTS detects the power, frequency, and timing of the ranging request. It determines how far these parameters vary from optimal, if at all, and sends a ranging response message instruction the cable modem to change its parameters as necessary. The protection CMTS may also use a DOCSIS ping to determine whether the protection path works.
FIG. 3B presents an interaction diagram for cable network components used in a specific embodiment of the present invention. Again, this embodiment involves registration of a cable modem in a manner allowing rapid cut over to a protection CMTS if a working CMTS fails. As illustrated in FIG. 3B, the relevant components are a cable modem 321, a working CMTS 323, and a provisioning server 325.
Initially, a new cable modem comes on line at 320. It then sends a registration request (322) to working CMTS 323. As part of the registration procedure, working CMTS 323 requests an IP address for the cable modem from provisioning server 325. See arrow 324. In a preferred embodiment, provisioning server 325 is running DHCP, which allows it to assign an IP address to cable modem 321 as indicated by operation 326. Subsequently, provisioning server 325 forwards the IP address to working CMTS 323. See arrow 328.
Working CMTS 323 now has all the information it requires to complete registration of cable modem 321. As part of the registration process, it records the assigned IP address of cable modem 321. See operation 330. Working CMTS 323 then forwards the IP address and registration information to cable modem 321 as indicated by arrow 332. Concurrently, working CMTS 323 injects the host route for the cable modem into the relevant routing protocol. See operation 334.
Now that cable modem 321 is registered on the working CMTS, the cable network can begin pre-registering the cable modem on the protection CMTS. In the specific embodiment depicted in FIG. 3B, this pre-registration process begins with provisioning server 325 informing cable modem 321 of the protection CMTS. As indicated in the discussion of FIG. 3A, this may involve informing the cable modem of the radio frequency channel for the protection CMTS. Regardless of the specifics, the operation of informing the cable modem is depicted by arrow 336 in FIG. 3B. After it has been informed in this manner, cable modem 321 initiates the registration procedure with the protection CMTS in a manner such as that described with reference to FIG. 3A.
In this example, provisioning server 325 serves various functions. It may normally be used to provide various telephony support services for VoIP. Server 325 may run on an arbitrary piece of hardware such as a Sun workstation or other Unix system, a Windows NT server and the like. In the depicted embodiment, the provisioning server implements DHCP as well as other relevant functions for the cable network. For example, it may contain a list of MAC addresses for cable modems associated with various paying customers. Associated with this list is the type of service available to each cable modem. For example, those subscribers having telephony service will be identified. When a cable modem registers, the provisioning server will recognize that it is a telephony subscriber and therefore cause it to register on both the working and protection CMTSs.
As mentioned, associated with the registration process, the cable network head-end injects the relevant host route into an appropriate routing protocol. FIG. 4 illustrates this process schematically. Normally, a CMTS advertises routes to its cable modems by identifying its interface subnet(s) via the appropriate routing protocol. In an embodiment of this invention, the CMTS advertises only a very small chunk of address space, not normally associated with its interfaces. These addresses provide host routes or small chunks of address space including IP addresses assigned to the cable modems during registration. Note that when the advertised address space is so small as to identify only a single cable modem, that “chunk” of address space, as used in a routing protocol, is referred to as a “host route.”
Various routing protocols are in use. These include OSPS, RIP, and IGRP. In general, these protocols allow routers to exchange information identifying chunks of IP address space that they know about and/or are servicing. Conventionally, as part of a routing protocol, a CMTS may let its peer routers know that it handles an address space given by the subnet/255.255.255.0, for example. In other words, all cable modems that the CMTS handles have IP addresses falling within this address mask. Because the CMTS provides this address mask to its peers via a routing protocol, they know that if they have a packet destined for a node having IP address within the subnet, they should transmit the packet to the CMTS. In this invention, the CMTSs advertise specific host routes alone or in addition to their specific interface subnets.
As shown in FIG. 4, an HFC network 400 supports various cable modems, including cable modems 401, 403, 405 and 407. Each of these cable modems may be serviced by a separate fiber node, for example. In the network situation depicted, cable modem 401 has just registered and is obtaining its IP address from a provisioning server 409. If provisioning server 409 is employing DHCP to assign IP addresses, a working CMTS 411 will serve the DHCP relay function. By performing this function, CMTS 411 gleans the IP address that has been assigned to cable modem 401. It records this information. Of course, other procedures may be employed to assign IP addresses to cable modems coming on line. Preferably such procedure should allow for notifying working CMTS 411 of newly assigned IP addresses for its cable modems.
As shown, the head-end of the cable network includes multiple aggregation routers. These routers serve to facilitate communication between the cable network and external sources. In the specific embodiment shown in FIG. 4, there are two aggregation routers, a router 413 and a router 415. After CMTS determines the IP address of newly registered cable modem 401, it injects the host route for that cable modem into the routing protocols used by aggregation routers 413 and 415, as illustrated. This host route specifies that cable modem 401 can be reached through CMTS 411. Aggregation routers 413 and 415 are configured to limit propagation of this host route to routers within the head-end. In a preferred embodiment, the working and protection CMTSs of this invention are routing CMTSs, and therefore participate in the necessary routing procedures. One example of the hardware and software employed in such routing CMTSs is described below in connection with the description of FIG. 8A.
In the topology depicted in FIG. 4, multiple CMTSs on a cable plant connect to external networks via one or more higher-level aggregation routers ( routers 413 and 415 in this example). Each CMTS on the cable network is responsible for its own group of cable modems with associated host routes and address/mask. Each of these CMTS advertises its portion of IP address space to the higher-level router(s). A higher-level router in possession of this information, then advertises to its peers via a routing protocol that it can handle packets having destination addresses falling within any of the host routes and address blocks of the underlying CMTSs.
Note that provisioning server 409 is connected to HFC network 400. In the embodiment described with reference to FIGS. 3A and 3B, provisioning server 409 informs cable modem 401 of a protection CMTS. In the embodiment depicted in FIG. 4, a CMTS 417 serves as the protection CMTS for cable modem 401. As illustrated, CMTS 417 can communicate with provisioning server 409 and thereby use its services.
In the above-described embodiments, some technique is required for notifying the protection CMTS of the cable modem's IP address. There are at least three preferred approaches to informing the protection CMTS. The first requires that the cable modem notify the protection CMTS of the IP address that it has obtained during an initial registration through the working CMTS. This notification may serve as a part of the DOCSIS registration process with the working CMTS. In this embodiment, the cable modem may or may not complete a complete registration (ranging and the like) with the protection CMTS. Regardless of the level of pre-registration, the protection CMTS can automatically advertise the host route to the cable modem, should the working path fail.
In a second approach, the cable modem separately registers through the protection CMTS (before or after it registers through the working CMTS) and obtains an IP address during registration. This IP address is identical to the IP address that the cable modem obtains via the working CMTS. Because the protection CMTS participates in the registration process, it records the cable modem's IP address. If DHCP is used, then the DHCP server will recognize that the cable modem requesting an IP address has already obtained such address and will merely assign the same address during the second registration. A third approach requires that the working CMTS communicate the cable modem's IP address to the protection CMTS. This may be accomplished via a special protocol for communication between the working and protection CMTSs.
2. Stage 2—The Cutover Process
FIG. 5 schematically presents the working and protection paths that cable modem 401 may employ. As shown, cable modem 401 normally communicates through CMTS 411 using downstream channel 56. Communications to and from external networks are routed through aggregation router 413. A redundant router 415 is provided to backup router 413 should it fail.
If CMTS 411 fails (or some component on the path from CMTS 411 fails), cable modem 401 reconnects through protection CMTS 417. Note that in this Figure, downstream communication from CMTS 417 is conducted over channel 57. After CMTS 401 reconnects to the protection CMTS, traffic is routed through that CMTS and aggregation router 413. One event that must occur during the cutover is notification, via the appropriate routing protocol(s), that a new working CMTS (the protection CMTS) now provides access to the cable modems previously handled by a failed CMTS. In the embodiment of FIG. 5, part of the cutover process requires that protection CMTS 417 inject its host route to cable modem 401 into the appropriate routing protocol. Preferably, this is a conventional process such as described above with reference to the working CMTS.
FIG. 6 presents a process flow diagram illustrating fault recovery steps in accordance with a specific embodiment of this invention. As shown, a process 602 beings at 604 with either the cable modem or the working CMTS detecting a failure. Various mechanisms for detecting such failures will be discussed below.
After failure detection, the cable modem loads, at 606, its previously stored protection path parameters. These include, for example, the upstream and downstream frequency bands for communicating with the protection CMTS, the appropriate cable modem transmission power to the protection CMTS, the communications time slots allotted for the protection CMTS, etc. Then, at 608, the cable modem connects to the protection CMTS and trims its parameters. Note that signal transmission properties vary nearly continually within a cable network. As a consequence, the parameters obtained during the pre-registration stage may no longer be optimal for communication with the protection CMTS. Trimming simply refers to the process of reoptimizing the transmission frequency, power, timing, etc. in light of current network conditions. In accordance with the DOCSIS protocol, trimming may be accomplished by the “ranging” process.
After the cable modem confirms that the protection CMTS path is working (via ranging, for example), it announces to the protection CMTS that the path is in fact working. See block 610. This announcement may take various forms; e.g., a maintenance ranging request. Thereafter, at 612, the protection CMTS injects its host route into the routing protocol. If the working CMTS has not already stopped injecting its host route into the routing protocol, it now stops. The receiving aggregation router (or routers) aggregates the new host route in a manner that prevents propagation outside of the head-end. See 614 At this point, upstream packets are immediately successful, and, very soon thereafter after interior gateway protocol convergence, external packets now transit through the correct CMTS and reach the cable modem.
FIG. 7 provides an interaction diagram depicting the interaction of a cable modem 701, a working CMTS 703, and a protection CMTS 705 during cutover in accordance with a specific embodiment of this invention. Initially, at 707, cable modem 701 detects a failure. Alternatively, at 709, the working CMTS detects a failure. Either way, the device detecting the failure announces it to the other device. See arrow 711.
After the failure has been detected and announced, cable modem 701 loads the protection CMTS parameters as indicated by arrow 713. Using these parameters, it then attempts to reconnect with the protection CMTS 705. See arrow 715. Reconnection may involve sending a DOCSIS ranging request.
Upon receipt of the appropriate connection request from cable modem 701, protection CMTS 705 confirms that the cable modem is transmitting in a manner that allows the CMTS to service it. See arrow 717. In a DOCSIS protocol, this procedure may involve confirming that the frequency, power and timing of a ranging request are appropriate. In any event, protection CMTS 705 replies to cable modem 701 as indicated by arrow 719. Following the DOCSIS example, the reply will be a ranging response that includes any necessary changes to transmission frequency, power, and/or timing. When in receipt of this information, cable modem 701 can trim its parameters as appropriate. See 721. Next, cable modem 701 announces that it is working as indicated by arrow 723. At this point, the protection CMTS injects the new host route into the routing protocol as indicated at 725.
As emphasized herein, the systems and methods of this invention may provide fail over protection when there is a detected failure. Such failure may be an equipment failure (e.g., all operations of a CMTS cease), a circuit failure (e.g., on line card serving a subsection of the cable network fails), extreme noise (significant noise occurs over a wide frequency band and/or for an extended period of time), etc. The following examples illustrate the range of possible failures. In one case, a downstream circuit on a line card fails but upstream circuit continues to function. Even though the upstream route still functions, it may be most efficient to have the protection CMTS take over both upstream and downstream service. In another example, a fiber node residing between a working CMTS and its cable modems fails. While the working CMTS is still operational, the path to it is not. In this case, the correction would require that upstream and downstream data bypass the inoperative fiber node. This likely means that the working CMTS can not be used until the fiber node is repaired or replaced. A protection CMTS is then employed.
In normal operation (according to a standard such as DOCSIS), there should be continual “chit chat” between the CMTS and its modems. These messages are often sent at the link or MAC level. In DOCSIS, the messages take the form of pings and/or ranging requests. These messages, which are sent at least about every 30 seconds, confirm that the upstream and downstream paths between cable modem and CMTS are operational. If the CMTS should go down or some part of the path between it and the cable should become inoperational, then the cable modem will recognize that it can no longer communicate. At that point, it may begin the cutover procedure. In another scenario, the downstream path is operational, the cable modem is operational, and the CMTS is operational. The upstream path, however, is inoperational. The CMTS will recognize that it is not receiving messages from the cable modem. It may then infer that the upstream path has a problem and initiate the cutover to its protection CMTS. These examples illustrate that either the head end or the cable modems can initiate the cutover from a working to a protection path. This capability provides high system reliability.
C. CMTS Configurations
Generally, the techniques of the present invention may be implemented on software and/or hardware. For example, they can be implemented in an operating system kernel, in a separate user process, in a library package bound into network applications, on a specially constructed machine, or on a network interface card. In a specific embodiment of this invention, the methods of the present invention are implemented in software such as an operating system or in an application running on an operating system.
A software or software/hardware hybrid system of this invention is preferably implemented on a general-purpose programmable machine selectively activated or reconfigured by a computer program stored in memory. Such programmable machine may be a network device designed to handle network traffic. Such network devices typically have multiple network interfaces. One important class of device that may be used to implement the present invention is the cable modem termination system. Preferably, the CMTS is a “routing” CMTS, which handles at least some routing functions. Alternatively, the CMTS may be a “bridging” CMTS, which handles only lower-level tasks.
FIG. 8A provides an example of some components of a CMTS that may be used to implement certain aspects of this invention. In the specific embodiment as shown in FIG. 8A, a CMTS 804 provides functions on three network layers including a physical layer 832, a Media Access Control (MAC) layer 830, and a network layer 834. Generally, the physical layer is responsible for receiving and transmitting RF signals on the cable plant. Hardware portions of the physical layer include a downstream modulator and transmitter 806 and an upstream demodulator and receiver 814. The physical layer also includes software 886 for driving the hardware components of the physical layer.
Upstream optical data signals (packets) arriving via an optical fiber node 810 are converted to electrical signals by a receiver 812. Next, the upstream information packet (RF electrical signals) is demodulated by the demodulator/receiver 814 and then passed to MAC layer block 830. A primary purpose of MAC layer 830 is to encapsulate, with MAC headers, downstream packets and decapsulate, of MAC headers, upstream packets. In one embodiment, the encapsulation and decapsulation proceed as dictated by the above-mentioned DOCSIS standard for transmission of data or other information. Note that at the time when this document was filed, the DOCSIS standard was described in the “Data-Over-Cable Service Interface Specifications—Radio Interface Specifications” SP-RFIv1.1-I02-990731, Interim Specification Jul. 31, 1999. That document is incorporated herein by reference for all purposes. The MAC headers include addresses to specific modems or to a hub (if sent upstream) by a MAC layer block 830 in CMTS 804. Note that the cable modems also include MAC addressing components. In the cable modems, these components encapsulate upstream data with a header containing the MAC address of the hub.
MAC layer block 830 includes a MAC hardware portion 804 and a MAC software portion 884, which together serve the above-described functions. In a preferred embodiment, MAC hardware portion 804 is distinct from the router's general-purpose microprocessor and is dedicated to performing some MAC layer functions.
After MAC layer block 830 has processed the upstream information, it is then passed to network layer block 834. Network layer block 834 includes switching software 882 for causing the upstream information packet to be switched to an appropriate data network interface on data network interface 802. When a packet is received at the data network interface 802 from an external source, the switching software within network layer 834 passes the packet to MAC layer 830. MAC block 804 then transmits information via a one-way communication medium to downstream modulator and transmitter 806. Downstream modulator and transmitter 806 takes the data (or other information) in a packet structure and converts it to modulated downstream frames, such as MPEG or ATM frames, on the downstream carrier using, for example, QAM 64 modulation (other methods of modulation can be used such as CDMA (Code Division Multiple Access) OFDM (Orthogonal Frequency Division Multiplexing), FSK (FREQ Shift Keying)). The return data is likewise modulated using, for example, QAM 16 or QSPK. Data from other services (e.g. television) is added at a combiner 807. An optical converter 808 converts the modulated RF electrical signals to optical signals that can be received and transmitted via Fiber Node 810 to the cable modem hub.
Note that alternate embodiments of the CMTS (not shown) may not include network layer 834. In such embodiments, a CMTS device may include only a physical layer and a MAC layer, which are responsible for modifying a packet according to the appropriate standard for transmission of information over a cable modem network. The network layer 834 of these alternate embodiments of CMTS devices may be included, for example, as part of a conventional router for a packet-switched network. In a specific embodiment, the network layer of the CMTS is configured as a cable line card coupled to a standard router that includes the physical layer block 832 and MAC layer block 830. Using this type of configuration, the CMTS is able to send and/or receive IP packets to and from the data network interface 802 using switching software block 882.
The data network interface 802 is an interface component between external data sources and the cable system. The external data sources transmit data to the data network interface 802 via, for example, optical fiber, microwave link, satellite link, or through various media. The data network interface includes hardware and software for interfacing to various networks such as, for example, Ethernet, ATM, frame relay, etc.
As shown in FIG. 8A, CMTS 804 includes a central hardware block 850 including one or more processors 855 and memory 857. These hardware components interact with software and other hardware portions of the various layers within the CMTS. They provide general purpose computing power for much of the software. Memory 857 may include, for example, I/O memory (e.g. buffers), program memory, shared memory, etc. Hardware block 850 may physically reside with the other CMTS components. In one embodiment, the software entities 882, 884, and 886 are implemented as part of a network operating system running on hardware 850. Preferably, the protective registration and cutover functions of this invention are implemented in software as part of the operating system. In FIG. 8A, such software may be part of MAC layer software 884 and/or the switching software 882, or may be closely associated therewith. Of course, the registration and cutover logic could reside in hardware, software, or some combination of the two.
The procedures employed by the working and protection CMTSs during registration and pre-registration are preferably performed at the MAC layer of the CMTS logic. Thus, in CMTS 804, most of the registration operations would be performed by the hardware and software provided for MAC layer logic 830. Associated with the registration are adjustments to the cable modem's transmission power and transmission frequency. To allow MAC layer logic 830 to implement such adjustments, it may use power readings (and sometimes frequency and signal to noise ratio readings) from an amplitude estimator 816 forming part of the physical layer logic 832.
The operations associated with obtaining an IP address for cable modems are preferably implemented at the network layer lever 834. As noted, this may involve the CMTS communicating with a DHCP server via data network interface 802, for example. In addition, network layer logic 834 is typically responsible for the operations required to inject host routes into the appropriate routing protocols.
FIG. 8B presents a block diagram of a cable modem 890 suitable for use with this invention. As shown, modem 890 contains many logic blocks, hardware elements, and software elements similar to those of CMTS 804. A memory 857′ should be able to store registration parameters from both working and protection CMTSs. Note that rather than keeping track of information for all cable modems serviced by a CMTS interface, modem 890 need only keep track of its own parameter (e.g., power, frequency, time slots . . . ). Thus, the memory 857′ and processors 855′ need not have the storage and processing capacities of their counterparts in CMTS 804.
As shown, interface 802′ connects to a PC or other node associated with the cable modem. At the other end of modem 890, a module 806′ modulates and transmits upstream data and a module 814′ demodulates and receives downstream data. The roles of these blocks are reversed at the CMTS, which sits at the other end of the cable network. Further, the downstream and upstream lines combine directly to a coaxial cable 892.
The redundancy methods of this present invention may be implemented on various general purpose cable modem termination systems. In a specific embodiment, the systems of this invention may be specially configured CMTSs such as, for example, specially configured models in the uBR-7200 series of CMTSs available from Cisco Systems, Inc. of San Jose, Calif. In an alternative embodiment, the methods of this invention may be implemented on a general-purpose network host machine such as a personal computer or workstation. Further, the invention may be at least partially implemented on a card (e.g., an interface card) for a network device or a general-purpose computing device.
Although the system shown in FIG. 8A represents one specific CMTS architecture of the present invention, it is by no means the only CMTS architecture on which the present invention can be implemented. For example, other types of interfaces and media could also be used with the CMTS.
Regardless of network device's configuration (for cable plants or otherwise), it may employ one or more memories or memory modules (e.g., memory 857) configured to store program instructions for the network operations and other functions of the present invention described herein. The program instructions may specify an operating system and one or more applications, for example. Such memory or memories may also be configured to store data structures or other specific non-program information described herein.
Because such information and program instructions may be employed to implement the systems/methods described herein, the present invention relates to machine-readable media that include program instructions, state information, etc. for performing various operations described herein. Examples of machine-readable media include, but are not limited to, magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROM disks; magneto-optical media such as floptical disks; and hardware devices that are specially configured to store and perform program instructions, such as read-only memory devices (ROM) and random access memory (RAM). The invention may also be embodied in a carrier wave travelling over an appropriate medium such as airwaves, optical lines, electric lines, etc. Examples of program instructions include both machine code, such as produced by a compiler, and files containing higher level code that may be executed by the computer using an interpreter.
Presented below is a very specific methodology and message format to handle redundant CMTSs and a CMTS-cable modem (CM) protocol for quick ranging to the backup CMTS and quick cutover when needed. Many of the terms and procedures presented here are described in detail in the DOCSIS standard, version 1.1, previously incorporated by reference.
Media Access Control Specification
MAC Management Messages
Downstream Channel Change Request (DCC-REQ)
A DCC-REQ may be transmitted by a CMTS to a CM to switch to the downstream channel that the CM is using. The format of a DCC-REQ may be as shown in Figure below:
Figure USRE044661-20131224-C00001
Transaction ID Unique identifier for this transaction assigned by the CMTS
Action Code The appropriate Action Code; the CM may behave as follows
    • 0=Switch to the Protect downstream channel do initialization
    • 1=Switch to the Protect downstream channel do occasional ranging
    • 2=Switch to the Protect downstream channel after failure
    • 3=Switch to the Working downstream channel
    • All other parameters are coded as TLV tuples.
When the Action Code is 0, 1, or 2, the DCC-REQ message may contain the following TLVs. When Action Code is 3, the DCC-REQ message must contain the following TLVs.
Downstream Frequency The downstream frequency which the CM is to switch to.
Priority The priority of this backup channel
If the downstream frequency is not explicitly stated with the downstream frequency TLV, then the CM must choose a downstream frequency based upon the list of downsteam frequencies and their priorities that were provided during configuration. If the list does not exist, or the frequencies are not working, the CM must begin searching for a new downsteam.
When the Action Code is 0, 1, or 3, if the CMTS does not get a DCC-RSP after T9 timeout, it must retry.
The CMTS should provide each CM an Occasional Ranging opportunity with the Protect CMTS at least once every 24 hour period.
Downstream Channel Change Response (DCC-RSP)
An DCC-RSP must be transmitted by a CM to a CMTS in response to receiving a DCC-REQ if the DCC-REQ Action Code is a 0, 1, or 3. If DCC-REQ Action Code was a 0 or a 1, the CM must send a DCC-RSP after it has returned back from the Protect CMTS. If the DCC-REQ Action Code was a 3, the CM must send a DCC-RSP before it returns to the Working CMTS. If the DCC-REQ Action Code was a 2, the CM must not send a DCC-RSP.
The format of a DCC-RSP message may be as shown in Figure below:
Figure USRE044661-20131224-C00002
Transaction ID Transaction ID from corresponding DCC-REQ
Response 0=Okay
1=Failure
All other parameters are coded as TLV tuples.
The DCC-RSP message may contain:
Downstream Frequency The downstream frequency which the CM is to switch to.
Priority The priority of this backup channel
Cable Modem—CMTS Interaction
Cable Modem Initialization
For Working CMTS, following the standard procedure and:
Transfer Operational Parameters
The CM's config. file may contain the Backup Downstream Channel Set TLV. If present, the CM must send them in the Registration Request.
After the CM initializes with the Working CMTS, the Working CMTS should send a DCC-REQ with an Action Code of 0 to allow the CM to initialize with the Protect CMTS. When the CM registers with the Protect CMTS, it follows the standard procedure with the exception of skipping:
Establish IP Connecivity
Establish Time of Day
Transfer Operational Parameters
Several TLVs have been added in REG-REQ and REG-RSP.
Registration
Registration Request must contain the following TLVs:
    • Modem Primary SID for Protect CMTS with Initialization SID 0;
    • Modem IP Address for Protect CMTS with the CM's current IP address;
The Registration Response must contain the following TLVs:
Modem Primary SID for Protect CMTS with the assigned primary SID if provided now or Initialization SID 0 if provided later during failure-over.
Modem IP Address for Protect CMTS with the same IP address if it can support or Initialization IP address of 0.0.0.0 if CM must invoke DHCP mechanisms to obtain an IP address later when failure.
Modem Occasional Ranging SID for Protect CMTS. The Protect CMTS must allocate a contention ranging opportunity with a region large enough to account for the variation in delays between any two CMs.
Modem Failure Ranging SID for Protect CMTS. The Protect CMTS must allocate a contention ranging opportunity with region large enough to account for the variation in delays between any two CMs.
Baseline Privacy Initialization
If the CM is provisioned to run Baseline Privacy, the CM must skip it now, and initialize Baseline Privacy operations later during failure switch.
Standard Operation
Changing Downstream Channels
The Working CMTS must provide each CM an Occasional Ranging opportunity with the Protect CMTS at least once every 24 hour period by sending a DCC-REQ with an Action Code equal to 1. If the CMTS does not get DCC-RSP after T9 timeout, it must retry.
When a CM performs Occasional Ranging with the Protect CMTS, the CM must send the RNG-REQ message using the Occasional Ranging SID. If the Occasional Ranging SID is equal to the Initialization SID 0, than the CM must use the ranging backoff parameter in the current MAP. The Protect CMTS must allocate a contention ranging opportunity with a region large enough to account for the variation in delays between any two CM. The CM must finish Occasional Ranging within T9 timeout.
The CM may accumulate the adjustment of the ranging parameters with the Working CMTS, and apply it to the ranging parameters for the Protect CMTS to better estimate the CM's initial ranging parameters when switching to the Protect CMTS.
Changing Upstream Burst Parameters
Never change for Protect CMTS
Changing Upstream Channels
Never change for Protect CMTS
Failure Switch Mode
When a CM receives a DCC-REQ with Action Code 2 or when a CM detects downstream failure, the CM will Failure Switch using the following steps:
    • step1: CM switches downstream channels and synchronize with the Protect downstream channel.
    • step2: For Failure Ranging, the CM must send the RNG-REQ using the Failure Ranging SID. The Protect CMTS must send the RNG-RSP message with the Ranging Status=“success” and with the a Primary SID for use with the Protect CMTS.
    • step3: If the CM IP Address for Protect CMTS is the Initialization IP address of 0.0.0.0, then the CM must invoke DHCP mechanisms to obtain an IP address.
    • step4: If the CM is provisioned to run Baseline Privacy, the CM must initialize Baseline Privacy operations.
The Protect CMTS must allocate contention ranging opportunities with a region large enough to account for the variation in delays between any two CMs.
Parameters and Constants
System Name Time Reference Minimum Value Default Value Maximum Value
CMTS T9 Wait for DCC-RSP 5
CMTS DCC-REQ Retries Number of Retries on DCC-REQ 3
Common Radio Frequency Interface Encodings
Backup Downstream Channel Set: This field defines the parameters associated with Backup Downstream Channels
Type Length Value: 29 n
Priority: The priority of this backup channel
Type Length Value: 29.1 1 0-7
More than one backup downstream channel may have the same priority. In this case, the CM must scan for these channels from lowest to highest frequency.
Downstream Frequency: The receive frequency to be used by the CM. This is the center frequency of the downstream channel in Hz stored as a 32-bit binary number. Downstream Frequency is the unique index of the Backup Downstream Channel Set.
Type Length Value: 29.2 4 Rx Frequency
Valid Range: The receive frequency must be a multiple of 62599 Hz
Downstream In-Active Timer: Timer in msec that the CM uses to detect downstream failure before it switchs to the Protect CMTS. This timer should be a level timer based on the highest QoS the CM has.
Type Length Value: 29.4 4 Downstream in-active timer
Modem Primary SID for Protect CMTS: This is a 16-bit field of which the lower 14 bits define the SID with bits 14 and 15 defined to be 0. During initialization with Protect CMTS, the CM must send REG-REQ message containing this TLV with an Initialization SID 0. Protect CMTS must send REG-RSP message containing this TLV with an assigned Primary SID if provided now or Initialization SID of 0 if provided later when a failure occurs. During failure switchover, the Protect CMTS must send RNG-RSP message with Ranging Status=“success”, containing this TLV with the assigned primary SID.
Type Length Value: 29.5 2 SID
Modem IP Address for Protect CMTS: The IP address of the CM when it is in normal operation with the Protect CMTS. During initialization with the Protect CMTS, the CM must send REG-REQ message containing this TLV with its current IP address. The Protect CMTS must send a REG-RSP message containing this TLV with the same IP address if it can support the address, or the Initialization IP address of 0.0.0.0 if it cannot. If the CM receives 0.0.0.0, the CM must invoke DHCP mechanisms to obtain an IP address when it performs registration on the Protect CMTS.
Type Length Value: 29.6 4 IP Address
Modem Occasional Ranging SID for Protect CMTS: SID is a 16-bit field of which the lower 14 bits define the SID with bits 14, 15 defined to be 0. During initialization with Protect CMTS, Protect CMTS must send REG-RSP message contains this TLV. When CM do Occasional Ranging with Protect CMTS, CM must send the RNG-REQ use this Occasional Ranging SID, if Occasional Ranging SID is Initialization SID 0, than use the ranging backoff in the current MAP. Protect CMTS must allocate contention ranging opportunity with region large enough to account for the variation in delays between any two CMs, CM must finish Occasional Ranging within T9 timeout.
Type Length Value: 29.7 4 SID,
Occasional Ranging backoff start,
Occasional Ranging backoff end
Modem Failure Ranging SID for Protect CMTS: The SID is a 16-bit field of which the lower 14 bits define the SID with bits 14 and 15 defined to be 0. During the initialization with Protect CMTS, the Protect CMTS must send a REG-RSP message containing this TLV. During failure switchover, when the CM does Failure Ranging with the Protect CMTS, the CM must send the RNG-REQ using this Failure Ranging SID. The Protect CMTS must send a RNG-RSP with Ranging Status=“success” message and containing the Modem Primary SID for Protect CMTS TLV with the assigned Primary SID. The Protect CMTS must allocate a contention ranging opportunity with a region large enough to account for the variation in delays between any two CMs.
Type Length Value: 29.8 4 SID,
Failure Ranging backoff start,
Failure Ranging backoff end
CMTS Redundancy
Overview
DOCSIS systems which are intended to be used for high availability applications such as voice or mission critical data need to be able to offer rundancy in equipment in order to protect from either CMTS failure of HFC plant failure. The general approach that DOCSIS follows is to provide the CM access to two (or more) CMTS domains, and let the CM switch-over from the first CMTS, known as the Working CMTS, to the second CMTS, known as the Protect CMTS, when the CM determines there is a failure with the Working CMTS.
The issues addressed include:
    • What is the criteria for the CM to switch from the Working CMTS to Protect CMTS,
    • What is the criteria for the CM to switch from the Protect CMTS to Working CMTS.
    • Allowing the Working and Protect CMTS to support traffic at the same time.
    • Allowing the CM to be moved between CMTS domains for the purposes of load sharing.
    • Ranging on the Protect CMTS.
    • Management of Service Flows, SIDs, IP Addresses, and Baseline Privacy between the two CMTSs.
In order to quickly switch the CM to from the Working CMTS to the Protect CMTS, the CM needs to pre-initialization and perform occasional ranging with the Protect CMTS. The operation of the CM with the Protect CMTS can be classified as four states:
Pre-Initialization: The CM will partially initialize with the Protect CMTS.
Occasional Ranging: The CM will perform occasional ranging with the Protect CMTS
Failure Switch: The CM will perform final initialization with the Protect CMTS during failure
Normal Operation: Standard operation
For Pre-Initialization, the challenges are:
CM may not get a primary SID assigned;
CM's current IP address may not be supported by the Protect CMTS;
CM must not initialize Baseline Privacy operations if the CM is provisioned to run Baseline Privacy.
The solution is for the CM to perform final initialization with Protect CMTS during failure.
For Occasional Ranging, the challenges are:
    • CM may not get a primary SID assigned;
    • each ranging opportunity must be quick enough;
    • each region must be large enough to account for variation in delays between any two CMs.
The solution is to allocate a quick contention ranging opportunity to Modem Occasional Ranging SID for Protect CMTS. This is similar in concept to the Initial Maintenance IE.
For Failure Switch, the challenges are:
CM must first does Failure Ranging which has the same problems as Occasional Ranging, than final initial with Protect CMTS.
The solution is to allocate a much more quicker contention ranging opportunity to Modem Failure Ranging SID for Protect CMTS. This is similiar in concept to the Initial Maintenance IE. The CM gets a Primary SID assigned in RNG-RSP with Ranging Status=success message. The CM must invoke DHCP mechanisms to obtain an IP address and must initialize Baseline Privacy operations if the CM is provisioned to run Baseline Privacy.
For Normal Operation, the challenge is:
Protect CMTS may not support that many CMs at normal operation.
The solution is for the Protect CMTS to send the CM back to its Working CMTS or some other Working CMTS.
D. Other Embodiments
Setting working and protection paths, as described above, has another application beyond merely providing redundancy. Typically installing new software on a cable network is very problematic, mainly because the types of bugs and how to remedy them are unknown ahead of time. Thus, there must a period of service time in which the network may experience significant problems associated with the new software's bugs. In fact, the network performance can be so poor, that the old software is reinstalled. By providing a protection path, the new software can be tested by some of the cable modems without disrupting service through the working path for most cable modems. Thus, the new software and its affects on the cable network can be characterized before it is used for actual service.
While the discussion to this point has focused on a redundancy technology for cable networks, the technology of the present invention may be applied to any shared-access network having a plurality of hosts or nodes which share at least one channel for communicating with at least one “head-end” in the network. Examples of shared-access networks include, in addition to cable networks, wireless networks, Ethernet, etc. In the cable network, the plurality of nodes represents a plurality of cable modems that communicate with at least one CMTS at the centralized termination system using at least one shared-access upstream and downstream channel.
In general, the methods and apparatus described above may be implemented on a protection device (e.g., a router) for providing redundancy in a network having (1) a working device (e.g., another router) that provides normal service to a host and (2) the protection device which takes over service to the host should service from the working device fail. Such general methods may include the following sequence: (a) pre-registering the host with the protection device before or after it registers with the working device; and (b) assuming a protection state in which the protection device can take over service of the host should its service with the working device fail. Generally, such methods (and associated apparatus) will be particularly valuable in the context of telephony service.
In the wireless system (e.g., represented by FIG. 9) the plurality of nodes or hosts corresponds to the plurality of wireless nodes 950 which use at least one shared access channel to communicate with at least one access control system 922 located at the head end of the wireless system.
As shown in FIG. 9, the wireless system includes a central termination system (or head end) 920. The head end includes a working access controller or access control system (ACS) 922 which communicates with a plurality of wireless nodes 950, and coordinates access between each of the wireless nodes and the head end 920. The access controller 922 may include memory and at least one processor. In a specific embodiment, the function of the access controller 922 is analogous to that of the CMTS described above with respect to cable modem networks. It may serve as a router as well.
The head end 920 communicates with a plurality of wireless nodes 950 via any one of a plurality of wireless transmitting and receiving devices 910. As shown in FIG. 9, for example, the plurality of wireless transmitting and receiving devices 910 may include satellite base stations 902, orbital satellites 906, radio towers 904, etc.
In a specific embodiment which is analogous to that of cable modem networks, the head end 920 of the wireless computer system communicates with the plurality of nodes 950 via one or more downlink channels 907 and one or more uplink channels 909. Each downlink channel 907 is a broadcast-type channel utilized by the head end to communicate with an associated group of wireless nodes within the wireless network. The uplink channel 909 is a shared-access channel, which is utilized by a group of wireless nodes (analogous to cable modems) to communicate with the head end 920.
The working access controller 922 stores registration parameters for the various nodes that it services. The access controller 922 may also store the IP addresses for nodes that it services while being backed up by a protection access controller 923. These IP addresses are also stored by protection access controller 922 to allow a smooth transition in service should working access controller 922 fail.
In a specific embodiment of the present invention, the registration process and information is similar to that of the cable network CMTSs described above. Moreover, the technique of the present invention for cutover using a single IP address for both the working and protection access controllers may be implemented in wireless system 900.
The wireless devices or nodes 950 may include any one of a number of wireless transmitting/receiving devices. For example, a satellite dish 952 may be used to communicate with the head end 920 via the uplink and downlink channels. The satellite dish may, in turn, be connected to a local area network (LAN) 930 which, may be further connected to one or more computer systems 932. Another wireless device may be a portable/wireless computer system 954, which is able to transmit and receive information to the head end via uplink and downlink channels 907 and 909. Other wireless devices 956 may include, for example, wireless telephones, handheld computing devices, etc.
In specific embodiments where the uplink and downlink channels within the wireless system 900 are utilized in a manner similar to that of the upstream and downstream channels of a cable modem network, the above-described redundancy methods may easily be implemented in wireless system 900 using the detailed description of the present invention provided herein. Moreover, the technique of the present invention may be easily implemented in any computer network which uses shared access channels for communicating between a centralized computing system and one or more remote nodes.
Although the foregoing invention has been described in some detail for purposes of clarity of understanding, it will be apparent that certain changes and modifications may be practiced within the scope of the appended claims. For example, while ranging was described above, other techniques for causing modems to transmit signals at predefined frequencies and amplitudes may be employed.

Claims (63)

What is claimed is:
1. A method implemented on a protection CMTS for providing redundancy for a cable network having a working CMTS that provides normal service to a cable modem and the protection CMTS which takes over service to the cable modem should service from the working CMTS become unavailable, the method comprising:
(a) at least partially registering the cable modem with the protection CMTS prior to the working CMTS becoming unavailable; and
(b) assuming a protection state in which the protection CMTS can take over service of the cable modem should its service with the working CMTS become unavailable,
wherein the cable modem is informed of an upstream channel of the protection CMTS.
2. The method of claim 1, wherein registering comprises specifying at least one of a transmission power, a transmission time slot, and or a transmission frequency at which the cable modem is to communicate with the protection CMTS should the cable modem service with the working CMTS become unavailable.
3. The method of claim 1, wherein registering comprises specifying one or more parameters as specified by DOCSIS.
4. The method of claim 1, wherein registering comprises noting an IP address for the cable modem, which IP address is used in communications between the cable modem and the working CMTS.
5. The method of claim 4, wherein the protection CMTS obtains the cable modem IP address in a communication from the cable modem.
6. The method of claim 4, wherein the protection CMTS obtains the cable modem IP address in a communication from the working CMTS.
7. The method of claim 1, wherein the service provided to the cable modem includes telephony service.
8. The method of claim 1, wherein during the protection state, the protection CMTS periodically establishes communication with the cable modem.
9. The method of claim 8, wherein the communication includes instructions to the cable modem to adjust at least one of a transmission power and or a transmission frequency at which the cable modem is to communicate with the protection CMTS should service with the working CMTS become unavailable.
10. The method of claim 1, further comprising:
(c) determining that the working CMTS's service to the cable modem has or will become unavailable; and
(d) taking over service to the cable modem.
11. A method implemented on a protection router for providing redundancy in a network having a working router that provides normal service to a host and the protection router which takes over service to the host should service from the working router become unavailable, the method comprising:
(a) at least partially registering the host with the protection router prior to the working router becoming unavailable; and
(b) assuming a protection state in which the protection router can take over service of the host should its service with the working router become unavailable, wherein the service includes telephony service,
wherein the host is informed of an upstream channel of the protection router.
12. The method of claim 1 11, wherein the network is a wireless network.
13. A CMTS designed or configured to act as a protection CMTS for a cable network having a working CMTS that provides normal service to a cable modem and the protection CMTS which takes over service to the cable modem should the service from the working CMTS become unavailable, the CMTS comprising:
(a) one or more processors;
(b) memory in communication with at least one of the one or more processors; and
(c) wherein at least one of the one or more processors are configured to store registration data for the cable modem in the memory, and wherein the CMTS is configured to not provide communication service to the cable modem unless the service from the working CMTS should become unavailable and wherein the CMTS is configured to store the registration data at a time prior to the working CMTS becoming unavailable,
wherein the cable modem is informed of an upstream channel of the CMTS.
14. The CMTS of claim 13, wherein the registration data includes at least one of a transmission power, transmission time slots, and or a transmission frequency at which the cable modem is to communicate with the protection CMTS should the cable modem service with the working CMTS become unavailable.
15. The CMTS of claim 13, wherein the processors and memory are configured to implement DOCSIS.
16. The CMTS of claim 13, wherein the registration data includes an IP address for the cable modem, which IP address is used in communications between the cable modem and the working CMTS.
17. The CMTS of claim 13, wherein the processors and memory are configured to periodically establish communication with the cable modem.
18. The CMTS of claim 13, wherein the CMTS is designed or configured to perform routing operations.
19. A computer program product comprising a machine readable medium on which is stored program instructions for a method implemented on a protection CMTS, the method providing redundancy for a cable network having a working CMTS that provides normal service to a cable modem and the protection CMTS which takes over service to the cable modem should the service from the working CMTS become unavailable, the program instructions comprising instructions for:
(a) at least partially registering the cable modem with the protection CMTS prior to the working CMTS becoming unavailable; and
(b) assuming a protection state in which the protection CMTS can take over service of the cable modem should its service with the working CMTS become unavailable,
wherein the cable modem is informed of an upstream channel of the protection CMTS.
20. The computer program product of claim 19, wherein the instruction for registering requires specifying at least one of a transmission power, a transmission frequency, and or transmission time slots at which the cable modem is to communicate with the protection CMTS should the cable modem service with the working CMTS become unavailable.
21. The computer program product of claim 19, wherein the instructions for registering comprise operations compliant with DOCSIS.
22. The computer program product of claim 19, wherein the instructions for registering comprise instructions for noting an IP address for the cable modem, which IP address is used in communications between the cable modem and the working CMTS.
23. The computer program product of claim 19, further comprising instructions for periodically establishing communication with the cable modem which the protection CMTS is in the protection state.
24. The computer program product of claim 19, further comprising instructions for:
(c) determining that the working CMTS's services to the cable modem has become unavailable; and
(d) taking over service to the cable modem.
25. A method implemented on a protection CMTS for providing redundancy for a cable network having a working CMTS that provides normal service to a cable modem and the protection CMTS which takes over service to the cable modem should service from the working CMTS become unavailable, the method comprising:
(a) at least partially registering the cable modem with the protection CMTS prior to the working CMTS becoming unavailable;
(b) thereafter, determining that the working CMTS's service to the cable modem has become unavailable; and
(c) taking over service to the cable modem,
wherein the cable modem is informed of an upstream channel of the protection CMTS.
26. The method of claim 25, wherein taking over service comprises using registration parameters for the cable modem, which registration parameters were previously provided to the protection CMTS.
27. The method of claim 26, wherein the registration parameters include an IP address for the cable modem, which IP address is used in communications between the cable modem and the working CMTS.
28. The method of claim 26, wherein the registration parameters include at least one of a transmission power, a transmission frequency, and or transmission time slots at which the cable modem is to communicate with the protection CMTS should the cable modem service with the working CMTS become unavailable.
29. The method of claim 25, wherein the service provided to the cable modem includes telephony service.
30. The method of claim 25, wherein determining that the working CMTS's service to the cable modem has become unavailable comprises receiving a communication indicating such unavailability from at least one of the cable modem and or the working CMTS.
31. The method of claim 25, further comprising providing routing services to one or more cable modems in the cable network.
32. The method of claim 30, wherein the communication indicating unavailability is a downstream channel change request.
33. A cable modem designed or configured for use on a cable network having a first CMTS that provides normal service to a cable modern and a second CMTS which takes over service to the cable modem should the service from the first CMTS become unavailable, the cable modem comprising;
(a) a cable network interface; and
(b) memory,
wherein the cable modem is configured to
register with the first CMTS,
be informed of an upstream channel for the second to CMTS,
register with the second CMTS using the upstream channel for the second CMTS, and
store registration data obtained from the second CMTS.
34. The cable modem of claim 33, wherein the registration data further comprises an IP address that is used for communications through both the working CMTS and the protection CMTS.
35. The cable modem of claim 33, wherein the registration data includes (i) at least one of a transmission power, transmission time slots, and or a transmission frequency at which the cable modem is to communicate with the protection CMTS should the cable modem service with the working CMTS become unavailable, and (ii) similar transmission data for communication with the working CMTS.
36. The cable modem of claim 33, wherein the cable modem is designed or configured to implement DOCSIS.
37. The cable modem of claim 36, wherein the cable modem is designed or configured to send a channel change response in response to a downstream channel change request from the working CMTS.
38. A protection CMTS for providing redundancy for a cable network having a working CMTS that provides normal service to a cable modem, the protection CMTS taking over service to the cable modem should service from the working CMTS become unavailable, the protection CMTS comprising:
(a) means for at least partially registering the cable modem with the protection CMTS prior to the working CMTS becoming unavailable; and
(b) means for, prior to the working CMTS becoming unavailable, assuming a protection state in which the protection CMTS can take over service of the cable modem should its service with the working CMTS become unavailable,
wherein the cable modem is informed of an upstream channel of the protection CMTS.
39. The method of claim 1, further comprising:
after registration, but before the protection CMTS takes over, requesting that the cable modem change one or more parameters to optimize communication on a path between the protection CMTS and the cable modem.
40. The method of claim 11, further comprising:
after registration, but before the protection router takes over, requesting that the cable modem change one or more parameters to optimize communication on a path between the protection router and the cable modem.
41. The cable modem of claim 33, wherein the cable modem is configured to be informed of the second CMTS's upstream charnel by the first CMTS.
42. The CMTS of claim 16, wherein at least one of the one or more processors of the CMTS is configured to obtain the cable modem IP address in a communication from the cable modem.
43. The CMTS of claim 16, wherein at least one of the one or more processors of the CMTS is configured to obtain the cable modem IP address in a communication from the working CMTS.
44. The CMTS of claim 13, wherein the service provided to the cable modem includes telephony service.
45. The CMTS of claim 17, wherein the communication includes instructions to the cable modem to adjust at least one of a transmission power or a transmission frequency at which the cable modem is to communicate with the protection CMTS should service with the working CMTS become unavailable.
46. The CMTS of claim 13, wherein at least one of the one or more processors are configured further to:
determine that the working CMTS's service to the cable modem has or will become unavailable; and
take over service to the cable modem.
47. The CMTS of claim 13, wherein at least one of the one or more processors are configured further to:
after registration, but before the protection CMTS takes over, request that the cable modem change one or more parameters to optimize communication on a path between the protection CMTS and the cable modem.
48. A CMTS designed or configured to act as a protection CMTS for a cable network having a working CMTS that provides normal service to a cable modem and the protection CMTS which takes over service to the cable modem should service from the working CMTS become unavailable, the CMTS comprising:
one or more processors; and
memory in communication with at least one of the one or more processors;
wherein at least one of the one or more processors are configured to
(a) at least partially register the cable modem with the protection CMTS prior to the working CMTS becoming unavailable;
(b) thereafter, determine that the working CMTS's service to the cable modem has become unavailable; and
(c) take over service to the cable modem,
wherein the cable modem is informed of an upstream channel of the protection CMTS.
49. The CMTS of claim 48, wherein at least one of the one or more processors of the CMTS is configured to take over service by using registration parameters for the cable modem, which registration parameters were previously provided to the protection CMTS.
50. The CMTS of claim 49, wherein the registration parameters include an IP address for the cable modem, which IP address is used in communications between the cable modem and the working CMTS.
51. The CMTS of claim 49, wherein the registration parameters include at least one of a transmission power, a transmission frequency, or transmission time slots at which the cable modem is to communicate with the protection CMTS should the cable modem service with the working CMTS become unavailable.
52. The CMTS of claim 48, wherein the service provided to the cable modem includes telephony service.
53. The CMTS of claim 48, wherein at least one of the one or more processors of the CMTS is configured to determine that the working CMTS's service to the cable modem has become unavailable comprises receiving a communication indicating such unavailability from at least one of the cable modem or the working CMTS.
54. The CMTS of claim 53, wherein the communication indicating unavailability is a downstream channel change request.
55. The CMTS of claim 48, wherein at least one of the one or more processors are configured further to provide routing services to one or more cable modems in the cable network.
56. A method implemented on a cable modem designed or configured for use on a cable network having a first CMTS that provides normal service to a cable modem and a second CMTS which takes over service to the cable modem should the service from the first CMTS become unavailable, the method comprising:
registering with the first CMTS;
receiving information about an upstream channel for the second CMTS;
registering with the second CMTS using the upstream channel for the second CMTS; and
storing registration data obtained from the second CMTS.
57. The method of claim 56, wherein the registration data includes an IP address that is used for communications through both the working CMTS and the protection CMTS.
58. The method of claim 56, wherein the registration data includes (i) at least one of a transmission power, transmission time slots, or a transmission frequency at which the cable modem is to communicate with the protection CMTS should the cable modem service with the working CMTS become unavailable, and (ii) similar transmission data for communication with the working CMTS.
59. The method of claim 56, wherein the cable modem is designed or configured to implement DOCSIS.
60. The method of claim 59, wherein the cable modem is designed or configured to send a channel change response in response to a downstream channel change request from the working CMTS.
61. The method of claim 56, wherein the cable modem is configured to be informed of the second CMTS's upstream channel by the first CMTS.
62. A computer program product comprising a machine readable medium on which is stored program instructions for a method implemented on a cable modem designed or configured for use on a cable network having a first CMTS that provides normal service to a cable modem and a second CMTS which takes over service to the cable modem should the service from the first CMTS become unavailable, the program instructions comprising instructions for:
registering with the first CMTS,
receiving information about an upstream channel for the second CMTS,
registering with the second CMTS using the upstream channel for the second CMTS, and
storing registration data obtained from the second CMTS.
63. A cable modem designed or configured for use on a cable network having a first CMTS that provides normal service to a cable modem and a second CMTS which takes over service to the cable modem should the service from the first CMTS become unavailable, the cable modem comprising:
means for registering with the first CMTS;
means for receiving information about an upstream channel for the second CMTS;
means for registering with the second CMTS using the upstream channel for the second CMTS; and
means for storing registration data obtained from the second CMTS.
US11/636,725 2000-01-18 2006-12-06 Method for a cable modem to rapidly switch to a backup CMTS Expired - Fee Related USRE44661E1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11/636,725 USRE44661E1 (en) 2000-01-18 2006-12-06 Method for a cable modem to rapidly switch to a backup CMTS

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/484,611 US7058007B1 (en) 2000-01-18 2000-01-18 Method for a cable modem to rapidly switch to a backup CMTS
US11/636,725 USRE44661E1 (en) 2000-01-18 2006-12-06 Method for a cable modem to rapidly switch to a backup CMTS

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/484,611 Reissue US7058007B1 (en) 2000-01-18 2000-01-18 Method for a cable modem to rapidly switch to a backup CMTS

Publications (1)

Publication Number Publication Date
USRE44661E1 true USRE44661E1 (en) 2013-12-24

Family

ID=36568976

Family Applications (2)

Application Number Title Priority Date Filing Date
US09/484,611 Ceased US7058007B1 (en) 2000-01-18 2000-01-18 Method for a cable modem to rapidly switch to a backup CMTS
US11/636,725 Expired - Fee Related USRE44661E1 (en) 2000-01-18 2006-12-06 Method for a cable modem to rapidly switch to a backup CMTS

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09/484,611 Ceased US7058007B1 (en) 2000-01-18 2000-01-18 Method for a cable modem to rapidly switch to a backup CMTS

Country Status (1)

Country Link
US (2) US7058007B1 (en)

Families Citing this family (62)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6760316B1 (en) * 1998-10-30 2004-07-06 Broadcom Corporation Method and apparatus for the synchronization of multiple cable modem termination system devices
US6751191B1 (en) 1999-06-29 2004-06-15 Cisco Technology, Inc. Load sharing and redundancy scheme
US7058007B1 (en) 2000-01-18 2006-06-06 Cisco Technology, Inc. Method for a cable modem to rapidly switch to a backup CMTS
US7535826B1 (en) * 2000-12-11 2009-05-19 Juniper Networks, Inc Routing protocols for accommodating nodes with redundant routing facilities
US7603033B1 (en) 2001-06-28 2009-10-13 Netapp, Inc. Fault tolerant optical data communication network
US7263060B1 (en) 2001-06-28 2007-08-28 Network Appliance, Inc. Multiple switch protected architecture
WO2003028374A1 (en) * 2001-09-27 2003-04-03 Broadcom Corporation Synchronization of multiple cable modem termination systems
US7227838B1 (en) 2001-12-14 2007-06-05 Cisco Technology, Inc. Enhanced internal router redundancy
US7739393B2 (en) * 2002-01-28 2010-06-15 Cisco Technology, Inc. Apparatus and method for restoring traffic during failover in a cable head end
US7020157B2 (en) * 2002-05-09 2006-03-28 Optical Solutions, Inc. Network address assignment in a passive optical network
US7174376B1 (en) 2002-06-28 2007-02-06 Cisco Technology, Inc. IP subnet sharing technique implemented without using bridging or routing protocols
AU2003247862A1 (en) * 2002-07-15 2004-02-02 Flarion Technologies, Inc. Methods and apparatus for improving resiliency of communication networks
JP4083169B2 (en) * 2002-11-29 2008-04-30 富士通株式会社 Communication apparatus, control method, and program
US7577088B2 (en) * 2003-01-17 2009-08-18 Adtran, Inc. System and method to backup communication occurring across a plurality of subscriber lines
US7720002B1 (en) * 2003-07-10 2010-05-18 Juniper Networks, Inc. Systems and methods for initializing cable modems
KR100575945B1 (en) * 2003-08-26 2006-05-02 삼성전자주식회사 Gigabit ethernet passive optical network having double link structure and double link setting method using that
US7467321B1 (en) * 2003-11-26 2008-12-16 Cisco Technology, Inc. Fast software fault detection and notification to a backup unit
US8059661B2 (en) * 2004-12-29 2011-11-15 Cisco Technology, Inc. Methods and apparatus for using DHCP for home address management of nodes attached to an edge device and for performing mobility and address management as a proxy home agent
US7539193B2 (en) * 2005-01-27 2009-05-26 Time Warner Cable, Inc. System and method for facilitating communication between a CMTS and an application server in a cable network
US20070064593A1 (en) * 2005-09-01 2007-03-22 Tim Scale Method and system for automatically resetting a cable access module upon detection of a lock-up
US20070076790A1 (en) * 2005-09-30 2007-04-05 Thibeault Brian K Method and apparatus for testing a network using a spare receiver
US7724647B2 (en) * 2005-11-08 2010-05-25 Arris Group, Inc. Method and system for fast channel change in a DOCSIS set top gateway device
US7903585B2 (en) 2006-02-15 2011-03-08 Cisco Technology, Inc. Topology discovery of a private network
US8594118B2 (en) 2006-03-24 2013-11-26 General Instrument Corporation Method and apparatus for configuring logical channels in a network
US9088355B2 (en) 2006-03-24 2015-07-21 Arris Technology, Inc. Method and apparatus for determining the dynamic range of an optical link in an HFC network
US8085790B2 (en) * 2006-07-14 2011-12-27 Cisco Technology, Inc. Ethernet layer 2 protocol packet switching
US8537972B2 (en) 2006-12-07 2013-09-17 General Instrument Corporation Method and apparatus for determining micro-reflections in a network
US7957296B2 (en) * 2007-01-02 2011-06-07 Intel Corporation Apparatus for and method of detecting loss of signal in a radio frequency cable
US7843810B2 (en) * 2007-07-30 2010-11-30 Cisco Technology, Inc. Keeping modems online upon N+1 switchover in cable modem termination systems
US7839773B2 (en) 2008-03-14 2010-11-23 Cisco Technology, Inc. Modem timing offset compensation for line card redundancy failover
US8224936B2 (en) * 2008-05-21 2012-07-17 Cisco Technology, Inc. Configuration file override
US8908500B1 (en) * 2008-07-30 2014-12-09 Adtran, Inc. Systems and methods for protecting bonding engines in network communications
US7764692B1 (en) * 2008-08-05 2010-07-27 Cisco Technology, Inc. Bypass of routing protocol filtering in a multi-subnet network
US7986690B2 (en) * 2008-08-12 2011-07-26 Cisco Technology, Inc. Inter-gateway cloned device detector using provisioning request analysis
US8335917B2 (en) 2008-08-12 2012-12-18 Cisco Technology, Inc. System for binding a device to a gateway to regulate service theft through cloning
US9203638B2 (en) * 2008-11-11 2015-12-01 Arris Enterprises, Inc. CMTS plant topology fault management
CN101902419B (en) * 2009-05-27 2013-02-13 鸿富锦精密工业(深圳)有限公司 Cable modem and method thereof for keeping communication linkage
US8516532B2 (en) * 2009-07-28 2013-08-20 Motorola Mobility Llc IP video delivery using flexible channel bonding
US8526485B2 (en) 2009-09-23 2013-09-03 General Instrument Corporation Using equalization coefficients of end devices in a cable television network to determine and diagnose impairments in upstream channels
US8654640B2 (en) 2010-12-08 2014-02-18 General Instrument Corporation System and method for IP video delivery using distributed flexible channel bonding
US8937992B2 (en) 2011-08-30 2015-01-20 General Instrument Corporation Method and apparatus for updating equalization coefficients of adaptive pre-equalizers
US9479353B2 (en) * 2011-10-13 2016-10-25 Cisco Technology, Inc. Selective reestablishment of cable modem internet protocol connectivity
US8576705B2 (en) 2011-11-18 2013-11-05 General Instrument Corporation Upstream channel bonding partial service using spectrum management
US9113181B2 (en) 2011-12-13 2015-08-18 Arris Technology, Inc. Dynamic channel bonding partial service triggering
US8867371B2 (en) 2012-04-27 2014-10-21 Motorola Mobility Llc Estimating physical locations of network faults
US8837302B2 (en) 2012-04-27 2014-09-16 Motorola Mobility Llc Mapping a network fault
US9003460B2 (en) 2012-04-27 2015-04-07 Google Technology Holdings LLC Network monitoring with estimation of network path to network element location
US8868736B2 (en) 2012-04-27 2014-10-21 Motorola Mobility Llc Estimating a severity level of a network fault
US9065731B2 (en) 2012-05-01 2015-06-23 Arris Technology, Inc. Ensure upstream channel quality measurement stability in an upstream channel bonding system using T4 timeout multiplier
US8989221B2 (en) * 2012-06-04 2015-03-24 Cisco Technology, Inc. System and method for discovering and verifying a hybrid fiber-coaxial topology in a cable network environment
US9136943B2 (en) 2012-07-30 2015-09-15 Arris Technology, Inc. Method of characterizing impairments detected by equalization on a channel of a network
US9137164B2 (en) 2012-11-15 2015-09-15 Arris Technology, Inc. Upstream receiver integrity assessment for modem registration
US9203639B2 (en) 2012-12-27 2015-12-01 Arris Technology, Inc. Dynamic load balancing under partial service conditions
US9197886B2 (en) 2013-03-13 2015-11-24 Arris Enterprises, Inc. Detecting plant degradation using peer-comparison
US9025469B2 (en) 2013-03-15 2015-05-05 Arris Technology, Inc. Method for estimating cable plant topology
US9042236B2 (en) 2013-03-15 2015-05-26 Arris Technology, Inc. Method using equalization data to determine defects in a cable plant
US10477199B2 (en) 2013-03-15 2019-11-12 Arris Enterprises Llc Method for identifying and prioritizing fault location in a cable plant
CN104901883B (en) * 2014-03-06 2018-12-04 中国移动通信集团广东有限公司 A kind of configuration method of router, device and standby usage business router
CN103905338B (en) * 2014-04-01 2017-03-08 中国联合网络通信集团有限公司 The method and device that a kind of IP backbone merges
CN105790993B (en) * 2014-12-25 2019-09-06 中兴通讯股份有限公司 A kind of cut over method, apparatus and BAS Broadband Access Server
CN110611690B (en) 2018-06-15 2022-05-10 上海诺基亚贝尔股份有限公司 Method for master core device reselection, remote device and computer readable medium
CN113785537B (en) * 2019-02-27 2023-04-04 迈凌亚洲新加坡私人有限公司 Copper backhaul for hybrid fiber coaxial networks

Citations (213)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4692918A (en) 1984-12-17 1987-09-08 At&T Bell Laboratories Reliable local data network arrangement
US4827411A (en) 1987-06-15 1989-05-02 International Business Machines Corporation Method of maintaining a topology database
US4965772A (en) 1987-06-15 1990-10-23 International Business Machines Corporation Method and apparatus for communication network alert message construction
US5016244A (en) 1989-09-08 1991-05-14 Honeywell Inc. Method for controlling failover between redundant network interface modules
US5018133A (en) 1987-11-18 1991-05-21 Hitachi, Ltd. Network system comprising a plurality of LANs using hierarchical routing
US5218600A (en) 1989-06-19 1993-06-08 Richard Hirschmann Gmbh & Co. Process for networking computers and/or computer networks and networking systems
US5315592A (en) 1992-04-23 1994-05-24 Xyplex Inc. Parallel bridging
US5371852A (en) 1992-10-14 1994-12-06 International Business Machines Corporation Method and apparatus for making a cluster of computers appear as a single host on a network
US5414704A (en) 1992-10-22 1995-05-09 Digital Equipment Corporation Address lookup in packet data communications link, using hashing and content-addressable memory
US5423002A (en) 1992-04-20 1995-06-06 3Com Corporation System for extending network resources to remote networks
US5452447A (en) 1992-12-21 1995-09-19 Sun Microsystems, Inc. Method and apparatus for a caching file server
WO1995029544A1 (en) 1994-04-22 1995-11-02 Cisco Systems, Inc. Standby router protocol
US5488412A (en) 1994-03-31 1996-01-30 At&T Corp. Customer premises equipment receives high-speed downstream data over a cable television system and transmits lower speed upstream signaling on a separate channel
US5506987A (en) 1991-02-01 1996-04-09 Digital Equipment Corporation Affinity scheduling of processes on symmetric multiprocessing systems
US5511208A (en) 1993-03-23 1996-04-23 International Business Machines Corporation Locating resources in computer networks having cache server nodes
US5515429A (en) 1991-03-12 1996-05-07 Fujitsu Limited Backup apparatus against line defect and backup method against line defect
US5541911A (en) 1994-10-12 1996-07-30 3Com Corporation Remote smart filtering communication management system
US5544320A (en) 1993-01-08 1996-08-06 Konrad; Allan M. Remote information service access system based on a client-server-service model
US5555244A (en) 1994-05-19 1996-09-10 Integrated Network Corporation Scalable multimedia network
US5572528A (en) 1995-03-20 1996-11-05 Novell, Inc. Mobile networking method and apparatus
US5586121A (en) 1995-04-21 1996-12-17 Hybrid Networks, Inc. Asymmetric hybrid access system and method
US5611049A (en) 1992-06-03 1997-03-11 Pitts; William M. System for accessing distributed data cache channel at each network node to pass requests and data
US5619552A (en) 1993-08-20 1997-04-08 Nokia Telecommunications Oy Arrangement and method for location registration
US5644720A (en) 1995-07-31 1997-07-01 West Publishing Company Interprocess communications interface for managing transaction requests
US5644713A (en) 1994-05-12 1997-07-01 The Furukawa Electric Co., Ltd. Method of effecting dynamic management of path or routing information without requiring an internetworking operation for routing
US5729537A (en) 1996-06-14 1998-03-17 Telefonaktiebolaget L M Ericsson (Publ) Method and apparatus for providing anonymous data transfer in a communication system
US5740375A (en) 1996-02-15 1998-04-14 Bay Networks, Inc. Forwarding internetwork packets by replacing the destination address
USRE35774E (en) 1991-09-10 1998-04-21 Hybrid Networks, Inc. Remote link adapter for use in TV broadcast data transmission system
US5751971A (en) 1995-07-12 1998-05-12 Cabletron Systems, Inc. Internet protocol (IP) work group routing
US5774660A (en) 1996-08-05 1998-06-30 Resonate, Inc. World-wide-web server with delayed resource-binding for resource-based load balancing on a distributed resource multi-node network
WO1998031107A2 (en) 1997-01-07 1998-07-16 Gifford David K Replica routing
US5787470A (en) 1996-10-18 1998-07-28 At&T Corp Inter-cache protocol for improved WEB performance
US5793763A (en) 1995-11-03 1998-08-11 Cisco Technology, Inc. Security system for network address translation systems
US5825759A (en) 1994-10-26 1998-10-20 Telefonaktiebolaget Lm Ericsson Distributing network services and resources in a mobile communications network
US5835696A (en) 1995-11-22 1998-11-10 Lucent Technologies Inc. Data router backup feature
US5848241A (en) 1996-01-11 1998-12-08 Openframe Corporation Ltd. Resource sharing facility functions as a controller for secondary storage device and is accessible to all computers via inter system links
US5852717A (en) 1996-11-20 1998-12-22 Shiva Corporation Performance optimizations for computer networks utilizing HTTP
US5862345A (en) 1996-02-07 1999-01-19 Nec Corporation System for location multicasting and database management for mobile sessions in any computer subnetworks without using a home router of a home subnetwork
US5862451A (en) 1996-01-22 1999-01-19 Motorola, Inc. Channel quality management in a cable telephony system
US5872773A (en) 1996-05-17 1999-02-16 Lucent Technologies Inc. Virtual trees routing protocol for an ATM-based mobile network
US5892903A (en) 1996-09-12 1999-04-06 Internet Security Systems, Inc. Method and apparatus for detecting and identifying security vulnerabilities in an open network computer communication system
US5940596A (en) 1996-03-25 1999-08-17 I-Cube, Inc. Clustered address caching system for a network switch
US5943604A (en) 1997-10-31 1999-08-24 Cisco Technology, Inc. Echo device method for locating upstream ingress noise gaps at cable television head ends
US5946047A (en) 1997-03-12 1999-08-31 Hybrid Networks, Inc. Network system for handling digital data over a TV channel
US5946048A (en) 1997-03-12 1999-08-31 Hybrid Networks, Inc. Network device for handling digital data over a TV channel
US5950205A (en) 1997-09-25 1999-09-07 Cisco Technology, Inc. Data transmission over the internet using a cache memory file system
US5949753A (en) 1997-04-11 1999-09-07 International Business Machines Corporation Redundant internet protocol gateways using local area network emulation
US5953335A (en) 1997-02-14 1999-09-14 Advanced Micro Devices, Inc. Method and apparatus for selectively discarding packets for blocked output queues in the network switch
US5956346A (en) 1996-10-22 1999-09-21 Hybrid Networks, Inc. Broadband communication system using TV channel roll-off spectrum
US5959660A (en) 1996-08-26 1999-09-28 Hybrid Networks, Inc. Subchannelization scheme for use in a broadband communications system
US5959968A (en) 1997-07-30 1999-09-28 Cisco Systems, Inc. Port aggregation protocol
US5963540A (en) 1997-12-19 1999-10-05 Holontech Corporation Router pooling in a network flowswitch
US5982745A (en) 1995-03-21 1999-11-09 Newbridge Networks Corporation LAN bridging redundancy
US5989060A (en) 1997-05-02 1999-11-23 Cisco Technology System and method for direct communication with a backup network device via a failover cable
US5996021A (en) 1997-05-20 1999-11-30 At&T Corp Internet protocol relay network for directly routing datagram from ingress router to egress router
US5996016A (en) 1997-04-15 1999-11-30 International Business Machines Corporation Reinitiation of bind calls for IP applications concurrently executing with alternate address
US5999536A (en) 1996-11-29 1999-12-07 Anritsu Corporation Router for high-speed packet communication between terminal apparatuses in different LANs
US6006264A (en) 1997-08-01 1999-12-21 Arrowpoint Communications, Inc. Method and system for directing a flow between a client and a server
US6006266A (en) 1996-06-03 1999-12-21 International Business Machines Corporation Multiplexing of clients and applications among multiple servers
US6016388A (en) 1994-06-08 2000-01-18 Hughes Electronics Corporation Method and apparatus for requesting and retrieving information from a source computer using terrestrial and satellite interfaces
US6058425A (en) 1997-07-21 2000-05-02 International Business Machines Corporation Single server access in a multiple TCP/IP instance environment
US6061650A (en) 1996-09-10 2000-05-09 Nortel Networks Corporation Method and apparatus for transparently providing mobile network functionality
US6065061A (en) 1997-12-16 2000-05-16 Lucent Technologies Inc. Internet protocol based network architecture for cable television access with switched fallback
US6073168A (en) 1996-06-03 2000-06-06 Webtv Networks, Inc. Method for reducing delivery latency of an image or other secondary information associated with a file
US6078575A (en) 1996-10-01 2000-06-20 Lucent Technologies Inc. Mobile location management in ATM networks
US6088721A (en) 1998-10-20 2000-07-11 Lucent Technologies, Inc. Efficient unified replication and caching protocol
US6092178A (en) 1998-09-03 2000-07-18 Sun Microsystems, Inc. System for responding to a resource request
US6097882A (en) 1995-06-30 2000-08-01 Digital Equipment Corporation Method and apparatus of improving network performance and network availability in a client-server network by transparently replicating a network service
US6108300A (en) 1997-05-02 2000-08-22 Cisco Technology, Inc Method and apparatus for transparently providing a failover network device
US6111675A (en) 1997-08-27 2000-08-29 Mciworldcom, Inc. System and method for bi-directional transmission of telemetry service signals using a single fiber
US6128666A (en) 1997-06-30 2000-10-03 Sun Microsystems, Inc. Distributed VLAN mechanism for packet field replacement in a multi-layered switched network element using a control field/signal for indicating modification of a packet with a database search engine
US6131121A (en) 1995-09-25 2000-10-10 Netspeak Corporation Point-to-point computer network communication utility utilizing dynamically assigned network protocol addresses
US6148000A (en) 1996-10-02 2000-11-14 International Business Machines Corporation Merging of data cells at network nodes
US6148410A (en) 1997-09-15 2000-11-14 International Business Machines Corporation Fault tolerant recoverable TCP/IP connection router
US6157965A (en) * 1998-02-27 2000-12-05 Intel Corporation System and method for binding a virtual device driver to a network driver interface
US6167438A (en) 1997-05-22 2000-12-26 Trustees Of Boston University Method and system for distributed caching, prefetching and replication
US6167446A (en) 1997-11-03 2000-12-26 Inca Technology, Inc. Automatically configuring network-name-services
US6173312B1 (en) 1996-07-09 2001-01-09 Hitachi, Ltd. System for reliably connecting a client computer to a server computer
US6178455B1 (en) 1997-01-17 2001-01-23 Scientific-Atlanta, Inc. Router which dynamically requests a set of logical network addresses and assigns addresses in the set to hosts connected to the router
US6182139B1 (en) 1996-08-05 2001-01-30 Resonate Inc. Client-side resource-based load-balancing with delayed-resource-binding using TCP state migration to WWW server farm
US6189102B1 (en) 1998-05-27 2001-02-13 3Com Corporation Method for authentication of network devices in a data-over cable system
US6189043B1 (en) 1997-06-09 2001-02-13 At&T Corp Dynamic cache replication in a internet environment through routers and servers utilizing a reverse tree generation
US6195689B1 (en) 1999-05-05 2001-02-27 Mediaone Group, Inc. Headend provisioning agent
US6195705B1 (en) 1998-06-30 2001-02-27 Cisco Technology, Inc. Mobile IP mobility agent standby protocol
US6202169B1 (en) 1997-12-31 2001-03-13 Nortel Networks Corporation Transitioning between redundant computer systems on a network
US6205481B1 (en) 1998-03-17 2001-03-20 Infolibria, Inc. Protocol for distributing fresh content among networked cache servers
US6230196B1 (en) 1997-11-12 2001-05-08 International Business Machines Corporation Generation of smart HTML anchors in dynamic web page creation
US6227785B1 (en) 1999-06-29 2001-05-08 Siemens Automotive Corporation Self-tightening clip
US6230326B1 (en) 1998-07-30 2001-05-08 Nortel Networks Limited Method and apparatus for initialization of a cable modem
US6236678B1 (en) 1998-10-30 2001-05-22 Broadcom Corporation Method and apparatus for converting between byte lengths and burdened burst lengths in a high speed cable modem
US6240089B1 (en) 1997-02-24 2001-05-29 Nec Corporation Method of multicasting for mobile host used in any one of subnetworks connected to one another
US6240461B1 (en) 1997-09-25 2001-05-29 Cisco Technology, Inc. Methods and apparatus for caching network data traffic
US6243760B1 (en) 1997-06-24 2001-06-05 Vistar Telecommunications Inc. Information dissemination system with central and distributed caches
US6243360B1 (en) 1996-09-18 2001-06-05 International Business Machines Corporation Network server having dynamic load balancing of messages in both inbound and outbound directions
US6247054B1 (en) 1997-03-24 2001-06-12 Nortel Networks Limited Method and apparatus for redirecting packets using encapsulation
US6253234B1 (en) 1997-10-17 2001-06-26 International Business Machines Corporation Shared web page caching at browsers for an intranet
US6260070B1 (en) 1998-06-30 2001-07-10 Dhaval N. Shah System and method for determining a preferred mirrored service in a network by evaluating a border gateway protocol
US20010014097A1 (en) 1998-12-31 2001-08-16 Paul R. Beck Method and apparatus for providing an integrated cluster alias address
US6286038B1 (en) 1998-08-03 2001-09-04 Nortel Networks Limited Method and apparatus for remotely configuring a network device
US6286084B1 (en) 1998-09-16 2001-09-04 Cisco Technology, Inc. Methods and apparatus for populating a network cache
US6295276B1 (en) 1999-12-31 2001-09-25 Ragula Systems Combining routers to increase concurrency and redundancy in external network access
US6298063B1 (en) * 1995-11-03 2001-10-02 Cisco Technology, Inc. System and method for providing backup machines for implementing multiple IP addresses on multiple ports
US6298381B1 (en) 1998-10-20 2001-10-02 Cisco Technology, Inc. System and method for information retrieval regarding services
US20010042105A1 (en) 1998-02-23 2001-11-15 Steven M Koehler System and method for listening to teams in a race event
US6324564B1 (en) 1998-06-02 2001-11-27 Nettech Systems, Inc. Optimized wireless communication system
US6327622B1 (en) 1998-09-03 2001-12-04 Sun Microsystems, Inc. Load balancing in a network environment
US20010049741A1 (en) 1999-06-18 2001-12-06 Bryan D. Skene Method and system for balancing load distribution on a wide area network
US6330606B1 (en) 1996-06-03 2001-12-11 Webtv Networks, Inc. Method and apparatus for dispatching document requests in a proxy
US6330602B1 (en) 1997-04-14 2001-12-11 Nortel Networks Limited Scaleable web server and method of efficiently managing multiple servers
US6339830B1 (en) 1997-06-13 2002-01-15 Alcatel Internetworking, Inc. Deterministic user authentication service for communication network
US20020010783A1 (en) 1999-12-06 2002-01-24 Leonard Primak System and method for enhancing operation of a web server cluster
US20020012327A1 (en) 2000-07-27 2002-01-31 Hideaki Okada System and method of communications control
US6345294B1 (en) 1999-04-19 2002-02-05 Cisco Technology, Inc. Methods and apparatus for remote configuration of an appliance on a network
US20020019879A1 (en) 2000-05-15 2002-02-14 Mark Jasen Method and system for prioritizing network services
US20020023159A1 (en) 2000-04-17 2002-02-21 Mark Vange HTTP redirector
US20020040400A1 (en) 1999-07-15 2002-04-04 F5 Networks, Inc. Method and system for storing load balancing information with an HTTP cookie
US6370147B1 (en) 1998-04-23 2002-04-09 3Com Corporation Method for addressing of passive network hosts in a data-over-cable system
US6377972B1 (en) 1999-01-19 2002-04-23 Lucent Technologies Inc. High quality streaming multimedia
US6385204B1 (en) 1999-11-22 2002-05-07 Worldcom, Inc. Network architecture and call processing system
US6389027B1 (en) 1998-08-25 2002-05-14 International Business Machines Corporation IP multicast interface
US6389462B1 (en) 1998-12-16 2002-05-14 Lucent Technologies Inc. Method and apparatus for transparently directing requests for web objects to proxy caches
US20020062372A1 (en) 2000-08-04 2002-05-23 Jack Hong High performance server farm with tagging and pipelining
US6397260B1 (en) 1999-03-08 2002-05-28 3Com Corporation Automatic load sharing for network routers
US6415323B1 (en) 1999-09-03 2002-07-02 Fastforward Networks Proximity-based redirection system for robust and scalable service-node location in an internetwork
US20020099849A1 (en) 2001-01-25 2002-07-25 Crescent Networks, Inc. Dense virtual router packet switching
US6434608B1 (en) 1999-02-26 2002-08-13 Cisco Technology, Inc. Methods and apparatus for caching network traffic
US6438123B1 (en) 1998-11-10 2002-08-20 Cisco Technology, Inc. Method and apparatus for supporting header suppression and multiple microflows in a network
US6438652B1 (en) 1998-10-09 2002-08-20 International Business Machines Corporation Load balancing cooperating cache servers by shifting forwarded request
US6442558B1 (en) 1998-12-03 2002-08-27 International Business Machines Corporation Mechanisms for division, storage, reconstruction, generation, and delivery of java class files
US20020120697A1 (en) 2000-08-14 2002-08-29 Curtis Generous Multi-channel messaging system and method
US6446121B1 (en) 1998-05-26 2002-09-03 Cisco Technology, Inc. System and method for measuring round trip times in a network using a TCP packet
US6449250B1 (en) 1998-01-28 2002-09-10 Fujitsu Limited Method for switching central device and a cable modem system using the same
US6449249B1 (en) 2000-09-07 2002-09-10 Arris International, Inc. Spare circuit switching
US20020129134A1 (en) 2000-05-26 2002-09-12 Leighton F. Thomson Global load balancing across mirrored data centers
US6463475B1 (en) 1997-09-26 2002-10-08 3Com Corporation Method and device for tunnel switching
US6466964B1 (en) 1999-06-15 2002-10-15 Cisco Technology, Inc. Methods and apparatus for providing mobility of a node that does not support mobility
US6470027B1 (en) 1999-04-30 2002-10-22 At&T Corp. System and method for providing message redirection in networked environments
US6470389B1 (en) 1997-03-14 2002-10-22 Lucent Technologies Inc. Hosting a network service on a cluster of servers using a single-address image
US6477522B1 (en) 1999-06-10 2002-11-05 Gateway, Inc. Dynamic performance based server selection
US6477197B1 (en) 1998-06-30 2002-11-05 Arris International, Inc. Method and apparatus for a cable modem upstream RF switching system
US6480469B1 (en) 1998-12-16 2002-11-12 Worldcom, Inc. Dial-up access response testing method and system therefor
US6493318B1 (en) 1998-05-04 2002-12-10 Hewlett-Packard Company Cost propagation switch protocols
US20020191562A1 (en) 1997-05-12 2002-12-19 Kabushiki Kaisha Toshiba Router device, datagram transfer method and communication system realizing handoff control for mobile terminals
US20030014540A1 (en) 2001-07-06 2003-01-16 Nortel Networks Limited Policy-based forwarding in open shortest path first (OSPF) networks
US6510469B1 (en) 1998-05-13 2003-01-21 Compaq Information Technologies Group,L.P. Method and apparatus for providing accelerated content delivery over a network
US6510162B1 (en) * 1998-05-27 2003-01-21 3Com Corporation System and method for managing channel usage in a data over cable system
US6512774B1 (en) 1999-03-18 2003-01-28 3Com Corporation Fail over with multiple network interface cards
US6519646B1 (en) 1998-09-01 2003-02-11 Sun Microsystems, Inc. Method and apparatus for encoding content characteristics
US20030031178A1 (en) 2001-08-07 2003-02-13 Amplify.Net, Inc. Method for ascertaining network bandwidth allocation policy associated with network address
US20030037165A1 (en) 2001-07-06 2003-02-20 Daisuke Shinomiya Dynamic load sharing system using a virtual router
US6532493B1 (en) 1998-10-29 2003-03-11 Cisco Technology, Inc. Methods and apparatus for redirecting network cache traffic
US6553568B1 (en) * 1999-09-29 2003-04-22 3Com Corporation Methods and systems for service level agreement enforcement on a data-over cable system
US6556591B2 (en) * 1999-10-09 2003-04-29 Conexant Systems, Inc. Method and apparatus for upstream burst transmission synchronization in cable modems
US6578066B1 (en) 1999-09-17 2003-06-10 Alteon Websystems Distributed load-balancing internet servers
US6578077B1 (en) 1997-05-27 2003-06-10 Novell, Inc. Traffic monitoring tool for bandwidth management
US6577642B1 (en) 1999-01-15 2003-06-10 3Com Corporation Method and system for virtual network administration with a data-over cable system
US6588016B1 (en) 1998-06-30 2003-07-01 Cisco Technology, Inc. Method and apparatus for locating a faulty component in a cable television system having cable modems
US6594305B1 (en) 1998-06-30 2003-07-15 Cisco Technology, Inc. Media access layer ping protocol for diagnosing cable modem links
US20030133420A1 (en) 2002-01-09 2003-07-17 Wassim Haddad Load balancing in data transfer networks
US6598232B1 (en) 1998-11-10 2003-07-22 Nortel Networks Limited Hybrid amplifier-regenerator for optimizing cable network transmissions
US6606352B2 (en) 1999-01-15 2003-08-12 Broadcom Corporation Method and apparatus for converting between byte lengths and burdened burst lengths in a high speed modem
US6606315B1 (en) 1999-07-02 2003-08-12 Cisco Technology, Inc. Synchronizing service instructions among forwarding agents using a service manager
US6611868B1 (en) 1999-05-21 2003-08-26 3Com Corporation Method and system for automatic link hang up
US20030161303A1 (en) 2002-02-22 2003-08-28 Nortel Networks Limited Traffic switching using multi-dimensional packet classification
US6621810B1 (en) 1999-05-27 2003-09-16 Cisco Technology, Inc. Mobile IP intra-agent mobility
US6633585B1 (en) 1999-08-13 2003-10-14 International Business Machines Corporation Enhanced flow control in ATM edge switches
US6636498B1 (en) 1999-01-08 2003-10-21 Cisco Technology, Inc. Mobile IP mobile router
US6636971B1 (en) 1999-08-02 2003-10-21 Intel Corporation Method and an apparatus for secure register access in electronic device
US6650641B1 (en) * 1999-07-02 2003-11-18 Cisco Technology, Inc. Network address translation using a forwarding agent
US6650624B1 (en) * 1998-10-30 2003-11-18 Broadcom Corporation Cable modem apparatus and method
US6671259B1 (en) 1999-03-30 2003-12-30 Fujitsu Limited Method and system for wide area network load balancing
US6674713B1 (en) 1999-02-23 2004-01-06 Cisco Technology, Inc. Method and apparatus for providing continuous voice and call communications between a data network and a telephony network
US6683873B1 (en) 1999-12-27 2004-01-27 Cisco Technology, Inc. Methods and apparatus for redirecting network traffic
US6687217B1 (en) 1999-05-04 2004-02-03 Carriercomm, Inc. Method of and system for one plus one protection for radio equipment
US6691165B1 (en) 1998-11-10 2004-02-10 Rainfinity, Inc. Distributed server cluster for controlling network traffic
US20040071141A1 (en) 2002-10-15 2004-04-15 Dhara Narendra Kumar Distributed service architecture based on a hierarchical load balancing approach
US6724724B1 (en) 1999-01-21 2004-04-20 Cisco Technology, Inc. System and method for resolving an electronic address
US6728748B1 (en) 1998-12-01 2004-04-27 Network Appliance, Inc. Method and apparatus for policy based class of service and adaptive service level management within the context of an internet and intranet
US6735631B1 (en) 1998-02-10 2004-05-11 Sprint Communications Company, L.P. Method and system for networking redirecting
US6742044B1 (en) 2000-05-10 2004-05-25 Cisco Technology, Inc. Distributed network traffic load balancing technique implemented without gateway router
US6751191B1 (en) 1999-06-29 2004-06-15 Cisco Technology, Inc. Load sharing and redundancy scheme
US6760302B1 (en) 1996-12-20 2004-07-06 The Trustees Of Columbia University In The City Of New York Automatic protection switching system in a network
US6760316B1 (en) * 1998-10-30 2004-07-06 Broadcom Corporation Method and apparatus for the synchronization of multiple cable modem termination system devices
US6765892B1 (en) 2000-06-26 2004-07-20 Cisco Technology, Inc. Optimizing IP multicast data transmission in a mobile IP environment
US6768743B1 (en) 1999-10-26 2004-07-27 3Com Corporation Method and system for address server redirection for multiple address networks
US6779039B1 (en) 2000-03-31 2004-08-17 Avaya Technology Corp. System and method for routing message traffic using a cluster of routers sharing a single logical IP address distinct from unique IP addresses of the routers
US6789125B1 (en) 2000-05-10 2004-09-07 Cisco Technology, Inc. Distributed network traffic load balancing technique implemented without gateway router
US6795860B1 (en) 1999-04-05 2004-09-21 Cisco Technology, Inc. System and method for selecting a service with dynamically changing information
US6801949B1 (en) 1999-04-12 2004-10-05 Rainfinity, Inc. Distributed server cluster with graphical user interface
US6804221B1 (en) 2000-06-26 2004-10-12 Alcatel Micromobility using multicast
US6826599B1 (en) 2000-06-15 2004-11-30 Cisco Technology, Inc. Method and apparatus for optimizing memory use in network caching
US6835696B2 (en) 2001-11-22 2004-12-28 Communications Research Laboratory Independent Administrative Institute Method of forming a superconductor film
US6839809B1 (en) 2000-05-31 2005-01-04 Cisco Technology, Inc. Methods and apparatus for improving content quality in web caching systems
US6839829B1 (en) * 2000-01-18 2005-01-04 Cisco Technology, Inc. Routing protocol based redundancy design for shared-access networks
US6857026B1 (en) 1999-12-14 2005-02-15 Nortel Networks Limited Using alternate routes for fail-over in a communication network
WO2005018176A1 (en) 2003-07-31 2005-02-24 Cisco Technology, Inc. Distributing and balancing traffic flow in a virtual gateway
US6885667B1 (en) 2000-12-26 2005-04-26 Cisco Technology, Inc. Redirection to a virtual router
US20050111352A1 (en) 2003-11-21 2005-05-26 Boon Ho Method and system for monitoring a network containing routers using a backup routing protocol
US6920498B1 (en) 2000-08-31 2005-07-19 Cisco Technology, Inc. Phased learning approach to determining closest content serving sites
US20050213832A1 (en) 2004-03-22 2005-09-29 Nortel Networks Limited Method and apparatus for providing network based load balancing of medical image data
US6952401B1 (en) 1999-03-17 2005-10-04 Broadcom Corporation Method for load balancing in a network switch
US6981056B1 (en) 2000-06-28 2005-12-27 Cisco Technology, Inc. Wide area load balancing of web traffic
US7042876B1 (en) 2000-09-12 2006-05-09 Cisco Technology, Inc. Stateful network address translation protocol implemented over a data network
US7058007B1 (en) 2000-01-18 2006-06-06 Cisco Technology, Inc. Method for a cable modem to rapidly switch to a backup CMTS
US7065043B2 (en) 2001-12-24 2006-06-20 Innomedia Pte Ltd. Method and system for connecting to a proxy server with the lowest workload through querying a load monitor
US7068712B1 (en) * 2000-01-18 2006-06-27 Cisco Technology, Inc. Cable network redundancy architecture
US7072979B1 (en) 2000-06-28 2006-07-04 Cisco Technology, Inc. Wide area load balancing of web traffic
US7117273B1 (en) 2000-01-25 2006-10-03 Cisco Technology, Inc. Methods and apparatus for maintaining a map of node relationships for a network
US7149217B2 (en) 2001-08-14 2006-12-12 Extreme Networks Load-sharing technique for distributing multi-protocol label switching protocol encapsulated flows across multiple physical links
US7281036B1 (en) 1999-04-19 2007-10-09 Cisco Technology, Inc. Method and apparatus for automatic network address assignment
US7349979B1 (en) 1999-12-02 2008-03-25 Cisco Technology, Inc. Method and apparatus for redirecting network traffic
US7349348B1 (en) 2000-01-24 2008-03-25 Cisco Technologies, Inc. Method and apparatus for determining a network topology in the presence of network address translation
US7395348B1 (en) 2000-06-05 2008-07-01 Cisco Technology, Inc. Network cache-based content routing

Patent Citations (242)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4692918A (en) 1984-12-17 1987-09-08 At&T Bell Laboratories Reliable local data network arrangement
US4827411A (en) 1987-06-15 1989-05-02 International Business Machines Corporation Method of maintaining a topology database
US4965772A (en) 1987-06-15 1990-10-23 International Business Machines Corporation Method and apparatus for communication network alert message construction
US5018133A (en) 1987-11-18 1991-05-21 Hitachi, Ltd. Network system comprising a plurality of LANs using hierarchical routing
US5218600A (en) 1989-06-19 1993-06-08 Richard Hirschmann Gmbh & Co. Process for networking computers and/or computer networks and networking systems
US5016244A (en) 1989-09-08 1991-05-14 Honeywell Inc. Method for controlling failover between redundant network interface modules
US5506987A (en) 1991-02-01 1996-04-09 Digital Equipment Corporation Affinity scheduling of processes on symmetric multiprocessing systems
US5515429A (en) 1991-03-12 1996-05-07 Fujitsu Limited Backup apparatus against line defect and backup method against line defect
USRE35774E (en) 1991-09-10 1998-04-21 Hybrid Networks, Inc. Remote link adapter for use in TV broadcast data transmission system
US5423002A (en) 1992-04-20 1995-06-06 3Com Corporation System for extending network resources to remote networks
US5315592A (en) 1992-04-23 1994-05-24 Xyplex Inc. Parallel bridging
US5611049A (en) 1992-06-03 1997-03-11 Pitts; William M. System for accessing distributed data cache channel at each network node to pass requests and data
US5371852A (en) 1992-10-14 1994-12-06 International Business Machines Corporation Method and apparatus for making a cluster of computers appear as a single host on a network
US5414704A (en) 1992-10-22 1995-05-09 Digital Equipment Corporation Address lookup in packet data communications link, using hashing and content-addressable memory
US5452447A (en) 1992-12-21 1995-09-19 Sun Microsystems, Inc. Method and apparatus for a caching file server
US5544320A (en) 1993-01-08 1996-08-06 Konrad; Allan M. Remote information service access system based on a client-server-service model
US5511208A (en) 1993-03-23 1996-04-23 International Business Machines Corporation Locating resources in computer networks having cache server nodes
US5619552A (en) 1993-08-20 1997-04-08 Nokia Telecommunications Oy Arrangement and method for location registration
US5488412A (en) 1994-03-31 1996-01-30 At&T Corp. Customer premises equipment receives high-speed downstream data over a cable television system and transmits lower speed upstream signaling on a separate channel
US5473599A (en) 1994-04-22 1995-12-05 Cisco Systems, Incorporated Standby router protocol
WO1995029544A1 (en) 1994-04-22 1995-11-02 Cisco Systems, Inc. Standby router protocol
US5644713A (en) 1994-05-12 1997-07-01 The Furukawa Electric Co., Ltd. Method of effecting dynamic management of path or routing information without requiring an internetworking operation for routing
US5555244A (en) 1994-05-19 1996-09-10 Integrated Network Corporation Scalable multimedia network
US5673265A (en) 1994-05-19 1997-09-30 Integrated Network Corporation Scalable multimedia network
US6016388A (en) 1994-06-08 2000-01-18 Hughes Electronics Corporation Method and apparatus for requesting and retrieving information from a source computer using terrestrial and satellite interfaces
US5541911A (en) 1994-10-12 1996-07-30 3Com Corporation Remote smart filtering communication management system
US5825759A (en) 1994-10-26 1998-10-20 Telefonaktiebolaget Lm Ericsson Distributing network services and resources in a mobile communications network
US5572528A (en) 1995-03-20 1996-11-05 Novell, Inc. Mobile networking method and apparatus
US5982745A (en) 1995-03-21 1999-11-09 Newbridge Networks Corporation LAN bridging redundancy
US5828655A (en) 1995-04-21 1998-10-27 Hybrid Networks, Inc. Hybrid access system with quality-based channel switching
US5859852A (en) 1995-04-21 1999-01-12 Hybrid Networks, Inc. Hybrid access system with automated client-side configuration
US5586121A (en) 1995-04-21 1996-12-17 Hybrid Networks, Inc. Asymmetric hybrid access system and method
US5818845A (en) 1995-04-21 1998-10-06 Hybrid Networks, Inc. Hybrid access system having channel allocation and prioritized polling schemes
US5959997A (en) 1995-04-21 1999-09-28 Hybrid Networks, Inc. Hybrid access system with AGC control of upstream channel transmit power
US6097882A (en) 1995-06-30 2000-08-01 Digital Equipment Corporation Method and apparatus of improving network performance and network availability in a client-server network by transparently replicating a network service
US5751971A (en) 1995-07-12 1998-05-12 Cabletron Systems, Inc. Internet protocol (IP) work group routing
US6249820B1 (en) 1995-07-12 2001-06-19 Cabletron Systems, Inc. Internet protocol (IP) work group routing
US5644720A (en) 1995-07-31 1997-07-01 West Publishing Company Interprocess communications interface for managing transaction requests
US6131121A (en) 1995-09-25 2000-10-10 Netspeak Corporation Point-to-point computer network communication utility utilizing dynamically assigned network protocol addresses
US5793763A (en) 1995-11-03 1998-08-11 Cisco Technology, Inc. Security system for network address translation systems
US6298063B1 (en) * 1995-11-03 2001-10-02 Cisco Technology, Inc. System and method for providing backup machines for implementing multiple IP addresses on multiple ports
US5835696A (en) 1995-11-22 1998-11-10 Lucent Technologies Inc. Data router backup feature
US5848241A (en) 1996-01-11 1998-12-08 Openframe Corporation Ltd. Resource sharing facility functions as a controller for secondary storage device and is accessible to all computers via inter system links
US5862451A (en) 1996-01-22 1999-01-19 Motorola, Inc. Channel quality management in a cable telephony system
US5862345A (en) 1996-02-07 1999-01-19 Nec Corporation System for location multicasting and database management for mobile sessions in any computer subnetworks without using a home router of a home subnetwork
US5740375A (en) 1996-02-15 1998-04-14 Bay Networks, Inc. Forwarding internetwork packets by replacing the destination address
US5940596A (en) 1996-03-25 1999-08-17 I-Cube, Inc. Clustered address caching system for a network switch
US5872773A (en) 1996-05-17 1999-02-16 Lucent Technologies Inc. Virtual trees routing protocol for an ATM-based mobile network
US6006266A (en) 1996-06-03 1999-12-21 International Business Machines Corporation Multiplexing of clients and applications among multiple servers
US6073168A (en) 1996-06-03 2000-06-06 Webtv Networks, Inc. Method for reducing delivery latency of an image or other secondary information associated with a file
US6330606B1 (en) 1996-06-03 2001-12-11 Webtv Networks, Inc. Method and apparatus for dispatching document requests in a proxy
US5729537A (en) 1996-06-14 1998-03-17 Telefonaktiebolaget L M Ericsson (Publ) Method and apparatus for providing anonymous data transfer in a communication system
US6173312B1 (en) 1996-07-09 2001-01-09 Hitachi, Ltd. System for reliably connecting a client computer to a server computer
US6182139B1 (en) 1996-08-05 2001-01-30 Resonate Inc. Client-side resource-based load-balancing with delayed-resource-binding using TCP state migration to WWW server farm
US5774660A (en) 1996-08-05 1998-06-30 Resonate, Inc. World-wide-web server with delayed resource-binding for resource-based load balancing on a distributed resource multi-node network
US5959660A (en) 1996-08-26 1999-09-28 Hybrid Networks, Inc. Subchannelization scheme for use in a broadband communications system
US6061650A (en) 1996-09-10 2000-05-09 Nortel Networks Corporation Method and apparatus for transparently providing mobile network functionality
US5892903A (en) 1996-09-12 1999-04-06 Internet Security Systems, Inc. Method and apparatus for detecting and identifying security vulnerabilities in an open network computer communication system
US6243360B1 (en) 1996-09-18 2001-06-05 International Business Machines Corporation Network server having dynamic load balancing of messages in both inbound and outbound directions
US6078575A (en) 1996-10-01 2000-06-20 Lucent Technologies Inc. Mobile location management in ATM networks
US6148000A (en) 1996-10-02 2000-11-14 International Business Machines Corporation Merging of data cells at network nodes
US5787470A (en) 1996-10-18 1998-07-28 At&T Corp Inter-cache protocol for improved WEB performance
US5956346A (en) 1996-10-22 1999-09-21 Hybrid Networks, Inc. Broadband communication system using TV channel roll-off spectrum
US5852717A (en) 1996-11-20 1998-12-22 Shiva Corporation Performance optimizations for computer networks utilizing HTTP
US5999536A (en) 1996-11-29 1999-12-07 Anritsu Corporation Router for high-speed packet communication between terminal apparatuses in different LANs
US6760302B1 (en) 1996-12-20 2004-07-06 The Trustees Of Columbia University In The City Of New York Automatic protection switching system in a network
WO1998031107A2 (en) 1997-01-07 1998-07-16 Gifford David K Replica routing
US6052718A (en) 1997-01-07 2000-04-18 Sightpath, Inc Replica routing
US7149771B1 (en) 1997-01-07 2006-12-12 Cisco Technology, Inc. Replica routing
US6301223B1 (en) 1997-01-17 2001-10-09 Scientific-Atlanta, Inc. Method of using routing protocols to reroute packets during a link failure
US6178455B1 (en) 1997-01-17 2001-01-23 Scientific-Atlanta, Inc. Router which dynamically requests a set of logical network addresses and assigns addresses in the set to hosts connected to the router
US5953335A (en) 1997-02-14 1999-09-14 Advanced Micro Devices, Inc. Method and apparatus for selectively discarding packets for blocked output queues in the network switch
US6240089B1 (en) 1997-02-24 2001-05-29 Nec Corporation Method of multicasting for mobile host used in any one of subnetworks connected to one another
US5946048A (en) 1997-03-12 1999-08-31 Hybrid Networks, Inc. Network device for handling digital data over a TV channel
US5946047A (en) 1997-03-12 1999-08-31 Hybrid Networks, Inc. Network system for handling digital data over a TV channel
US6470389B1 (en) 1997-03-14 2002-10-22 Lucent Technologies Inc. Hosting a network service on a cluster of servers using a single-address image
US6247054B1 (en) 1997-03-24 2001-06-12 Nortel Networks Limited Method and apparatus for redirecting packets using encapsulation
US5949753A (en) 1997-04-11 1999-09-07 International Business Machines Corporation Redundant internet protocol gateways using local area network emulation
US6330602B1 (en) 1997-04-14 2001-12-11 Nortel Networks Limited Scaleable web server and method of efficiently managing multiple servers
US5996016A (en) 1997-04-15 1999-11-30 International Business Machines Corporation Reinitiation of bind calls for IP applications concurrently executing with alternate address
US5989060A (en) 1997-05-02 1999-11-23 Cisco Technology System and method for direct communication with a backup network device via a failover cable
US6108300A (en) 1997-05-02 2000-08-22 Cisco Technology, Inc Method and apparatus for transparently providing a failover network device
US20020191562A1 (en) 1997-05-12 2002-12-19 Kabushiki Kaisha Toshiba Router device, datagram transfer method and communication system realizing handoff control for mobile terminals
US7151758B2 (en) 1997-05-12 2006-12-19 Kabushiki Kaisha Toshiba Router device, datagram transfer method and communication system realizing handoff control for mobile terminals
US5996021A (en) 1997-05-20 1999-11-30 At&T Corp Internet protocol relay network for directly routing datagram from ingress router to egress router
US6167438A (en) 1997-05-22 2000-12-26 Trustees Of Boston University Method and system for distributed caching, prefetching and replication
US6578077B1 (en) 1997-05-27 2003-06-10 Novell, Inc. Traffic monitoring tool for bandwidth management
US6189043B1 (en) 1997-06-09 2001-02-13 At&T Corp Dynamic cache replication in a internet environment through routers and servers utilizing a reverse tree generation
US6339830B1 (en) 1997-06-13 2002-01-15 Alcatel Internetworking, Inc. Deterministic user authentication service for communication network
US6243760B1 (en) 1997-06-24 2001-06-05 Vistar Telecommunications Inc. Information dissemination system with central and distributed caches
US6128666A (en) 1997-06-30 2000-10-03 Sun Microsystems, Inc. Distributed VLAN mechanism for packet field replacement in a multi-layered switched network element using a control field/signal for indicating modification of a packet with a database search engine
US6058425A (en) 1997-07-21 2000-05-02 International Business Machines Corporation Single server access in a multiple TCP/IP instance environment
US5959968A (en) 1997-07-30 1999-09-28 Cisco Systems, Inc. Port aggregation protocol
US6006264A (en) 1997-08-01 1999-12-21 Arrowpoint Communications, Inc. Method and system for directing a flow between a client and a server
US6111675A (en) 1997-08-27 2000-08-29 Mciworldcom, Inc. System and method for bi-directional transmission of telemetry service signals using a single fiber
US6148410A (en) 1997-09-15 2000-11-14 International Business Machines Corporation Fault tolerant recoverable TCP/IP connection router
US5950205A (en) 1997-09-25 1999-09-07 Cisco Technology, Inc. Data transmission over the internet using a cache memory file system
US6832252B1 (en) 1997-09-25 2004-12-14 Cisco Technology, Inc. Methods and apparatus for caching network data traffic
US6240461B1 (en) 1997-09-25 2001-05-29 Cisco Technology, Inc. Methods and apparatus for caching network data traffic
US6463475B1 (en) 1997-09-26 2002-10-08 3Com Corporation Method and device for tunnel switching
US6253234B1 (en) 1997-10-17 2001-06-26 International Business Machines Corporation Shared web page caching at browsers for an intranet
US5943604A (en) 1997-10-31 1999-08-24 Cisco Technology, Inc. Echo device method for locating upstream ingress noise gaps at cable television head ends
US6167446A (en) 1997-11-03 2000-12-26 Inca Technology, Inc. Automatically configuring network-name-services
US6230196B1 (en) 1997-11-12 2001-05-08 International Business Machines Corporation Generation of smart HTML anchors in dynamic web page creation
US6065061A (en) 1997-12-16 2000-05-16 Lucent Technologies Inc. Internet protocol based network architecture for cable television access with switched fallback
US5963540A (en) 1997-12-19 1999-10-05 Holontech Corporation Router pooling in a network flowswitch
US6202169B1 (en) 1997-12-31 2001-03-13 Nortel Networks Corporation Transitioning between redundant computer systems on a network
US6449250B1 (en) 1998-01-28 2002-09-10 Fujitsu Limited Method for switching central device and a cable modem system using the same
US6735631B1 (en) 1998-02-10 2004-05-11 Sprint Communications Company, L.P. Method and system for networking redirecting
US20010042105A1 (en) 1998-02-23 2001-11-15 Steven M Koehler System and method for listening to teams in a race event
US6157965A (en) * 1998-02-27 2000-12-05 Intel Corporation System and method for binding a virtual device driver to a network driver interface
US6205481B1 (en) 1998-03-17 2001-03-20 Infolibria, Inc. Protocol for distributing fresh content among networked cache servers
US6370147B1 (en) 1998-04-23 2002-04-09 3Com Corporation Method for addressing of passive network hosts in a data-over-cable system
US6493318B1 (en) 1998-05-04 2002-12-10 Hewlett-Packard Company Cost propagation switch protocols
US6510469B1 (en) 1998-05-13 2003-01-21 Compaq Information Technologies Group,L.P. Method and apparatus for providing accelerated content delivery over a network
US6292832B1 (en) 1998-05-26 2001-09-18 Cisco Technology, Inc. System and method for determining a preferred service in a network
US6446121B1 (en) 1998-05-26 2002-09-03 Cisco Technology, Inc. System and method for measuring round trip times in a network using a TCP packet
US6189102B1 (en) 1998-05-27 2001-02-13 3Com Corporation Method for authentication of network devices in a data-over cable system
US6510162B1 (en) * 1998-05-27 2003-01-21 3Com Corporation System and method for managing channel usage in a data over cable system
US6324564B1 (en) 1998-06-02 2001-11-27 Nettech Systems, Inc. Optimized wireless communication system
US6195705B1 (en) 1998-06-30 2001-02-27 Cisco Technology, Inc. Mobile IP mobility agent standby protocol
US6594305B1 (en) 1998-06-30 2003-07-15 Cisco Technology, Inc. Media access layer ping protocol for diagnosing cable modem links
US6588016B1 (en) 1998-06-30 2003-07-01 Cisco Technology, Inc. Method and apparatus for locating a faulty component in a cable television system having cable modems
US6477197B1 (en) 1998-06-30 2002-11-05 Arris International, Inc. Method and apparatus for a cable modem upstream RF switching system
US6487605B1 (en) 1998-06-30 2002-11-26 Cisco Technology, Inc. Mobile IP mobility agent standby protocol
US6260070B1 (en) 1998-06-30 2001-07-10 Dhaval N. Shah System and method for determining a preferred mirrored service in a network by evaluating a border gateway protocol
US6230326B1 (en) 1998-07-30 2001-05-08 Nortel Networks Limited Method and apparatus for initialization of a cable modem
US6286038B1 (en) 1998-08-03 2001-09-04 Nortel Networks Limited Method and apparatus for remotely configuring a network device
US6389027B1 (en) 1998-08-25 2002-05-14 International Business Machines Corporation IP multicast interface
US6519646B1 (en) 1998-09-01 2003-02-11 Sun Microsystems, Inc. Method and apparatus for encoding content characteristics
US6327622B1 (en) 1998-09-03 2001-12-04 Sun Microsystems, Inc. Load balancing in a network environment
US6092178A (en) 1998-09-03 2000-07-18 Sun Microsystems, Inc. System for responding to a resource request
US6286084B1 (en) 1998-09-16 2001-09-04 Cisco Technology, Inc. Methods and apparatus for populating a network cache
US6499088B1 (en) 1998-09-16 2002-12-24 Cisco Technology, Inc. Methods and apparatus for populating a network cache
US6438652B1 (en) 1998-10-09 2002-08-20 International Business Machines Corporation Load balancing cooperating cache servers by shifting forwarded request
US6298381B1 (en) 1998-10-20 2001-10-02 Cisco Technology, Inc. System and method for information retrieval regarding services
US6088721A (en) 1998-10-20 2000-07-11 Lucent Technologies, Inc. Efficient unified replication and caching protocol
US6532493B1 (en) 1998-10-29 2003-03-11 Cisco Technology, Inc. Methods and apparatus for redirecting network cache traffic
US6760316B1 (en) * 1998-10-30 2004-07-06 Broadcom Corporation Method and apparatus for the synchronization of multiple cable modem termination system devices
US6236678B1 (en) 1998-10-30 2001-05-22 Broadcom Corporation Method and apparatus for converting between byte lengths and burdened burst lengths in a high speed cable modem
US6650624B1 (en) * 1998-10-30 2003-11-18 Broadcom Corporation Cable modem apparatus and method
US6598232B1 (en) 1998-11-10 2003-07-22 Nortel Networks Limited Hybrid amplifier-regenerator for optimizing cable network transmissions
US6438123B1 (en) 1998-11-10 2002-08-20 Cisco Technology, Inc. Method and apparatus for supporting header suppression and multiple microflows in a network
US6691165B1 (en) 1998-11-10 2004-02-10 Rainfinity, Inc. Distributed server cluster for controlling network traffic
US6728748B1 (en) 1998-12-01 2004-04-27 Network Appliance, Inc. Method and apparatus for policy based class of service and adaptive service level management within the context of an internet and intranet
US6442558B1 (en) 1998-12-03 2002-08-27 International Business Machines Corporation Mechanisms for division, storage, reconstruction, generation, and delivery of java class files
US6480469B1 (en) 1998-12-16 2002-11-12 Worldcom, Inc. Dial-up access response testing method and system therefor
US6389462B1 (en) 1998-12-16 2002-05-14 Lucent Technologies Inc. Method and apparatus for transparently directing requests for web objects to proxy caches
US20010014097A1 (en) 1998-12-31 2001-08-16 Paul R. Beck Method and apparatus for providing an integrated cluster alias address
US6665304B2 (en) 1998-12-31 2003-12-16 Hewlett-Packard Development Company, L.P. Method and apparatus for providing an integrated cluster alias address
US6636498B1 (en) 1999-01-08 2003-10-21 Cisco Technology, Inc. Mobile IP mobile router
US6606352B2 (en) 1999-01-15 2003-08-12 Broadcom Corporation Method and apparatus for converting between byte lengths and burdened burst lengths in a high speed modem
US6577642B1 (en) 1999-01-15 2003-06-10 3Com Corporation Method and system for virtual network administration with a data-over cable system
US6377972B1 (en) 1999-01-19 2002-04-23 Lucent Technologies Inc. High quality streaming multimedia
US6724724B1 (en) 1999-01-21 2004-04-20 Cisco Technology, Inc. System and method for resolving an electronic address
US6674713B1 (en) 1999-02-23 2004-01-06 Cisco Technology, Inc. Method and apparatus for providing continuous voice and call communications between a data network and a telephony network
US6434608B1 (en) 1999-02-26 2002-08-13 Cisco Technology, Inc. Methods and apparatus for caching network traffic
US6397260B1 (en) 1999-03-08 2002-05-28 3Com Corporation Automatic load sharing for network routers
US6952401B1 (en) 1999-03-17 2005-10-04 Broadcom Corporation Method for load balancing in a network switch
US6512774B1 (en) 1999-03-18 2003-01-28 3Com Corporation Fail over with multiple network interface cards
US6671259B1 (en) 1999-03-30 2003-12-30 Fujitsu Limited Method and system for wide area network load balancing
US6795860B1 (en) 1999-04-05 2004-09-21 Cisco Technology, Inc. System and method for selecting a service with dynamically changing information
US6801949B1 (en) 1999-04-12 2004-10-05 Rainfinity, Inc. Distributed server cluster with graphical user interface
US6345294B1 (en) 1999-04-19 2002-02-05 Cisco Technology, Inc. Methods and apparatus for remote configuration of an appliance on a network
US7281036B1 (en) 1999-04-19 2007-10-09 Cisco Technology, Inc. Method and apparatus for automatic network address assignment
US6470027B1 (en) 1999-04-30 2002-10-22 At&T Corp. System and method for providing message redirection in networked environments
US6687217B1 (en) 1999-05-04 2004-02-03 Carriercomm, Inc. Method of and system for one plus one protection for radio equipment
US6195689B1 (en) 1999-05-05 2001-02-27 Mediaone Group, Inc. Headend provisioning agent
US6611868B1 (en) 1999-05-21 2003-08-26 3Com Corporation Method and system for automatic link hang up
US6621810B1 (en) 1999-05-27 2003-09-16 Cisco Technology, Inc. Mobile IP intra-agent mobility
US6477522B1 (en) 1999-06-10 2002-11-05 Gateway, Inc. Dynamic performance based server selection
US6466964B1 (en) 1999-06-15 2002-10-15 Cisco Technology, Inc. Methods and apparatus for providing mobility of a node that does not support mobility
US6795857B1 (en) 1999-06-15 2004-09-21 Cisco Technology, Inc. Methods and apparatus for providing mobility of a node that does not support mobility
US20010049741A1 (en) 1999-06-18 2001-12-06 Bryan D. Skene Method and system for balancing load distribution on a wide area network
US7006431B1 (en) 1999-06-29 2006-02-28 Cisco Technology, Inc. Load sharing and redundancy scheme
US6751191B1 (en) 1999-06-29 2004-06-15 Cisco Technology, Inc. Load sharing and redundancy scheme
US6227785B1 (en) 1999-06-29 2001-05-08 Siemens Automotive Corporation Self-tightening clip
US6650641B1 (en) * 1999-07-02 2003-11-18 Cisco Technology, Inc. Network address translation using a forwarding agent
US6606315B1 (en) 1999-07-02 2003-08-12 Cisco Technology, Inc. Synchronizing service instructions among forwarding agents using a service manager
US6473802B2 (en) 1999-07-15 2002-10-29 F5 Networks, Inc. Method and system for storing load balancing information with an HTTP cookie
US20020040400A1 (en) 1999-07-15 2002-04-04 F5 Networks, Inc. Method and system for storing load balancing information with an HTTP cookie
US6636971B1 (en) 1999-08-02 2003-10-21 Intel Corporation Method and an apparatus for secure register access in electronic device
US6633585B1 (en) 1999-08-13 2003-10-14 International Business Machines Corporation Enhanced flow control in ATM edge switches
US6415323B1 (en) 1999-09-03 2002-07-02 Fastforward Networks Proximity-based redirection system for robust and scalable service-node location in an internetwork
US6578066B1 (en) 1999-09-17 2003-06-10 Alteon Websystems Distributed load-balancing internet servers
US6553568B1 (en) * 1999-09-29 2003-04-22 3Com Corporation Methods and systems for service level agreement enforcement on a data-over cable system
US6556591B2 (en) * 1999-10-09 2003-04-29 Conexant Systems, Inc. Method and apparatus for upstream burst transmission synchronization in cable modems
US6768743B1 (en) 1999-10-26 2004-07-27 3Com Corporation Method and system for address server redirection for multiple address networks
US6385204B1 (en) 1999-11-22 2002-05-07 Worldcom, Inc. Network architecture and call processing system
US7349979B1 (en) 1999-12-02 2008-03-25 Cisco Technology, Inc. Method and apparatus for redirecting network traffic
US7734816B2 (en) 1999-12-02 2010-06-08 Cisco Technology, Inc. Method and apparatus for redirecting network traffic
US20020010783A1 (en) 1999-12-06 2002-01-24 Leonard Primak System and method for enhancing operation of a web server cluster
US6857026B1 (en) 1999-12-14 2005-02-15 Nortel Networks Limited Using alternate routes for fail-over in a communication network
US6683873B1 (en) 1999-12-27 2004-01-27 Cisco Technology, Inc. Methods and apparatus for redirecting network traffic
US6295276B1 (en) 1999-12-31 2001-09-25 Ragula Systems Combining routers to increase concurrency and redundancy in external network access
US7058007B1 (en) 2000-01-18 2006-06-06 Cisco Technology, Inc. Method for a cable modem to rapidly switch to a backup CMTS
US6839829B1 (en) * 2000-01-18 2005-01-04 Cisco Technology, Inc. Routing protocol based redundancy design for shared-access networks
US7068712B1 (en) * 2000-01-18 2006-06-27 Cisco Technology, Inc. Cable network redundancy architecture
US7349348B1 (en) 2000-01-24 2008-03-25 Cisco Technologies, Inc. Method and apparatus for determining a network topology in the presence of network address translation
US7117273B1 (en) 2000-01-25 2006-10-03 Cisco Technology, Inc. Methods and apparatus for maintaining a map of node relationships for a network
US6779039B1 (en) 2000-03-31 2004-08-17 Avaya Technology Corp. System and method for routing message traffic using a cluster of routers sharing a single logical IP address distinct from unique IP addresses of the routers
US7143195B2 (en) 2000-04-17 2006-11-28 Circadence Corporation HTTP redirector
US20020023159A1 (en) 2000-04-17 2002-02-21 Mark Vange HTTP redirector
US6789125B1 (en) 2000-05-10 2004-09-07 Cisco Technology, Inc. Distributed network traffic load balancing technique implemented without gateway router
US7401159B1 (en) 2000-05-10 2008-07-15 Cisco Technology, Inc. Distributed network traffic load balancing technique implemented without gateway router
US6742044B1 (en) 2000-05-10 2004-05-25 Cisco Technology, Inc. Distributed network traffic load balancing technique implemented without gateway router
US7162540B2 (en) 2000-05-15 2007-01-09 Catchfire Systems, Inc. Method and system for prioritizing network services
US20020019879A1 (en) 2000-05-15 2002-02-14 Mark Jasen Method and system for prioritizing network services
US7111061B2 (en) 2000-05-26 2006-09-19 Akamai Technologies, Inc. Global load balancing across mirrored data centers
US20020129134A1 (en) 2000-05-26 2002-09-12 Leighton F. Thomson Global load balancing across mirrored data centers
US6839809B1 (en) 2000-05-31 2005-01-04 Cisco Technology, Inc. Methods and apparatus for improving content quality in web caching systems
US7395348B1 (en) 2000-06-05 2008-07-01 Cisco Technology, Inc. Network cache-based content routing
US6826599B1 (en) 2000-06-15 2004-11-30 Cisco Technology, Inc. Method and apparatus for optimizing memory use in network caching
US6765892B1 (en) 2000-06-26 2004-07-20 Cisco Technology, Inc. Optimizing IP multicast data transmission in a mobile IP environment
US6804221B1 (en) 2000-06-26 2004-10-12 Alcatel Micromobility using multicast
US7072979B1 (en) 2000-06-28 2006-07-04 Cisco Technology, Inc. Wide area load balancing of web traffic
US6981056B1 (en) 2000-06-28 2005-12-27 Cisco Technology, Inc. Wide area load balancing of web traffic
US20020012327A1 (en) 2000-07-27 2002-01-31 Hideaki Okada System and method of communications control
US20020062372A1 (en) 2000-08-04 2002-05-23 Jack Hong High performance server farm with tagging and pipelining
US7062570B2 (en) 2000-08-04 2006-06-13 Avaya Technology, Corp. High performance server farm with tagging and pipelining
US20020120697A1 (en) 2000-08-14 2002-08-29 Curtis Generous Multi-channel messaging system and method
US6920498B1 (en) 2000-08-31 2005-07-19 Cisco Technology, Inc. Phased learning approach to determining closest content serving sites
US6449249B1 (en) 2000-09-07 2002-09-10 Arris International, Inc. Spare circuit switching
US7042876B1 (en) 2000-09-12 2006-05-09 Cisco Technology, Inc. Stateful network address translation protocol implemented over a data network
US7136383B1 (en) 2000-12-26 2006-11-14 Cisco Technology, Inc. Redirection to a virtual router
US6885667B1 (en) 2000-12-26 2005-04-26 Cisco Technology, Inc. Redirection to a virtual router
US7039720B2 (en) 2001-01-25 2006-05-02 Marconi Intellectual Property (Ringfence) , Inc. Dense virtual router packet switching
US20020099849A1 (en) 2001-01-25 2002-07-25 Crescent Networks, Inc. Dense virtual router packet switching
US20030037165A1 (en) 2001-07-06 2003-02-20 Daisuke Shinomiya Dynamic load sharing system using a virtual router
US20030014540A1 (en) 2001-07-06 2003-01-16 Nortel Networks Limited Policy-based forwarding in open shortest path first (OSPF) networks
US20030031178A1 (en) 2001-08-07 2003-02-13 Amplify.Net, Inc. Method for ascertaining network bandwidth allocation policy associated with network address
US7149217B2 (en) 2001-08-14 2006-12-12 Extreme Networks Load-sharing technique for distributing multi-protocol label switching protocol encapsulated flows across multiple physical links
US6835696B2 (en) 2001-11-22 2004-12-28 Communications Research Laboratory Independent Administrative Institute Method of forming a superconductor film
US7065043B2 (en) 2001-12-24 2006-06-20 Innomedia Pte Ltd. Method and system for connecting to a proxy server with the lowest workload through querying a load monitor
US20030133420A1 (en) 2002-01-09 2003-07-17 Wassim Haddad Load balancing in data transfer networks
US20030161303A1 (en) 2002-02-22 2003-08-28 Nortel Networks Limited Traffic switching using multi-dimensional packet classification
US7260102B2 (en) 2002-02-22 2007-08-21 Nortel Networks Limited Traffic switching using multi-dimensional packet classification
US20040071141A1 (en) 2002-10-15 2004-04-15 Dhara Narendra Kumar Distributed service architecture based on a hierarchical load balancing approach
WO2005018176A1 (en) 2003-07-31 2005-02-24 Cisco Technology, Inc. Distributing and balancing traffic flow in a virtual gateway
US7593346B2 (en) 2003-07-31 2009-09-22 Cisco Technology, Inc. Distributing and balancing traffic flow in a virtual gateway
US20050111352A1 (en) 2003-11-21 2005-05-26 Boon Ho Method and system for monitoring a network containing routers using a backup routing protocol
US20050213832A1 (en) 2004-03-22 2005-09-29 Nortel Networks Limited Method and apparatus for providing network based load balancing of medical image data

Non-Patent Citations (141)

* Cited by examiner, † Cited by third party
Title
3Com Corporation, "Configuring Boundary Routing System Architecture," NETBuilder Family Bridge/Router Release Notes, Mar. 1994, pp. 26-29.
Akamai Technologies, Inc.-Global Internet Content Delivery-"How Free Flow Works," webmaster@akamai.com 1999-2000.
Asit, et al., "Multimedia Caching Strategies for Heterogeneous Application and Server Environments," Multimedia Tools and Application, May 1997, vol. 4, No. 3, pp. 379-312.
B. Welch, "A Comparison of the Vnode and Sprite File System Architectures," Proceedings of the File System Workshop, May 1992, pp. 29-44.
C.E. Perkins and T. Jagannadh, "DHCP for Mobile Networking with TCP/IP," IBM, Watson Research Center IEEE, Apr. 1995.
Cardellini, et al., "Dynamic Load Balancing on Web-Server Systems," Internet Computing, IEEE, May-Jun. 1993, vol. 3, sue 3, pp. 28-39.
Chambless, et al., "Home Agent Redunduncy Protocol (HARP)," Oct. 27, 1997.
Cisco Technology, Inc., "Configuring IP Routing Protocols," Dec. 10, 1997, http://www.cco.com/univercd/data/doc/software/11-2/cnp1/5ciprout.htm#REF40277, pp. 1-6, 120-122.
CN First Office Action dated Nov. 14, 2008 for Chinese Patent Application No. 200480021154.3.
CN Fourth Office Action dated Mar. 23, 2010 for Chinese Patent Application No. 200480021154.3.
CN Second Office Action dated May 22, 2009 for Chinese Patent Application No. 200480021154.3.
CN Third Office Action dated Oct. 9, 2009 for Chinese Patent Application No. 200480021154.3.
D. Farinacci, et al., Request for Comments No. 2784, entitled, "Generic Routing Encapsulation (GRE)," Jan. 2000, Network Working Group.
D. Oran, RFC 1142 "OSI IS-IS Intra-domain Routing Protocol", Feb. 1990.
Denny, et al. "Stateful Network Address Translation Protocol Implemented Over a Data Network," U.S. Appl. No. 09/735,199, filed Dec. 11, 2000, 67 Pages.
DHCP for Mobile Networking with TCP/IP, Perkins, C.E. and Jagannadh T., IBM, T.J. Watson Research Center, IEEE, Apr. 1995.
Digital land, Inc. -e-Business Without Limits-, "Enabling Technologies," http://www.digle.net. May 4, 2000.
E. Gerich, "Guidelines for Management of IP Address Space," RFC: 1466, Network Working Group, May 1993, 10 Pages.
Eager, et al., "Adaptive Load Sharing in Homogeneous Distributed Systems," IEEE, Transactions on Software Engineering, vol. Se-12, No. 5, May 1986, pp. 662-675.
EP Examination Report dated Oct. 13, 2006 from EP Patent Application No. 04755658.4.
EP Office Action dated Jan. 7, 2008 from EP Patent Application No. 04755658.4.
EP Office Action dated Sep. 3, 2009 for EP 04755658.4.
Gibson, et al., "File Server Scaling with Network-Attached Secure Disks," Association for Computing Machinery, 1997, pp. 272-284.
Ian Wilson, "Redirection to a Virtual Router," U.S. Appl. No. 09/748,828, filed Dec. 26, 2000, 33 Pages.
Information Sciences Institute, Request for Comments No. 793, entitled, "Transmission Control Protocol-DARPA Internet Program-Protocol Specification," Sep. 1981, Internet Engineering Task Force, 49 pages.
Internap, "Preferred Collocation Services," http://www.internap.com Copyright © 2001 Internap Network Services Corporation.
J. Moy, RFC 1247 "OSPF Version 2", Jul. 19, 1991.
J. Ousterhout, "A Trace-Driven Analysis of the UNIX 4.2 BSD File System," Jan. 2, 1993, Computer Science Division, Electrical Engineering and Computer Science, University of California, Berkeley, CA, pp. 1-12.
J. Ousterhout, "Beating the I/O Bottleneck: A Case for Log-Structured File Systems," Jan. 30, 1992, Computer Science Division, Electrical Engineering and Computer Sciences, University of California, Berkeley, CA, pp. 1-17.
K. Egevang et al., "The IP Network Address Translator (NAT)", Network Working Group, pp. 1-10, May 1994.
K. Johnson, "A Method and Apparatus for Minimalist Approach to Implementing Server Selection," U.S. Appl. No. 60/177,415, filed Jan. 21, 2000, 39 pages.
Kanekar, et al., "Load Sharing and Redundancy Scheme," U.S. Appl. 09/342,589, filed Jun. 29, 1999, 75 Pages.
Kent K. Leung, "Mobile IP Mobility Agent Standby Protocol", U.S. Appl. 09/107,701, filed Nov. 14, 2000, 51 Pages.
Kent Leung, "Mobile IP Mobility Agent Standby Protocol," U.S. Appl. No. 09/714,466, filed Nov. 14, 2000, 51 Pages.
Leung, et al. "Robust HA Redundancy and Load Balancing," U.S. Appl. No. 10/008,494, filed Nov. 9, 2001, 53 Pages.
M. Arlitt, et al., Hewlett-Packard Laboratories, "Evaluating Content Management Techniques For Web Proxy Caches," Apr. 30, 1999, 9 pages.
Meyer, et al., "Request for Comments No. 2026, entitled, "Generic Routing Encapsulation (GRE), Jan. 2000, Internet Engineering Task Force, 9 pages.
Network Working Group, RFC 2002, "IP Mobility Support," Oct. 1996.
Nosella, et al. "Gateway Load Balancing Protocol," U.S. Appl. No. 09/883,674, filed Jun. 18, 2001, 48 Pages.
P. Mockapetris, Request for Comments No. 1034, entitled, "Domain Name-Concepts and Facilities," Nov. 1987, Internet Engineering Task Force, 37 pages.
P. Srisuresh, et al, "IP Network Address Translator (NAT) Terminology and Considerations," RFC: 2663, Network Working Group, Aug. 1999, 30 Pages.
P. Srisuresh, et al, "Loading Sharing Using IP Network Address Translation (LSNAT)," RFC: 2391, Network Working Group, Aug. 1998, 18 Pages.
Pai, et al., "Locality-Aware Request Distribution in Cluster-based Network Servers," Association for Computing Machinery, 1998, pp. 205-216.
PCT International Search Report and Written Opinion mailed on Jul. 10, 2004 for PCT Application No. PCT/US2004/019617.
PCT International Search Report mailed on Aug. 24, 1995 for PCT Application No. PCT/US1995/04887.
Perkins, et al., "Route Optimization for Mobile IP," Cluster Computing, Jun. 1998 vol. 1, No. 2, pp. 161-176.
Release notes for 3Com Corporation, "NETBuilder Family Bridge/Router", pp. 27-29, (Mar. 1994).
S. Knight et al., "Virtual Router Redundancy Protocol", Apr. 1998, IETF, RFC 2338. *
T. Li, et al., RFC 2281 "Cisco Hot Standby Router Protocol (HSRP)," Mar. 1998. Mar. 1998.
U. Black, "TCP/IP and Related Protocols," McGraw-Hill, Inc. pp. 226-249, 1992.
US Final Office action dated Apr. 21, 2003 for U.S. Appl. No. 09/484,189.
US Final Office Action dated Apr. 27, 2005 for U.S. Appl. No. 09/605,917.
US Final Office Action dated Apr. 4, 2006 for U.S. Appl. No. 11/083,727.
US Final Office Action dated Aug. 10, 2004 for U.S. Appl. No. 09/484,611.
US Final Office Action dated Aug. 15, 2003 for U.S. Appl. No. 09/484,611.
US Final Office Action dated Aug. 20, 2008 for U.S. Appl. No. 10/899,668.
US Final Office Action dated Dec. 1, 2004 for U.S. Appl. No. 09/608,802.
US Final Office Action dated Dec. 21, 2005, 2005 for U.S. Appl. No. 09/883,674.
US Final Office Action dated Feb. 2, 2004 for U.S. Appl. No. 09/605,917.
US Final Office Action dated Jan. 30, 2007 for U.S. Appl. No. 09/608,802.
US Final Office Action dated Mar. 2, 2006 for U.S. Appl. No. 09/608,802.
US Final Office Action dated May 7, 2003 for U.S. Appl. No. 09/342,859.
US Final Office Action dated May 9, 2008 for U.S. Appl. No. 10/632,704.
US Final Office Action dated Oct. 1, 2003 for U.S. Appl. No. 09/569,090.
US Final Office Action dated Oct. 15, 2009 for U.S. Appl. No. 11/190,696.
US Final Office Action dated Oct. 4, 2006 for U.S. Appl. No. 10/008,494.
US Final Office Action dated Sep. 20, 2005 for U.S. Appl. No. 09/883,674.
US Notice of Allowance dated Apr. 15, 2004 for U.S. Appl. No. 09/484,189.
US Notice of Allowance dated Apr. 29, 2004 for U.S. Appl. No. 09/569,083.
US Notice of Allowance dated Apr. 30, 2009 for U.S. Appl. No. 10/632,704.
US Notice of Allowance dated Aug. 14, 2000 for U.S. Appl. No. 09/107,701.
US Notice of Allowance dated Aug. 18, 2005 for U.S. Appl. No. 09/605,917.
US Notice of Allowance dated Aug. 4, 2003 for U.S. Appl. No. 09/342,859.
US Notice of Allowance dated Dec. 21, 2004 for U.S. Appl. No. 09/748,828.
US Notice of Allowance dated Feb. 10, 2004 for U.S. Appl. No. 09/606,418.
US Notice of Allowance dated Jan. 26, 2007 for U.S. Appl. No. 10/008,494.
US Notice of Allowance dated Jan. 26, 2010 for U.S. Appl. No. 12/020,467.
US Notice of Allowance dated Jan. 5, 2006 for U.S. Appl. No. 09/484,611.
US Notice of Allowance dated Jan. 9, 2004 for U.S. Appl. No. 09/569,090.
US Notice of Allowance dated Jul. 1, 2005 for U.S. Appl. No. 09/606,418.
US Notice of Allowance dated Jul. 24, 1995 for U.S. Appl. No. 08/231,330.
US Notice of Allowance dated Jun. 3, 2005 for U.S. Appl. No. 09/484,612.
US Notice of Allowance dated Jun. 30, 2006 for U.S. Appl. No. 11/083,727.
US Notice of Allowance dated Mar. 27, 2007 for U.S. Appl. No. 10/008,494.
US Notice of Allowance dated Mar. 7, 2008 for U.S. Appl. No. 10/851,456.
US Notice of Allowance dated May 3, 2005 for U.S. Appl. No. 10/723,371.
US Notice of Allowance dated Nov. 22, 2005 for U.S. Appl. No. 09/484,612.
US Notice of Allowance dated Oct. 25, 2007 for U.S. Appl. No. 09/608,802.
US Notice of Allowance dated Sep. 8, 2003 for U.S. Appl. No. 09/476,188.
US Notice of Allowance for U.S. Appl. No. 09/714,466 dated May 21, 2002.
US Office Action dated Apr. 10, 2003 for U.S. Appl. No. 09/476,188.
US Office Action dated Apr. 15, 2003 for U.S. Appl. No. 09/569,090.
US Office Action dated Apr. 20, 2004 for U.S. Appl. No. 09/748,828.
US Office Action dated Apr. 25, 2003 for U.S. Appl. No. 09/484,612.
US Office Action dated Aug. 13, 2003 for U.S. Appl. No. 09/605,917.
US Office Action dated Dec. 10, 2009 for U.S. Appl. No. 09/883,674.
US Office Action dated Dec. 15, 2004 for U.S. Appl. No. 10/723,371.
US Office Action dated Dec. 2, 2003 for U.S. Appl. No. 09/608,802.
US Office action dated Dec. 8, 2003 for U.S. Appl. No. 09/484,189.
US Office Action dated Feb. 12, 2003 for U.S. Appl. No. 09/484,611.
US Office Action dated Feb. 12, 2008 for U.S. Appl. No. 10/899,668.
US Office Action dated Feb. 13, 2006 for U.S. Appl. No. 09/883,674.
US Office Action dated Feb. 16, 2005 for U.S. Appl. No. 09/484,611.
US Office Action dated Feb. 2, 2000 for U.S. Appl. No. 09/107,701.
US Office Action dated Jan. 21, 2004 for U.S. Appl. No. 09/484,611.
US Office Action dated Jul. 13, 2004 for U.S. Appl. No. 09/605,917.
US Office Action dated Jul. 19, 2005 for U.S. Appl. No. 09/484,611.
US Office Action dated Jul. 9, 2009 for U.S. Appl. No. 12/020,467.
US Office Action dated Jun. 10, 2009 for U.S. Appl. No. 09/883,674.
US Office Action dated Jun. 8, 2010, for U.S. Appl. No. 09/883,674.
US Office Action dated Jun. 9, 2009 for U.S. Appl. No. 10/899,668.
US Office Action dated Mar. 10, 2004 for U.S. Appl. No. 09/484,612.
US Office Action dated Mar. 15, 2004 for U.S. Appl. No. 09/608,802.
US Office Action dated Mar. 17, 1995 for U.S. Appl. No. 08/231,330.
US Office Action dated Mar. 17, 2009 for U.S. Appl. No. 11/190,696.
US Office Action dated Mar. 18, 2003 for U.S. Appl. No. 09/484,611.
US Office Action dated Mar. 25, 2010 for U.S. Appl. No. 10/899,668.
US Office Action dated Mar. 30, 2007 for U.S. Appl. No. 10/632,704.
US Office Action dated May 2, 2006 for U.S. Appl. No. 10/008,494.
US Office Action dated May 3, 2005 for U.S. Appl. No. 09/883,674.
US Office Action dated Nov. 15, 2002 for U.S. Appl. No. 09/342,859.
US Office action dated Nov. 18, 2002 for U.S. Appl. No. 09/484,189.
US Office Action dated Nov. 29, 2005 for U.S. Appl. No. 11/083,727.
US Office Action dated Nov. 6, 2002 for U.S. Appl. No. 09/484,612.
US Office Action dated Nov. 6, 2003 for U.S. Appl. No. 09/484,612.
US Office Action dated Oct. 14, 2003 for U.S. Appl. No. 09/606,418.
US Office Action dated Oct. 17, 2007 for U.S. Appl. No. 10/632,704.
US Office Action dated Oct. 6, 2003 for U.S. Appl. No. 09/569,083.
US Office Action dated Sep. 16, 2004 for U.S. Appl. No. 09/484,612.
US Office Action dated Sep. 20, 2005 for U.S. Appl. No. 09/608,802.
US Office Action dated Sep. 6, 2006 for U.S. Appl. No. 09/608,802.
US Office Action for dated Sep. 24, 2007 U.S. Appl. No. 10/851,456.
US Office Action for U.S. Appl. No. 09/714,466 dated Jun. 4, 2001.
US Office Action for U.S. Appl. No. 09/714,466 dated Nov. 27, 2001.
US Supplemental Notice of Allowance dated Mar. 12, 2004 for U.S. Appl. No. 09/569,090.
US Supplemental Notice of Allowance dated Oct. 3, 2003 for U.S. Appl. No. 09/342,859.
US Supplemental Notice of Allowance dated Sep. 15, 2005 for U.S. Appl. No. 10/723,371.
Valloppillil, "Cache Array Routing Protocol v1.0", Oct. 20, 1997, Internet-Draft, http://ds1.internic/net/internet-drafts/draft-vinod-carp-v1-02.txt, pp. 1-6.
Woundy, et al. "Routing Protocol Based Redundancy Design for Shared-Access Networks," U.S. Appl. No. 09/484,189, filed Jan. 18, 2000, 53 Pages.
Y. Rekhter, et al, "Address Allocation for Private Internets," RFC: 1918, Network Working Group, Feb. 1996, 9 Pages.
Zang, et al. "Cable Network Redundancy Architecture," U.S. Appl. No. 09/484,612, filed Jan. 18, 2000, 60 Pages.

Also Published As

Publication number Publication date
US7058007B1 (en) 2006-06-06

Similar Documents

Publication Publication Date Title
USRE44661E1 (en) Method for a cable modem to rapidly switch to a backup CMTS
US6839829B1 (en) Routing protocol based redundancy design for shared-access networks
US6742187B1 (en) Upstream bandwidth allocation map (MAP)-initiated channel change method for data-over-cable systems
US11018758B2 (en) Mobility across satellite beams using L2 connectivity
US7068712B1 (en) Cable network redundancy architecture
US7701951B2 (en) Resource reservation and admission control for IP network
US10439862B2 (en) Communication terminal with multiple virtual network interfaces
US7085287B1 (en) Map routing technique implemented in access networks
US7672230B2 (en) Downstream channel change technique implemented in an access network
US6693878B1 (en) Technique and apparatus for using node ID as virtual private network (VPN) identifiers
US6442158B1 (en) Method and system for quality-of-service based data forwarding in a data-over-cable system
US6891858B1 (en) Dynamic modulation of modulation profiles for communication channels in an access network
US7072337B1 (en) System and method for resolving network addresses for network devices on distributed network subnets
US7209442B1 (en) Packet fiber node
US7895312B1 (en) IP subnet sharing technique implemented without using bridging or routing protocols
RU2273096C2 (en) Service change-over in multiple-address transmission session
US7739359B1 (en) Methods and apparatus for secure cable modem provisioning
US7085306B1 (en) System and method for a multi-frequency upstream channel in a computer network
US7349430B1 (en) Addressing scheme implemented in access networks
US8365255B1 (en) Configuration file download enforcement
CN101904133A (en) Method and arrangement for network QOS
US20140355605A1 (en) System and method for combining multiple communication links
US7840988B1 (en) Front-end structure for access network line card
US20090150955A1 (en) Apparatus and method for switch operation of downstream terminal platform for ip data transmission using legacy transmission system in hfc network
US7656877B1 (en) Apparatus and methods for sniffing data in a cable head end

Legal Events

Date Code Title Description
FPAY Fee payment

Year of fee payment: 8

SULP Surcharge for late payment

Year of fee payment: 7

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.)

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.)