US20110289212A1 - Virtual Interface - Google Patents
Virtual Interface Download PDFInfo
- Publication number
- US20110289212A1 US20110289212A1 US13/196,708 US201113196708A US2011289212A1 US 20110289212 A1 US20110289212 A1 US 20110289212A1 US 201113196708 A US201113196708 A US 201113196708A US 2011289212 A1 US2011289212 A1 US 2011289212A1
- Authority
- US
- United States
- Prior art keywords
- network
- testing system
- computing device
- client computing
- communication channel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/08—Protocols specially adapted for terminal emulation, e.g. Telnet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
Definitions
- the invention relates to testing and analysis of communications networks, systems and devices, and, applications that run thereon.
- Networks such as the Internet provide access to a variety of data of all kinds which is communicated using a variety of network devices including servers, routers, hubs, switches, and other devices.
- testing to ensure successful operation and to identify limitations may be performed.
- Network devices may be tested, for example, to ensure that they function as intended, comply with supported protocols, and can withstand anticipated traffic demands.
- networks may be augmented with network analyzing devices, network compliance systems, network monitoring devices, and network traffic generators, all which are referred to herein as network testing systems.
- the network testing systems may allow for the sending, capturing and/or analyzing of network communications.
- FIG. 1 is a block diagram of an environment in accordance with the invention.
- FIG. 2 is a block diagram of a system in accordance with the invention.
- FIG. 3 is a block diagram of a client driver in accordance with the invention.
- FIG. 4 is a block diagram of a server driver in accordance with the invention.
- FIG. 5A is a flow chart of actions taken by a mirror client and a mirror server in accordance with the invention.
- FIG. 5B is a flow chart of actions taken by a mirror client to remove a mirror device in accordance with the invention.
- FIG. 6 is a flow chart of actions taken by a mirror server in accordance with the invention.
- FIG. 7 is a flow chart of further actions taken by a mirror client and a mirror server in accordance with the invention.
- the environment includes a client computer 100 , a network testing system 110 , a connection 104 , plural network capable devices 130 , and a network 140 .
- the client computer 100 may include or be one or more of any computing devices such as computer workstations, personal computers, servers, portable computers, computing tablets, and the like.
- the client computer 100 is coupled to network testing system 110 via connection 104 .
- the client computer 100 includes a network interface circuit which provides the client computer 100 the capability to communicate over a network or communication channel such as connection 104 .
- client computer 100 may communicate with network testing system 110 via network 140 over network connections 108 and 116 .
- the client computer 100 may include a processor, a memory such as, for example, random access memory (RAM), and a storage device.
- the storage device may include a machine readable medium such as a hard disk, a CD-ROM, and other similar devices.
- the storage device may be one or more of a magnetic disk drive such as a hard disk drive, an optical disk drive such as a compact disk (CD) or digital versatile disk (DVD) reader/writer, and other similar devices.
- the client computer 100 may include mirror client software stored permanently or temporarily in memory and/or on a storage device included therein.
- the client computer 100 may also include an operating system such as, for example, versions of Linux, Unix and Microsoft Windows.
- the mirror client functionality may be implemented on one or more hardware devices, and as a combination of hardware and software.
- the hardware devices include field programmable gate arrays (FPGA), application specific integrated circuits (ASIC), programmable logic devices (PLD), programmable logic arrays (PLA), processors and other kinds of devices.
- the network testing system 110 may include or be one or more of a traffic generator, a performance analyzer, a conformance validation system, a network analyzer, a network management system, and/or others.
- the network testing system 110 may include a processor, a memory such as, for example, RAM and flash memory, and a storage device.
- the network testing system 110 may include one or more network cards 114 and a back plane 112 .
- the network testing system 110 and/or one or more of the network cards 114 may be coupled to network 140 via network connection 116 . Although only one network connection 116 is shown, two or more network connections may exist between the network testing system 110 and the network 140 .
- the network testing system 110 may be in the form of a card rack, as shown in FIG. 1 , or may be an integrated unit. Alternatively, the network testing system may comprise a number of separate units cooperating to provide traffic generation, traffic and/or network analysis, network conformance testing, and other tasks. Alternatively, the network testing system 110 may be a computer with one or
- the network testing system 110 and the network cards 114 may support one or more well known communications standards or protocols such as, for example, the 10 Gigabit Ethernet standard, SONET, the Fibre Channel standards, and one or more varieties of the IEEE 802 Ethernet standards, may support proprietary protocols, and may support other protocols.
- communications standards or protocols such as, for example, the 10 Gigabit Ethernet standard, SONET, the Fibre Channel standards, and one or more varieties of the IEEE 802 Ethernet standards, may support proprietary protocols, and may support other protocols.
- the term “network card” encompasses line cards, test cards, analysis cards, network line cards, load modules, interface cards, network interface cards, data interface cards, packet engine cards, service cards, smart cards, switch cards, relay access cards, and others.
- the network cards 114 may include one or more FPGAs, ASICs, PLDs, PLAs, processors and other kinds of devices.
- the network cards may include memory.
- the network cards 114 may include software and firmware.
- Each network card 114 may include a circuit, chip or chip set that allows the network card 114 to communicate over a network as one or more network capable devices.
- a “network capable device” is any device that may communicate over network 140 .
- the network cards 114 may be connected to the network through wire, optical fiber, wirelessly or otherwise.
- Each network card 114 may support a single communications protocol, may support a number of related protocols, or may support a number of unrelated protocols.
- the network cards 114 may be permanently installed in the network testing system 110 , may be removable, or may be a combination thereof.
- the network testing system 110 and/or each network card 114 may include mirror server software and/or be capable of executing mirror server software.
- the functionality of the mirror server may be implemented on network cards 114 as one or more FPGAs, ASICs, PLDs, PLAs, processors, flash memory, firmware and/or other kinds of devices.
- the back plane 112 may serve as a bus or communications medium for the network cards 114 .
- the back plane 112 may also provide power to the network cards 114 .
- the network capable devices 130 may be any devices capable of communicating over the network 140 .
- the network capable devices 130 may be computing devices such as workstations, personal computers, servers, portable computers, personal digital assistants (PDAs), computing tablets, and the like; peripheral devices such as printers, scanners, facsimile machines and the like; network capable storage devices including disk drives such as network attached storage (NAS) and storage area network (SAN) devices; networking devices such as routers, relays, firewalls, hubs, switches, bridges, and multiplexers.
- the network capable devices 130 may include appliances such as refrigerators, washing machines, and the like as well as residential or commercial HVAC systems, alarm systems, and any other device or system capable of communicating over a network.
- the network capable devices 130 may be referred to as devices under test (DUTs).
- the network 140 may be a local area network (LAN), a wide area network (WAN), a storage area network (SAN).
- the network 140 may be wired, wireless, or a combination of these, and may include or be the Internet.
- the network 140 may be public or private, and may be a segregated test network. Communications on the network 140 may take various forms, including frames, cells, datagrams, packets or other units of information, all of which are referred to herein as “data units”.
- the network 140 may be comprised of numerous nodes providing numerous physical and logical paths for data to travel.
- connection 104 may be a private LAN, a private WAN, an Ethernet cable, or other wired or wireless connection.
- the connection 104 may be a direct connection such as, for example, via Universal Serial Bus (USB) and IEEE 1394 cables.
- USB Universal Serial Bus
- software on the client computer 100 may transparently access the capabilities, including features and functionality, of one or more network devices on network cards 114 in network testing system 110 . That is, software on the client computer 100 may transparently use the mirror device as if it were a network device installed in the client computer.
- Capabilities include, for example, without limitation, added protocol support, increased speed (i.e., higher speed PHY or layer 1 ), increased throughput (i.e., processing capability), application support, and others.
- the client may include a device such as a network interface card (NIC) which allows for network communication at speeds up to 100 Mbps
- the network testing system 110 may include network devices on network cards 114 which allow for communication at 10 Gbps.
- Capabilities also include allowing a client computer 100 located remote to the network testing system 110 to transparently access the network cards 114 to communicate with network devices 130 over network 140 as if the client computer 100 were local to the network devices 130 .
- a user of software on a client computer 100 may communicate over connection 104 to access the capabilities of a network device on network cards 114 .
- the techniques may be used to test one or more devices 130 over network 140 .
- a client computer 100 may communicate over network 140 with network devices in network cards 114 in network testing system 110 via network connections 108 and 116 .
- FIG. 2 is a block diagram of a system in accordance with the invention.
- a mirror client 200 and a mirror server 230 are coupled to one another via network 220 .
- a mirror client 200 includes application software 202 , operating system 204 , mirror client driver 212 , one or more mirror devices 210 and tunnel device 216 .
- Mirror server 230 includes operating system 232 , mirror server driver 236 , tunnel device 238 and one or more network devices 234 .
- the mirror server may access a network 240 via the network devices 234 .
- the mirror client 200 may be a personal computer or workstation like client computer 100 shown in FIG. 1 , and the mirror server may be a network testing system 110 or a network card 114 shown in FIG. 1 .
- the network 220 may correspond to the connection 104 of FIG. 1
- the network 240 may correspond to the network 140 of FIG. 1
- the application software 202 may be network testing software including software applications that allow a user to send, receive and/or analyze network traffic from the application layer down to the physical layer, and perform other network testing functions for network devices, network systems and/or network applications.
- the network traffic is comprised of data units.
- any upper layer software that is, any software at layers two and above in the Open Systems Interconnection (OSI) model, may access the mirror device in addition to or in place of the application software 202 .
- “Upper layer software” as used herein includes application programs, application layer software, network layer software, internet protocol (IP) software, session layer software, presentation layer software, and any software that is layer two and above.
- IP internet protocol
- the application software 202 on mirror client 200 may control, monitor and otherwise access the network device 234 on mirror server 230 through the local mirror device 210 . All activity occurring on the network device 234 on mirror server 230 is mirrored in mirror device 210 . This may be achieved by establishing a communication channel such as tunnel 222 over a network 220 that connects the mirror client 200 and the mirror server 230 . Any incoming data units received by network device 234 are forwarded to mirror device 210 , and any outgoing data units sent to mirror device 210 are forwarded to network device 234 .
- Mirror device 210 serves as a virtual interface to network device 234 .
- Mirror device 210 is a virtual network device that exists solely in software.
- network device 234 is a NIC
- mirror device 210 serves as a virtual NIC.
- network device 234 includes one or more ports
- one or more mirror devices 210 may provide a virtual interface to the ports on the network device 234 .
- multiple mirror devices on mirror client 200 may provide multiple virtual interfaces to network devices on multiple mirror servers which may be located geographically near to and/or far from the mirror client 200 .
- the mirror device 210 may be accessed by the application software 202 the same way the application software 202 traditionally accesses hardware (and software) devices. That is, the application software 202 may access the mirror device 210 via the operating system 204 in the same way any application would use operating system provided interfaces (such as procedure calls) to access any hardware (or software) device. Similarly, according to the virtual interface techniques described herein, any upper layer software may access the mirror device 210 in the same manner as the upper layer software accesses hardware and/or software devices included in mirror client 200 .
- Mirror device 210 may be created by using an operating system utility.
- the operating system 204 may maintain information about the mirror device 210 in a device list or other data structure, just as the operating system 204 maintains information about other devices accessible on the mirror client 200 .
- the mirror device 210 may be accessed by IOCTL calls or other interface made available by the operating system.
- the application software 202 may initiate outgoing data units from the mirror device 210 .
- Mirror client driver 212 may provide the processing by which the mirror device 210 may send outgoing data units.
- the mirror client driver 212 may provide an application program interface (API) or programming interface in the form of one or more procedure calls, or other interface to the application software 202 or other upper layer software.
- API application program interface
- Mirror client driver 212 formats the outgoing data unit according to any tunnel requirements, and sends outgoing data units via tunnel device 216 over tunnel 222 to mirror server 230 .
- the outgoing data unit is received by tunnel device 238 and passed to mirror server driver 236 on network device 234 .
- Mirror server driver 236 un-tunnels the data unit and communicates it onto the network 240 via network device 234 .
- the network device 234 may be a hardware device having a physical interface that allows for communications over network 240 .
- the network device 234 may be a high speed NIC that allows for transmission speeds of 10 Gbps or more.
- the network device 234 may receive incoming data units from the network 240 .
- the incoming data units may be tunneled from the network device 234 at the mirror server 230 to the mirror device 210 at the mirror client 200 .
- the tunneling is performed by the mirror server driver 236 via the tunnel device 218 .
- the mirror client driver 212 receives incoming data units via tunnel device 216 and un-tunnels them.
- the mirror client driver 212 passes the incoming data units to the application software 202 via the operating system 204 .
- the tunnel 222 may be formed between tunnel devices 216 and 238 .
- Tunnel devices 216 and 218 may each be NICs.
- the tunnel 222 may be created using a transmission control protocol (TCP) socket.
- TCP transmission control protocol
- IP internet protocol
- MAC media access control
- a User Datagram Protocol (UDP) socket or other communication protocol construct may be used to form the communication channel over tunnel 222 .
- mirror client 200 and mirror server 232 may be passed between mirror client 200 and mirror server 232 using any kind of communication channel, including TCP and UDP sockets, ethernet, and any other communication technique or protocol, whether publicly known or proprietary.
- a “mirror protocol” may be used for communication between the mirror client driver 212 and the mirror server driver 236 .
- the mirror protocol allows for the packaging and unpackaging of data units that are transferred across the tunnel 222 between the mirror client 200 and the mirror server 230 .
- the mirror protocol may define a mirror protocol packet as having a header and a payload.
- the header may include a mirror protocol packet type, a mirror protocol version number, authentication information, and codes that may be used for increased control over the communications on the tunnel, as well as other fields.
- the mirror protocol allows for five types of mirror protocol packets: query, response, report, error, and data. Also included in the header is the length of the payload in bytes (octets).
- the payload may be an incoming data unit received over the network 240 or an outgoing data unit to be sent on to the network 240 .
- the payload may also contain other data originating from the mirror client driver 212 or the mirror server driver 236 which corresponds to the mirror protocol packet type.
- tunnel devices 216 and 238 which may be NICs
- the tunnel devices may be USB or IEEE 1394 interfaces and the communication channel may be a USB or IEEE 1394 communication line.
- the communication channel may be formed over Ethernet, SONET or Fibre Channel, and others.
- a mirror client and a mirror server may communicate over network 240 via network connections like those depicted as network connections 108 and 116 in FIG. 1 .
- FIG. 3 is a block diagram of a mirror client driver 300 in accordance with the invention.
- the mirror client driver 300 may include a tunnel module 310 , a client management module 312 , and a device simulation module 314 . Although three module are discussed and shown, more and fewer modules may be included to achieve the functionality of the mirror client driver 300 .
- the tunnel module 310 is used to create the tunnel 320 , to close the tunnel 320 , and to manage the exchange of data to and from the mirror client driver 300 .
- the exchange of data may be achieved using the mirror protocol discussed above.
- the tunnel module 310 allows for establishing a tunnel, in one embodiment, opening a socket, with the mirror server; sending mirror protocol packets to the mirror server; receiving mirror protocol packets from the mirror server; and closing the connection with the mirror server.
- the device simulation module 314 allows for the creation, deletion, and other control of mirror devices, such as mirror device 210 shown in FIG. 2 .
- the device simulation module 314 receives device creation/deletion instructions from the client management module 312 .
- the device simulation module 314 also receives incoming data units data from the tunnel module 310 and makes the incoming data units available to application programs via, in one embodiment, a programming interface 322 .
- the device simulation module 314 provides the programming interface 322 to upper layer software.
- the device simulation module 314 may conform to rules for device drivers defined by an operating system on a client computer.
- the device simulation module 314 processes requests for information about a specific network device on the mirror server, and processes requests to send outgoing data units via a specific network device on the mirror server.
- the client management module 312 receives requests from upper layer software via the device simulation module 314 and manages tunnel related operations via the tunnel module 310 .
- the client management module 312 provides a mirror client utility program interface 324 which is used to create and delete the mirror devices.
- the client management module 312 maps and maintains mapping information regarding the tunnels and associated mirror devices, network devices on the mirror server, and/or network interfaces to the network devices on the mirror server, as well as other pertinent tunnel information.
- the mapping information may be stored as a connection information base.
- FIG. 4 is a block diagram of a mirror server driver 400 in accordance with the invention.
- the mirror server driver 400 maintains information for the tunnels between the mirror server and the mirror client, manages communications with the mirror devices over the tunnel, receives and processes incoming data units from the network, and receives and processes requests from the mirror client received over the tunnel.
- the mirror server driver 400 may consist of a tunnel module 402 , a network interface module 406 , and a server management module 404 .
- the tunnel module 402 creates and closes tunnels based on requests received via the server management module 404 .
- the tunnel module 402 exchanges mirror protocol packets with the mirror client according to the mirror protocol.
- the mirror protocol packets are exchanged between the mirror client and the mirror server over the tunnel to the mirror client 414 .
- the tunnel module 402 provides an interface to the server management module 404 to allow a server utility program resident on the mirror server to create a tunnel by, in one embodiment, opening a socket.
- the tunnel module 402 accepts connections from the mirror client, sends mirror protocol packets over the tunnel to the mirror client, and receives mirror protocol packets over the tunnel from the mirror client.
- the network interface module 406 allows for the receipt of incoming data units over a network and sending outgoing data units over the network.
- the network interface module 406 receives incoming data units over a physical layer interface 410 with the network, and sends the incoming data units to the corresponding mirror device on the mirror client via the tunnel module 402 .
- Information to be passed from a mirror device to a network device is received via the tunnel module 402 and directed to the network interface module 406 .
- the server management module 404 receives requests from the application software or other upper layer software on the mirror client via tunnel module 402 , manages tunnel related operations via tunnel module 402 , and communicates with the network interface module 406 .
- the requests may also originate from the mirror device on the mirror client.
- the server management module 404 maintains mapping information regarding the various network interfaces and corresponding tunnels, which may be, in one embodiment, sockets.
- the server management module 404 also receives tunnel creation instructions, tunnel deletion instructions, other instructions, and other queries from a server utility program via a server utility program interface 412 .
- the client management module 312 on the mirror client and the server management module 404 on the mirror server cooperatively manage the tunnel which allows a mirror device on the mirror client to mirror a network device on the mirror server.
- FIG. 5A is a flow chart of actions taken by a mirror client and a mirror server in accordance with the invention.
- a mirror device is created on the mirror client. This may be achieved by running a mirror client utility to create the mirror device.
- the mirror client utility may be an application program or an operating system utility.
- the mirror client utility may require arguments such as the network (e.g., IP) address of the network interfaces of the network devices on the mirror server, a port designation on the network device, a name to correspond to the mirror device created, and others.
- IP network
- the mirror client receives the mirror device creation request, as shown in block 502 .
- a mirror device is created and a tunnel connection is established with the specified mirror server, as shown in block 504 . This may be achieved by using a socket. If the attempt to establish the connection is unsuccessful, an error code is returned. If the tunnel is successfully created, the mirror client updates a connection information base that includes information about the established mirror devices and mappings of the tunnel and associated network device with a mirror device, as shown in block 506 .
- the connection information base may be in any format or data structure, including, in one embodiment, a linked list of tunnel/mirror device mappings.
- a check may be made to determine whether the tunnel is readable, as shown in block 508 . This may be achieved by listening on a socket or waiting for data from the tunnel. If the tunnel is readable, there is a mirror protocol packet available via the tunnel 525 , and the data stream from the tunnel 526 is read, as shown in block 510 .
- the mirror protocol packet is evaluated to determine what kind of mirror protocol packet has been received, as shown in block 512 .
- the mirror protocol packet may contain a data unit received from the mirror server 550 over a network or other data. If the kind of mirror protocol packet is “data”, the data unit in the mirror protocol packet is extracted, as shown in block 514 .
- the data from the data unit is made available to upper layer software in the mirror client 540 , as shown in block 516 .
- the data and/or the data unit is made available to a network layer via a procedure call interface.
- queues, mailboxes, data registers, and other techniques may be used to made the data and/or the data unit to available to upper layer software.
- the mirror protocol packet may contain a query for information about the mirror device or the mirror client.
- the mirror client 540 processes the query accordingly based on the particular query, as shown in block 518 . This may be achieved by the mirror client driver providing requested information to the mirror server 550 or to one or more network interfaces associated with a network device included in the mirror server 550 .
- the mirror client 540 uses the tunnel 526 to communicate any response to the query to the mirror server 550 or to one or more network interfaces associated with network devices accessible via the mirror server 550 .
- the mirror protocol packets received by mirror client 540 may also contain control and status information.
- the control and status information may include information about the status of the tunnel, configuration information concerning the network device emulated by the mirror device, status information regarding a network interface and/or a network device on the mirror server 550 , and other information.
- the mirror client may also receive a request to remove a mirror device.
- a single utility program may be used to create and remove mirror devices. Arguments provided to the utility program may control its functionality. Alternatively, separate programs may be provided which allow for the creation and removal of mirror devices.
- FIG. 5B is a flow chart of actions taken by a mirror client to remove a mirror device in accordance with the invention.
- the client utility program may be called with appropriate arguments.
- the arguments identify the mirror device to be removed.
- the mirror device may be identified by one or more of a tunnel name or identifier, a socket number, an interface name, an interface identifier, a device name, and other techniques.
- the mirror client receives the mirror device removal request, as shown in block 530 .
- the tunnel associated with the mirror device is closed, as shown in block 532 , and the mirror device is removed from the operating system device list, as shown in block 534 . This may be achieved via an operating system provided procedure or interface, such as for example, an IOCTL call.
- the connection information base is updated to remove the mirror device, the tunnel, the mapping of the network interface and the tunnel with the mirror device, and any associated interfaces, as shown in block 536 .
- FIG. 6 is a flow chart of actions taken by a mirror server in accordance with the invention.
- the mirror server may receive a request from a server utility program, as shown in block 610 .
- the actions taken by the mirror server are dependent on the kind of request.
- a check for the kind of request is made, as shown in block 612 .
- the kind of request may be to start a communication tunnel to one or more network interfaces associated with a network device, as shown in block 620 ; to register one or more network interfaces associated with a network device as available for mirroring, as shown in block 630 ; to unregister a network interface to a network device from the mirroring system, as shown in block 640 ; and to end all mirroring regarding all network interfaces to all network devices, as shown in block 650 .
- the functionality of processing of each kind of request and the kinds of requests may be combined, further delineated or expanded.
- the request may include arguments such as one or more of the network (e.g., IP address) of the network device or network interface, the network address of the mirror server, a tunnel, port or socket designation or identifier, and/or others.
- a list of network interfaces to be added to the server interface database may also be specified.
- the server utility program request may use an operating system procedure or utility such as an IOCTL to communicate the start request.
- the server management module may communicate with the driver module to implement the server utility program start request.
- a server interface database mapping the network interfaces to corresponding tunnels is updated, as shown in block 622 .
- the tunnel may be a socket.
- a well known protocol such as TCP may be used to communicate over the tunnel.
- the server interface database may be used to maintain a list of all tunnels, and, in some embodiments, sockets, which have been created and their corresponding network interfaces.
- the specified tunnel is opened and is bound to the specified network address, as shown in block 624 .
- the mirror server then listens on the tunnel for mirror protocol packets from the mirror client, as shown in block 626 .
- a thread may be created via the operating system. The thread may be used to process information received from the tunnel and/or monitor the tunnel. One thread may be used by the mirror server driver, or multiple threads may be used by the mirror server driver.
- the request may include arguments such as the port or socket designation of the network interface or the network device, and a list of identifiers of network interfaces to be added to the server interface database.
- arguments such as the port or socket designation of the network interface or the network device, and a list of identifiers of network interfaces to be added to the server interface database.
- the port, network device identifier, network interface identifier or other designation regarding the network device need not be included.
- the server utility program request specifies that a network interface to a network device should be registered, as shown in block 630 , the network interface is added to the server interface database mapped to a network device and/or port on the network device, as shown in block 632 .
- a notification is sent to the mirror client that the specified network interface no longer exists, as shown in block 642 . This may be achieved by sending an appropriate mirror protocol packet over the tunnel.
- the tunnel, and, in one embodiment, any socket, associated with the interface is closed, as shown in block 644 .
- the server interface database is updated, removing the specified network interface, as shown in block 646 . Other data related to the specified network device may also be removed from the server interface database.
- a notification is sent to the mirror client that all network interfaces no longer exist, as shown in block 652 . This may be achieved by sending an appropriate mirror protocol packet over the tunnel. All tunnels, including, in some embodiments, all TCP connections/sockets, are closed, as shown in block 654 . The server interface database is cleared, removing all network interfaces and any corresponding tunnel (and any socket) mappings, as shown in block 656 . If one or more threads were created to manage the mirror server functionality, the one or more threads are deleted.
- FIG. 7 is a flow chart of further actions taken by a mirror client and a mirror server in accordance with the invention.
- the mirror server accepts a connection from a mirror client, as shown in block 702 .
- the mirror server then waits on the tunnel associated with the connection.
- a check is made to determine if the tunnel is readable, as shown in block 704 . That is, a check is made to determine if there is a mirror protocol packet in the tunnel 736 . This may be achieved by waiting on a TCP socket.
- the mirror client 740 will have sent a mirror protocol packet to the mirror server via tunnel 736 , as shown in block 734 .
- Software on the mirror client elects to send a mirror protocol packet including a data unit or a query to the mirror server 750 , as shown in block 730 .
- the query may be a query for the availability of a network device or network interface to be mirrored.
- the mirror client prepares the mirror protocol packet, as shown in block 732 .
- the mirror client 740 then sends the mirror protocol packet to the mirror server 750 via tunnel 736 , as shown in block 734 .
- the tunnel is readable, as shown in block 704
- the data stream from the tunnel 736 is read, as shown in block 706 .
- a check is made to determine the kind of mirror protocol packet read from the tunnel 736 , as shown in block 710 .
- the kind of mirror protocol packet may be an outgoing data unit or a query in the form of an mirror request. Other mirror protocol packets may also be checked for and handled appropriately.
- the outgoing data unit is extracted from the mirror protocol packet, as shown in block 712 .
- the outgoing packet may be assembled or constructed according to parameters specified in the mirror protocol packet.
- the outgoing data unit is then transmitted via the network device associated with the network interface, as shown in block 714 .
- the kind of mirror protocol packet is a query in the form of mirror request, as shown in block 710 , a check is made to determine the availability of the specified network interface, as shown in block 716 . If the network interface is available, the connection information base is updated, such that an entry mapping the tunnel and its associated network interface with the corresponding mirror client virtual interface is added, as shown in block 720 . A request granted mirror protocol packet may then be sent to the mirror client over tunnel 736 , as shown in block 722 . If the network device and/or the network interface to the network device is not available, the mirror server prepares and sends a response to the mirror client. The response is sent over the tunnel 736 in the form of a mirror protocol packet stating the network interface to the network device is not available, as shown in block 726 .
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Description
- This patent claims priority from Utility patent application Ser. No. 10/608,491 filed Jun. 27, 2003, entitled “VIRTUAL INTERFACE”, which is incorporated herein by reference.
- A portion of the disclosure of this patent document contains material which is subject to copyright protection. This patent document may show and/or describe matter which is or may become trade dress of the owner. The copyright and trade dress owner has no objection to the facsimile reproduction by anyone of the patent disclosure as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright and trade dress rights whatsoever.
- 1. Field of the Invention
- The invention relates to testing and analysis of communications networks, systems and devices, and, applications that run thereon.
- 2. Description of Related Art
- Networks such as the Internet provide access to a variety of data of all kinds which is communicated using a variety of network devices including servers, routers, hubs, switches, and other devices. Before placing a network, network device or application into use, testing to ensure successful operation and to identify limitations may be performed. Network devices may be tested, for example, to ensure that they function as intended, comply with supported protocols, and can withstand anticipated traffic demands.
- To assist with the construction, installation and maintenance of networks, network devices and applications, networks may be augmented with network analyzing devices, network compliance systems, network monitoring devices, and network traffic generators, all which are referred to herein as network testing systems. The network testing systems may allow for the sending, capturing and/or analyzing of network communications.
- Personal computers and workstations running software applications used to test networks, monitor networks, check network conformance, analyze networks, generate network and perform other network related tasks are not typically equipped with network devices, hardware and components which have the capabilities and features of network testing systems.
-
FIG. 1 is a block diagram of an environment in accordance with the invention. -
FIG. 2 is a block diagram of a system in accordance with the invention. -
FIG. 3 is a block diagram of a client driver in accordance with the invention. -
FIG. 4 is a block diagram of a server driver in accordance with the invention. -
FIG. 5A is a flow chart of actions taken by a mirror client and a mirror server in accordance with the invention. -
FIG. 5B is a flow chart of actions taken by a mirror client to remove a mirror device in accordance with the invention. -
FIG. 6 is a flow chart of actions taken by a mirror server in accordance with the invention. -
FIG. 7 is a flow chart of further actions taken by a mirror client and a mirror server in accordance with the invention. - Throughout this description, the embodiments and examples shown should be considered as exemplars, rather than limitations on the disclosure.
- The System
- Referring to
FIG. 1 , there is shown a block diagram of an environment in accordance with the invention. The environment includes aclient computer 100, anetwork testing system 110, aconnection 104, plural networkcapable devices 130, and anetwork 140. - The
client computer 100 may include or be one or more of any computing devices such as computer workstations, personal computers, servers, portable computers, computing tablets, and the like. Theclient computer 100 is coupled tonetwork testing system 110 viaconnection 104. Theclient computer 100 includes a network interface circuit which provides theclient computer 100 the capability to communicate over a network or communication channel such asconnection 104. Alternatively,client computer 100 may communicate withnetwork testing system 110 vianetwork 140 overnetwork connections - The
client computer 100 may include a processor, a memory such as, for example, random access memory (RAM), and a storage device. The storage device may include a machine readable medium such as a hard disk, a CD-ROM, and other similar devices. The storage device may be one or more of a magnetic disk drive such as a hard disk drive, an optical disk drive such as a compact disk (CD) or digital versatile disk (DVD) reader/writer, and other similar devices. - The
client computer 100 may include mirror client software stored permanently or temporarily in memory and/or on a storage device included therein. Theclient computer 100 may also include an operating system such as, for example, versions of Linux, Unix and Microsoft Windows. Alternatively, the mirror client functionality may be implemented on one or more hardware devices, and as a combination of hardware and software. The hardware devices include field programmable gate arrays (FPGA), application specific integrated circuits (ASIC), programmable logic devices (PLD), programmable logic arrays (PLA), processors and other kinds of devices. - The
network testing system 110 may include or be one or more of a traffic generator, a performance analyzer, a conformance validation system, a network analyzer, a network management system, and/or others. Thenetwork testing system 110 may include a processor, a memory such as, for example, RAM and flash memory, and a storage device. Thenetwork testing system 110 may include one ormore network cards 114 and aback plane 112. Thenetwork testing system 110 and/or one or more of thenetwork cards 114 may be coupled tonetwork 140 vianetwork connection 116. Although only onenetwork connection 116 is shown, two or more network connections may exist between thenetwork testing system 110 and thenetwork 140. Thenetwork testing system 110 may be in the form of a card rack, as shown inFIG. 1 , or may be an integrated unit. Alternatively, the network testing system may comprise a number of separate units cooperating to provide traffic generation, traffic and/or network analysis, network conformance testing, and other tasks. Alternatively, thenetwork testing system 110 may be a computer with one or more network cards included therein. - The
network testing system 110 and thenetwork cards 114 may support one or more well known communications standards or protocols such as, for example, the 10 Gigabit Ethernet standard, SONET, the Fibre Channel standards, and one or more varieties of the IEEE 802 Ethernet standards, may support proprietary protocols, and may support other protocols. - The term “network card” encompasses line cards, test cards, analysis cards, network line cards, load modules, interface cards, network interface cards, data interface cards, packet engine cards, service cards, smart cards, switch cards, relay access cards, and others. The
network cards 114 may include one or more FPGAs, ASICs, PLDs, PLAs, processors and other kinds of devices. The network cards may include memory. In addition, thenetwork cards 114 may include software and firmware. - Each
network card 114 may include a circuit, chip or chip set that allows thenetwork card 114 to communicate over a network as one or more network capable devices. A “network capable device” is any device that may communicate overnetwork 140. Thenetwork cards 114 may be connected to the network through wire, optical fiber, wirelessly or otherwise. Eachnetwork card 114 may support a single communications protocol, may support a number of related protocols, or may support a number of unrelated protocols. Thenetwork cards 114 may be permanently installed in thenetwork testing system 110, may be removable, or may be a combination thereof. - As described in more detail below, the
network testing system 110 and/or eachnetwork card 114 may include mirror server software and/or be capable of executing mirror server software. Alternatively, the functionality of the mirror server may be implemented onnetwork cards 114 as one or more FPGAs, ASICs, PLDs, PLAs, processors, flash memory, firmware and/or other kinds of devices. - The
back plane 112 may serve as a bus or communications medium for thenetwork cards 114. Theback plane 112 may also provide power to thenetwork cards 114. - The network
capable devices 130 may be any devices capable of communicating over thenetwork 140. The networkcapable devices 130 may be computing devices such as workstations, personal computers, servers, portable computers, personal digital assistants (PDAs), computing tablets, and the like; peripheral devices such as printers, scanners, facsimile machines and the like; network capable storage devices including disk drives such as network attached storage (NAS) and storage area network (SAN) devices; networking devices such as routers, relays, firewalls, hubs, switches, bridges, and multiplexers. In addition, the networkcapable devices 130 may include appliances such as refrigerators, washing machines, and the like as well as residential or commercial HVAC systems, alarm systems, and any other device or system capable of communicating over a network. The networkcapable devices 130 may be referred to as devices under test (DUTs). - The
network 140 may be a local area network (LAN), a wide area network (WAN), a storage area network (SAN). Thenetwork 140 may be wired, wireless, or a combination of these, and may include or be the Internet. Thenetwork 140 may be public or private, and may be a segregated test network. Communications on thenetwork 140 may take various forms, including frames, cells, datagrams, packets or other units of information, all of which are referred to herein as “data units”. Thenetwork 140 may be comprised of numerous nodes providing numerous physical and logical paths for data to travel. - The
connection 104 may be a private LAN, a private WAN, an Ethernet cable, or other wired or wireless connection. Alternatively, theconnection 104 may be a direct connection such as, for example, via Universal Serial Bus (USB) and IEEE 1394 cables. - According to the techniques described herein, software on the
client computer 100 may transparently access the capabilities, including features and functionality, of one or more network devices onnetwork cards 114 innetwork testing system 110. That is, software on theclient computer 100 may transparently use the mirror device as if it were a network device installed in the client computer. Capabilities include, for example, without limitation, added protocol support, increased speed (i.e., higher speed PHY or layer 1), increased throughput (i.e., processing capability), application support, and others. For example, the client may include a device such as a network interface card (NIC) which allows for network communication at speeds up to 100 Mbps, while thenetwork testing system 110 may include network devices onnetwork cards 114 which allow for communication at 10 Gbps. Capabilities also include allowing aclient computer 100 located remote to thenetwork testing system 110 to transparently access thenetwork cards 114 to communicate withnetwork devices 130 overnetwork 140 as if theclient computer 100 were local to thenetwork devices 130. - According to the techniques described herein, a user of software on a
client computer 100 may communicate overconnection 104 to access the capabilities of a network device onnetwork cards 114. The techniques may be used to test one ormore devices 130 overnetwork 140. Alternatively, aclient computer 100 may communicate overnetwork 140 with network devices innetwork cards 114 innetwork testing system 110 vianetwork connections -
FIG. 2 is a block diagram of a system in accordance with the invention. Amirror client 200 and amirror server 230 are coupled to one another vianetwork 220. Amirror client 200 includesapplication software 202,operating system 204,mirror client driver 212, one ormore mirror devices 210 andtunnel device 216.Mirror server 230 includesoperating system 232,mirror server driver 236,tunnel device 238 and one ormore network devices 234. The mirror server may access anetwork 240 via thenetwork devices 234. Themirror client 200 may be a personal computer or workstation likeclient computer 100 shown inFIG. 1 , and the mirror server may be anetwork testing system 110 or anetwork card 114 shown inFIG. 1 . Thenetwork 220 may correspond to theconnection 104 ofFIG. 1 , and thenetwork 240 may correspond to thenetwork 140 ofFIG. 1 - The
application software 202 may be network testing software including software applications that allow a user to send, receive and/or analyze network traffic from the application layer down to the physical layer, and perform other network testing functions for network devices, network systems and/or network applications. The network traffic is comprised of data units. Alternatively, any upper layer software, that is, any software at layers two and above in the Open Systems Interconnection (OSI) model, may access the mirror device in addition to or in place of theapplication software 202. “Upper layer software” as used herein includes application programs, application layer software, network layer software, internet protocol (IP) software, session layer software, presentation layer software, and any software that is layer two and above. - The
application software 202 onmirror client 200 may control, monitor and otherwise access thenetwork device 234 onmirror server 230 through thelocal mirror device 210. All activity occurring on thenetwork device 234 onmirror server 230 is mirrored inmirror device 210. This may be achieved by establishing a communication channel such astunnel 222 over anetwork 220 that connects themirror client 200 and themirror server 230. Any incoming data units received bynetwork device 234 are forwarded to mirrordevice 210, and any outgoing data units sent to mirrordevice 210 are forwarded tonetwork device 234. -
Mirror device 210 serves as a virtual interface tonetwork device 234.Mirror device 210 is a virtual network device that exists solely in software. Whennetwork device 234 is a NIC,mirror device 210 serves as a virtual NIC. Similarly, whennetwork device 234 includes one or more ports, one ormore mirror devices 210 may provide a virtual interface to the ports on thenetwork device 234. Additionally, multiple mirror devices onmirror client 200 may provide multiple virtual interfaces to network devices on multiple mirror servers which may be located geographically near to and/or far from themirror client 200. - The
mirror device 210 may be accessed by theapplication software 202 the same way theapplication software 202 traditionally accesses hardware (and software) devices. That is, theapplication software 202 may access themirror device 210 via theoperating system 204 in the same way any application would use operating system provided interfaces (such as procedure calls) to access any hardware (or software) device. Similarly, according to the virtual interface techniques described herein, any upper layer software may access themirror device 210 in the same manner as the upper layer software accesses hardware and/or software devices included inmirror client 200. -
Mirror device 210 may be created by using an operating system utility. Theoperating system 204 may maintain information about themirror device 210 in a device list or other data structure, just as theoperating system 204 maintains information about other devices accessible on themirror client 200. Themirror device 210 may be accessed by IOCTL calls or other interface made available by the operating system. - The
application software 202 may initiate outgoing data units from themirror device 210.Mirror client driver 212 may provide the processing by which themirror device 210 may send outgoing data units. Alternatively, rather than accessing themirror device 210 through theoperating system 204, themirror client driver 212 may provide an application program interface (API) or programming interface in the form of one or more procedure calls, or other interface to theapplication software 202 or other upper layer software.Mirror client driver 212 formats the outgoing data unit according to any tunnel requirements, and sends outgoing data units viatunnel device 216 overtunnel 222 tomirror server 230. The outgoing data unit is received bytunnel device 238 and passed to mirrorserver driver 236 onnetwork device 234.Mirror server driver 236 un-tunnels the data unit and communicates it onto thenetwork 240 vianetwork device 234. - The
network device 234 may be a hardware device having a physical interface that allows for communications overnetwork 240. Thenetwork device 234 may be a high speed NIC that allows for transmission speeds of 10 Gbps or more. Thenetwork device 234 may receive incoming data units from thenetwork 240. The incoming data units may be tunneled from thenetwork device 234 at themirror server 230 to themirror device 210 at themirror client 200. The tunneling is performed by themirror server driver 236 via the tunnel device 218. Themirror client driver 212 receives incoming data units viatunnel device 216 and un-tunnels them. Themirror client driver 212 passes the incoming data units to theapplication software 202 via theoperating system 204. - The
tunnel 222 may be formed betweentunnel devices Tunnel devices 216 and 218 may each be NICs. Thetunnel 222 may be created using a transmission control protocol (TCP) socket. When using a TCP socket, the internet protocol (IP) addresses and the media access control (MAC) addresses of thetunnel devices tunnel 222. Although communication betweenmirror client 200 andmirror server 232 is described herein as viatunnel 222 using sockets, data units may be passed betweenmirror client 200 andmirror server 232 using any kind of communication channel, including TCP and UDP sockets, ethernet, and any other communication technique or protocol, whether publicly known or proprietary. - A “mirror protocol” may be used for communication between the
mirror client driver 212 and themirror server driver 236. In general, the mirror protocol allows for the packaging and unpackaging of data units that are transferred across thetunnel 222 between themirror client 200 and themirror server 230. The mirror protocol may define a mirror protocol packet as having a header and a payload. The header may include a mirror protocol packet type, a mirror protocol version number, authentication information, and codes that may be used for increased control over the communications on the tunnel, as well as other fields. In one embodiment, the mirror protocol allows for five types of mirror protocol packets: query, response, report, error, and data. Also included in the header is the length of the payload in bytes (octets). The payload may be an incoming data unit received over thenetwork 240 or an outgoing data unit to be sent on to thenetwork 240. The payload may also contain other data originating from themirror client driver 212 or themirror server driver 236 which corresponds to the mirror protocol packet type. - Although communications between
mirror client 200 andmirror server 232 are described herein as viatunnel 222 betweentunnel devices network 240 via network connections like those depicted asnetwork connections FIG. 1 . -
FIG. 3 is a block diagram of amirror client driver 300 in accordance with the invention. Themirror client driver 300 may include atunnel module 310, aclient management module 312, and adevice simulation module 314. Although three module are discussed and shown, more and fewer modules may be included to achieve the functionality of themirror client driver 300. - The
tunnel module 310 is used to create the tunnel 320, to close the tunnel 320, and to manage the exchange of data to and from themirror client driver 300. The exchange of data may be achieved using the mirror protocol discussed above. Thetunnel module 310 allows for establishing a tunnel, in one embodiment, opening a socket, with the mirror server; sending mirror protocol packets to the mirror server; receiving mirror protocol packets from the mirror server; and closing the connection with the mirror server. - The
device simulation module 314 allows for the creation, deletion, and other control of mirror devices, such asmirror device 210 shown inFIG. 2 . Thedevice simulation module 314 receives device creation/deletion instructions from theclient management module 312. Thedevice simulation module 314 also receives incoming data units data from thetunnel module 310 and makes the incoming data units available to application programs via, in one embodiment, aprogramming interface 322. Thedevice simulation module 314 provides theprogramming interface 322 to upper layer software. Thedevice simulation module 314 may conform to rules for device drivers defined by an operating system on a client computer. Thedevice simulation module 314 processes requests for information about a specific network device on the mirror server, and processes requests to send outgoing data units via a specific network device on the mirror server. - The
client management module 312 receives requests from upper layer software via thedevice simulation module 314 and manages tunnel related operations via thetunnel module 310. Theclient management module 312 provides a mirror clientutility program interface 324 which is used to create and delete the mirror devices. Theclient management module 312 maps and maintains mapping information regarding the tunnels and associated mirror devices, network devices on the mirror server, and/or network interfaces to the network devices on the mirror server, as well as other pertinent tunnel information. The mapping information may be stored as a connection information base. -
FIG. 4 is a block diagram of amirror server driver 400 in accordance with the invention. Themirror server driver 400 maintains information for the tunnels between the mirror server and the mirror client, manages communications with the mirror devices over the tunnel, receives and processes incoming data units from the network, and receives and processes requests from the mirror client received over the tunnel. Themirror server driver 400 may consist of atunnel module 402, anetwork interface module 406, and aserver management module 404. - The
tunnel module 402 creates and closes tunnels based on requests received via theserver management module 404. Thetunnel module 402 exchanges mirror protocol packets with the mirror client according to the mirror protocol. The mirror protocol packets are exchanged between the mirror client and the mirror server over the tunnel to themirror client 414. Thetunnel module 402 provides an interface to theserver management module 404 to allow a server utility program resident on the mirror server to create a tunnel by, in one embodiment, opening a socket. Thetunnel module 402 accepts connections from the mirror client, sends mirror protocol packets over the tunnel to the mirror client, and receives mirror protocol packets over the tunnel from the mirror client. - The
network interface module 406 allows for the receipt of incoming data units over a network and sending outgoing data units over the network. Thenetwork interface module 406 receives incoming data units over aphysical layer interface 410 with the network, and sends the incoming data units to the corresponding mirror device on the mirror client via thetunnel module 402. Information to be passed from a mirror device to a network device is received via thetunnel module 402 and directed to thenetwork interface module 406. - The
server management module 404 receives requests from the application software or other upper layer software on the mirror client viatunnel module 402, manages tunnel related operations viatunnel module 402, and communicates with thenetwork interface module 406. The requests may also originate from the mirror device on the mirror client. Theserver management module 404 maintains mapping information regarding the various network interfaces and corresponding tunnels, which may be, in one embodiment, sockets. Theserver management module 404 also receives tunnel creation instructions, tunnel deletion instructions, other instructions, and other queries from a server utility program via a serverutility program interface 412. - The
client management module 312 on the mirror client and theserver management module 404 on the mirror server cooperatively manage the tunnel which allows a mirror device on the mirror client to mirror a network device on the mirror server. - The Methods
-
FIG. 5A is a flow chart of actions taken by a mirror client and a mirror server in accordance with the invention. A mirror device is created on the mirror client. This may be achieved by running a mirror client utility to create the mirror device. The mirror client utility may be an application program or an operating system utility. The mirror client utility may require arguments such as the network (e.g., IP) address of the network interfaces of the network devices on the mirror server, a port designation on the network device, a name to correspond to the mirror device created, and others. - The mirror client receives the mirror device creation request, as shown in
block 502. A mirror device is created and a tunnel connection is established with the specified mirror server, as shown inblock 504. This may be achieved by using a socket. If the attempt to establish the connection is unsuccessful, an error code is returned. If the tunnel is successfully created, the mirror client updates a connection information base that includes information about the established mirror devices and mappings of the tunnel and associated network device with a mirror device, as shown inblock 506. The connection information base may be in any format or data structure, including, in one embodiment, a linked list of tunnel/mirror device mappings. - A check may be made to determine whether the tunnel is readable, as shown in
block 508. This may be achieved by listening on a socket or waiting for data from the tunnel. If the tunnel is readable, there is a mirror protocol packet available via the tunnel 525, and the data stream from thetunnel 526 is read, as shown inblock 510. - The mirror protocol packet is evaluated to determine what kind of mirror protocol packet has been received, as shown in
block 512. The mirror protocol packet may contain a data unit received from themirror server 550 over a network or other data. If the kind of mirror protocol packet is “data”, the data unit in the mirror protocol packet is extracted, as shown inblock 514. The data from the data unit is made available to upper layer software in themirror client 540, as shown inblock 516. In one embodiment, the data and/or the data unit is made available to a network layer via a procedure call interface. In some embodiments, queues, mailboxes, data registers, and other techniques may be used to made the data and/or the data unit to available to upper layer software. - The mirror protocol packet may contain a query for information about the mirror device or the mirror client. In response to a query, the
mirror client 540 processes the query accordingly based on the particular query, as shown inblock 518. This may be achieved by the mirror client driver providing requested information to themirror server 550 or to one or more network interfaces associated with a network device included in themirror server 550. Themirror client 540 uses thetunnel 526 to communicate any response to the query to themirror server 550 or to one or more network interfaces associated with network devices accessible via themirror server 550. - The mirror protocol packets received by
mirror client 540 may also contain control and status information. The control and status information may include information about the status of the tunnel, configuration information concerning the network device emulated by the mirror device, status information regarding a network interface and/or a network device on themirror server 550, and other information. - The flow of actions from
blocks tunnel 526 are read, which, in one embodiment, may be achieved by accessing an appropriate socket. - In addition to receiving a request to create a mirror device, the mirror client may also receive a request to remove a mirror device. A single utility program may be used to create and remove mirror devices. Arguments provided to the utility program may control its functionality. Alternatively, separate programs may be provided which allow for the creation and removal of mirror devices.
-
FIG. 5B is a flow chart of actions taken by a mirror client to remove a mirror device in accordance with the invention. To remove a mirror device, the client utility program may be called with appropriate arguments. The arguments identify the mirror device to be removed. The mirror device may be identified by one or more of a tunnel name or identifier, a socket number, an interface name, an interface identifier, a device name, and other techniques. The mirror client receives the mirror device removal request, as shown inblock 530. The tunnel associated with the mirror device is closed, as shown inblock 532, and the mirror device is removed from the operating system device list, as shown inblock 534. This may be achieved via an operating system provided procedure or interface, such as for example, an IOCTL call. The connection information base is updated to remove the mirror device, the tunnel, the mapping of the network interface and the tunnel with the mirror device, and any associated interfaces, as shown inblock 536. -
FIG. 6 is a flow chart of actions taken by a mirror server in accordance with the invention. The mirror server may receive a request from a server utility program, as shown inblock 610. The actions taken by the mirror server are dependent on the kind of request. A check for the kind of request is made, as shown inblock 612. The kind of request may be to start a communication tunnel to one or more network interfaces associated with a network device, as shown inblock 620; to register one or more network interfaces associated with a network device as available for mirroring, as shown inblock 630; to unregister a network interface to a network device from the mirroring system, as shown inblock 640; and to end all mirroring regarding all network interfaces to all network devices, as shown inblock 650. In alternative embodiments, the functionality of processing of each kind of request and the kinds of requests may be combined, further delineated or expanded. - When the server utility program request specifies that a tunnel to a network interface should be started, as shown in
block 620, the request may include arguments such as one or more of the network (e.g., IP address) of the network device or network interface, the network address of the mirror server, a tunnel, port or socket designation or identifier, and/or others. A list of network interfaces to be added to the server interface database may also be specified. The server utility program request may use an operating system procedure or utility such as an IOCTL to communicate the start request. The server management module may communicate with the driver module to implement the server utility program start request. - When a start request and associated arguments are received, a server interface database mapping the network interfaces to corresponding tunnels is updated, as shown in
block 622. The tunnel may be a socket. A well known protocol such as TCP may be used to communicate over the tunnel. The server interface database may be used to maintain a list of all tunnels, and, in some embodiments, sockets, which have been created and their corresponding network interfaces. The specified tunnel is opened and is bound to the specified network address, as shown inblock 624. The mirror server then listens on the tunnel for mirror protocol packets from the mirror client, as shown inblock 626. A thread may be created via the operating system. The thread may be used to process information received from the tunnel and/or monitor the tunnel. One thread may be used by the mirror server driver, or multiple threads may be used by the mirror server driver. - When the server utility program request specifies that a network interface should be registered or unregistered, the request may include arguments such as the port or socket designation of the network interface or the network device, and a list of identifiers of network interfaces to be added to the server interface database. In those implementations in which there is only one network device, one network interface or one port, then the port, network device identifier, network interface identifier or other designation regarding the network device need not be included.
- When the server utility program request specifies that a network interface to a network device should be registered, as shown in
block 630, the network interface is added to the server interface database mapped to a network device and/or port on the network device, as shown inblock 632. - When the server utility program request specifies that a network interface should be unregistered, as shown in
block 640, a notification is sent to the mirror client that the specified network interface no longer exists, as shown inblock 642. This may be achieved by sending an appropriate mirror protocol packet over the tunnel. The tunnel, and, in one embodiment, any socket, associated with the interface is closed, as shown inblock 644. The server interface database is updated, removing the specified network interface, as shown inblock 646. Other data related to the specified network device may also be removed from the server interface database. - When the server utility program request specifies to end, as shown in
block 650, a notification is sent to the mirror client that all network interfaces no longer exist, as shown inblock 652. This may be achieved by sending an appropriate mirror protocol packet over the tunnel. All tunnels, including, in some embodiments, all TCP connections/sockets, are closed, as shown inblock 654. The server interface database is cleared, removing all network interfaces and any corresponding tunnel (and any socket) mappings, as shown inblock 656. If one or more threads were created to manage the mirror server functionality, the one or more threads are deleted. -
FIG. 7 is a flow chart of further actions taken by a mirror client and a mirror server in accordance with the invention. The mirror server accepts a connection from a mirror client, as shown inblock 702. The mirror server then waits on the tunnel associated with the connection. A check is made to determine if the tunnel is readable, as shown inblock 704. That is, a check is made to determine if there is a mirror protocol packet in thetunnel 736. This may be achieved by waiting on a TCP socket. - For the socket to be readable, the
mirror client 740 will have sent a mirror protocol packet to the mirror server viatunnel 736, as shown inblock 734. Software on the mirror client elects to send a mirror protocol packet including a data unit or a query to themirror server 750, as shown in block 730. The query may be a query for the availability of a network device or network interface to be mirrored. The mirror client prepares the mirror protocol packet, as shown inblock 732. Themirror client 740 then sends the mirror protocol packet to themirror server 750 viatunnel 736, as shown inblock 734. - Continuing with activity on the
mirror server 750, if the tunnel is readable, as shown inblock 704, the data stream from thetunnel 736 is read, as shown inblock 706. A check is made to determine the kind of mirror protocol packet read from thetunnel 736, as shown inblock 710. The kind of mirror protocol packet may be an outgoing data unit or a query in the form of an mirror request. Other mirror protocol packets may also be checked for and handled appropriately. - If the mirror protocol packet includes an outgoing data unit to be sent on the network interface, the outgoing data unit is extracted from the mirror protocol packet, as shown in
block 712. Alternatively, the outgoing packet may be assembled or constructed according to parameters specified in the mirror protocol packet. The outgoing data unit is then transmitted via the network device associated with the network interface, as shown inblock 714. - If the kind of mirror protocol packet is a query in the form of mirror request, as shown in
block 710, a check is made to determine the availability of the specified network interface, as shown inblock 716. If the network interface is available, the connection information base is updated, such that an entry mapping the tunnel and its associated network interface with the corresponding mirror client virtual interface is added, as shown inblock 720. A request granted mirror protocol packet may then be sent to the mirror client overtunnel 736, as shown in block 722. If the network device and/or the network interface to the network device is not available, the mirror server prepares and sends a response to the mirror client. The response is sent over thetunnel 736 in the form of a mirror protocol packet stating the network interface to the network device is not available, as shown inblock 726. - Although exemplary embodiments of the invention have been shown and described, it will be apparent to those having ordinary skill in the art that a number of changes, modifications, or alterations to the systems and methods described herein may be made. All such changes, modifications and alterations should therefore be seen as within the scope of the disclosure.
Claims (17)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/196,708 US8078736B1 (en) | 2003-06-27 | 2011-08-02 | Virtual interface |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/608,491 US8005958B2 (en) | 2003-06-27 | 2003-06-27 | Virtual interface |
US13/196,708 US8078736B1 (en) | 2003-06-27 | 2011-08-02 | Virtual interface |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/608,491 Continuation US8005958B2 (en) | 2003-06-27 | 2003-06-27 | Virtual interface |
Publications (2)
Publication Number | Publication Date |
---|---|
US20110289212A1 true US20110289212A1 (en) | 2011-11-24 |
US8078736B1 US8078736B1 (en) | 2011-12-13 |
Family
ID=34062297
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/608,491 Active 2027-08-14 US8005958B2 (en) | 2003-06-27 | 2003-06-27 | Virtual interface |
US12/639,879 Expired - Lifetime US8073966B2 (en) | 2003-06-27 | 2009-12-16 | Virtual interface |
US13/196,708 Expired - Fee Related US8078736B1 (en) | 2003-06-27 | 2011-08-02 | Virtual interface |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/608,491 Active 2027-08-14 US8005958B2 (en) | 2003-06-27 | 2003-06-27 | Virtual interface |
US12/639,879 Expired - Lifetime US8073966B2 (en) | 2003-06-27 | 2009-12-16 | Virtual interface |
Country Status (1)
Country | Link |
---|---|
US (3) | US8005958B2 (en) |
Families Citing this family (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050132353A1 (en) * | 2003-12-11 | 2005-06-16 | Chueh-Hsin Chen | Method for installing networked attached storage |
US7949792B2 (en) * | 2004-02-27 | 2011-05-24 | Cisco Technology, Inc. | Encoding a TCP offload engine within FCP |
US7810103B2 (en) * | 2004-04-30 | 2010-10-05 | Microsoft Corporation | System and method for validating communication specification conformance between a device driver and a hardware device |
US10887212B2 (en) * | 2004-08-20 | 2021-01-05 | Extreme Networks, Inc. | System, method and apparatus for traffic mirror setup, service and security in communication networks |
US8443094B2 (en) * | 2005-05-12 | 2013-05-14 | Oracle America, Inc. | Computer system comprising a communication device |
RU2008100055A (en) * | 2005-06-10 | 2009-07-20 | Одеск Корпорейшн (Us) | VIRTUAL OFFICE ENVIRONMENT |
US8352590B2 (en) * | 2006-02-21 | 2013-01-08 | Cisco Technology, Inc. | Method and system for network management using wire tapping |
US8295275B2 (en) * | 2006-03-20 | 2012-10-23 | Intel Corporation | Tagging network I/O transactions in a virtual machine run-time environment |
US9015333B2 (en) | 2009-12-18 | 2015-04-21 | Cisco Technology, Inc. | Apparatus and methods for handling network file operations over a fibre channel network |
DE102010007670A1 (en) * | 2010-02-10 | 2011-08-11 | Phoenix Contact GmbH & Co. KG, 32825 | Method and control of a network system, network system and computer program |
US8615014B2 (en) * | 2010-03-03 | 2013-12-24 | Iwebgate Technology Limited | System and method for multiple concurrent virtual networks |
US9425986B2 (en) | 2010-03-03 | 2016-08-23 | Iwebgate Technology Limited | System and method for multiple concurrent virtual networks |
US8447329B2 (en) | 2011-02-08 | 2013-05-21 | Longsand Limited | Method for spatially-accurate location of a device using audio-visual information |
US8488011B2 (en) | 2011-02-08 | 2013-07-16 | Longsand Limited | System to augment a visual data stream based on a combination of geographical and visual information |
US8392450B2 (en) * | 2011-02-08 | 2013-03-05 | Autonomy Corporation Ltd. | System to augment a visual data stream with user-specific content |
US8493353B2 (en) | 2011-04-13 | 2013-07-23 | Longsand Limited | Methods and systems for generating and joining shared experience |
US9131011B1 (en) | 2011-08-04 | 2015-09-08 | Wyse Technology L.L.C. | Method and apparatus for communication via fixed-format packet frame |
US8621123B2 (en) | 2011-10-06 | 2013-12-31 | Honeywell International Inc. | Device management using virtual interfaces |
US8539123B2 (en) | 2011-10-06 | 2013-09-17 | Honeywell International, Inc. | Device management using a dedicated management interface |
US8743735B1 (en) * | 2012-01-18 | 2014-06-03 | Cadence Design Systems, Inc. | Emulation system for verifying a network device |
US9430876B1 (en) | 2012-05-10 | 2016-08-30 | Aurasma Limited | Intelligent method of determining trigger items in augmented reality environments |
US9064326B1 (en) | 2012-05-10 | 2015-06-23 | Longsand Limited | Local cache of augmented reality content in a mobile computing device |
US9066200B1 (en) | 2012-05-10 | 2015-06-23 | Longsand Limited | User-generated content in a virtual reality environment |
US10205648B1 (en) * | 2014-05-30 | 2019-02-12 | EMC IP Holding Company LLC | Network monitoring using traffic mirroring and encapsulated tunnel in virtualized information processing system |
CN106533821A (en) * | 2015-09-14 | 2017-03-22 | 北京国电智深控制技术有限公司 | Test method and system for controlling system channel |
EP3910880A1 (en) * | 2020-05-14 | 2021-11-17 | Nokia Technologies Oy | Blockchain based device monitoring |
CN117278445B (en) * | 2023-11-17 | 2024-04-16 | 江苏信而泰智能装备有限公司 | Network tester |
CN117938653B (en) * | 2024-03-18 | 2024-06-11 | 广州致远电子股份有限公司 | Communication interface configuration method, device, equipment and storage medium |
Family Cites Families (44)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA1335832C (en) | 1989-04-21 | 1995-06-06 | Wing-Man Chan | Remote test access system for isdn testing |
US5600632A (en) | 1995-03-22 | 1997-02-04 | Bell Atlantic Network Services, Inc. | Methods and apparatus for performance monitoring using synchronized network analyzers |
JP3574231B2 (en) | 1995-08-21 | 2004-10-06 | 富士通株式会社 | Computer network simulator |
US5764639A (en) * | 1995-11-15 | 1998-06-09 | Staples; Leven E. | System and method for providing a remote user with a virtual presence to an office |
JPH10190705A (en) | 1996-10-22 | 1998-07-21 | Sony Corp | Transmission device/method and reception device/method |
US6041042A (en) | 1997-05-27 | 2000-03-21 | Cabletron Systems, Inc. | Remote port mirroring system and method thereof |
US5974463A (en) | 1997-06-09 | 1999-10-26 | Compaq Computer Corporation | Scaleable network system for remote access of a local network |
US6173399B1 (en) * | 1997-06-12 | 2001-01-09 | Vpnet Technologies, Inc. | Apparatus for implementing virtual private networks |
US6173333B1 (en) | 1997-07-18 | 2001-01-09 | Interprophet Corporation | TCP/IP network accelerator system and method which identifies classes of packet traffic for predictable protocols |
US6377571B1 (en) | 1998-04-23 | 2002-04-23 | 3Com Corporation | Virtual modem for dialout clients in virtual private network |
US6446121B1 (en) | 1998-05-26 | 2002-09-03 | Cisco Technology, Inc. | System and method for measuring round trip times in a network using a TCP packet |
US6557037B1 (en) * | 1998-05-29 | 2003-04-29 | Sun Microsystems | System and method for easing communications between devices connected respectively to public networks such as the internet and to private networks by facilitating resolution of human-readable addresses |
US6157955A (en) | 1998-06-15 | 2000-12-05 | Intel Corporation | Packet processing system including a policy engine having a classification unit |
US6675218B1 (en) | 1998-08-14 | 2004-01-06 | 3Com Corporation | System for user-space network packet modification |
US6414958B1 (en) | 1998-11-30 | 2002-07-02 | Electronic Data Systems Corporation | Four-port secure ethernet VLAN switch supporting SNMP and RMON |
US6263363B1 (en) * | 1999-01-28 | 2001-07-17 | Skydesk, Inc. | System and method for creating an internet-accessible working replica of a home computer on a host server controllable by a user operating a remote access client computer |
US6519254B1 (en) * | 1999-02-26 | 2003-02-11 | Lucent Technologies Inc. | RSVP-based tunnel protocol providing integrated services |
US7181542B2 (en) * | 2000-04-12 | 2007-02-20 | Corente, Inc. | Method and system for managing and configuring virtual private networks |
US6631416B2 (en) * | 2000-04-12 | 2003-10-07 | Openreach Inc. | Methods and systems for enabling a tunnel between two computers on a network |
US6894999B1 (en) | 2000-11-17 | 2005-05-17 | Advanced Micro Devices, Inc. | Combining VLAN tagging with other network protocols allows a user to transfer data on a network with enhanced security |
US7124189B2 (en) * | 2000-12-20 | 2006-10-17 | Intellisync Corporation | Spontaneous virtual private network between portable device and enterprise network |
US7242665B2 (en) * | 2001-01-25 | 2007-07-10 | Ericsson Ab | Network device virtual interface |
US20030018804A1 (en) | 2001-03-28 | 2003-01-23 | Amruth Laxman | Method and apparatus for deriving a standard MAC address from physical location |
US20020191649A1 (en) | 2001-06-13 | 2002-12-19 | Woodring Sherrie L. | Port mirroring in channel directors and switches |
US6483840B1 (en) | 2001-06-25 | 2002-11-19 | Lsi Logic Corporation | High speed TCP/IP stack in silicon |
US6928478B1 (en) | 2001-06-25 | 2005-08-09 | Network Appliance, Inc. | Method and apparatus for implementing a MAC address pool for assignment to a virtual interface aggregate |
DE60130042T2 (en) * | 2001-06-27 | 2008-05-15 | Hyglo Systems Ab | DISTRIBUTED SERVER FUNCTIONALITY FOR AN EMULATED LAN |
EP1289212A1 (en) | 2001-08-28 | 2003-03-05 | Lucent Technologies Inc. | Electro-optic interface for parallel data transmission |
KR100385996B1 (en) | 2001-09-05 | 2003-06-02 | 삼성전자주식회사 | Method for allocating a plurality of IP addresses to a NIC(Network Interface Card) and apparatus therefor |
US7516216B2 (en) | 2001-10-01 | 2009-04-07 | Ixia | Generating traffic for testing a system under test |
US6895443B2 (en) | 2001-11-02 | 2005-05-17 | Microsoft Corporation | Method and system for facilitating communication between nodes on different segments of a network |
US7379465B2 (en) * | 2001-12-07 | 2008-05-27 | Nortel Networks Limited | Tunneling scheme optimized for use in virtual private networks |
US7366147B2 (en) * | 2002-04-15 | 2008-04-29 | Qualcomm Incorporated | Methods and apparatus for tunneling between different addressing domains |
US6804777B2 (en) * | 2002-05-15 | 2004-10-12 | Threatguard, Inc. | System and method for application-level virtual private network |
US7391739B1 (en) | 2002-06-28 | 2008-06-24 | At&T Delaware Intellectual Property, Inc. | System and method for creating a frame relay port mirror |
US7606939B1 (en) | 2002-10-31 | 2009-10-20 | Cisco Technology, Inc. | Scaling private virtual local area networks (VLANs) across large metropolitan area networks (MANs). |
US8332464B2 (en) * | 2002-12-13 | 2012-12-11 | Anxebusiness Corp. | System and method for remote network access |
US7457300B2 (en) | 2003-01-21 | 2008-11-25 | Telefonaktiebolaget L M Ericsson (Publ) | Ethernet address management system |
US7400586B2 (en) | 2003-02-25 | 2008-07-15 | Avaya Technology Corp. | Collaborative remote communication circuit diagnostic tool |
US7447622B2 (en) * | 2003-04-01 | 2008-11-04 | Microsoft Corporation | Flexible network simulation tools and related methods |
US7710867B1 (en) | 2003-05-23 | 2010-05-04 | F5 Networks, Inc. | System and method for managing traffic to a probe |
US7440415B2 (en) * | 2003-05-30 | 2008-10-21 | Ixia | Virtual network addresses |
US7366182B2 (en) * | 2004-08-13 | 2008-04-29 | Qualcomm Incorporated | Methods and apparatus for efficient VPN server interface, address allocation, and signaling with a local addressing domain |
US7561559B2 (en) | 2005-03-30 | 2009-07-14 | Ixia | Hardware time stamping and processor synchronization |
-
2003
- 2003-06-27 US US10/608,491 patent/US8005958B2/en active Active
-
2009
- 2009-12-16 US US12/639,879 patent/US8073966B2/en not_active Expired - Lifetime
-
2011
- 2011-08-02 US US13/196,708 patent/US8078736B1/en not_active Expired - Fee Related
Also Published As
Publication number | Publication date |
---|---|
US20050015642A1 (en) | 2005-01-20 |
US8078736B1 (en) | 2011-12-13 |
US8073966B2 (en) | 2011-12-06 |
US8005958B2 (en) | 2011-08-23 |
US20100095019A1 (en) | 2010-04-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8078736B1 (en) | Virtual interface | |
US7440415B2 (en) | Virtual network addresses | |
US10419319B1 (en) | Monitoring gateway systems and methods for openflow type networks | |
US7599289B2 (en) | Electronic communication control | |
CN102082690B (en) | Passive finding equipment and method of network topology | |
US7106751B2 (en) | Apparatus for linking a SAN with a LAN | |
CN1514586B (en) | Testing method of data communication equipment of imitating multiuser, multi connection | |
US20160205008A1 (en) | Diagnosis and throughput measurement of fibre channel ports in a storage area network environment | |
US10075377B1 (en) | Statistical collection in a network switch natively configured as a load balancer | |
US8180856B2 (en) | Testing a network | |
TW201325144A (en) | High performance Ethernet networking utilizing existing Fibre Channel fabric HBA technology | |
CN107210933B (en) | Mechanism for providing hardware resource information to attached equipment | |
WO2005069551A1 (en) | User mac frame transfer method, edge transfer device, and program | |
CN109474713B (en) | Message forwarding method and device | |
CN113872826B (en) | Network card port stability testing method, system, terminal and storage medium | |
CN113347258A (en) | Method and system for data acquisition, monitoring and analysis under cloud flow | |
CN110932992A (en) | Load balancing communication method based on tunnel mode | |
CN1299471C (en) | Broadband insertion server testing gating and testing method | |
RU2602333C2 (en) | Network system, packet processing method and storage medium | |
US10009253B2 (en) | Providing shared resources to virtual devices | |
US9804899B2 (en) | Communications using the common object request broker architecture (CORBA) | |
CN112532468B (en) | Network measurement system, method, device and storage medium | |
Chiu et al. | Design the dns-like smart switch for heterogeneous network base on sdn architecture | |
CN112333162B (en) | Service processing method and equipment | |
JPH09289521A (en) | Virtual lan system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: IXIA, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HANNEL, CLIFFORD;DESDIER, MARCEL F.;OLDERDISSEN, JAN R.A.;REEL/FRAME:026693/0518 Effective date: 20030627 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT, TE Free format text: SECURITY AGREEMENT;ASSIGNOR:IXIA;REEL/FRAME:029698/0060 Effective date: 20121221 |
|
AS | Assignment |
Owner name: SILICON VALLEY BANK, AS SUCCESSOR ADMINISTRATIVE A Free format text: NOTICE OF SUBSTITUTION OF ADMINISTRATIVE AGENT;ASSIGNOR:BANK OF AMERICA, N.A., RESIGNING ADMINISTRATIVE AGENT;REEL/FRAME:034870/0598 Effective date: 20150130 |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
AS | Assignment |
Owner name: IXIA, CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:SILICON VALLEY BANK, AS SUCCESSOR ADMINISTRATIVE AGENT;REEL/FRAME:042335/0465 Effective date: 20170417 |
|
AS | Assignment |
Owner name: KEYSIGHT TECHNOLOGIES SINGAPORE (HOLDINGS) PTE. LTD., SINGAPORE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:IXIA;REEL/FRAME:044222/0695 Effective date: 20170930 Owner name: KEYSIGHT TECHNOLOGIES SINGAPORE (HOLDINGS) PTE. LT Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:IXIA;REEL/FRAME:044222/0695 Effective date: 20170930 |
|
AS | Assignment |
Owner name: KEYSIGHT TECHNOLOGIES SINGAPORE (SALES) PTE. LTD., Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KEYSIGHT TECHNOLOGIES SINGAPORE (HOLDINGS) PTE. LTD.;REEL/FRAME:048225/0065 Effective date: 20181001 Owner name: KEYSIGHT TECHNOLOGIES SINGAPORE (SALES) PTE. LTD., SINGAPORE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KEYSIGHT TECHNOLOGIES SINGAPORE (HOLDINGS) PTE. LTD.;REEL/FRAME:048225/0065 Effective date: 20181001 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20191213 |