CA2345292A1 - High performance distributed discovery system - Google Patents

High performance distributed discovery system

Info

Publication number
CA2345292A1
CA2345292A1 CA 2345292 CA2345292A CA2345292A1 CA 2345292 A1 CA2345292 A1 CA 2345292A1 CA 2345292 CA2345292 CA 2345292 CA 2345292 A CA2345292 A CA 2345292A CA 2345292 A1 CA2345292 A1 CA 2345292A1
Authority
CA
Grant status
Application
Patent type
Prior art keywords
network
discovery
distributed
network topology
system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA 2345292
Other languages
French (fr)
Inventor
Loren Christensen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LINMOR Inc
Original Assignee
Linmor Technologies Inc.
Loren Christensen
Linmor Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance or administration or management of packet switching networks
    • H04L41/04Architectural aspects of network management arrangements
    • H04L41/042Arrangements involving multiple distributed management centers cooperatively managing the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance or administration or management of packet switching networks
    • H04L41/12Arrangements for maintenance or administration or management of packet switching networks network topology discovery or management

Abstract

A high performance distributed discovery system, leveraging the functionality of a high speed communications network, for the discovery of the network topology of a high speed data network. The system comprises a plurality of discovery engines on at least one, and preferably a plurality of data collection node computers that poll and register managed network objects with the resulting distributed record compilation forming a distributed network topology database that is selectively accessed by at least one performance monitoring server computer to provide for network management.
A
plurality of discovery engine instances are located on the data collection node computers on a ratio of one engine instance to one central processing unit so as to provide for the parallel processing of the distributed network topology database.

Description

High Performance Distributed Discovery System Field of the Invention The present invention relates to the discovery of the network topology of devices comprising a high speed data network, and more particularly to a high performance distributed discovery system.
Background of the Invention Today's high speed data networks contain an ever-growing number of devices.
A network needs to be monitored for the existence, disappearance, reappearance and status of traditional network devices such as routers, hubs and bridges and more recently high speed switching devices such as ATM, Frame Relay, DSL, VoIP and Cable Modems.
In order to enable network monitoring, a process known as discovery is typically performed. Discovery is the process by which network management systems selectively poll a network to discover very large numbers of objects in a very short period of time, without introducing excessive network traffic. It is the function of a discovery system to discover devices on a network and the structure of that network. Discovery is primarily intended to get network management users quickly up to speed, track changes in the network, update network maps, and report on these changes.
Discovery typically further involves discovering the configuration of individual devices, their relationship, as well as discovering interconnection links or implied relationships.
In the past rapid discovery was not an issue, since the level of scalability of performance monitoring did not require the depth of discovery that is now required.
Major advances in scalability have recently been achieved in performance monitoring, and as performance monitoring scales to manage larger and larger networks the scalability of discovery must advance accordingly in order to deal with the inevitable increase in the number of network objects and react quickly to changes in network topology.
S
At present network devices are typically polled over long distances from the network management system. This consumes valuable bandwidth and results in increased processing times and potential data loss. As well, customers often dislike inadvertent access around their firewalls, via the common connection to the network performance monitoring server computer. Therefore, what is needed is a method of object discovery that is proximal to the managed network.
For the foregoing reasons, there is a need for an economical method of network topology discovery that provides for high speed polling, high obj ect capacity, scalability, and proximity to managed networks, while preserving security policies that are inherent in the network domain configuration.
Summary of the Invention The present invention is directed to a high performance distributed discovery system that satisfies this need. The system, leveraging the functionality of a high speed communications network, comprises distributing records of discovered network devices using a plurality of discovery engine instances located on at least one data collection node computer whereby the resulting distributed record compilation comprises a distributed network topology database. The distributed network topology database is accessed using at least one performance monitor server computer to facilitate network management.
At least one discovery engine instance is located on the data collection node computers on a ratio of one engine instance to one central processing unit whereby the total number of engine instances is at least two so as to enable the parallel processing of the distributed network topology database.

In aspects of the invention a vendor specific discovery subroutine is launched upon detection by the system of a non-MIB II standard device so as to query the vendor's private MIB using a vendor specific algorithm.
Advances in overall scalability are achieved by dividing the workload of network topology discovery across several computing nodes. The discovery job is distributed across all the data collectors such that the only requirement for each data collector is to be able to reach, typically via TCP/IP and SNMP, the nades and networks for which it is responsible. This reachability requirement already exists for telemetry, in any case, and has therefore already been provided for.
Other aspects and features of the present invention will become apparent to those ordinarily skilled in the art upon review of the following description of specific embodiments of the invention in conjunction with the accompanying figures.
Brief Description of the Drawings These and other features, aspects, and advantages of the present invention will become better understood with regard to the following description, appended claims, and accompanying drawings where:
Figure 1 is a schematic overview of the high performance distributed discovery system.
Detailed Description of the Presently Preferred Embodiment As shown in figure 1, the high performance distributed discovery system, leveraging the functionality of a high speed communications network 14, comprises at least one data collection (DC) node computer 12 and at least one performance monitor (PM) server computer 18 in network 14 contact with the DC node computers 12.

The DC node computers 12 poll and register managed network 14 objects with the resulting distributed record compilation forming a distributed network topology database 16 that is accessed by the PM server computers 18.
A plurality of discovery engine instances 20 are located on the DC node computers 12 on a ratio of one engine instance 20 to one central processing unit so as to provide for the parallel processing of the distributed network topology database 16.
The discovery engine 20 is comprised of a base program and a scalable family of vendor-specific discovery subroutines. The base program is designed to query and register any IP device and subsequently obtain detailed device, state and topology information for any IP device that responds to an SNMP query, such as any device that is managed by an SNMP agent. The base program discovers detailed information for any device that supports the standard MIB-II, but not the vendor's private MIB.
The discovery of detailed information from a vendor's private MIB is accomplished through what is known as vendor-specific discovery subroutines.
These discovery subroutines are lightweight independent applications that are launched whenever the main discovery program detects a particular vendor's hardware.
The discovery subroutines contain vendor-specific algorithms designed to query the vendor's private MIB.
Launch points for each discovery subroutine are included in the main program.
So, if during the normal operation of discovery a valid element value is encountered identifying a specific vendor's hardware, the appropriate discovery subroutine is launched.
The DC node computers 12 are responsible for telemetry to the managed elements and management of the topology database 16. The PM server computers 18 provide system control and reporting interface.

S
The proximal topology of the DC node computers 12 in relation to the managed network 14 provides for inherent scalability and a reduction in required bandwidth. As well, the ability to utilize excess memory and disk storage resources on the DC node computers 12 facilitates the discovery of larger networks. The aggregate resources of many DC node computers 12 is far greater than that available on any one PM
server computer 18. Advances in overall scalability are achieved by dividing the workload of network topology discovery across several computing nodes. The discovery job is distributed across all the DC node computers 12 such that the only requirement for each DC node computer 12 is to be able to reach, typically via TCP/IP and SNMP, the nodes and networks for which it is responsible. This reachability requirement already exists for telemetry, in any case, and has therefore already been provided for.
All the discovery and topology database storage is taking place behind the client's firewall requiring only a minimal amount of management traffic to be exerted on the network to generate reports. PM server computers 18 are utilized to access the distributed network topology database 16 for object management.
In embodiments of the invention unique algorithms selectively discover network devices based on "clues" picked up from existing information such as router tables and customer input.
The vendor specific discovery subroutines extend the base discovery application to provide for inter-operability with a multiplicity of ATM and FR vendors' equipment.
All of the processing intensive data collection takes place as close to the customers network and network devices as possible, thereby providing for faster discovery as well as distributed storage and processing. As well, the unwanted side-effect of the PM server computerl8 unwittingly becoming a router is removed, thereby enhancing security.

Devices are reliably re-discovered, thereby enabling the tracking of changes to a network's topology as it evolves in real time or near real time.
The ability to limit what is discovered by criteria such as vendor & device type has been added thereby eliminating the need to specify the address of each device when discovering the network.
The system will not re-discover existing devices unless explicitly requested to do so, which is significant when discovering a large network that is typically discovered in stages.
The system handles timeouts in a more reliable manner. This is important on wide area networks where timeouts are more common during discovery.
Since all the discovery sub-tasks can be performed simultaneously, the overall time to characterize the customer's network is reduced. This enables discovery to deal with larger networks in a faster manner, and eliminates the PM server computer's 18 reachability requirement with respect to managed elements.
This invention allows Network Service Providers to automatically discover more of the existing devices in their networks, permitting customers to reconcile what is really out in their network with what their administrative records tell them is out there. It has been shown that such verification can potentially lead to great cost savings in operations, as well as vastly improved discovery times as speed will now be directly correlated with the number of DC node computers 12 deployed.
The system provides for the rapid automatic mapping of a customer's network for the purpose of object management, down to unprecedentedly fine levels of granularity.

Claims (12)

1. A network topology distributed discovery system, leveraging the functionality of a high speed communications network, comprising the steps of:
(i) distributing records of discovered network devices using a plurality of discovery engine instances located on at least one data collection node computer whereby the resulting distributed record compilation comprises a distributed network topology database; and (ii) importing the distributed network topology database onto at least one performance monitor server computer so as to enable network management.
2. The system according to claim l, wherein at least one discovery engine instance is located on the data collection node computers on a ratio of one engine instance to one central processing unit whereby the total number of engine instances is at least two so as to enable the parallel processing of the distributed network topology database.
3. The system according to claim l, wherein a vendor specific discovery subroutine is launched upon detection by the system of a non-MIB II standard device so as to query the vendor's private MIB using a vendor specific algorithm.
4. The system according to claim 1, wherein at least one performance monitor client computer is connected to the network so as to communicate remotely with the performance monitor server computers.
5. A network topology distributed discovery system, leveraging the functionality of a high speed communications network, comprising:
(i) at least one data collection node computer connected to the network for discovering network devices using a plurality of discovery engine instances whereby a distributed network topology database is created; and (ii) at least one performance monitor server computer having imported the distributed network topology database whereby network management is enabled.
6. The system according to claim 5, wherein at least one discovery engine instance is located on the data collection node computers on a ratio of one engine instance to one central processing unit whereby the total number of engine instances for the system is at least two so as to enable the parallel processing of the network topology database.
7. The system according to claim 5, wherein a vendor specific discovery subroutine is launched upon detection by the system of a non-MIB II standard device so as to query the vendor's private MIB using a vendor specific algorithm.
8. The system according to claim 5, wherein at least one performance monitor client computer is connected to the network so as to communicate remotely with the performance monitor server computers.
9. A storage medium readable by an install server computer in a network topology distributed discovery system including the install server, leveraging the functionality of a high speed communications network, the storage medium encoding a computer process comprising:
(i) a processing portion for distributing records of discovered network devices using a plurality of discovery engine instances located on at least one data collection node computer whereby the resulting distributed record compilation comprises a distributed network topology database; and (ii) a processing portion for importing the distributed network topology database onto at least one performance monitor server computer so as to enable network management.
10. The system according to claim 9, wherein at least one discovery engine instance is located on the data collection node computers on a ratio of one engine instance to one central processing unit whereby the total number of engine instances is at least two so as to enable the parallel processing of the network topology database.
11. The system according to claim 9, wherein a vendor specific discovery subroutine is launched upon detection by the system of a non-MIB II standard device so as to query the vendor's private MIB using a vendor specific algorithm.
12. The system according to claim 9, wherein at least one performance monitor client computer is connected to the network so as to communicate remotely with the performance monitor server computers.
CA 2345292 2000-10-03 2001-04-26 High performance distributed discovery system Abandoned CA2345292A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CA 2322117 CA2322117A1 (en) 2000-10-03 2000-10-03 High performance distributed discovery system
CA2,322,117 2000-10-03
CA 2345292 CA2345292A1 (en) 2000-10-03 2001-04-26 High performance distributed discovery system

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CA 2345292 CA2345292A1 (en) 2000-10-03 2001-04-26 High performance distributed discovery system
PCT/CA2001/000666 WO2002030050A1 (en) 2000-10-03 2001-05-23 Distributed discovery system
GB0306298A GB2383228B (en) 2000-10-03 2001-05-23 Distributed discovery system

Publications (1)

Publication Number Publication Date
CA2345292A1 true true CA2345292A1 (en) 2002-04-03

Family

ID=25682142

Family Applications (1)

Application Number Title Priority Date Filing Date
CA 2345292 Abandoned CA2345292A1 (en) 2000-10-03 2001-04-26 High performance distributed discovery system

Country Status (3)

Country Link
CA (1) CA2345292A1 (en)
GB (1) GB2383228B (en)
WO (1) WO2002030050A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2674876A1 (en) * 2012-06-14 2013-12-18 Alcatel Lucent Streaming analytics processing node and network topology aware streaming analytics system
EP3035595A1 (en) * 2014-12-17 2016-06-22 Alcatel Lucent Routable distributed database for managing a plurality of entities of a telecommunication network

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE68928016T2 (en) * 1988-01-29 1997-12-11 Network Equipment Tech Monitor for state and topology of a telecommunication network
US5522042A (en) * 1994-01-28 1996-05-28 Cabletron Systems, Inc. Distributed chassis agent for distributed network management
US5706440A (en) * 1995-08-23 1998-01-06 International Business Machines Corporation Method and system for determining hub topology of an ethernet LAN segment
US5758083A (en) * 1995-10-30 1998-05-26 Sun Microsystems, Inc. Method and system for sharing information between network managers
US6085243A (en) * 1996-12-13 2000-07-04 3Com Corporation Distributed remote management (dRMON) for networks
EP0849910A3 (en) * 1996-12-18 1999-02-10 Northern Telecom Limited Communications network monitoring
US6205122B1 (en) * 1998-07-21 2001-03-20 Mercury Interactive Corporation Automatic network topology analysis
GB2374247B (en) * 1999-03-17 2004-06-30 Ericsson Telefon Ab L M Method and arrangement for performance analysis of data networks

Also Published As

Publication number Publication date Type
GB0306298D0 (en) 2003-04-23 grant
GB2383228A (en) 2003-06-18 application
WO2002030050A1 (en) 2002-04-11 application
GB2383228B (en) 2004-05-26 grant

Similar Documents

Publication Publication Date Title
US7328260B1 (en) Mapping discovered devices to SAN-manageable objects using configurable rules
Chowdhury et al. Payless: A low cost network monitoring framework for software defined networks
EP1463238B1 (en) Device for local management of security processes of a telecommunication network equipment
US5978845A (en) Network management relay mechanism
US7277935B2 (en) Management method for network device
US6892227B1 (en) Enterprise network analyzer host controller/zone controller interface system and method
US6330601B1 (en) Management system for a multi-level communication network
US8146160B2 (en) Method and system for authentication event security policy generation
US6754705B2 (en) Enterprise network analyzer architecture framework
US20030041167A1 (en) Method and system for managing secure geographic boundary resources within a network management framework
US20030041238A1 (en) Method and system for managing resources using geographic location information within a network management framework
US7143159B1 (en) Method for correlating and presenting network management data
US20100091676A1 (en) Multi-Segment Network Application Monitoring and Correlation Architecture
US6704284B1 (en) Management system and method for monitoring stress in a network
US6115362A (en) Method and apparatus for determining frame relay connections
US6286047B1 (en) Method and system for automatic discovery of network services
US7577729B1 (en) Distributed storage management services
US20060120384A1 (en) Method and system for information gathering and aggregation in dynamic distributed environments
US20030120780A1 (en) Network resource assignment system and method
US6292838B1 (en) Technique for automatic remote media access control (MAC) layer address resolution
US7577701B1 (en) System and method for continuous monitoring and measurement of performance of computers on network
US20090138577A1 (en) Network operating system for managing and securing networks
US20030009657A1 (en) Method and system for booting of a target device in a network management system
US6336138B1 (en) Template-driven approach for generating models on network services
US6714513B1 (en) Enterprise network analyzer agent system and method

Legal Events

Date Code Title Description
EEER Examination request
FZDE Dead