US20040205182A1 - Method and system for providing intelligent network management - Google Patents
Method and system for providing intelligent network management Download PDFInfo
- Publication number
- US20040205182A1 US20040205182A1 US10/836,242 US83624204A US2004205182A1 US 20040205182 A1 US20040205182 A1 US 20040205182A1 US 83624204 A US83624204 A US 83624204A US 2004205182 A1 US2004205182 A1 US 2004205182A1
- Authority
- US
- United States
- Prior art keywords
- network
- inference engine
- plan
- knowledge base
- communications
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/22—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks comprising specially adapted graphical user interfaces [GUI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/16—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks using machine learning or artificial intelligence
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
- H04L41/0668—Management of faults, events, alarms or notifications using network fault recovery by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
Definitions
- the present invention relates to the monitoring and management of voice, video and data networks, and more particularly, to the use of decision support systems to assist operators in managing network devices and network interconnections.
- the present invention provides an intelligent decision support system for management of distributed data and voice networks using a partial order planner.
- SNMP Simple Network Management Protocol
- Vigilant NetworksTM provides some added features that help to identify certain network problems such as network congestion and network errors. This system is superior to previous network management systems in that it is able to monitor additional information that may identify problems that are slowing down a computer network regardless of whether a failure occurs. Basically, the Vigilant NetworksTM system works by providing additional network information and statistics related to the physical network layer to the management console.
- Modern networks are often critical to the successful operation of a business or industrial process. When degradation or malfunctions within network devices have been diagnosed, it is often necessary to reconfigure the network devices and their data as rapidly as possible so that quality of service can be maintained. There is a desire for an intelligent network management solution that assists in performing network reconfigurations in order to rapidly carry out a planned network response to a disturbance.
- U.S. Pat. No. 5,905,715 issued to Azarmi et al. discloses a network management application that receives data from a network, analyzes it, and acts on it by issuing reports and control outputs appropriately.
- This system does not provide for active, goal-directed planning nor conflict detection across multiple independent actors as does the present invention.
- U.S. Pat. No. 5,963,447 issued to Kohn et al. discloses a system of distributed agents working together in a network to control complex distributed processes. This system shows one way in which a collection of intelligent agents can interact and cooperate to achieve goals; however, the '447 patent discloses using the technology to build control systems and not an intelligent decision support system that assists multiple human network controllers and operators such as that provided by the present invention.
- a method for providing intelligent decision support in a network management system includes monitoring actions received by a network management console. The actions received are used to interpret the intent of a human operator. Finally, the method includes updating the network management console display based on the determined intent of the human operator. More specific embodiments include monitoring for one or more key presses, mouse clicks, and mouse movements to assist in determining the intentions of a network operator. A more specific embodiment also includes determining a plan for carrying out a determined intention. In some embodiments, the plan is created using an inference engine which can include a non-monotonic truth maintenance system, and a partial-order planner. Finally, a more specific embodiment includes monitoring communications networks used to transport data communications, voice communications, and video communications.
- an intelligent decision support system for managing a communications network.
- the system includes a knowledge base encoding expert knowledge about communication networks, an inference engine, a network management system, and a graphical user interface.
- the inference engine is coupled to the knowledge base and is used to determine the intent of a network operator.
- the network management system is used to collect data from a plurality of network devices, and the graphical user interface displays information regarding the communications network.
- the intelligent decision support system modifies the information displayed by the graphical user interface based on the determined intent of the network operator.
- more specific embodiments of the present invention represent knowledge as plan and goal graphs, concept graphs, and/or scripts comprising sequences of partially-specified primitive network control actions.
- Some embodiments use an inference engine including a partial order planner, and/or a non-monotonic truth maintenance system.
- Embodiments of the present invention can be used to manage communications networks transporting data communications, voice communications, and video communications.
- FIG. 1 is a schematic diagram illustrating a representative computer network that is managed by an embodiment of the present invention
- FIG. 2 depicts a block diagram showing the software components of one embodiment of the present invention
- FIG. 3 illustrates an inference engine according to one embodiment of the present invention
- FIG. 4 is a block diagram showing a distributed, intelligent agent system in which a firewall intelligent agent and a network management console intelligent agent performed distributed situation assessment;
- FIG. 5 is a block diagramming describing the life cycle of a plan maintained by a planner according to one embodiment of the present invention
- FIG. 6 illustrates a portion of a concept graph according to one embodiment of the present invention
- FIG. 7 illustrates a portion of a plan-goal graph (PGG) according to one embodiment of the present invention
- FIG. 8 describes a goal instance created by an intent interpreter according to one embodiment of the present invention.
- FIG. 9 depicts a portion of a plan-goal graph (PGG) illustrating the operation of a planner according to one embodiment of the present invention.
- a concept graph a knowledge representation of the dependencies between observable data values and higher-level computations and assertions made about the data.
- a concept graph can be implemented as a directed acyclic graph of concept nodes that is a particular type of augmented transition network (ATN).
- ATN augmented transition network
- Expert System a computer program that uses a knowledge base to assist in solving problems. Most expert systems use an inference engine to derive new facts and beliefs using a knowledge base.
- Full-Order Planner (also called a total-order planner) a process that computes a fully-ordered list of primitive steps or actions to reach a goal, in which each step or action is fully definitized at the completion of the planning process.
- Inference Engine a computer program that infers new facts or beliefs from known facts or beliefs using a knowledge base and a set of logical operations.
- Intent Interpreter an expert system that uses a knowledge base to determine the present intention of a user or a system.
- Knowledge Base a collection of knowledge (e.g., objects, concepts, relationships, facts, rules, etc.) expressed in a manner such that it can be used by an inference engine.
- a knowledge base may include rules and facts or assertions as in traditional expert systems.
- Least Commitment Planner a process that generates a plan that avoids making a choice between two or more alternative courses of action unless it is necessary to do so.
- a least commitment planner avoids definitizing any particular sub-element of a plan beyond the minimum necessary to determine likely success.
- Final definitization of the primitive steps is deferred until just prior to the execution of each plan sub-element by a plan execution agent.
- Primitive step a representation of an activity that is not further decomposed by a planner. Also called a primitive action.
- Partial-Order Planner a process that generates a partially ordered set of activities at the completion of the planning process.
- Plan a abstract representation of a set of activities to be performed from the present into the future.
- a plan may be decomposable into plan sub-elements that define more detailed activities.
- the lowest level of decomposition of a plan is a primitive step or action.
- Plan Execution Agent a process that directly operates on the environment by performing activities represented by a plan.
- Plan-Goal Graph a knowledge representation for expressing causal relationships in an operational domain as well as the intentions of a user.
- a PGG can be expressed as an acyclic, directed graph where plans are decomposed into subgoals or primitive actions.
- Planner a computer program that determines a sequence of operations or actions to be taken to reach one or more goals.
- Non-Monotonic Truth Maintenance a system for maintaining the consistency of beliefs, assumptions, justifications and/or assertions in a knowledge base wherein knowledge can be retracted when an inconsistency is detected.
- FIG. 1 depicts a computer network that is representative of networks managed according to various illustrative embodiments of the present invention.
- This computer network is an Ethernet-based network given by way of example only.
- Asynchronous Transfer Mode (ATM) switches can be used with many network topologies and architectures.
- the present invention can be used with Asynchronous Transfer Mode (ATM) switches, Token Ring networks, Fiber Channel networks, or any other networks now available or available in the future.
- ATM Asynchronous Transfer Mode
- any other communications network including, but not limited to the following: public or private voice networks, such as the Public Switch Telephone Network (PSTN) or Private Branch Exchanges (PBXs); public or private data networks, such as intranets, AOLTM, or wireless networks; and public or private video networks.
- PSTN Public Switch Telephone Network
- PBXs Private Branch Exchanges
- public or private data networks such as intranets, AOLTM, or wireless networks
- AOLTM Advanced Online
- FIG. 1 The simplified network topology shown in FIG. 1 is an example of an architecture that could be used by a company to provide services to remote customers.
- Servers 101 include web servers, mail servers, news servers, etc. for providing public communications and electronic commerce services for a company. These public servers are required to provide some access to machines on the Internet, beyond the control of the company. Because of the nature of these servers, there is an inherent security risk. For this reason, servers 101 are placed on a separate network with increased security commonly called a demilitarized zone (DMZ).
- FIG. 2 depicts DMZ 102 behind a firewall 103 to provide isolation from the company's internal network 107 and to provide protection from unauthorized access from the Internet 104 .
- DMZ demilitarized zone
- the company's internal network 107 includes one or more internal hosts 108 that are used by company employees for day to day business needs, such as planning, design, development, and operations. It is imperative that this network operates reliably and continuously so that the company's automation and communication activities are not interrupted.
- External hosts such as customer workstations 105 and work-at-home users 106 access the company's network through the Internet 104 .
- customers 105 may view information, send electronic mail, conduct electronic commerce, etc. using the company's web servers or other public servers 101 .
- An employee working at home may access the company's internal network 107 to assist in performing required tasks.
- a network management console 109 is used to monitor the various network devices such as hubs, routers, switches, firewalls, servers, hosts, workstations, etc.
- the first embodiment of the present invention is an intelligent decision support system for managing a computer network as shown in FIG. 2.
- the system is embodied as a network management console 109 on an IntelTM-based computer system running Microsoft Windows 2000TM operating system.
- the network management console 109 connects to the internal network 107 using a conventional network interface device.
- the network management console 109 includes a plurality of network interface devices to provide increased redundancy and to decrease the amount of network management traffic that must be sent from one segment of a network to another.
- the intelligent network management system detects potential conflicting activities between network operators and advises the operators of the nature of the potential conflicts.
- the network management console 109 is embodied as a web-based application.
- the primary interface to end users is a web server application such as the Microsoft Internet Information ServerTM (IIS).
- IIS Microsoft Internet Information ServerTM
- the present embodiment is implemented using JavaTM and Active Server PagesTM (ASPs) served by an IIS server running on network management console 109 .
- ASPs Active Server PagesTM
- a network operator can access the system by running a web browser such as Internet ExplorerTM or Netscape CommunicatorTM on the network management console 109 , or on another host connected to internal network 107 .
- Inference engine 202 is coupled to knowledge base 203 to perform various tasks such as determining the intent of a network operator, determining goals that the human operator needs or desires to meet, determining the state of the network and its operational condition, determining plans to meet these goals, and to determine what information needs to be displayed to the network operator.
- the knowledge base 203 includes expert knowledge about communication networks. This knowledge is encoded using traditional knowledge engineering techniques known to those of ordinary skill in the art.
- Coupled to inference engine 202 is the operator monitor 205 component.
- the operator monitor 205 monitors and records when a user presses a key, moves the mouse, or presses a mouse button. The information collected can then be used by inference engine 202 to determine the present intention of a human operator.
- the intentions of the human operators are monitored by the operator monitor 205 to detect any conflicts in intended activities between a plurality of operators.
- Inference engine 202 is also coupled to the network management collector 204 . This component monitors the communications network using conventional technology such as by sending pings or SNMP requests to network devices. The data collected is incorporated into knowledge base 203 in order to assist the inference engine 202 in performing its functions.
- inference engine 202 is coupled to a graphical user interface 201 component that facilitates input and output with a network operator.
- the graphical user interface 201 output is dependent on the current state of the system as determined by the inference engine 202 .
- the system begins in the all clear state, with the operator activity being nominal network operations. For this activity, the system displays a network diagram similar to conventional network management systems. The monitored network devices are shown in a color indicative of the devices' status. For example, a device is displayed in green if it is fully functional, in yellow if there are warning messages or other informational messages available, and in red if the device is down or there has been a critical event detected.
- the system remains in the all clear state until the network management collector 204 detects a change in the status of a device, or until the inference engine 202 detects a new intention of the network operator. For example, if the network operator begins viewing the firewall 103 log files and logs on to public servers 101 , the inference engine may determine that the operator's activity has changed from nominal network operations to respond to security event. In that case, the graphical user interface 201 changes the display to show information that may help the network operator diagnose and resolve security problems. In this case, the graphical user interface 201 displays the logfiles from the public servers 101 as well as the firewall 103 logfile.
- a customer calls and complains that she cannot access the server.
- the network operator needs to determine whether the problem is with the company's network devices or with the Internet access provided by a third party.
- the network manager begins tracing packets between the DMZ 102 and hosts on the Internet 104 .
- the inference engine 202 detects the change in the network operator's intent and updates the display accordingly. In this example, if the operator's change in activity to trace packets as a part of the response to a network malfunction creates a conflict with another operator's intent to respond to a security event in another part of the network, the conflict is detected and both operators are advised of the conflict situation so that they can coordinate their activities.
- the system can be made to automatically correct some common errors that occur. For example, if the web server software occasionally experiences problems requiring that the software be restarted, knowledge about detecting the problem and resolving the problem can be encoded in the knowledge base 203 . Then, the system can automatically correct the problem whenever it occurs.
- the system can be integrated into an advanced notification system allowing messages to be sent using electronic mail, an integrated voice response (IVR) system, a paging system, or any other communications means.
- IVR integrated voice response
- the network management console 109 can be embodied as on a UnixTM platform using Hewlett PackardTM, Sun MicrosystemsTM, or IntelTM-based computers.
- One embodiment of the present invention is implemented using an inference engine 301 such as the one described in FIG. 3 including one or more planners 302 , an intent interpreter 303 , an information manager 304 , a script performer 305 , a knowledge base 306 , and a situation assessor 307 .
- an inference engine 301 such as the one described in FIG. 3 including one or more planners 302 , an intent interpreter 303 , an information manager 304 , a script performer 305 , a knowledge base 306 , and a situation assessor 307 .
- Each of these components is described in more detail below.
- the following publications describing various exemplary implementations of the constituent components of an inference engine are hereby incorporated by reference: (1) Hoshstrasser, Belinda Hardman and Norman D. Geddes. Proceedings of the International Joint Conferences on Artificial Intelligence 1989 Workshop on Integrated Human-Machine Intelligence in Aerospace Systems. OPAL: Operator Intent Inferencing for Intelligent Operator Support Systems
- Intelligent Control for Automated Vehicles A Decision Aiding Method for Coordination of Multiple Uninhabited Tactical Aircraft. Association for Unmanned Vehicle Systems International AUVSI' 98 25 th Annual Symposium and Exhibition . (Huntsville, Ala., Jun. 8-12, 1998); (11) Geddes, N. D., R. J. Lee, and J. L. Brown. A Portable Lightweight Associate for Urban Helicopter Pilotage. Submitted to IEEE (Sep. 25, 1997); and (13) Geddes, N. D. “Associate Systems: A framework for human-computer cooperation.” 7 th International Conference of Human - Computer Interaction . (San Francisco, Calif., Aug. 24-29, 1997).
- any conventional planner can be used with the present invention; however, the preferred embodiment uses a real-time, partial-order planner.
- a planner is able to effectively manage real-time operation in a changing world.
- the current state of the system is constantly changing. For example, hosts are losing and gaining network access, users are logging on to the firewall, customers are accessing various servers, etc.
- a system that only plans as far as necessary for given constraints conserves resources by preventing excessive planning in a dynamic environment where preferences, goals, and intentions are always changing.
- the partial order, least commitment planner uses an abstract decomposition of the network management objectives.
- This decomposition is represented as a plan and goal graph (PGG), an acyclic, directed graph that represents the hierarchy of possible goals that may be pursued to achieve an intention and the methods (or plans) that can be used to satisfy each goal.
- PSG plan and goal graph
- general plans are represented by plan nodes of the PGG that are higher in the directed acyclic graph structure, while lower-level plan sub-elements provide increasing levels of detail in the lower levels of the PGG.
- a partial order planning system using a plan and goal graph (PGG) is described by N. D. Geddes and R. J. Lee in a paper entitled “Intelligent Control for Automated Vehicles: A Decision Aiding Method for Coordination of Multiple Uninhabited Tactical Aircraft” published June 1998.
- a planner determines a sequence of activities that can be taken to achieve as many desired states or goals as possible given available resources and domain constraints.
- a full order planner determines the “optimal” sequence of activities to be taken. Because this process requires searching all combinations of activities to determine the best combination, it is order n-cubed or worse in the number of activities.
- Partial order planners compute less than the “optimal” sequence of activities to be taken. For example, one type of partial order planner is a least commitment planner that operates by committing to as little as possible, thus reducing exponential growth of the search space resulting in increased planning speed. Since all plans are not necessarily considered, a partial order planner may not find the optimal sequence of activities for reaching one or more goals; however, a plan that satisfies domain and resource constraints will be quickly provided and the resulting plan can be recalculated as changes occur.
- the planner 302 is a partial order planner and manages its level of commitment to the activities in the plan by using a state transition method to set the life cycle states of plan sub-elements. By providing graded levels of commitment, the planner 302 can continue to plan about alternative activities without having to make a commitment to the selection of a specific activity until later.
- One embodiment of the plan life cycle state transitions is shown in FIG. 6. As a plan sub-element moves through its life cycle states from candidate towards the active state, the partial order planner is increasing its commitment to that plan sub-element. The partial order planner may also reduce its commitment by changing the plan sub-element state to rejected state or revoked state and ultimately to a terminated state. This mechanism provides a non-monotonic, graded level of commitment for each plan sub-element.
- state transitions of the plan sub-elements are performed by the planner 302 in response to event signals received from the situation assessor 307 .
- the planner 302 moves a plan sub-element to a new life cycle state
- the planner 302 requests the activation of specific monitors within situation assessor 307 .
- the monitors represent the conditions under which a plan sub-element should be transitioned to a different one of its plurality of life cycle states.
- the situation assessor 307 periodically evaluates the specific monitors that have been activated, and provides an event signal to the planner 302 for each specific monitor whose conditions are satisfied.
- the intent interpreter 303 is an important component of the intelligent network management system in some embodiments.
- One embodiment of the present invention uses an intent interpreter similar to that described by B. H. Hoshstrasser and N. D. Geddes in a paper entitled “OPAL: Operater Intent Inferencing for Intelligent Operator Support Systems” published July 1989.
- the system monitors a network operator's actions to determine what the operator is trying to accomplish.
- the intent interpreter does this using a task-analytic decomposition of the purposes of network operators within the communications network domain.
- This decomposition is represented as a plan and goal graph (PGG), an acyclic, directed graph that represents the hierarchy of possible goals that may be pursued to achieve an intention and the methods (or plans) that can be used to satisfy each goal.
- intent interpreter 303 uses knowledge represented as scripts. These scripts are sequences of primitive actions whose execution may be dependent on the state of the execution context. Other embodiments may use scripts that may include non-primitive actions (e.g., recursive script calls or additional script calls). Scripts represent standard procedures or processes that are routinely used to perform specific network activities described by plan sub-elements. Such standard operational procedures may include standard responses to both normal and abnormal events and operating conditions within a network.
- the intent interpreter 303 uses reasoning on the PGG to represent problem solving behaviors that are necessary when existing network management procedures defined by scripts are not appropriate for the situation. Using assertions made by the other components of the system together with domain knowledge stored in knowledge base 206 , the intent interpreter determines the most likely intent of a network operator. This determined intent is then used to update the information being displayed to the network operator and to generate one or more plans to satisfy the interpreted goals of the operator.
- Script performer 305 can be used to execute multiple parallel situated scripts that are stored in knowledge base 306 .
- these scripts are sequences of partially specified primitive actions whose execution is context sensitive. This components is a valuable tool to increase the efficiency of the system by supporting real-time monitoring, information display, and network modifications.
- the scripts can be thought of as a knowledge representation optimized for procedure execution; just as software executables can be viewed as optimized representations of source code.
- the information manager 304 component of this embodiment of the present invention provides automatic information management features for the user interface.
- the information manager 304 uses knowledge stored in knowledge base 306 including the present intent of the network operator as determined by intent interpreter 303 to decide what information should be displayed to the network operator.
- Information needed by a user changes as the user's tasks and intentions change.
- This embodiment of the present invention uses a model to determine the information needed based on the current knowledge base.
- One embodiment of the present invention uses an information manager 304 similar to that described in an article by B. W. Webb, N. D. Geddes, and L. O. Neste entitled “Information Management with a Hierarchical Display Generator.” This article describes an implementation of a system that selects and tailors the format of displayed information to the tasks being performed by a user.
- knowledge base 306 stores all knowledge patterns and instances used in the system to conduct reasoning including plans, scripts, assertions, relationships, frames, etc.
- Situation assessor 307 maintains the consistency of the instances within the knowledge base 306 by identifying and resolving any inconsistent or outdated beliefs.
- the situation assessor uses a concept graph to update data values and beliefs.
- a concept graph is a knowledge representation of the dependencies between observable data values and higher-level computations and assertions made about the data.
- the concept graph includes one or more means for calculating the degree of belief that the situation assessor 307 has in the values of each concept.
- One such means for calculating belief is Bayes Formula.
- the situation assessor 307 receives new data, concepts that depend on that data are updated and their belief values are also updated. As a result of the updated belief values, the situation assessor 307 may reduce its belief in a concept, providing for non-monotonic truth maintenance for the situation assessor 307 .
- next embodiment of the present invention uses a network management console similar to those embodiments describe above; however, this embodiment also includes intelligent agents installed on network devices to increase the functionality and performance of the system.
- Each intelligent agent includes an inference engine as shown in FIG. 3 and discussed above.
- firewall 103 includes an intelligent agent that performs the same functions as the network management console inference engine shown in FIG. 3.
- the intelligent agent can be implemented on firewall 103 by encoding the necessary expert knowledge using conventional techniques.
- FIG. 4 shows a block diagram of a firewall 401 with embedded intelligent agents 402 connected to a network management console 403 including an intelligent agent 404 .
- the situation assessor 307 of the firewall and of the network management console share information from the knowledge base to create a shared, distributed situation assessment.
- the starting point for the planning cycle is the posting of a high-level goal instance from a plan-goal graph (PGG).
- PSG plan-goal graph
- the posting of a goal triggers a planning cycle that involves decomposing and specializing high-level goals into low-level actions that can be executed to achieve that goal.
- Each goal in the PGG has one or more child plans, some of which can be decomposed into actions which can be executed directly and some that must be recursively decomposed into sub-goals and sub-plans and specialized until the primitive steps (actions) are reached.
- the planner is a least commitment planner, commitment to a specialization created during decomposition is limited to only those aspects of the plan for which commitment cannot be deferred. If the system has been configured to interact closely with a human, candidate plans that are successfully decomposed and specialized may be proposed to the operator.
- the planner manages the specific life cycle states of each sub-element of a plan.
- the life cycle states depicted in FIG. 5, provide the mechanism for managing the commitment of the system to the each of the plan sub-elements.
- Each of the life cycle states of a plan sub-element has specific monitoring knowledge associated with it, serving to focus the processing of the situation assessor and providing for an event-based control of the planner.
- the dynamic planner maintains the parameters of the plan or goal and monitors for its success or failure.
- the planner can dynamically adjust plan parameters that mediate its execution and dynamically reselect and specialize children of a node as required.
- the operation of the system begins in the situation assessor 307 .
- this component monitors and reads inputs to the system.
- the situation assessor 307 uses the inputs it receives to add data to the knowledge base regarding the current state of the system. For example, in the present embodiment, the system monitors a user's key presses and mouse clicks to add facts or observations to the knowledge base 306 . It may also collect data from switching systems and financial systems to update the situation of importance to network management.
- FIG. 6 shows a concept graph according to one embodiment of the present invention.
- the situation assessor 307 stores knowledge about the situations of possible interest in the knowledge base 306 in the form of a concept graph such as the one shown in FIG. 6.
- the concept graph specifies the relationships between lower level data and higher level concepts.
- the situation assessor 307 creates concept instances which represent specific data and conclusions that it determines based on its data inputs.
- the concepts may represent highly aggregated and abstract conclusions about the situation of the network and its business operations.
- Each concept is capable of having monitors defined for it that can be activated by the planner 302 as the life cycle states of plans and goals change over time.
- the concept graph shows the relationship between the concept of Routing Cost and the concepts of Link Cost and the Transmission Route.
- a monitor is a data input that can be defined by the system. Instead of monitoring all possible inputs at one time, embodiments of the present invention provide a mechanism for identifying what data is actually needed. A monitor corresponding to the needed data is then activated so that the needed data can be collected and used in the decision support process.
- the situation assessor 307 can also send and receive copies of concept patterns and instances by communicating with other network management systems also containing a situation assessor 307 and a knowledge base 306 .
- the communication may be achieved by a plurality of methods including local networks, direct connection and wide area networks such as the Internet.
- the situation assessor 307 processes any monitors related to the new fact. If a monitor is found to be satisfied, an event is generated to the planner 302 that causes the planner to update its planning.
- the intent interpreter 303 processes the new assertion to update a model of the current intent of the user.
- the intent interpreter uses a PGG model of user intentions such as the portion of the one shown in FIG. 7.
- FIG. 7 shows a portion of a PGG model of user intentions.
- the top-level plan is Network Operations. This plan can be decomposed into three goals:
- a plan may also have a script for completing a plan associated with it or a goal may be fully decomposed into one or more primitive actions.
- the intent interpreter 303 searches through the system's PGG models of user intention to determine the possible and likely intentions of the current user. The intent interpreter 303 then instantiates one or more goals based on the current perceived intentions of the user.
- a user within the Network Operations Center (NOC) of Company A performs a primitive step or action at the user interface by placing a link request (1) with a specific network company to carry a load of traffic over a particular link from a source to a destination.
- the intent interpreter 303 searches for an explanation of this action, and finds in the knowledge base that the network company has a spot traffic carrying agreement with the requesting Company A.
- the intent interpreter 303 tentatively hypothesizes that the user plans to use a short-term, spot-priced link as the plan (2) for satisfying the goal to select a link (3) as a part of some service routing plan.
- the intent interpreter 303 searches for a higher level plan within the knowledge base 306 that explains the goal, and finds that there is an active plan for performing a rerouting of traffic to improve the quality of service (QOS) (4). Hence, the intent interpreter 303 instantiates the plan (2) and the goal (3) within the knowledge base 306 . The posting of the new goal starts the planner 302 to consider if there are more effective alternative plans for the goal, such as using an owned or is leased link as a part of the service route.
- QOS quality of service
- the intent interpreter 303 uses non-monotonic reasoning in its search through the PGG knowledge in the knowledge base 306 . If it is unable to find a complete path in the PGG from a hypothesized node to one known to be active, it can back up, retract its earlier assumptions and explore other paths.
- the intent interpreter 303 also sends and receives copies of plan and goal patterns and instances by communicating with other network management systems that contain an intent interpreter 303 and a knowledge base 306 .
- the communication may be achieved by a plurality of methods, including local network, direct connection, and wide area networking such as the Internet.
- the planner 302 determines if any further planning needs to take place. For example, if the intent interpreter 303 instantiates a new goal, then the planner 302 needs to create a plan for achieving that goal.
- the planner 302 is a least commitment planner that performs a search of the PGGs stored in knowledge base 306 to determine subgoals and actions that need to be taken.
- the planner 302 uses knowledge in the knowledge base 306 to determine if any of the newly changed or updated goal or plan instances are in conflict with any other goal or plan instances. If a conflict is detected, the planner 302 sends a notification to the user interface.
- a user at the NOC for Company A enters data defining the goal to route data service from a source to a destination (1) in response to an order.
- the planner 302 uses knowledge in the knowledge base 306 to determine that the appropriate plan for the service route should meet both cost and QOS limits (2). This plan has multiple subgoal instances, all of the same goal class, Link Selected (3).
- the planner 302 uses knowledge in the knowledge base 306 to determine the link selection order. After the route is active, a monitor is satisfied reporting that a spot price for a link has dropped below the current price of a selected link in use.
- the planner 302 explores the plan to reroute to reduce costs (2) as a solution of the route service goal.
- the planner 302 determines that a spot link use (4) will be more effective than either a leased or owned link and proposes this solution, leading to action (5).
- script performer 305 One optimization that is made in the present embodiment is the use of script performer 305 .
- many plans are commonly encountered and constitute a body of accepted methods known to practitioners within the domain. These plans can be implemented as scripts that represent partially specified procedures that can be executed without the need for extensive planning.
- the script performer 305 is a component of the present embodiment that facilitates the execution of scripts. These scripts are represented in the system's PGGs that are a part of the knowledge base 306 .
- the script performer 305 can perform many and possibly all of the primitive actions that could be performed by a human user, but the script performer 305 is limited by a set of permissions provided by the human operator.
- the planner 302 can create the instance of the plan to use a spot link (purchased over the spot market at the moment). If the script performer 305 has been given permission, it can execute the script and automatically send the requests to the necessary involved network elements.
- the components described above provide a mechanism for assessing the current situation or state of system, planning one or more responses and executing the course of action.
- the information manager 304 is used to display information to a user or to update the user's display based on the current intentions or plans that have been identified by the planner 302 and the intent interpreter 303 using the knowledge base 306 , the script performer 305 , and the situation assessor 307 .
- the knowledge base 306 contains a representation of the information that a human user would need to access if he was involved in a plan to reroute service to improve QOS.
- One type of information relevant to a plan of this kind might be the specific link quality conditions over alternate links between the source and the destination of the route.
- the information manager 304 uses the attributes of the plan and the knowledge base 306 to determine that the link QOS between Atlanta and Chattanooga and Chattanooga and Dallas is of interest to the human.
- the information manager 304 then commands the display presentations to show the appropriate QOS forecast map for the correct region and time period.
Abstract
A network management system and method is disclosed for providing an intelligent decision support system for assisting human operators monitor, maintain, and diagnose and solve problems with a network. According to one embodiment, a system and method is provided that uses a partial order planner and a knowledge base to implement intelligent decision support using knowledge stored as plan and goal graphs, concept graphs, and/or scripts.
Description
- A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent disclosure, as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright rights whatsoever.
- The present invention relates to the monitoring and management of voice, video and data networks, and more particularly, to the use of decision support systems to assist operators in managing network devices and network interconnections. The present invention provides an intelligent decision support system for management of distributed data and voice networks using a partial order planner.
- Communication (voice, data, and video) networks are increasingly becoming mission critical components of businesses. As companies become more dependent on their networks, the cost of network outages increases tremendously in lost revenue and lost productivity.
- Today, various network management packages such as Hewlett-Packard OpenView™ and LeCroy Vigilant Networks™ provide tools to monitor computer networks, alerting operators when problems are detected. Most of the available systems use the Simple Network Management Protocol (SNMP) to monitor various network devices, periodically polling the devices by pinging the devices or by sending out a SNMP request. If a device fails to respond, then the system notifies an operator and the device is identified as unreachable on the network management console.
- Vigilant Networks™ provides some added features that help to identify certain network problems such as network congestion and network errors. This system is superior to previous network management systems in that it is able to monitor additional information that may identify problems that are slowing down a computer network regardless of whether a failure occurs. Basically, the Vigilant Networks™ system works by providing additional network information and statistics related to the physical network layer to the management console.
- As networks become larger and more complex, operators are increasingly deluged with unmanageable amounts of data. At the same time, network quality of service goals require rapid response to any degradation or hostile network traffic. There is a great desire for an intelligent network management solution that assist network operators in monitoring and managing large complex networks.
- As communication networks increase in size, so to does the complexity of network management. It was once easy to visualize the components of a network so that a single operator could quickly determine a likely point of failure of a device and fix the problem. Today, networks are becoming too large for operators to ponder all of the interrelations between thousands of network components to determine the cause of a problem. There is a desire for a system and method that can assist a user in narrowing down the possible causes of a performance problem and suggest or implement potential solutions beyond mere fault detection.
- Modern networks are often critical to the successful operation of a business or industrial process. When degradation or malfunctions within network devices have been diagnosed, it is often necessary to reconfigure the network devices and their data as rapidly as possible so that quality of service can be maintained. There is a desire for an intelligent network management solution that assists in performing network reconfigurations in order to rapidly carry out a planned network response to a disturbance.
- Additionally, using such services as the Simple Network Management Protocol (SNMP), operators can monitor large amounts of data from a central console. As networks grow, the amount of data becomes unwieldy. Data only becomes information to a user by virture of its relevance to the user's active goals and methods for achieving them. The modern network operator finds himself data rich, but information poor. There is a desire to provide a system and method for assisting a human operator by displaying the information most pertinent to the operator's goals or plans.
- The large size, complexity, and distributed nature of networks often result in the need to employ many human network technicians, who are simultaneously interacting with different network devices at remote locations and with different intentions. These activities can produce unexpected network degradation and outages due to unexpected interactions between the separate technical activities. There is a need for an intelligent network management solution that can detect potential degrading interactions between network operations and activities before they occur.
- Finally, there is a desire to provide a network management console that interprets the intentions of a human operator and adjusts the information displayed on the network management console based on the user's intention.
- Several patents disclosing network management systems have been issued by the United States Patent and Trademark Office. For example, U.S. Pat. No. 5,359,649 issued to Rosu et al. (the '649 patent) discloses a system for optimizing the traffic capacity of a telecommunications network by receiving traffic data from each exchange in the network and dynamically fine tuning the congestion condition. The '649 patent does not disclose an intelligent decision support system that can determine the intention of the user and adjust a display console based on that intent. In addition, it describes how to tune for traffic capacity but not for revenue, which is a completely different need for modern network managers.
- Additionally, U.S. Pat. No. 5,905,715 issued to Azarmi et al. (the '715 patent) discloses a network management application that receives data from a network, analyzes it, and acts on it by issuing reports and control outputs appropriately. This system does not provide for active, goal-directed planning nor conflict detection across multiple independent actors as does the present invention.
- Finally, U.S. Pat. No. 5,963,447 issued to Kohn et al. (the '447 patent) discloses a system of distributed agents working together in a network to control complex distributed processes. This system shows one way in which a collection of intelligent agents can interact and cooperate to achieve goals; however, the '447 patent discloses using the technology to build control systems and not an intelligent decision support system that assists multiple human network controllers and operators such as that provided by the present invention.
- There is a need for an intelligent decision support system that improves on the prior art by providing user intent inferencing so that system can update displays and make suggestions based on the current intent of a user. There is a need for a system that is able to detect conflicts between the intentions and operational plans of multiple network operators. There is also a need for a system that uses a partial-order planner to provide real-time intelligent decision support to a user across very large network systems.
- In accordance with the invention, a method for providing intelligent decision support in a network management system is provided. The method includes monitoring actions received by a network management console. The actions received are used to interpret the intent of a human operator. Finally, the method includes updating the network management console display based on the determined intent of the human operator. More specific embodiments include monitoring for one or more key presses, mouse clicks, and mouse movements to assist in determining the intentions of a network operator. A more specific embodiment also includes determining a plan for carrying out a determined intention. In some embodiments, the plan is created using an inference engine which can include a non-monotonic truth maintenance system, and a partial-order planner. Finally, a more specific embodiment includes monitoring communications networks used to transport data communications, voice communications, and video communications.
- According to another aspect of the present invention, an intelligent decision support system is provided for managing a communications network. The system includes a knowledge base encoding expert knowledge about communication networks, an inference engine, a network management system, and a graphical user interface. The inference engine is coupled to the knowledge base and is used to determine the intent of a network operator. The network management system is used to collect data from a plurality of network devices, and the graphical user interface displays information regarding the communications network. The intelligent decision support system modifies the information displayed by the graphical user interface based on the determined intent of the network operator.
- Further, more specific embodiments of the present invention represent knowledge as plan and goal graphs, concept graphs, and/or scripts comprising sequences of partially-specified primitive network control actions. Some embodiments use an inference engine including a partial order planner, and/or a non-monotonic truth maintenance system.
- Embodiments of the present invention can be used to manage communications networks transporting data communications, voice communications, and video communications.
- The present invention is further described in the detailed description which follows, by reference to a plurality of drawings by way of non-limiting examples of illustrated embodiments of the present invention, in which like reference numerals represent similar parts throughout the several drawings, and wherein:
- FIG. 1 is a schematic diagram illustrating a representative computer network that is managed by an embodiment of the present invention;
- FIG. 2 depicts a block diagram showing the software components of one embodiment of the present invention;
- FIG. 3 illustrates an inference engine according to one embodiment of the present invention;
- FIG. 4 is a block diagram showing a distributed, intelligent agent system in which a firewall intelligent agent and a network management console intelligent agent performed distributed situation assessment;
- FIG. 5 is a block diagramming describing the life cycle of a plan maintained by a planner according to one embodiment of the present invention;
- FIG. 6 illustrates a portion of a concept graph according to one embodiment of the present invention;
- FIG. 7 illustrates a portion of a plan-goal graph (PGG) according to one embodiment of the present invention;
- FIG. 8 describes a goal instance created by an intent interpreter according to one embodiment of the present invention; and
- FIG. 9 depicts a portion of a plan-goal graph (PGG) illustrating the operation of a planner according to one embodiment of the present invention.
- Concept Graph: a knowledge representation of the dependencies between observable data values and higher-level computations and assertions made about the data. A concept graph can be implemented as a directed acyclic graph of concept nodes that is a particular type of augmented transition network (ATN).
- Expert System: a computer program that uses a knowledge base to assist in solving problems. Most expert systems use an inference engine to derive new facts and beliefs using a knowledge base.
- Full-Order Planner: (also called a total-order planner) a process that computes a fully-ordered list of primitive steps or actions to reach a goal, in which each step or action is fully definitized at the completion of the planning process.
- Inference Engine: a computer program that infers new facts or beliefs from known facts or beliefs using a knowledge base and a set of logical operations.
- Intent Interpreter: an expert system that uses a knowledge base to determine the present intention of a user or a system.
- Knowledge Base: a collection of knowledge (e.g., objects, concepts, relationships, facts, rules, etc.) expressed in a manner such that it can be used by an inference engine. For example, a knowledge base may include rules and facts or assertions as in traditional expert systems.
- Least Commitment Planner: a process that generates a plan that avoids making a choice between two or more alternative courses of action unless it is necessary to do so. A least commitment planner avoids definitizing any particular sub-element of a plan beyond the minimum necessary to determine likely success. Final definitization of the primitive steps is deferred until just prior to the execution of each plan sub-element by a plan execution agent.
- Primitive step. a representation of an activity that is not further decomposed by a planner. Also called a primitive action.
- Partial-Order Planner: a process that generates a partially ordered set of activities at the completion of the planning process.
- Plan. a abstract representation of a set of activities to be performed from the present into the future. A plan may be decomposable into plan sub-elements that define more detailed activities. The lowest level of decomposition of a plan is a primitive step or action.
- Plan Execution Agent. a process that directly operates on the environment by performing activities represented by a plan.
- Plan-Goal Graph (PGG): a knowledge representation for expressing causal relationships in an operational domain as well as the intentions of a user. A PGG can be expressed as an acyclic, directed graph where plans are decomposed into subgoals or primitive actions.
- Planner: a computer program that determines a sequence of operations or actions to be taken to reach one or more goals.
- Non-Monotonic Truth Maintenance: a system for maintaining the consistency of beliefs, assumptions, justifications and/or assertions in a knowledge base wherein knowledge can be retracted when an inconsistency is detected.
- The present invention includes methods and systems for providing intelligent decision support services to a network operator. FIG. 1 depicts a computer network that is representative of networks managed according to various illustrative embodiments of the present invention. This computer network is an Ethernet-based network given by way of example only. One of ordinary skill in the art will understand that the present invention can be used with many network topologies and architectures. For example, the present invention can be used with Asynchronous Transfer Mode (ATM) switches, Token Ring networks, Fiber Channel networks, or any other networks now available or available in the future. Additionally, one of ordinary skill in the art will readily appreciate that the present invention can be used on any other communications network including, but not limited to the following: public or private voice networks, such as the Public Switch Telephone Network (PSTN) or Private Branch Exchanges (PBXs); public or private data networks, such as intranets, AOL™, or wireless networks; and public or private video networks.
- The various embodiments of the present invention improve on traditional artificial techniques. One of ordinary skill in the art may find the following references helpful in providing appropriate background understanding in the design and construction of inference engines, knowledge bases, and various knowledge representations used by the present invention: (1) Schank, R. C. and Abelson, R., Scripts, Plans Goals and Understanding, Hillsdale, N.J.: Lawrence Erlbaum Associates (1977); (2) Schank, R. C. and Riesbeck, C. K., Inside Computer Understanding. Hillsdale, N.J.: Lawrence Erlbaum Associates (1981); (3) Sacerdoti, E. D., A Structure for Plans and Behaviors, New York: Elsevier (1978); (4) Rinnooy Kan, A. H. G., Machine Scheduling Problems. The Hague: Martinus Nijhoff (1976); and (5) Charniak, E, Riesbeck, C. K. and McDermott, D., Artificial Intelligence Programming. Hillsdale, N.J.: Lawrence Erlbaum Associates (1980).
- The simplified network topology shown in FIG. 1 is an example of an architecture that could be used by a company to provide services to remote customers.
Servers 101 include web servers, mail servers, news servers, etc. for providing public communications and electronic commerce services for a company. These public servers are required to provide some access to machines on the Internet, beyond the control of the company. Because of the nature of these servers, there is an inherent security risk. For this reason,servers 101 are placed on a separate network with increased security commonly called a demilitarized zone (DMZ). FIG. 2 depictsDMZ 102 behind afirewall 103 to provide isolation from the company'sinternal network 107 and to provide protection from unauthorized access from theInternet 104. - The company's
internal network 107 includes one or moreinternal hosts 108 that are used by company employees for day to day business needs, such as planning, design, development, and operations. It is imperative that this network operates reliably and continuously so that the company's automation and communication activities are not interrupted. - External hosts such as
customer workstations 105 and work-at-home users 106 access the company's network through theInternet 104. For example,customers 105 may view information, send electronic mail, conduct electronic commerce, etc. using the company's web servers or otherpublic servers 101. An employee working at home may access the company'sinternal network 107 to assist in performing required tasks. - It is imperative for the company to maintain a fully functional network architecture, therefore a
network management console 109 is used to monitor the various network devices such as hubs, routers, switches, firewalls, servers, hosts, workstations, etc. - The first embodiment of the present invention is an intelligent decision support system for managing a computer network as shown in FIG. 2. The system is embodied as a
network management console 109 on an Intel™-based computer system running Microsoft Windows 2000™ operating system. Thenetwork management console 109 connects to theinternal network 107 using a conventional network interface device. In other embodiments, thenetwork management console 109 includes a plurality of network interface devices to provide increased redundancy and to decrease the amount of network management traffic that must be sent from one segment of a network to another. In this embodiment, with a plurality of network consoles and operators, the intelligent network management system detects potential conflicting activities between network operators and advises the operators of the nature of the potential conflicts. - The
network management console 109 is embodied as a web-based application. The primary interface to end users is a web server application such as the Microsoft Internet Information Server™ (IIS). The present embodiment is implemented using Java™ and Active Server Pages™ (ASPs) served by an IIS server running onnetwork management console 109. Thus, a network operator can access the system by running a web browser such as Internet Explorer™ or Netscape Communicator™ on thenetwork management console 109, or on another host connected tointernal network 107. - Next, we turn to the software configuration of the
network management console 109 as shown in FIG. 2.Inference engine 202 is coupled toknowledge base 203 to perform various tasks such as determining the intent of a network operator, determining goals that the human operator needs or desires to meet, determining the state of the network and its operational condition, determining plans to meet these goals, and to determine what information needs to be displayed to the network operator. Theknowledge base 203 includes expert knowledge about communication networks. This knowledge is encoded using traditional knowledge engineering techniques known to those of ordinary skill in the art. - Coupled to
inference engine 202 is the operator monitor 205 component. The operator monitor 205 monitors and records when a user presses a key, moves the mouse, or presses a mouse button. The information collected can then be used byinference engine 202 to determine the present intention of a human operator. The intentions of the human operators are monitored by the operator monitor 205 to detect any conflicts in intended activities between a plurality of operators. -
Inference engine 202 is also coupled to thenetwork management collector 204. This component monitors the communications network using conventional technology such as by sending pings or SNMP requests to network devices. The data collected is incorporated intoknowledge base 203 in order to assist theinference engine 202 in performing its functions. - Finally,
inference engine 202 is coupled to agraphical user interface 201 component that facilitates input and output with a network operator. Thegraphical user interface 201 output is dependent on the current state of the system as determined by theinference engine 202. - We now describe the operation of a system according to one embodiment of the present invention with reference to the computer network architecture shown in FIG. 1. In this embodiment, we use a simplified model of network operator intent consisting of three activities: (1) nominal network operations (all clear), (2) respond to security event (security incident), and (3) respond to network fault (network outage). The information needed by the network operator differs for each of the three system technical activities.
- The system begins in the all clear state, with the operator activity being nominal network operations. For this activity, the system displays a network diagram similar to conventional network management systems. The monitored network devices are shown in a color indicative of the devices' status. For example, a device is displayed in green if it is fully functional, in yellow if there are warning messages or other informational messages available, and in red if the device is down or there has been a critical event detected.
- The system remains in the all clear state until the
network management collector 204 detects a change in the status of a device, or until theinference engine 202 detects a new intention of the network operator. For example, if the network operator begins viewing thefirewall 103 log files and logs on topublic servers 101, the inference engine may determine that the operator's activity has changed from nominal network operations to respond to security event. In that case, thegraphical user interface 201 changes the display to show information that may help the network operator diagnose and resolve security problems. In this case, thegraphical user interface 201 displays the logfiles from thepublic servers 101 as well as thefirewall 103 logfile. - As another example, a customer calls and complains that she cannot access the server. The network operator needs to determine whether the problem is with the company's network devices or with the Internet access provided by a third party. To resolve the problem, the network manager begins tracing packets between the
DMZ 102 and hosts on theInternet 104. Theinference engine 202 detects the change in the network operator's intent and updates the display accordingly. In this example, if the operator's change in activity to trace packets as a part of the response to a network malfunction creates a conflict with another operator's intent to respond to a security event in another part of the network, the conflict is detected and both operators are advised of the conflict situation so that they can coordinate their activities. - One of ordinary skill in the art will appreciate that many additional modifications of this embodiment may be made without departing from the present invention. For example, the system can be made to automatically correct some common errors that occur. For example, if the web server software occasionally experiences problems requiring that the software be restarted, knowledge about detecting the problem and resolving the problem can be encoded in the
knowledge base 203. Then, the system can automatically correct the problem whenever it occurs. - Additionally, the system can be integrated into an advanced notification system allowing messages to be sent using electronic mail, an integrated voice response (IVR) system, a paging system, or any other communications means.
- One of ordinary skill in the art will appreciate that there are many variations of the software and hardware configuration that we have just discussed. For example, the
network management console 109 can be embodied as on a Unix™ platform using Hewlett Packard™, Sun Microsystems™, or Intel™-based computers. - One embodiment of the present invention is implemented using an
inference engine 301 such as the one described in FIG. 3 including one ormore planners 302, anintent interpreter 303, aninformation manager 304, ascript performer 305, aknowledge base 306, and asituation assessor 307. Each of these components is described in more detail below. In addition, the following publications describing various exemplary implementations of the constituent components of an inference engine are hereby incorporated by reference: (1) Hoshstrasser, Belinda Hardman and Norman D. Geddes. Proceedings of the International Joint Conferences on Artificial Intelligence 1989 Workshop on Integrated Human-Machine Intelligence in Aerospace Systems. OPAL: Operator Intent Inferencing for Intelligent Operator Support Systems. (Aug. 21, 1989); (2) Geddes, Norman D., et al. Fostering Collaboration in System of Systems; (3) Rouse, William B., et al. An Architecture for Intelligent Interfaces: Outline of an Approach to Supporting Operators of Complex Systems. Human-Computer Interaction, vol. 3, pp. 87-122 (1987); (4) Geddes, Norman D. and Mark A. Hoffman. Supervising Unmanned Roving Vehicles Through an Intelligent Interface; (5) Geddes, Norman D., et al. Automated Acquisition of Information Requirements for an Intelligent Display; (6) Miller, Christopher A., et al. Plan-Based Information Requirements: Automated Knowledge Acquisition to Support Information Management in an Intelligent Pilot-Vehicle Interface. Digital Avionics Systems Conference (Seattle, Wash., Oct. 5-9, 1992); (7) Geddes, Norman D., Large Scale Models of Cooperative and Hostile Intentions. IEEE Computer Society, International Conference and Workshop on Engineering of Computer Based Systems (ECBS'97) (Monterey, Calif., Mar. 27-28, 1997); (8) Webb, Barry W., Norman D. Geddes, and Leslie O. Neste. Information Management with a Hierarchical Display Generator; (9) Rouse, W. B., N. D. Geddes, and J. M. Hammer. Computer-aided fighter pilots. IEEE Spectrum. pp. 38-41 (March 1990); (10) Geddes, N. D. and R. J. Lee. Intelligent Control for Automated Vehicles: A Decision Aiding Method for Coordination of Multiple Uninhabited Tactical Aircraft. Association for Unmanned Vehicle Systems International AUVSI'98 25th Annual Symposium and Exhibition. (Huntsville, Ala., Jun. 8-12, 1998); (11) Geddes, N. D., R. J. Lee, and J. L. Brown. A Portable Lightweight Associate for Urban Helicopter Pilotage. Submitted to IEEE (Sep. 25, 1997); and (13) Geddes, N. D. “Associate Systems: A framework for human-computer cooperation.” 7th International Conference of Human-Computer Interaction. (San Francisco, Calif., Aug. 24-29, 1997). - First, we discuss the one or
more planners 302. Any conventional planner can be used with the present invention; however, the preferred embodiment uses a real-time, partial-order planner. Such a planner is able to effectively manage real-time operation in a changing world. During the network management process, the current state of the system is constantly changing. For example, hosts are losing and gaining network access, users are logging on to the firewall, customers are accessing various servers, etc. A system that only plans as far as necessary for given constraints conserves resources by preventing excessive planning in a dynamic environment where preferences, goals, and intentions are always changing. - In one embodiment of the present invention, the partial order, least commitment planner uses an abstract decomposition of the network management objectives. This decomposition is represented as a plan and goal graph (PGG), an acyclic, directed graph that represents the hierarchy of possible goals that may be pursued to achieve an intention and the methods (or plans) that can be used to satisfy each goal. Broad, general plans are represented by plan nodes of the PGG that are higher in the directed acyclic graph structure, while lower-level plan sub-elements provide increasing levels of detail in the lower levels of the PGG. A partial order planning system using a plan and goal graph (PGG) is described by N. D. Geddes and R. J. Lee in a paper entitled “Intelligent Control for Automated Vehicles: A Decision Aiding Method for Coordination of Multiple Uninhabited Tactical Aircraft” published June 1998.
- Traditional network management systems either have no planner at all or use a full-order planner. A planner determines a sequence of activities that can be taken to achieve as many desired states or goals as possible given available resources and domain constraints. A full order planner determines the “optimal” sequence of activities to be taken. Because this process requires searching all combinations of activities to determine the best combination, it is order n-cubed or worse in the number of activities. Partial order planners compute less than the “optimal” sequence of activities to be taken. For example, one type of partial order planner is a least commitment planner that operates by committing to as little as possible, thus reducing exponential growth of the search space resulting in increased planning speed. Since all plans are not necessarily considered, a partial order planner may not find the optimal sequence of activities for reaching one or more goals; however, a plan that satisfies domain and resource constraints will be quickly provided and the resulting plan can be recalculated as changes occur.
- In one embodiment of the present invention, the
planner 302 is a partial order planner and manages its level of commitment to the activities in the plan by using a state transition method to set the life cycle states of plan sub-elements. By providing graded levels of commitment, theplanner 302 can continue to plan about alternative activities without having to make a commitment to the selection of a specific activity until later. One embodiment of the plan life cycle state transitions is shown in FIG. 6. As a plan sub-element moves through its life cycle states from candidate towards the active state, the partial order planner is increasing its commitment to that plan sub-element. The partial order planner may also reduce its commitment by changing the plan sub-element state to rejected state or revoked state and ultimately to a terminated state. This mechanism provides a non-monotonic, graded level of commitment for each plan sub-element. - In one embodiment of the present invention, state transitions of the plan sub-elements are performed by the
planner 302 in response to event signals received from thesituation assessor 307. When theplanner 302 moves a plan sub-element to a new life cycle state, theplanner 302 requests the activation of specific monitors withinsituation assessor 307. In one embodiment of the present invention, the monitors represent the conditions under which a plan sub-element should be transitioned to a different one of its plurality of life cycle states. Thesituation assessor 307 periodically evaluates the specific monitors that have been activated, and provides an event signal to theplanner 302 for each specific monitor whose conditions are satisfied. - The
intent interpreter 303 is an important component of the intelligent network management system in some embodiments. One embodiment of the present invention uses an intent interpreter similar to that described by B. H. Hoshstrasser and N. D. Geddes in a paper entitled “OPAL: Operater Intent Inferencing for Intelligent Operator Support Systems” published July 1989. In this embodiment, to create an intelligent interface, the system monitors a network operator's actions to determine what the operator is trying to accomplish. The intent interpreter does this using a task-analytic decomposition of the purposes of network operators within the communications network domain. This decomposition is represented as a plan and goal graph (PGG), an acyclic, directed graph that represents the hierarchy of possible goals that may be pursued to achieve an intention and the methods (or plans) that can be used to satisfy each goal. Additionally,intent interpreter 303 uses knowledge represented as scripts. These scripts are sequences of primitive actions whose execution may be dependent on the state of the execution context. Other embodiments may use scripts that may include non-primitive actions (e.g., recursive script calls or additional script calls). Scripts represent standard procedures or processes that are routinely used to perform specific network activities described by plan sub-elements. Such standard operational procedures may include standard responses to both normal and abnormal events and operating conditions within a network. Theintent interpreter 303 uses reasoning on the PGG to represent problem solving behaviors that are necessary when existing network management procedures defined by scripts are not appropriate for the situation. Using assertions made by the other components of the system together with domain knowledge stored in knowledge base 206, the intent interpreter determines the most likely intent of a network operator. This determined intent is then used to update the information being displayed to the network operator and to generate one or more plans to satisfy the interpreted goals of the operator. -
Script performer 305 can be used to execute multiple parallel situated scripts that are stored inknowledge base 306. As discussed above, these scripts are sequences of partially specified primitive actions whose execution is context sensitive. This components is a valuable tool to increase the efficiency of the system by supporting real-time monitoring, information display, and network modifications. The scripts can be thought of as a knowledge representation optimized for procedure execution; just as software executables can be viewed as optimized representations of source code. - The
information manager 304 component of this embodiment of the present invention provides automatic information management features for the user interface. Theinformation manager 304 uses knowledge stored inknowledge base 306 including the present intent of the network operator as determined byintent interpreter 303 to decide what information should be displayed to the network operator. Information needed by a user changes as the user's tasks and intentions change. This embodiment of the present invention uses a model to determine the information needed based on the current knowledge base. One embodiment of the present invention uses aninformation manager 304 similar to that described in an article by B. W. Webb, N. D. Geddes, and L. O. Neste entitled “Information Management with a Hierarchical Display Generator.” This article describes an implementation of a system that selects and tailors the format of displayed information to the tasks being performed by a user. - Finally,
knowledge base 306 stores all knowledge patterns and instances used in the system to conduct reasoning including plans, scripts, assertions, relationships, frames, etc.Situation assessor 307 maintains the consistency of the instances within theknowledge base 306 by identifying and resolving any inconsistent or outdated beliefs. In one embodiment of the present invention, the situation assessor uses a concept graph to update data values and beliefs. A concept graph is a knowledge representation of the dependencies between observable data values and higher-level computations and assertions made about the data. - In one embodiment of the present invention, the concept graph includes one or more means for calculating the degree of belief that the
situation assessor 307 has in the values of each concept. One such means for calculating belief is Bayes Formula. When thesituation assessor 307 receives new data, concepts that depend on that data are updated and their belief values are also updated. As a result of the updated belief values, thesituation assessor 307 may reduce its belief in a concept, providing for non-monotonic truth maintenance for thesituation assessor 307. - The next embodiment of the present invention uses a network management console similar to those embodiments describe above; however, this embodiment also includes intelligent agents installed on network devices to increase the functionality and performance of the system.
- Each intelligent agent includes an inference engine as shown in FIG. 3 and discussed above. For example, in this embodiment,
firewall 103 includes an intelligent agent that performs the same functions as the network management console inference engine shown in FIG. 3. One of ordinary skill will appreciate that the intelligent agent can be implemented onfirewall 103 by encoding the necessary expert knowledge using conventional techniques. - FIG. 4 shows a block diagram of a
firewall 401 with embeddedintelligent agents 402 connected to a network management console 403 including anintelligent agent 404. In this manner, thesituation assessor 307 of the firewall and of the network management console share information from the knowledge base to create a shared, distributed situation assessment. - The following is a simplified illustrative embodiment showing the interactions between the various components of the inference engine. Consider an intelligent decision support system to assist a team of humans in collaborative network management across several independently owned network stages.
- The starting point for the planning cycle is the posting of a high-level goal instance from a plan-goal graph (PGG). The posting of a goal triggers a planning cycle that involves decomposing and specializing high-level goals into low-level actions that can be executed to achieve that goal. Each goal in the PGG has one or more child plans, some of which can be decomposed into actions which can be executed directly and some that must be recursively decomposed into sub-goals and sub-plans and specialized until the primitive steps (actions) are reached. Because the planner is a least commitment planner, commitment to a specialization created during decomposition is limited to only those aspects of the plan for which commitment cannot be deferred. If the system has been configured to interact closely with a human, candidate plans that are successfully decomposed and specialized may be proposed to the operator.
- In addition to creating the decomposition of a plan into its sub-elements, the planner manages the specific life cycle states of each sub-element of a plan. The life cycle states, depicted in FIG. 5, provide the mechanism for managing the commitment of the system to the each of the plan sub-elements. Each of the life cycle states of a plan sub-element has specific monitoring knowledge associated with it, serving to focus the processing of the situation assessor and providing for an event-based control of the planner.
- Throughout the life cycle of a PGG plan or goal, the dynamic planner maintains the parameters of the plan or goal and monitors for its success or failure. As a result, the planner can dynamically adjust plan parameters that mediate its execution and dynamically reselect and specialize children of a node as required.
- The operation of the system begins in the
situation assessor 307. In the simplest embodiments, this component monitors and reads inputs to the system. Thesituation assessor 307 uses the inputs it receives to add data to the knowledge base regarding the current state of the system. For example, in the present embodiment, the system monitors a user's key presses and mouse clicks to add facts or observations to theknowledge base 306. It may also collect data from switching systems and financial systems to update the situation of importance to network management. - FIG. 6 shows a concept graph according to one embodiment of the present invention. The
situation assessor 307 stores knowledge about the situations of possible interest in theknowledge base 306 in the form of a concept graph such as the one shown in FIG. 6. The concept graph specifies the relationships between lower level data and higher level concepts. Thesituation assessor 307 creates concept instances which represent specific data and conclusions that it determines based on its data inputs. The concepts may represent highly aggregated and abstract conclusions about the situation of the network and its business operations. Each concept is capable of having monitors defined for it that can be activated by theplanner 302 as the life cycle states of plans and goals change over time. For example, in FIG. 6, the concept graph shows the relationship between the concept of Routing Cost and the concepts of Link Cost and the Transmission Route. - A monitor is a data input that can be defined by the system. Instead of monitoring all possible inputs at one time, embodiments of the present invention provide a mechanism for identifying what data is actually needed. A monitor corresponding to the needed data is then activated so that the needed data can be collected and used in the decision support process.
- In this embodiment, the
situation assessor 307 can also send and receive copies of concept patterns and instances by communicating with other network management systems also containing asituation assessor 307 and aknowledge base 306. The communication may be achieved by a plurality of methods including local networks, direct connection and wide area networks such as the Internet. - Whenever a new fact is added to the
knowledge base 306, thesituation assessor 307 processes any monitors related to the new fact. If a monitor is found to be satisfied, an event is generated to theplanner 302 that causes the planner to update its planning. - Whenever a new fact is added to the
knowledge base 306 that represents the execution of a primitive action by the user, theintent interpreter 303 processes the new assertion to update a model of the current intent of the user. The intent interpreter uses a PGG model of user intentions such as the portion of the one shown in FIG. 7. - FIG. 7 shows a portion of a PGG model of user intentions. For example, the top-level plan is Network Operations. This plan can be decomposed into three goals:
- (1) Have Access, (2) Have Network, and (3) Have Revenue. These goals can, in turn, be decomposed into further plans and so on. A plan may also have a script for completing a plan associated with it or a goal may be fully decomposed into one or more primitive actions.
- The
intent interpreter 303 searches through the system's PGG models of user intention to determine the possible and likely intentions of the current user. Theintent interpreter 303 then instantiates one or more goals based on the current perceived intentions of the user. - In FIG. 8, a user within the Network Operations Center (NOC) of Company A performs a primitive step or action at the user interface by placing a link request (1) with a specific network company to carry a load of traffic over a particular link from a source to a destination. The
intent interpreter 303 searches for an explanation of this action, and finds in the knowledge base that the network company has a spot traffic carrying agreement with the requesting Company A. Theintent interpreter 303 tentatively hypothesizes that the user plans to use a short-term, spot-priced link as the plan (2) for satisfying the goal to select a link (3) as a part of some service routing plan. Theintent interpreter 303 then searches for a higher level plan within theknowledge base 306 that explains the goal, and finds that there is an active plan for performing a rerouting of traffic to improve the quality of service (QOS) (4). Hence, theintent interpreter 303 instantiates the plan (2) and the goal (3) within theknowledge base 306. The posting of the new goal starts theplanner 302 to consider if there are more effective alternative plans for the goal, such as using an owned or is leased link as a part of the service route. - The
intent interpreter 303 uses non-monotonic reasoning in its search through the PGG knowledge in theknowledge base 306. If it is unable to find a complete path in the PGG from a hypothesized node to one known to be active, it can back up, retract its earlier assumptions and explore other paths. - In this embodiment, the
intent interpreter 303 also sends and receives copies of plan and goal patterns and instances by communicating with other network management systems that contain anintent interpreter 303 and aknowledge base 306. The communication may be achieved by a plurality of methods, including local network, direct connection, and wide area networking such as the Internet. - Whenever a goal changes, or whenever a monitor event is received from the
situation assessor 307, theplanner 302 determines if any further planning needs to take place. For example, if theintent interpreter 303 instantiates a new goal, then theplanner 302 needs to create a plan for achieving that goal. In the preferred embodiment, theplanner 302 is a least commitment planner that performs a search of the PGGs stored inknowledge base 306 to determine subgoals and actions that need to be taken. - When goal instances and plan instances change life cycle state, the
planner 302 uses knowledge in theknowledge base 306 to determine if any of the newly changed or updated goal or plan instances are in conflict with any other goal or plan instances. If a conflict is detected, theplanner 302 sends a notification to the user interface. - In FIG. 9, a user at the NOC for Company A enters data defining the goal to route data service from a source to a destination (1) in response to an order. The
planner 302 uses knowledge in theknowledge base 306 to determine that the appropriate plan for the service route should meet both cost and QOS limits (2). This plan has multiple subgoal instances, all of the same goal class, Link Selected (3). Theplanner 302 uses knowledge in theknowledge base 306 to determine the link selection order. After the route is active, a monitor is satisfied reporting that a spot price for a link has dropped below the current price of a selected link in use. Theplanner 302 then explores the plan to reroute to reduce costs (2) as a solution of the route service goal. Theplanner 302 determines that a spot link use (4) will be more effective than either a leased or owned link and proposes this solution, leading to action (5). - One optimization that is made in the present embodiment is the use of
script performer 305. In a particular domain, many plans are commonly encountered and constitute a body of accepted methods known to practitioners within the domain. These plans can be implemented as scripts that represent partially specified procedures that can be executed without the need for extensive planning. Thescript performer 305 is a component of the present embodiment that facilitates the execution of scripts. These scripts are represented in the system's PGGs that are a part of theknowledge base 306. Thescript performer 305 can perform many and possibly all of the primitive actions that could be performed by a human user, but thescript performer 305 is limited by a set of permissions provided by the human operator. - As an example, consider the goal of selecting a link in a network service route, and its child plans for setting up a leased link, an owned link or a spot use link. Because the processes of setting up any of these types of network links is a well-defined and frequently recurring sequence of primitive actions, it can be represented as a script. The representation of the goal, its child plan, the script, and the relationship between the plan and the script are all a part of the
knowledge base 306. - When a specific instance of the goal of selecting a link, such as the goal for selecting the link from Atlanta to Dallas as a part of routing between Athens, Ga. and Abilene, Tex., the
planner 302 can create the instance of the plan to use a spot link (purchased over the spot market at the moment). If thescript performer 305 has been given permission, it can execute the script and automatically send the requests to the necessary involved network elements. - The components described above provide a mechanism for assessing the current situation or state of system, planning one or more responses and executing the course of action. The
information manager 304 is used to display information to a user or to update the user's display based on the current intentions or plans that have been identified by theplanner 302 and theintent interpreter 303 using theknowledge base 306, thescript performer 305, and thesituation assessor 307. - For example, the
knowledge base 306 contains a representation of the information that a human user would need to access if he was involved in a plan to reroute service to improve QOS. One type of information relevant to a plan of this kind might be the specific link quality conditions over alternate links between the source and the destination of the route. When an instance of such a plan is created, such as QOS Reroute from Atlanta to Dallas for a specific time interval, theinformation manager 304 uses the attributes of the plan and theknowledge base 306 to determine that the link QOS between Atlanta and Chattanooga and Chattanooga and Dallas is of interest to the human. Theinformation manager 304 then commands the display presentations to show the appropriate QOS forecast map for the correct region and time period. - Embodiments of the present invention have now been fully detailed. It will be appreciated that these examples are merely illustrative of the present invention. Many variations and modifications will be apparent to those of ordinary skill in the art.
Claims (26)
1-23. (canceled)
24. A method for providing decision support in a network, the method comprising:
monitoring actions received by a network management console from a plurality of network operators;
using the actions to determine an intent of a human network operator using an inference engine coupled to a knowledge base; and
updating a network management console display based on the determined intent by using active, goal-directed planning.
25. The method of claim 24 wherein updating is further based on conflict detection in intentions between the plurality of network operators.
26. The method of claim 24 , wherein monitoring comprises monitoring at least one of: key presses; mouse clicks; and mouse movements.
27. The method of claim 24 , further comprising: determining a plan for carrying out a determined intention.
28. The method of claim 27 , wherein determining a plan is performed using the inference engine.
29. The method of claim 28 , wherein the inference engine comprises at least one of:
a non-monotonic truth maintenance system; and
a partial-order planner.
30. The method of claim 24 , wherein the network management console monitors a communications network, the communications network performing at least one of: data communications, voice communications, and video communications.
31. A decision support system for managing a communications network, the system comprising:
a knowledge base including expert knowledge about communication networks;
an inference engine coupled to the knowledge base, the inference engine determining the intent of at least one network operator;
a network management system that monitors a communications network, collecting data from a plurality of network devices and network operators; and
a graphical user interface system that displays information regarding the communications network;
wherein the information displayed by the graphical user interface system is modified:
based on the determined intent of the network operator; and
by displaying information deemed most pertinent to a network operator's goals and plans.
32. The decision support system of claim 31 , further displaying notification of detected potential conflicts between one or more of the plurality of network operators.
33. The system of claim 31 , wherein the knowledge base comprises one or more plan and goal graphs.
34. The system of claim 31 , wherein the knowledge base comprises one or more concept graphs.
35. The system of claim 31 , wherein the knowledge base comprises one or more scripts, each script comprising a weakly-ordered, partially specified sequence of actions.
36. The system of claim 31 , wherein the inference engine comprises a partial order planner.
37. The system of claim 31 , wherein the inference engine detects potential conflicts in intentions between a plurality of network operators and provides notification of the detected potential conflicts to one or more of the plurality of network operators.
38. The system of claim 31 , wherein the inference engine comprises a non-monotonic truth maintenance system.
39. The system of claim 31 , wherein the communications network performs at least one of: data communications, voice communications, and video communications.
40. The system of claim 36 , wherein the inference engine creates one or more plan instances.
41. The system of claim 40 , wherein the inference engine manages life cycle states of the plan instances according to a commitment level of the partial order planner.
42. The system of claim 41 , wherein the inference engine manages monitoring of actions received by the network management system using the concept graphs according to the life cycle states of the plan instances.
43. The system of claim 42 , wherein the inference engine determines what further processing is needed by the partial order planner based on the monitoring of actions received by the network management system.
44. A network management system comprising:
a plurality of intelligent agents, each of the agents including:
a knowledge base including expert knowledge about communication networks;
an inference engine coupled to the knowledge base, the inference engine including a partial order planner;
a network management system that monitors a communications network, collecting data from and distributing data to a plurality of network devices and network operators; and
a graphical user interface system that displays information regarding the communications network;
wherein the information displayed by the graphical user interface system is modified:
based on a determined intent of a network operator; and
by displaying information most pertinent to network operator's goals and plans.
45. The system of claim 44 wherein the information displayed is further modified by displaying notification of detected potential conflicts between one or more of the network operators.
46. The system of claim 44 , wherein the knowledge base includes one or more concept graphs.
47. The system of claim 46 , wherein each agent of the plurality of intelligent agents determines at least one intention of at least one user and wherein the data management system of a first agent of the plurality of intelligent agents shares data with a second agent of the plurality of intelligent agents representing the at least one determined intention of the at least one user to facilitate collaboration.
48. The system of claim 47 , wherein the system uses the shared data to detect conflicts between a plurality of users.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/836,242 US20040205182A1 (en) | 2000-06-22 | 2004-05-03 | Method and system for providing intelligent network management |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/598,971 US6751661B1 (en) | 2000-06-22 | 2000-06-22 | Method and system for providing intelligent network management |
US10/836,242 US20040205182A1 (en) | 2000-06-22 | 2004-05-03 | Method and system for providing intelligent network management |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/598,971 Continuation US6751661B1 (en) | 2000-06-22 | 2000-06-22 | Method and system for providing intelligent network management |
Publications (1)
Publication Number | Publication Date |
---|---|
US20040205182A1 true US20040205182A1 (en) | 2004-10-14 |
Family
ID=24397672
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/598,971 Expired - Lifetime US6751661B1 (en) | 2000-06-22 | 2000-06-22 | Method and system for providing intelligent network management |
US10/836,242 Abandoned US20040205182A1 (en) | 2000-06-22 | 2004-05-03 | Method and system for providing intelligent network management |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/598,971 Expired - Lifetime US6751661B1 (en) | 2000-06-22 | 2000-06-22 | Method and system for providing intelligent network management |
Country Status (5)
Country | Link |
---|---|
US (2) | US6751661B1 (en) |
EP (1) | EP1305862A4 (en) |
AU (1) | AU2001271350A1 (en) |
CA (1) | CA2413873C (en) |
WO (1) | WO2001099251A1 (en) |
Cited By (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040006614A1 (en) * | 2002-07-03 | 2004-01-08 | Difalco Robert A. | Homogeneous monitoring of heterogeneous nodes |
US20050015429A1 (en) * | 2003-07-17 | 2005-01-20 | International Business Machines Corporation | Method and system for providing user control over receipt of cookies from e-commerce applications |
US20070043786A1 (en) * | 2005-08-16 | 2007-02-22 | Tripwire, Inc. | Conformance authority reconciliation |
US20070250365A1 (en) * | 2006-04-21 | 2007-10-25 | Infosys Technologies Ltd. | Grid computing systems and methods thereof |
US20070270982A1 (en) * | 2006-05-16 | 2007-11-22 | Foss Scot R | Diagnostics in process control and monitoring systems |
US20070283329A1 (en) * | 2006-01-09 | 2007-12-06 | Infosys Technologies, Ltd. | System and method for performance monitoring and diagnosis of information technology system |
US20080005053A1 (en) * | 2006-06-30 | 2008-01-03 | Microsoft Corporation | Communication-prompted user assistance |
US20080040145A1 (en) * | 2006-08-09 | 2008-02-14 | Infosys Technologies, Ltd. | Business case evaluation system and methods thereof |
US20090063373A1 (en) * | 2007-08-30 | 2009-03-05 | Howard Michael D | Methods and apparatus for adversarial reasoning |
US7536595B1 (en) | 2005-10-19 | 2009-05-19 | At&T Intellectual Property, Ii, L.P. | Systems, devices, and methods for initiating recovery |
US20100318653A1 (en) * | 2008-03-17 | 2010-12-16 | Fujitsu Limited | Information obtaining assistance apparatus and method |
US20110035202A1 (en) * | 2008-04-03 | 2011-02-10 | Karl Quinn | Behaviour model for a communication network |
US8140635B2 (en) | 2005-03-31 | 2012-03-20 | Tripwire, Inc. | Data processing environment change management methods and apparatuses |
US8543681B2 (en) * | 2001-10-15 | 2013-09-24 | Volli Polymer Gmbh Llc | Network topology discovery systems and methods |
US8606725B1 (en) * | 2008-10-29 | 2013-12-10 | Emory University | Automatic client-side user-behavior analysis for inferring user intent |
US8649995B2 (en) | 2011-04-07 | 2014-02-11 | Infosys Technologies, Ltd. | System and method for efficient test case generation using input dependency information |
US8868715B2 (en) | 2001-10-15 | 2014-10-21 | Volli Polymer Gmbh Llc | Report generation and visualization systems and methods and their use in testing frameworks for determining suitability of a network for target applications |
US8914341B2 (en) | 2008-07-03 | 2014-12-16 | Tripwire, Inc. | Method and apparatus for continuous compliance assessment |
US9256841B2 (en) | 2005-08-09 | 2016-02-09 | Tripwire, Inc. | Information technology governance and controls methods and apparatuses |
US10209967B2 (en) | 2010-10-18 | 2019-02-19 | Infosys Technologies Ltd. | System and method for detecting preventative maintenance operations in computer source code |
US20200162344A1 (en) * | 2018-11-20 | 2020-05-21 | Cisco Technology, Inc. | Interactive interface for network exploration with relationship mapping |
Families Citing this family (79)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6581025B2 (en) * | 1995-04-17 | 2003-06-17 | Discovision Associates | Time and work tracker for wireless devices |
US7072876B1 (en) * | 2000-09-19 | 2006-07-04 | Cigital | System and method for mining execution traces with finite automata |
US8023421B2 (en) * | 2002-07-25 | 2011-09-20 | Avaya Inc. | Method and apparatus for the assessment and optimization of network traffic |
US7349994B2 (en) | 2000-10-17 | 2008-03-25 | Avaya Technology Corp. | Method and apparatus for coordinating routing parameters via a back-channel communication medium |
WO2002033894A2 (en) | 2000-10-17 | 2002-04-25 | Routescience Technologies, Inc. | Method and apparatus for performance and cost optimization in an internetwork |
US7720959B2 (en) | 2000-10-17 | 2010-05-18 | Avaya Inc. | Method and apparatus for characterizing the quality of a network path |
US7487237B2 (en) * | 2000-10-17 | 2009-02-03 | Avaya Technology Corp. | Load optimization |
US6964023B2 (en) * | 2001-02-05 | 2005-11-08 | International Business Machines Corporation | System and method for multi-modal focus detection, referential ambiguity resolution and mood classification using multi-modal input |
US8452714B2 (en) * | 2001-04-26 | 2013-05-28 | Celcorp, Inc. | System and method for the automatic creation of a graphical representation of navigation paths generated by intelligent planner |
US20020169738A1 (en) * | 2001-05-10 | 2002-11-14 | Giel Peter Van | Method and system for auditing an enterprise configuration |
US20020194319A1 (en) * | 2001-06-13 | 2002-12-19 | Ritche Scott D. | Automated operations and service monitoring system for distributed computer networks |
AU2002360844A1 (en) * | 2001-12-31 | 2003-07-24 | Citadel Security Software Inc. | Automated computer vulnerability resolution system |
US7243148B2 (en) * | 2002-01-15 | 2007-07-10 | Mcafee, Inc. | System and method for network vulnerability detection and reporting |
US7543056B2 (en) | 2002-01-15 | 2009-06-02 | Mcafee, Inc. | System and method for network vulnerability detection and reporting |
US7257630B2 (en) * | 2002-01-15 | 2007-08-14 | Mcafee, Inc. | System and method for network vulnerability detection and reporting |
US8086720B2 (en) * | 2002-01-31 | 2011-12-27 | International Business Machines Corporation | Performance reporting in a network environment |
US7412502B2 (en) * | 2002-04-18 | 2008-08-12 | International Business Machines Corporation | Graphics for end to end component mapping and problem-solving in a network environment |
US8527620B2 (en) * | 2003-03-06 | 2013-09-03 | International Business Machines Corporation | E-business competitive measurements |
JP3783644B2 (en) * | 2002-04-03 | 2006-06-07 | ブラザー工業株式会社 | Terminal information notification system, network terminal device, and computer program |
US7197562B2 (en) * | 2002-04-05 | 2007-03-27 | Infocus Corporation | Projector device management system |
AU2003228512A1 (en) * | 2002-04-10 | 2003-10-27 | Instasolv, Inc. | Method and system for managing computer systems |
US20030217129A1 (en) * | 2002-05-15 | 2003-11-20 | Lucent Technologies Inc. | Self-organizing intelligent network architecture and methodology |
US6871163B2 (en) * | 2002-05-31 | 2005-03-22 | Sap Aktiengesellschaft | Behavior-based adaptation of computer systems |
US7359984B1 (en) | 2002-07-15 | 2008-04-15 | Packeteer, Inc. | Management of network quality of service |
FR2843260B1 (en) * | 2002-07-31 | 2005-04-08 | Cit Alcatel | RULES NETWORK MANAGEMENT SYSTEM COMPRISING AN INFERENCE ENGINE |
US7303010B2 (en) * | 2002-10-11 | 2007-12-04 | Intelligent Robotic Corporation | Apparatus and method for an autonomous robotic system for performing activities in a well |
US20040088404A1 (en) * | 2002-11-01 | 2004-05-06 | Vikas Aggarwal | Administering users in a fault and performance monitoring system using distributed data gathering and storage |
US6985944B2 (en) * | 2002-11-01 | 2006-01-10 | Fidelia Technology, Inc. | Distributing queries and combining query responses in a fault and performance monitoring system using distributed data gathering and storage |
US20040143836A1 (en) * | 2003-01-21 | 2004-07-22 | Mccormack Jonathan Ian | System and method for sharing objects among two or more electronic devices |
US20040158545A1 (en) * | 2003-02-12 | 2004-08-12 | Symantec Corporation | System and method for an expert architecture |
US7624422B2 (en) * | 2003-02-14 | 2009-11-24 | Preventsys, Inc. | System and method for security information normalization |
US7627891B2 (en) * | 2003-02-14 | 2009-12-01 | Preventsys, Inc. | Network audit and policy assurance system |
US20050049982A1 (en) * | 2003-02-24 | 2005-03-03 | Gopinath Ganapathy | Systems and methods for managing distributed design chains |
US20040205184A1 (en) * | 2003-03-06 | 2004-10-14 | International Business Machines Corporation | E-business operations measurements reporting |
US7398272B2 (en) * | 2003-03-24 | 2008-07-08 | Bigfix, Inc. | Enterprise console |
US7668953B1 (en) | 2003-11-13 | 2010-02-23 | Cisco Technology, Inc. | Rule-based network management approaches |
DE10356348A1 (en) * | 2003-11-28 | 2005-06-23 | Abb Patent Gmbh | System for automatic generation and installation of functionalities into data files, esp. system components in distributed automation system, has system information for data management stored in planning databank |
US7117113B1 (en) * | 2004-03-01 | 2006-10-03 | Cisco Technology, Inc. | Automated data collection and analysis |
DE102004011201B4 (en) * | 2004-03-04 | 2006-10-12 | Siemens Ag | Method for managing and monitoring the operation of multiple distributed in at least one communication network integrated hardware and / or software systems and system for performing the method |
US7644182B2 (en) * | 2004-03-11 | 2010-01-05 | Hewlett-Packard Development Company, L.P. | Reconfiguring a multicast tree |
US8201257B1 (en) | 2004-03-31 | 2012-06-12 | Mcafee, Inc. | System and method of managing network security risks |
US7519954B1 (en) | 2004-04-08 | 2009-04-14 | Mcafee, Inc. | System and method of operating system identification |
US20060031469A1 (en) * | 2004-06-29 | 2006-02-09 | International Business Machines Corporation | Measurement, reporting, and management of quality of service for a real-time communication application in a network environment |
US7908040B2 (en) * | 2004-07-15 | 2011-03-15 | Raytheon Company | System and method for automated search by distributed elements |
US8880664B1 (en) | 2004-07-26 | 2014-11-04 | Cisco Technology, Inc. | Method and apparatus for generating a network profile and device profile |
US7788352B2 (en) * | 2005-07-14 | 2010-08-31 | Yahoo! Inc. | System and method for servicing a user device |
US20070016636A1 (en) * | 2005-07-14 | 2007-01-18 | Yahoo! Inc. | Methods and systems for data transfer and notification mechanisms |
US20070016632A1 (en) * | 2005-07-14 | 2007-01-18 | Yahoo! Inc. | System and method for synchronizing between a user device and a server in a communication network |
US8112549B2 (en) | 2005-07-14 | 2012-02-07 | Yahoo! Inc. | Alert mechanism for notifying multiple user devices sharing a connected-data-set |
US7631045B2 (en) | 2005-07-14 | 2009-12-08 | Yahoo! Inc. | Content router asynchronous exchange |
US7623515B2 (en) | 2005-07-14 | 2009-11-24 | Yahoo! Inc. | Content router notification |
US7849199B2 (en) | 2005-07-14 | 2010-12-07 | Yahoo ! Inc. | Content router |
US8417782B2 (en) | 2005-07-14 | 2013-04-09 | Yahoo! Inc. | Universal calendar event handling |
US20070014277A1 (en) * | 2005-07-14 | 2007-01-18 | Yahoo! Inc. | Content router repository |
US20070038633A1 (en) * | 2005-08-10 | 2007-02-15 | International Business Machines Corporation | Method and system for executing procedures in mixed-initiative mode |
US20070100856A1 (en) * | 2005-10-21 | 2007-05-03 | Yahoo! Inc. | Account consolidation |
US7873696B2 (en) | 2005-10-28 | 2011-01-18 | Yahoo! Inc. | Scalable software blade architecture |
US7779157B2 (en) | 2005-10-28 | 2010-08-17 | Yahoo! Inc. | Recovering a blade in scalable software blade architecture |
US7870288B2 (en) * | 2005-10-28 | 2011-01-11 | Yahoo! Inc. | Sharing data in scalable software blade architecture |
US8024290B2 (en) * | 2005-11-14 | 2011-09-20 | Yahoo! Inc. | Data synchronization and device handling |
US8065680B2 (en) | 2005-11-15 | 2011-11-22 | Yahoo! Inc. | Data gateway for jobs management based on a persistent job table and a server table |
US20070112609A1 (en) * | 2005-11-16 | 2007-05-17 | Howard Michael D | Methods and apparatus to incorporate user feedback during planning |
US7533073B2 (en) | 2005-12-05 | 2009-05-12 | Raytheon Company | Methods and apparatus for heuristic search to optimize metrics in generating a plan having a series of actions |
WO2007080584A2 (en) * | 2006-01-11 | 2007-07-19 | Carmel-Haifa University Economic Corp. Ltd. | Uav decision and control system |
US7640460B2 (en) * | 2007-02-28 | 2009-12-29 | Microsoft Corporation | Detect user-perceived faults using packet traces in enterprise networks |
US8443074B2 (en) * | 2007-03-06 | 2013-05-14 | Microsoft Corporation | Constructing an inference graph for a network |
US8015139B2 (en) * | 2007-03-06 | 2011-09-06 | Microsoft Corporation | Inferring candidates that are potentially responsible for user-perceptible network problems |
US8161149B2 (en) | 2007-03-07 | 2012-04-17 | International Business Machines Corporation | Pseudo-agent |
US8495157B2 (en) * | 2007-03-07 | 2013-07-23 | International Business Machines Corporation | Method and apparatus for distributed policy-based management and computed relevance messaging with remote attributes |
US20080250264A1 (en) * | 2007-04-03 | 2008-10-09 | Hourselt Andrew G | System for Adaptive Action Plan Compilation Based on Error Reporting |
US20090240510A1 (en) * | 2008-03-18 | 2009-09-24 | Hopkins Lloyd B | Balanced Scorecard Method for Determining an Impact on a Business Service Caused by Degraded Operation of an IT System Component |
US8966110B2 (en) * | 2009-09-14 | 2015-02-24 | International Business Machines Corporation | Dynamic bandwidth throttling |
US20120306895A1 (en) * | 2010-10-22 | 2012-12-06 | Tollgrade Communications, Inc. | Home wiring test systems and method |
WO2012054921A2 (en) | 2010-10-22 | 2012-04-26 | Tollgrade Communications, Inc. | Integrated ethernet over coaxial cable, stb, and physical layer test and monitoring |
US8726103B2 (en) | 2010-12-07 | 2014-05-13 | At & T Intellectual Property I, Lp | Visual outage management tool |
JP5602247B2 (en) * | 2010-12-13 | 2014-10-08 | 株式会社日立製作所 | Design support system |
CN105071951B (en) * | 2015-07-09 | 2019-01-29 | 邹静 | A kind of transmission channel resources Dispatching Decision-making System |
US10977446B1 (en) * | 2018-02-23 | 2021-04-13 | Lang Artificial Intelligence Inc. | Unsupervised language agnostic intent induction and related systems and methods |
CN112822699B (en) * | 2019-11-15 | 2022-09-02 | 华为技术有限公司 | Method and device for executing intention |
Citations (46)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4881230A (en) * | 1987-10-05 | 1989-11-14 | Ibm Corporation | Expert system for processing errors in a multiplex communications system |
US5167010A (en) * | 1989-08-03 | 1992-11-24 | Westinghouse Electric Corp. | Expert advice display processing system |
US5299287A (en) * | 1988-07-01 | 1994-03-29 | Hitachi, Ltd. | Information processing system |
US5359649A (en) * | 1991-10-02 | 1994-10-25 | Telefonaktiebolaget L M Ericsson | Congestion tuning of telecommunications networks |
US5406477A (en) * | 1991-08-30 | 1995-04-11 | Digital Equipment Corporation | Multiple reasoning and result reconciliation for enterprise analysis |
US5428619A (en) * | 1990-02-15 | 1995-06-27 | Digital Equipment Corporation | Model based reasoning system for network fault diagnosis |
US5434952A (en) * | 1992-06-26 | 1995-07-18 | The Texas A&M Univesity System | System and method for specifying an expert system |
US5442731A (en) * | 1988-05-25 | 1995-08-15 | Matsushita Electric Industrial Co., Ltd. | Inference planning system |
US5504837A (en) * | 1993-05-10 | 1996-04-02 | Bell Communications Research, Inc. | Method for resolving conflicts among distributed entities through the generation of counter proposals by transversing a goal hierarchy with acceptable, unacceptable, and indeterminate nodes |
US5550746A (en) * | 1994-12-05 | 1996-08-27 | American Greetings Corporation | Method and apparatus for storing and selectively retrieving product data by correlating customer selection criteria with optimum product designs based on embedded expert judgments |
US5583763A (en) * | 1993-09-09 | 1996-12-10 | Mni Interactive | Method and apparatus for recommending selections based on preferences in a multi-user system |
US5586254A (en) * | 1992-02-13 | 1996-12-17 | Hitachi Software Engineering Co., Ltd. | System for managing and operating a network by physically imaging the network |
US5644727A (en) * | 1987-04-15 | 1997-07-01 | Proprietary Financial Products, Inc. | System for the operation and management of one or more financial accounts through the use of a digital communication and computation system for exchange, investment and borrowing |
US5655081A (en) * | 1995-03-08 | 1997-08-05 | Bmc Software, Inc. | System for monitoring and managing computer resources and applications across a distributed computing environment using an intelligent autonomous agent architecture |
US5701400A (en) * | 1995-03-08 | 1997-12-23 | Amado; Carlos Armando | Method and apparatus for applying if-then-else rules to data sets in a relational data base and generating from the results of application of said rules a database of diagnostics linked to said data sets to aid executive analysis of financial data |
US5706406A (en) * | 1995-05-22 | 1998-01-06 | Pollock; John L. | Architecture for an artificial agent that reasons defeasibly |
US5712960A (en) * | 1993-07-02 | 1998-01-27 | Cv Soft, S.R.L. | System and methods for intelligent database management using abductive reasoning |
US5724263A (en) * | 1993-10-21 | 1998-03-03 | At&T Corp | Automatic temporospatial pattern analysis and prediction in a telecommunications network using rule induction |
US5732398A (en) * | 1995-11-09 | 1998-03-24 | Keyosk Corp. | Self-service system for selling travel-related services or products |
US5745895A (en) * | 1994-06-21 | 1998-04-28 | International Business Machines Corporation | Method for association of heterogeneous information |
US5754850A (en) * | 1994-05-11 | 1998-05-19 | Realselect, Inc. | Real-estate method and apparatus for searching for homes in a search pool for exact and close matches according to primary and non-primary selection criteria |
US5768578A (en) * | 1994-02-28 | 1998-06-16 | Lucent Technologies Inc. | User interface for information retrieval system |
US5809212A (en) * | 1993-07-12 | 1998-09-15 | New York University | Conditional transition networks and computational processes for use interactive computer-based systems |
US5835922A (en) * | 1992-09-30 | 1998-11-10 | Hitachi, Ltd. | Document processing apparatus and method for inputting the requirements of a reader or writer and for processing documents according to the requirements |
US5845258A (en) * | 1995-06-16 | 1998-12-01 | I2 Technologies, Inc. | Strategy driven planning system and method of operation |
US5893083A (en) * | 1995-03-24 | 1999-04-06 | Hewlett-Packard Company | Methods and apparatus for monitoring events and implementing corrective action in a computer system |
US5905715A (en) * | 1994-09-01 | 1999-05-18 | British Telecommunications Public Limited Company | Network management system for communications networks |
US5918207A (en) * | 1996-05-01 | 1999-06-29 | Electronic Data Systems Corporation | Process and system for predictive resource planning |
US5953707A (en) * | 1995-10-26 | 1999-09-14 | Philips Electronics North America Corporation | Decision support system for the management of an agile supply chain |
US5963447A (en) * | 1997-08-22 | 1999-10-05 | Hynomics Corporation | Multiple-agent hybrid control architecture for intelligent real-time control of distributed nonlinear processes |
US5974395A (en) * | 1996-08-21 | 1999-10-26 | I2 Technologies, Inc. | System and method for extended enterprise planning across a supply chain |
US5983200A (en) * | 1996-10-09 | 1999-11-09 | Slotznick; Benjamin | Intelligent agent for executing delegated tasks |
US5995959A (en) * | 1997-01-24 | 1999-11-30 | The Board Of Regents Of The University Of Washington | Method and system for network information access |
US6006192A (en) * | 1997-03-12 | 1999-12-21 | International Business Machines Corporation | Method for production planning in an uncertain demand environment |
US6012044A (en) * | 1997-12-10 | 2000-01-04 | Financial Engines, Inc. | User interface for a financial advisory system |
US6012051A (en) * | 1997-02-06 | 2000-01-04 | America Online, Inc. | Consumer profiling system with analytic decision processor |
US6012152A (en) * | 1996-11-27 | 2000-01-04 | Telefonaktiebolaget Lm Ericsson (Publ) | Software fault management system |
US6026375A (en) * | 1997-12-05 | 2000-02-15 | Nortel Networks Corporation | Method and apparatus for processing orders from customers in a mobile environment |
US6049742A (en) * | 1997-09-26 | 2000-04-11 | International Business Machines Corporation | Projected supply planning matching assets with demand in microelectronics manufacturing |
US6134580A (en) * | 1996-09-17 | 2000-10-17 | Kabushiki Kaisha Toshiba | Data-processing apparatus, data-processing method, and storage medium onto which is stored a data-processing program |
US6151601A (en) * | 1997-11-12 | 2000-11-21 | Ncr Corporation | Computer architecture and method for collecting, analyzing and/or transforming internet and/or electronic commerce data for storage into a data storage area |
US6247012B1 (en) * | 1996-10-28 | 2001-06-12 | Pfu Limited | Information reception and delivery system using global and local directory tables in an intranet |
US6272482B1 (en) * | 1998-08-14 | 2001-08-07 | International Business Machines Corporation | Managing business rules using jurisdictions |
US20010021917A1 (en) * | 2000-03-08 | 2001-09-13 | Dgc Institute Co., Ltd | Electronic commerce system for updating information |
US20020087496A1 (en) * | 2000-04-05 | 2002-07-04 | Stirpe Paul A. | System, method and applications for knowledge commerce |
US20020095605A1 (en) * | 2001-01-12 | 2002-07-18 | Royer Barry Lynn | System and user interface for managing user access to network compatible applications |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5799317A (en) * | 1995-11-08 | 1998-08-25 | Mci Communications Corporation | Data management system for a telecommunications signaling system 7(SS#7) |
US5958012A (en) * | 1996-07-18 | 1999-09-28 | Computer Associates International, Inc. | Network management system using virtual reality techniques to display and simulate navigation to network components |
US6360193B1 (en) * | 1998-09-17 | 2002-03-19 | 21St Century Systems, Inc. | Method and system for intelligent agent decision making for tactical aerial warfare |
-
2000
- 2000-06-22 US US09/598,971 patent/US6751661B1/en not_active Expired - Lifetime
-
2001
- 2001-06-21 CA CA2413873A patent/CA2413873C/en not_active Expired - Fee Related
- 2001-06-21 AU AU2001271350A patent/AU2001271350A1/en not_active Abandoned
- 2001-06-21 EP EP01950351A patent/EP1305862A4/en not_active Withdrawn
- 2001-06-21 WO PCT/US2001/019713 patent/WO2001099251A1/en active Application Filing
-
2004
- 2004-05-03 US US10/836,242 patent/US20040205182A1/en not_active Abandoned
Patent Citations (46)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5644727A (en) * | 1987-04-15 | 1997-07-01 | Proprietary Financial Products, Inc. | System for the operation and management of one or more financial accounts through the use of a digital communication and computation system for exchange, investment and borrowing |
US4881230A (en) * | 1987-10-05 | 1989-11-14 | Ibm Corporation | Expert system for processing errors in a multiplex communications system |
US5442731A (en) * | 1988-05-25 | 1995-08-15 | Matsushita Electric Industrial Co., Ltd. | Inference planning system |
US5299287A (en) * | 1988-07-01 | 1994-03-29 | Hitachi, Ltd. | Information processing system |
US5167010A (en) * | 1989-08-03 | 1992-11-24 | Westinghouse Electric Corp. | Expert advice display processing system |
US5428619A (en) * | 1990-02-15 | 1995-06-27 | Digital Equipment Corporation | Model based reasoning system for network fault diagnosis |
US5406477A (en) * | 1991-08-30 | 1995-04-11 | Digital Equipment Corporation | Multiple reasoning and result reconciliation for enterprise analysis |
US5359649A (en) * | 1991-10-02 | 1994-10-25 | Telefonaktiebolaget L M Ericsson | Congestion tuning of telecommunications networks |
US5586254A (en) * | 1992-02-13 | 1996-12-17 | Hitachi Software Engineering Co., Ltd. | System for managing and operating a network by physically imaging the network |
US5434952A (en) * | 1992-06-26 | 1995-07-18 | The Texas A&M Univesity System | System and method for specifying an expert system |
US5835922A (en) * | 1992-09-30 | 1998-11-10 | Hitachi, Ltd. | Document processing apparatus and method for inputting the requirements of a reader or writer and for processing documents according to the requirements |
US5504837A (en) * | 1993-05-10 | 1996-04-02 | Bell Communications Research, Inc. | Method for resolving conflicts among distributed entities through the generation of counter proposals by transversing a goal hierarchy with acceptable, unacceptable, and indeterminate nodes |
US5712960A (en) * | 1993-07-02 | 1998-01-27 | Cv Soft, S.R.L. | System and methods for intelligent database management using abductive reasoning |
US5809212A (en) * | 1993-07-12 | 1998-09-15 | New York University | Conditional transition networks and computational processes for use interactive computer-based systems |
US5583763A (en) * | 1993-09-09 | 1996-12-10 | Mni Interactive | Method and apparatus for recommending selections based on preferences in a multi-user system |
US5724263A (en) * | 1993-10-21 | 1998-03-03 | At&T Corp | Automatic temporospatial pattern analysis and prediction in a telecommunications network using rule induction |
US5768578A (en) * | 1994-02-28 | 1998-06-16 | Lucent Technologies Inc. | User interface for information retrieval system |
US5754850A (en) * | 1994-05-11 | 1998-05-19 | Realselect, Inc. | Real-estate method and apparatus for searching for homes in a search pool for exact and close matches according to primary and non-primary selection criteria |
US5745895A (en) * | 1994-06-21 | 1998-04-28 | International Business Machines Corporation | Method for association of heterogeneous information |
US5905715A (en) * | 1994-09-01 | 1999-05-18 | British Telecommunications Public Limited Company | Network management system for communications networks |
US5550746A (en) * | 1994-12-05 | 1996-08-27 | American Greetings Corporation | Method and apparatus for storing and selectively retrieving product data by correlating customer selection criteria with optimum product designs based on embedded expert judgments |
US5701400A (en) * | 1995-03-08 | 1997-12-23 | Amado; Carlos Armando | Method and apparatus for applying if-then-else rules to data sets in a relational data base and generating from the results of application of said rules a database of diagnostics linked to said data sets to aid executive analysis of financial data |
US5655081A (en) * | 1995-03-08 | 1997-08-05 | Bmc Software, Inc. | System for monitoring and managing computer resources and applications across a distributed computing environment using an intelligent autonomous agent architecture |
US5893083A (en) * | 1995-03-24 | 1999-04-06 | Hewlett-Packard Company | Methods and apparatus for monitoring events and implementing corrective action in a computer system |
US5706406A (en) * | 1995-05-22 | 1998-01-06 | Pollock; John L. | Architecture for an artificial agent that reasons defeasibly |
US5845258A (en) * | 1995-06-16 | 1998-12-01 | I2 Technologies, Inc. | Strategy driven planning system and method of operation |
US5953707A (en) * | 1995-10-26 | 1999-09-14 | Philips Electronics North America Corporation | Decision support system for the management of an agile supply chain |
US5732398A (en) * | 1995-11-09 | 1998-03-24 | Keyosk Corp. | Self-service system for selling travel-related services or products |
US5918207A (en) * | 1996-05-01 | 1999-06-29 | Electronic Data Systems Corporation | Process and system for predictive resource planning |
US5974395A (en) * | 1996-08-21 | 1999-10-26 | I2 Technologies, Inc. | System and method for extended enterprise planning across a supply chain |
US6134580A (en) * | 1996-09-17 | 2000-10-17 | Kabushiki Kaisha Toshiba | Data-processing apparatus, data-processing method, and storage medium onto which is stored a data-processing program |
US5983200A (en) * | 1996-10-09 | 1999-11-09 | Slotznick; Benjamin | Intelligent agent for executing delegated tasks |
US6247012B1 (en) * | 1996-10-28 | 2001-06-12 | Pfu Limited | Information reception and delivery system using global and local directory tables in an intranet |
US6012152A (en) * | 1996-11-27 | 2000-01-04 | Telefonaktiebolaget Lm Ericsson (Publ) | Software fault management system |
US5995959A (en) * | 1997-01-24 | 1999-11-30 | The Board Of Regents Of The University Of Washington | Method and system for network information access |
US6012051A (en) * | 1997-02-06 | 2000-01-04 | America Online, Inc. | Consumer profiling system with analytic decision processor |
US6006192A (en) * | 1997-03-12 | 1999-12-21 | International Business Machines Corporation | Method for production planning in an uncertain demand environment |
US5963447A (en) * | 1997-08-22 | 1999-10-05 | Hynomics Corporation | Multiple-agent hybrid control architecture for intelligent real-time control of distributed nonlinear processes |
US6049742A (en) * | 1997-09-26 | 2000-04-11 | International Business Machines Corporation | Projected supply planning matching assets with demand in microelectronics manufacturing |
US6151601A (en) * | 1997-11-12 | 2000-11-21 | Ncr Corporation | Computer architecture and method for collecting, analyzing and/or transforming internet and/or electronic commerce data for storage into a data storage area |
US6026375A (en) * | 1997-12-05 | 2000-02-15 | Nortel Networks Corporation | Method and apparatus for processing orders from customers in a mobile environment |
US6012044A (en) * | 1997-12-10 | 2000-01-04 | Financial Engines, Inc. | User interface for a financial advisory system |
US6272482B1 (en) * | 1998-08-14 | 2001-08-07 | International Business Machines Corporation | Managing business rules using jurisdictions |
US20010021917A1 (en) * | 2000-03-08 | 2001-09-13 | Dgc Institute Co., Ltd | Electronic commerce system for updating information |
US20020087496A1 (en) * | 2000-04-05 | 2002-07-04 | Stirpe Paul A. | System, method and applications for knowledge commerce |
US20020095605A1 (en) * | 2001-01-12 | 2002-07-18 | Royer Barry Lynn | System and user interface for managing user access to network compatible applications |
Cited By (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8868715B2 (en) | 2001-10-15 | 2014-10-21 | Volli Polymer Gmbh Llc | Report generation and visualization systems and methods and their use in testing frameworks for determining suitability of a network for target applications |
US8543681B2 (en) * | 2001-10-15 | 2013-09-24 | Volli Polymer Gmbh Llc | Network topology discovery systems and methods |
US20040006614A1 (en) * | 2002-07-03 | 2004-01-08 | Difalco Robert A. | Homogeneous monitoring of heterogeneous nodes |
US7316016B2 (en) * | 2002-07-03 | 2008-01-01 | Tripwire, Inc. | Homogeneous monitoring of heterogeneous nodes |
US7921152B2 (en) * | 2003-07-17 | 2011-04-05 | International Business Machines Corporation | Method and system for providing user control over receipt of cookies from e-commerce applications |
US20050015429A1 (en) * | 2003-07-17 | 2005-01-20 | International Business Machines Corporation | Method and system for providing user control over receipt of cookies from e-commerce applications |
US9209996B2 (en) | 2005-03-31 | 2015-12-08 | Tripwire, Inc. | Data processing environment change management methods and apparatuses |
US8140635B2 (en) | 2005-03-31 | 2012-03-20 | Tripwire, Inc. | Data processing environment change management methods and apparatuses |
US9256841B2 (en) | 2005-08-09 | 2016-02-09 | Tripwire, Inc. | Information technology governance and controls methods and apparatuses |
US10264022B2 (en) | 2005-08-09 | 2019-04-16 | Tripwire, Inc. | Information technology governance and controls methods and apparatuses |
US10318894B2 (en) | 2005-08-16 | 2019-06-11 | Tripwire, Inc. | Conformance authority reconciliation |
US20070043786A1 (en) * | 2005-08-16 | 2007-02-22 | Tripwire, Inc. | Conformance authority reconciliation |
US7536595B1 (en) | 2005-10-19 | 2009-05-19 | At&T Intellectual Property, Ii, L.P. | Systems, devices, and methods for initiating recovery |
US20070283329A1 (en) * | 2006-01-09 | 2007-12-06 | Infosys Technologies, Ltd. | System and method for performance monitoring and diagnosis of information technology system |
US20070250365A1 (en) * | 2006-04-21 | 2007-10-25 | Infosys Technologies Ltd. | Grid computing systems and methods thereof |
US8032234B2 (en) * | 2006-05-16 | 2011-10-04 | Rosemount Inc. | Diagnostics in process control and monitoring systems |
US20070270982A1 (en) * | 2006-05-16 | 2007-11-22 | Foss Scot R | Diagnostics in process control and monitoring systems |
US7548895B2 (en) * | 2006-06-30 | 2009-06-16 | Microsoft Corporation | Communication-prompted user assistance |
US20080005053A1 (en) * | 2006-06-30 | 2008-01-03 | Microsoft Corporation | Communication-prompted user assistance |
US20080040145A1 (en) * | 2006-08-09 | 2008-02-14 | Infosys Technologies, Ltd. | Business case evaluation system and methods thereof |
US8412561B2 (en) | 2006-08-09 | 2013-04-02 | Infosys Technologies, Ltd. | Business case evaluation system and methods thereof |
US20090063373A1 (en) * | 2007-08-30 | 2009-03-05 | Howard Michael D | Methods and apparatus for adversarial reasoning |
US20100318653A1 (en) * | 2008-03-17 | 2010-12-16 | Fujitsu Limited | Information obtaining assistance apparatus and method |
US20110035202A1 (en) * | 2008-04-03 | 2011-02-10 | Karl Quinn | Behaviour model for a communication network |
US8914341B2 (en) | 2008-07-03 | 2014-12-16 | Tripwire, Inc. | Method and apparatus for continuous compliance assessment |
US10013420B1 (en) | 2008-07-03 | 2018-07-03 | Tripwire, Inc. | Method and apparatus for continuous compliance assessment |
US10795855B1 (en) | 2008-07-03 | 2020-10-06 | Tripwire, Inc. | Method and apparatus for continuous compliance assessment |
US11487705B1 (en) | 2008-07-03 | 2022-11-01 | Tripwire, Inc. | Method and apparatus for continuous compliance assessment |
US8606725B1 (en) * | 2008-10-29 | 2013-12-10 | Emory University | Automatic client-side user-behavior analysis for inferring user intent |
US10209967B2 (en) | 2010-10-18 | 2019-02-19 | Infosys Technologies Ltd. | System and method for detecting preventative maintenance operations in computer source code |
US8649995B2 (en) | 2011-04-07 | 2014-02-11 | Infosys Technologies, Ltd. | System and method for efficient test case generation using input dependency information |
US20200162344A1 (en) * | 2018-11-20 | 2020-05-21 | Cisco Technology, Inc. | Interactive interface for network exploration with relationship mapping |
US10904104B2 (en) * | 2018-11-20 | 2021-01-26 | Cisco Technology, Inc. | Interactive interface for network exploration with relationship mapping |
Also Published As
Publication number | Publication date |
---|---|
WO2001099251A1 (en) | 2001-12-27 |
US6751661B1 (en) | 2004-06-15 |
CA2413873A1 (en) | 2001-12-27 |
AU2001271350A1 (en) | 2002-01-02 |
CA2413873C (en) | 2011-12-06 |
EP1305862A4 (en) | 2007-11-21 |
EP1305862A1 (en) | 2003-05-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6751661B1 (en) | Method and system for providing intelligent network management | |
US6255943B1 (en) | Method and apparatus for distributed object filtering | |
US6430712B2 (en) | Method and apparatus for inter-domain alarm correlation | |
EP1460801B1 (en) | System and method for fault diagnosis using distributed alarm correlation | |
US7509540B1 (en) | Method and apparatus for maintaining the status of objects in computer networks using virtual state machines | |
US9509524B2 (en) | System and method for service level management | |
US7028228B1 (en) | Method and apparatus for identifying problems in computer networks | |
US6225999B1 (en) | Customizable user interface for network navigation and management | |
US7296194B1 (en) | Method and apparatus for maintaining the status of objects in computer networks using virtual state machines | |
Cheikhrouhou et al. | Intelligent agents in network management, a state-of-the-art | |
CA2272771A1 (en) | Node and link representation of network services | |
Schwartz et al. | Value-oriented network management | |
Kar et al. | An architecture for managing application services over global networks | |
Boutaba et al. | Towards Integrated Network Management: A Domain/policy Approach And Its Application To A High Speed Multi-network. | |
Silva et al. | Proactive network management based mobile agent and fuzzy logic | |
Ekaette et al. | A framework for network fault management using software agents | |
Katker et al. | FAULT MANAGEMENT IN QOS-ENABLED DISTRIBUTED SYSTEMS | |
Kerschberg et al. | Intelligent network management: a heterogeneous knowledge source approach | |
Mazda | Network management |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: APPLIED SYSTEMS INTELLIGENCE, INC., GEORGIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GEDDES, NORMAN D.;REEL/FRAME:015290/0692 Effective date: 20001018 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |