WO2002042923A1 - Systeme de suivi de services - Google Patents
Systeme de suivi de services Download PDFInfo
- Publication number
- WO2002042923A1 WO2002042923A1 PCT/US2001/043130 US0143130W WO0242923A1 WO 2002042923 A1 WO2002042923 A1 WO 2002042923A1 US 0143130 W US0143130 W US 0143130W WO 0242923 A1 WO0242923 A1 WO 0242923A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- service
- monitored
- services
- computer program
- communications link
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5003—Managing SLA; Interaction between SLA and QoS
- H04L41/5009—Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5061—Network service management, e.g. ensuring proper service fulfilment according to agreements characterised by the interaction between service providers and their network customers, e.g. customer relationship management
- H04L41/5067—Customer-centric QoS measurements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0823—Errors, e.g. transmission errors
- H04L43/0829—Packet loss
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
- H04L43/55—Testing of service level quality, e.g. simulating service usage
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5003—Managing SLA; Interaction between SLA and QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5029—Service quality level-based billing, e.g. dependent on measured service level customer is charged more or less
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0852—Delays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/16—Threshold monitoring
Definitions
- the present invention relates generally to methods and systems and for monitoring a service (e.g., a network, communications, or information service) for compliance with specified objectives related, for example, to the performance and reliability of the service.
- a service e.g., a network, communications, or information service
- WAN wide-area networks
- information servers e.g., Web servers
- server and communication outsourcing services that not only provide services, but also guarantee certain characteristics of those services, e.g., performance, reliability, and up-time.
- a service e.g., a network or information service
- Figure 1 is a schematic illustration of a computer for providing monitoring and analysis services according to the present invention
- FIG. 2 is a block diagram of a monitoring system for monitoring at least one of a monitored communications link and a monitored server;
- Figure 3 is an exemplary chart showing compliance with a longest allowable link downtime
- Figure 4 is an exemplary selection of database records corresponding to the longest allowable link downtime of Figure 3.
- FIG. 1 is a schematic illustration of a computer system for providing service (e.g., network and information service) monitoring.
- a monitoring computer system 100 implements the method of the present invention, wherein the computer housing 102 houses a motherboard 104 which contains a CPU 106, memory 108 (e.g., DRAM, ROM, EPROM, EEPROM, SRAM, SDRAM, and Flash RAM), and other optional special purpose logic devices (e.g., ASICs) or configurable logic devices (e.g., GAL and reprogrammable FPGA).
- a CPU 106 e.g., DRAM, ROM, EPROM, EEPROM, SRAM, SDRAM, and Flash RAM
- other optional special purpose logic devices e.g., ASICs
- configurable logic devices e.g., GAL and reprogrammable FPGA
- the computer 100 also includes a plurality of input devices, (e.g., a keyboard 122 and mouse 124), and a display card 110 for controlling monitor 120.
- the computer system 100 further includes a floppy disk drive 114; other removable media devices (e.g., compact disc 119, tape, and removable magneto-optical media, not shown); and a hard disk 112, or other fixed, high-density media drives, connected using an appropriate device bus (e.g., a SCSI bus, an Enhanced IDE bus, or a Ultra DMA bus).
- the computer 100 may additionally include a compact disc reader 118, a compact disc reader/writer unit (not shown) or a compact disc jukebox (not shown).
- compact disc 119 is shown in a CD caddy, the compact disc 119 can be inserted directly into a CD-ROM drive that does not require a caddy.
- a printer (not shown) also provides printed listings of how closely the service guarantees were met.
- the computer system includes at least one computer readable medium.
- Examples of computer readable media are compact discs 119, hard disks 112, floppy disks, tape, magneto-optical disks, PROMs (EPROM, EEPROM, Flash EPROM), DRAM, SRAM, SDRAM, etc.
- the present invention includes software for controlling the hardware of the monitoring computer system 100 and for enabling the monitoring computer system 100 to interact with a human user.
- Such software may include, but is not limited to, device drivers, operating systems and user applications, such as development tools.
- Such computer readable media further include the computer program product of the present invention for monitoring services for compliance with guarantees.
- the computer code devices of the present invention can be any interpreted or executable code mechanism, including, but not limited to, scripts, interpreters, dynamic link libraries, Java classes, and complete executable programs.
- Computer code devices may also be downloaded across a network using a network adapter (e.g., token ring or Ethernet) as an equivalent to embedding the computer code device within a computer readable medium.
- a network adapter e.g., token ring or Ethernet
- the monitoring computer system 100 of Figure 1 is used to monitor at least one of (1) a monitored link 210 (or monitored links 210') and (2) a monitored server 200.
- links 210 and 210' may be either wired (electrical or optical) or wireless and carry traffic of any protocol, e.g., Voice over IP, without departing from the teachings of the present invention.
- the monitoring computer system 100 which can be considered a back- end computer, generally simulates requests of various formats, types, and natures to different services and then records and monitors the information that is returned.
- requests are transmitted (e.g, using HTTP, ICMP, FTP, HTTPS, TELNET, SSH, WAP, and other protocols) on a per-service basis to the monitored server 200, and the details of the request made to the system (e.g., request type, exact time and date, service identification) are recorded.
- the requests are formatted similar to the format expected by the server. For example, to test the up-time of a link carrying IP traffic, the request must be IP- compatible so that it is forwarded by routers as appropriate.
- the response (e.g., from the corresponding server) is recorded and associated with the request that was made, along with the response time, any returned messages (e.g., indicating error or success), as well as protocol-specific response data (e.g., packet loss, latency, file size, file data).
- protocol-specific response data e.g., packet loss, latency, file size, file data
- Exemplary services include, but are not limited to, web, database, and application server services, firewall services, co-location services, routing and networking services (switches, routers, etc.), telecommunications connectivity services (e.g., Tl, T3, OC3, OC48, ISDN, DSL, Frame Relay, ATM, cable), application service provider services (e.g., caching services, free email, online CRM, chat, customer support tools, streaming media services, file sharing services, productivity services, storage services, back-up services), content services (news feeds, stock feeds, information feeds, account aggregation, etc.), proprietary services (e.g., Lexis-Nexis, Bloomberg, bill payment, ATM networks), training services, conferencing services, and productivity services. Moreover, performance measurement of any TCP- or UDP -based applications, services, or providers over IP is possible.
- Tl Transmission Control Protocol
- T3, OC3, OC48 ISDN
- DSL Frame Relay
- ATM Frame Relay
- application service provider services e.g.
- the monitoring computer system 100 may further include one or more measurement agents that request and receive performance data from the monitored server 200.
- the collected performance data is subsequently stored in the performance database 220.
- a database measurement agent is capable of remotely and non- intrusively connecting to a database server and gathering extensive details regarding availability, response time, disk utilization, CPU utilization, back-up performance, job performance, and other system-level information.
- the database measurement agent is capable of gathering detailed information, on both the application and the system level.
- the database measurement agent is designed as a rule-based system provided with the information necessary to connect, authenticate, and perform transactions on the database server. Once connected and authenticated, the database measurement agent can perform standard SQL-based transactions against any portion of the database(s) and tables.
- the agent is capable of gathering performance information regarding the underlying system, including disk space utilization, CPU utilization, memory utilization, and other system level-information.
- a storage area networks (SAN) measurement agent is capable of remotely and non-intrusively connecting to a SAN to determine if the SAN is available, responding appropriately, has capacity, etc.
- the SAN measurement agent first connects to the SAN, e.g., via a TCP/IP connection, or possibly over a proprietary IP address class and subnet.
- the agent sends requests to the SAN to determine the response of the SAN to the requests.
- the SAN measurement agent queries the SAN to determine the state of transactions on the system and logs the performance as well as the transaction problems that have occurred or are occurring.
- the SAN measurement agent is also capable of querying the SAN to determine the utilization of the SAN-thereby providing insight into capacity utilization and the need to upgrade or expand capacity.
- VoIP Voice-over-IP
- Performance of VoIP systems can be measured in terms of response time, availability, quality, and data integrity.
- the monitoring computer system 100 can also download relevant performance information from external data sources (programs, systems, or databases). Examples of such sources include HP Overview, Microsoft, Citrix Systems, Tivoli Systems, Network Associates, NetScout Systems, BMC, Info Vista, Micromuse, Computer Associates, and Compuware Corporation.
- the monitoring computer system 100 transmits at least one message on that link 210 to determine if the link 210 is in the intended state (e.g., up or down).
- the monitoring computer system 100 need not be directly connected to the link 210' to be monitored.
- the monitoring computer system 100 may send messages (e.g., via gateways, routers, or bridges) to other links 210' that are not directly connected to the monitoring computer system 100.
- the monitoring computer system 100 is connected (either directly or via a network, such as a WAN) to a database 220.
- a network such as a WAN
- the monitoring computer system 100 By knowing the rules for making the request (request type, server identification (e.g., URL, IP Address, port number), and other request parameters (e.g., file path, packet size)), the monitoring computer system 100, or a sub-portion thereof including a monitoring application, is able to make the appropriate request, record the results (page data, file size returned, response time, packet loss, latency, etc.), and appropriately associate them with the request information stored in the database 220.
- the monitoring computer system 100 tracks all of the individual components of the request as applied to the monitored server or service.
- the monitoring computer system 100 records the status of each stage of the transaction, the description/messages returned, as well as the total time to perform each step in the transaction including, but not limited to, DNS look-ups, making the request, initial responses from the servers/service, initial data transmission, and data transmission completion.
- the monitoring computer system 100 preferably also performs monitoring based upon set limits and definitions of the type of monitoring that is required. This is especially useful in a monitoring service that simulates different bandwidth speeds (14.4K modem, 28.8K modem, 33.6K modem, 56K modem, 128K ISDN, 256 Fractional Tl/DSL, as well as all different bandwidth dedicated connections).
- the monitoring computer system 100 further includes a compliance application that analyzes the performance data received by the monitoring computer system 100. Such an analysis can be performed in real-time (e.g., looking for links 210 that are down) or off-line using collected real-time information from the database 220.
- a compliance application that analyzes the performance data received by the monitoring computer system 100. Such an analysis can be performed in real-time (e.g., looking for links 210 that are down) or off-line using collected real-time information from the database 220.
- the present invention preferably receives information through a web-based, front-end application or interface (described below).
- Such characteristics can represent the contractual obligations of the service provider (e.g., a service level agreement (SLA)) that are to be monitored by the compliance application or comprise a company's internal quality requirements (e.g., for ISO 9000 compliance).
- SLA service level agreement
- the compliance application compares the performance data to the performance characteristics that are specified (or guaranteed for a service provider) and compiles the information
- the compliance application further provides information display capabilities (e.g., timeline-based error charts) portraying the compliance with specified performance characteristics, as shown in the exemplary bar chart of Figure 3. Such a display may be updated either in real-time or periodically and is preferably based upon a variety of factors.
- the compliance application customizes the compliance analysis based upon the specifications that are entered into the system and is able to determine non-compliance based upon single, multiple, or cumulative failures. For example, if a provider guarantees that the web site that it is hosting will be up and available (e.g., the web server is responding with the correct requested web page) 100% of the time, and if the compliance application finds any occurrence of a failure, the service provider is in violation of its contractual obligations.
- the compliance application can keep track of the number of failures and determine the level of compliance by the service provider. Similarly, as shown in Figure 4, if the service provider guarantees that a link will be down no more than a predetermined length of time (e.g., 10 seconds) in any day, then the compliance engine can analyze, from real-time or stored data, the longest period of time that the link was down (and preferably when that outage occurred).
- a predetermined length of time e.g. 10 seconds
- the compliance application can also do an analysis of the accuracy and validity of an actual response in comparison with an expected response. Additionally, the response data can be analyzed against other factors, including the last update of the data. The application is capable of doing these types of response analytics based upon the data that is returned and stored in response to the monitoring computer system requests.
- the compliance application can generate messages (e.g., email, instant messages, phone calls) automatically and in real-time to at least one of the provider and the subscriber if a provider is failing and is not complying with the signed service agreement.
- messages can be custom tailored to notify only when the compliance application determines that it meets the customer's predefined messaging requirements. These requirements can be based upon any of the metrics that are tracked and monitored by the monitoring application.
- the compliance application analyzes the performance data gathered by the measurement agents, either periodically or continuously, to determine if the data indicates that a performance problem is occurring or is about to occur. For example, a problem can be indicated when packet loss on a network is exceeding 0.5%, although contractual terms state that a violation is when packet loss exceeds 1.0%.
- the compliance application is capable of identifying this degraded level of performance as a problem, even though it may not be exceeding the limits defined in the contract or SLA.
- the compliance application preferably analyzes performance data and identifies performance issues using a formulaic or rule-based approach.
- the compliance application analyzes the results of an entire request-response transaction, including each step during the process. It then compares the results to predefined levels of performance that indicate problems as well as to the levels stated in contracts or SLAs. This comparison is not based upon straight comparisons of performance levels (packet loss as a percentage) only, but also upon performance relative to a period of time (packet loss as a percentage during some time period (month, week, day, year, or subset thereof).
- the compliance application automatically accounts for maintenance windows and scheduled downtimes when analyzing the data for service performance problems.
- the compliance application is capable of defining contract violations based upon response time of the service provider when problems occur. For example, a contract might indicate that the service provider must communicate with the client within two hours of identifying a problem.
- the compliance application is capable of identifying issues that require attention and resolution on the part of the providers.
- the compliance application connects directly with the service provider's trouble-ticket system, creates a trouble ticket on the identified issue providing details as to the problem and location, and tracks the progress of the problem until it is fixed and closed.
- the compliance application is capable of sending emails, pages, text messages, and instant messages, and placing phone calls when problems occur, allowing for a flexible methodology to notify the provider of the service problems.
- the compliance application is capable of looking at the performance measurement data including latency, packet loss, response time, error messages, status codes, response validation, etc. to determine if service problems are occurring. These are issues in which there is service degradation prior to complete service failure. By comparing the performance results to the continuously updated definitions of a performance problem, the compliance application is capable of defining performance as problematic in order to resolve the problem prior to it resulting in a failure. Additionally, the compliance application determines the owner of the component that is performing poorly, attributing the component (router, switch, server, etc.) to the provider or client that is responsible for the component.
- the compliance application preferably connects to the provider or client's trouble-ticket/reporting system (e.g., via a TCP/IP-based connection (HTTP, HTTPS, email, SNMP, RMON, other TCP connection) or another communication protocol-based connection).
- the compliance application creates a trouble ticket for the problem that has been identified.
- This trouble ticket includes detailed performance information regarding the problem, including any latency, packet loss, response time, error messages, status codes, response content, etc. that is applicable to the problem. This creates an actionable trouble ticket with full, detailed information.
- the compliance application tracks the progress of the trouble ticket after it has been created, by updating its status as necessary, associating all provider or client communications with the problem, continuously measuring the performance of the service to determine when the problem has been fixed, and finally closing the trouble ticket when it is fixed.
- the compliance application thereby monitors the issue from identification to closure.
- the same compliance application is capable of connecting to different provider and client trouble-ticketing/reporting systems using the flexible, rule-based framework that is the basis for the measurement agents.
- This provides the ability to connect to several different types of systems via a single interface in the compliance application.
- the compliance application is capable of opening tickets in a variety of trouble-reporting and tracking systems at remote locations.
- This type of integration can occur with many types of systems, including Tivoli, CA's Unicenter, other proprietary systems, etc.
- the monitoring computer system 100 preferably further includes a prediction engine that uses the large quantities of data that are gathered by the measurement agents.
- the prediction engine analyzes the performance data, either periodically or continuously, and compares the information to historic information collected in the past. Using a proprietary algorithm, the prediction engine analyzes the data to determine if current problems are indicators of future problems (increased traffic levels, utilization, etc.) or one-time, fluke events (e.g., power cable accidentally unplugged, network cable accidentally unplugged). Additionally, using detailed knowledge of the systems and services that are employed by the different providers and clients, the prediction engine is capable of tailoring a prediction based upon the type, location, function, and performance of a component.
- the performance characteristics to be tracked and their possible ranges are preferably entered via a web-based front-end application.
- the front-end application is preferably a form-driven mechanism through which the specifics of the service are entered (those needed to perform the monitoring), including the request type, server identification (e.g., URL, IP Address, Port Number), and other request parameters. This information is validated for formatting and data accuracy, and can be additionally checked by simulating a request to the service that is indicated. After validating the request, the data is then stored in the performance database 220 and is accessible to the compliance application and the prediction engine.
- the front-end application receives information related to the corresponding guarantees (e.g., contract requirements regarding up-time, response time, DNS look-up time, connection time, download time, packet loss, latency, etc.).
- the front-end application also accepts an indication as to the level of failure (number of occurrences) equivalent to non-compliance.
- This information is also validated for accuracy (numeric values, alpha values, formatting, acceptable ranges, etc.) to ensure that the data is accurate.
- This information is then stored in the performance database 220 utilized by the compliance application to perform the analytical and notification functions of the service.
- the compliance application can then automatically calculate, for example, the discounts that should be applied to the service contracts based upon the performance of the provider during the invoice period.
- the front-end application provides robust reporting tools that allow a human user to view reports of the performance of the services that are monitored, including real-time analysis and data, historic and trend information, costs/savings estimates (including exact/projected dollar savings calculations), and other projections. Additionally, the front- end application preferably generates reports based upon the monitored industry and service, providing company comparison reports detailing the results for each of the individual service providers in the report in comparison to their competitors.
- reports are preferably customizable and dynamic based upon certain parameters (e.g., date range, request type, response information, industry, service provider, etc.) that can be specified at report-generation time. This data then can be used to maintain a ranking of the providers with respect to the services that are provided.
- parameters e.g., date range, request type, response information, industry, service provider, etc.
- exemplary services that can be monitored include: Online Credit Card Processing, electronic Procurement services, Internet Faxing, ASP services (e.g., E- Commerce ASP services, ERP ASP services, Human Resource ASP services, Financial/Accounting ASP services, Supply Chain Management ASP services, CRM services), and electronic monitoring services generally.
- ASP services e.g., E- Commerce ASP services, ERP ASP services, Human Resource ASP services, Financial/Accounting ASP services, Supply Chain Management ASP services, CRM services
- electronic monitoring services generally.
- Both publicly available services web sites, ASP services, etc.
- private, internal services and service level agreements can be monitored. This can include intra-company service level agreements between departments and custom performance monitoring based upon these agreements.
- the front-end application receives other performance data to be entered into the performance database 220 and analyzed by the compliance application and/or prediction engine.
- This data which can be entered through the web-based interface, includes data necessary to perform the compliance analysis. This is especially useful for using the compliance engine to measure and analyze compliance of services that are not electronic. Exemplary non-electronic services include call center response and auditing.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Quality & Reliability (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Environmental & Geological Engineering (AREA)
- Debugging And Monitoring (AREA)
Abstract
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2002225627A AU2002225627A1 (en) | 2000-11-20 | 2001-11-20 | Service monitoring system |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US71512300A | 2000-11-20 | 2000-11-20 | |
US09/715,123 | 2000-11-20 | ||
US27972301P | 2001-03-30 | 2001-03-30 | |
US60/279,723 | 2001-03-30 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2002042923A1 true WO2002042923A1 (fr) | 2002-05-30 |
Family
ID=26959851
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2001/043130 WO2002042923A1 (fr) | 2000-11-20 | 2001-11-20 | Systeme de suivi de services |
Country Status (2)
Country | Link |
---|---|
AU (1) | AU2002225627A1 (fr) |
WO (1) | WO2002042923A1 (fr) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1739924A1 (fr) * | 2005-06-30 | 2007-01-03 | Intel Corporation | Lecteur de média numérique pour la validation de l'état de fonctionnement d'un serveur de média numérique |
WO2009107112A2 (fr) * | 2008-02-29 | 2009-09-03 | Alcatel Lucent | Mécanisme de trafic entrant qui surveille la qualité d'expérience (qoe) de services point à point avec une sensibilité à l'application |
US9325718B2 (en) | 2013-08-05 | 2016-04-26 | Tangoe, Inc. | System and method for communications routing |
US9531652B2 (en) | 2013-08-05 | 2016-12-27 | Tangoe, Inc. | Communications routing and contact updates |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5958009A (en) * | 1997-02-27 | 1999-09-28 | Hewlett-Packard Company | System and method for efficiently monitoring quality of service in a distributed processing environment |
US5974237A (en) * | 1996-12-18 | 1999-10-26 | Northern Telecom Limited | Communications network monitoring |
US6061724A (en) * | 1997-01-29 | 2000-05-09 | Infovista Sa | Modelling process for an information system, in particular with a view to measuring performance and monitoring the quality of service, and a measurement and monitoring system implementing this process |
US6138122A (en) * | 1998-03-02 | 2000-10-24 | Agilent Technologies | Modeling of internet services |
US6286047B1 (en) * | 1998-09-10 | 2001-09-04 | Hewlett-Packard Company | Method and system for automatic discovery of network services |
-
2001
- 2001-11-20 WO PCT/US2001/043130 patent/WO2002042923A1/fr not_active Application Discontinuation
- 2001-11-20 AU AU2002225627A patent/AU2002225627A1/en not_active Abandoned
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5974237A (en) * | 1996-12-18 | 1999-10-26 | Northern Telecom Limited | Communications network monitoring |
US6061724A (en) * | 1997-01-29 | 2000-05-09 | Infovista Sa | Modelling process for an information system, in particular with a view to measuring performance and monitoring the quality of service, and a measurement and monitoring system implementing this process |
US5958009A (en) * | 1997-02-27 | 1999-09-28 | Hewlett-Packard Company | System and method for efficiently monitoring quality of service in a distributed processing environment |
US6138122A (en) * | 1998-03-02 | 2000-10-24 | Agilent Technologies | Modeling of internet services |
US6286047B1 (en) * | 1998-09-10 | 2001-09-04 | Hewlett-Packard Company | Method and system for automatic discovery of network services |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1739924A1 (fr) * | 2005-06-30 | 2007-01-03 | Intel Corporation | Lecteur de média numérique pour la validation de l'état de fonctionnement d'un serveur de média numérique |
WO2007005705A1 (fr) * | 2005-06-30 | 2007-01-11 | Intel Corporation | Lecteur media numerique exposant les donnees sur l'etat de fonctionnement |
US7904580B2 (en) | 2005-06-30 | 2011-03-08 | Intel Corporation | Digital media player exposing operational state data |
WO2009107112A2 (fr) * | 2008-02-29 | 2009-09-03 | Alcatel Lucent | Mécanisme de trafic entrant qui surveille la qualité d'expérience (qoe) de services point à point avec une sensibilité à l'application |
WO2009107112A3 (fr) * | 2008-02-29 | 2009-11-26 | Alcatel Lucent | Mécanisme de trafic entrant qui surveille la qualité d'expérience (qoe) de services point à point avec une sensibilité à l'application |
US7929450B2 (en) | 2008-02-29 | 2011-04-19 | Alcatel Lucent | In-bound mechanism that monitors end-to-end QOE of services with application awareness |
US9325718B2 (en) | 2013-08-05 | 2016-04-26 | Tangoe, Inc. | System and method for communications routing |
US9531652B2 (en) | 2013-08-05 | 2016-12-27 | Tangoe, Inc. | Communications routing and contact updates |
Also Published As
Publication number | Publication date |
---|---|
AU2002225627A1 (en) | 2002-06-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7743128B2 (en) | Method and system for visualizing network performance characteristics | |
US8402525B1 (en) | Web services security system and method | |
JP4318459B2 (ja) | ハードウェアの使用量課金システム | |
Lamanna et al. | Slang: A language for defining service level agreements | |
US8260907B2 (en) | Methods, systems and computer program products for triggered data collection and correlation of status and/or state in distributed data processing systems | |
US20030167180A1 (en) | System and methods for determining contract compliance | |
US20060265272A1 (en) | System and methods for re-evaluating historical service conditions after correcting or exempting causal events | |
US7577701B1 (en) | System and method for continuous monitoring and measurement of performance of computers on network | |
US20030225549A1 (en) | Systems and methods for end-to-end quality of service measurements in a distributed network environment | |
US20060045019A1 (en) | Network testing agent with integrated microkernel operating system | |
US20070121626A1 (en) | User and activity based end-to-end utilization measurement system | |
US20060034185A1 (en) | Systems and methods for monitoring and evaluating a connectivity device | |
KR20030086268A (ko) | 서비스 제공자의 실적을 모니터링하는 시스템 및 방법 | |
WO2002082727A1 (fr) | Procede de collecte d'informations relatives a la performance d'un reseau, support lisible par ordinateur enregistrant ces informations et systeme et procede d'analyse de la performance du reseau | |
WO2002042923A1 (fr) | Systeme de suivi de services | |
US6665822B1 (en) | Field availability monitoring | |
KR20040110864A (ko) | 순차적인 서비스 품질(QoS) 정보를 관리 및 제공하는시스템 및 방법 | |
Sayal et al. | Semantic analysis of e-business operations | |
Hauck et al. | Service Oriented Application Management-Do current techniques meet the requirements? | |
Clemm et al. | Network Working Group G. Mirsky Internet-Draft J. Halpern Intended status: Standards Track Ericsson Expires: 5 September 2022 X. Min ZTE Corp. | |
Asfoura et al. | FERP mall role in FERP Web Services marketing | |
EP1321872A1 (fr) | Procede de calcul des risques, procede de distribution d'assurances, procede d'evaluation des valeurs d'actifs, sur reseau informatique | |
Guo et al. | A trusted web services assessment model based on six dimensional QoS framework and end-to-end monitoring | |
Janhunen | Benefits of automation in network monitoring | |
Racz et al. | Monitoring of sla compliances for hosted streaming services |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: COMMUNICATION PURSUANT TO RULE 69(1) EPC (EPO 1205A DATED 14-10-03) |
|
122 | Ep: pct application non-entry in european phase | ||
NENP | Non-entry into the national phase |
Ref country code: JP |
|
WWW | Wipo information: withdrawn in national office |
Country of ref document: JP |