Connect public, paid and private patent data with Google Patents Public Datasets

Post-deployment monitoring of server performance

Info

Publication number
WO2001016753A3
WO2001016753A3 PCT/US2000/024303 US0024303W WO2001016753A3 WO 2001016753 A3 WO2001016753 A3 WO 2001016753A3 US 0024303 W US0024303 W US 0024303W WO 2001016753 A3 WO2001016753 A3 WO 2001016753A3
Authority
WO
Grant status
Application
Patent type
Prior art keywords
server
agent
computers
transactional
performance
Prior art date
Application number
PCT/US2000/024303
Other languages
French (fr)
Other versions
WO2001016753A2 (en )
Inventor
Amnon Landan
Original Assignee
Mercury Interactive Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3414Workload generation, e.g. scripts, playback
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/32Monitoring with visual or acoustical indication of the functioning of the machine
    • G06F11/323Visualisation of programs or trace data
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/32Monitoring with visual or acoustical indication of the functioning of the machine
    • G06F11/324Display of status information
    • G06F11/327Alarm or error message display
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3419Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment by assessing time
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466Performance evaluation by tracing or monitoring
    • G06F11/3495Performance evaluation by tracing or monitoring for systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/875Monitoring of systems including the internet

Abstract

A monitoring system allows users to monitor the post-deployment performance of a web-based or other transactional server (30). The system includes an agent component ('agent') (32) which can be installed on agent computers (40) that have access to the transactional server (30), including computers of actual users of the transactional server (30). The agent (32) simulates the actions of actual users of the transactional server (30) while monitoring the server's performance. The specific transactions to be performed by the agent computers (40) are specified by testcases that are dispatched to the agent computers (40) using a controller (34). As each agent computer (40) executes a testcase, it reports the execution results (performance data) in real-time to a web-based reports server (36) which stores the results in a centralized database (42). The performance data may include, for example, server response times, screen display sequences for failed transactions, measured segment delays along network paths, and identifiers of 'broken' web site links. Authorized personnel can access the reports server (36) using a standard web browser to view the collected performance data via a series of customizable reports. Using the controller (34), the user can also assign testcase execution schedules to the agent computers (40), including periodic schedules that provide for continuous or near-continuous monitoring of the transactional server (30). In addition, the user can specify alert conditions which cause personnel to be immediately notified (e.g., by pager) of problems. The controller (34) and the reports server (36) also provide functions for allowing the user to monitor the operation of the transactional server (30) according to the attributes of the agent computers (40), such as the locations, organizations, and ISPs of such computers.
PCT/US2000/024303 1999-09-01 2000-08-31 Post-deployment monitoring of server performance WO2001016753A3 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US15182499 true 1999-09-01 1999-09-01
US60/151,824 1999-09-01
US09/484,686 2000-01-17
US09484686 US6449739B1 (en) 1999-09-01 2000-01-17 Post-deployment monitoring of server performance

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP20000959879 EP1214657A2 (en) 1999-09-01 2000-08-31 Post-deployment monitoring of server performance
JP2001520640A JP2003508849A (en) 1999-09-01 2000-08-31 After deployment of server performance monitoring
CA 2380358 CA2380358A1 (en) 1999-09-01 2000-08-31 Post-deployment monitoring of server performance

Publications (2)

Publication Number Publication Date
WO2001016753A2 true WO2001016753A2 (en) 2001-03-08
WO2001016753A3 true true WO2001016753A3 (en) 2001-11-29

Family

ID=26849002

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/024303 WO2001016753A3 (en) 1999-09-01 2000-08-31 Post-deployment monitoring of server performance

Country Status (5)

Country Link
US (2) US6449739B1 (en)
JP (1) JP2003508849A (en)
CA (1) CA2380358A1 (en)
EP (1) EP1214657A2 (en)
WO (1) WO2001016753A3 (en)

Families Citing this family (224)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6108637A (en) 1996-09-03 2000-08-22 Nielsen Media Research, Inc. Content display monitor
US6973490B1 (en) * 1999-06-23 2005-12-06 Savvis Communications Corp. Method and system for object-level web performance and analysis
US6449739B1 (en) 1999-09-01 2002-09-10 Mercury Interactive Corporation Post-deployment monitoring of server performance
US7290056B1 (en) * 1999-09-09 2007-10-30 Oracle International Corporation Monitoring latency of a network to manage termination of distributed transactions
US7206805B1 (en) 1999-09-09 2007-04-17 Oracle International Corporation Asynchronous transcription object management system
US6772107B1 (en) * 1999-11-08 2004-08-03 J.D. Edwards World Source Company System and method for simulating activity on a computer network
US6883120B1 (en) * 1999-12-03 2005-04-19 Network Appliance, Inc. Computer assisted automatic error detection and diagnosis of file servers
US7013251B1 (en) * 1999-12-15 2006-03-14 Microsoft Corporation Server recording and client playback of computer network characteristics
US7373376B1 (en) * 1999-12-30 2008-05-13 Keynote Systems, Inc. Method and system for evaluating quality of service over the internet
US6662226B1 (en) * 2000-01-27 2003-12-09 Inbit, Inc. Method and system for activating and capturing screen displays associated with predetermined user interface events
US7299281B1 (en) 2000-01-27 2007-11-20 Inbit, Inc. Method and system for activating and capturing screen displays associated with predetermined user interface events
US8510437B2 (en) * 2000-01-27 2013-08-13 Yawonba Holdings Au, Llc Method and system for tracking screen activities
US20030126258A1 (en) * 2000-02-22 2003-07-03 Conkright Gary W. Web based fault detection architecture
US7281040B1 (en) * 2000-03-07 2007-10-09 Cisco Technology, Inc. Diagnostic/remote monitoring by email
US7249192B1 (en) * 2000-03-09 2007-07-24 Hewlett-Packard Development Company, L.P. Protocol for insuring exactly once semantics of transactions across an unordered, unreliable network
US6892236B1 (en) * 2000-03-16 2005-05-10 Microsoft Corporation System and method of generating computer system performance reports
US6973489B1 (en) * 2000-03-21 2005-12-06 Mercury Interactive Corporation Server monitoring virtual points of presence
US7260837B2 (en) * 2000-03-22 2007-08-21 Comscore Networks, Inc. Systems and methods for user identification, user demographic reporting and collecting usage data usage biometrics
US7930285B2 (en) * 2000-03-22 2011-04-19 Comscore, Inc. Systems for and methods of user demographic reporting usable for identifying users and collecting usage data
US7111205B1 (en) * 2000-04-18 2006-09-19 Siemens Communications, Inc. Method and apparatus for automatically reporting of faults in a communication network
US7043546B2 (en) * 2000-04-28 2006-05-09 Agilent Technologies, Inc. System for recording, editing and playing back web-based transactions using a web browser and HTML
US7523180B1 (en) * 2000-04-28 2009-04-21 Microsoft Corporation System and method for service chain management in a client management tool
US6941339B1 (en) * 2000-05-17 2005-09-06 Unbound Technologies Inc. Stated network portal system and method
US20030009544A1 (en) * 2000-06-05 2003-01-09 Wach Raymond S. Method of performing distributed load testing
US7412501B2 (en) * 2000-06-07 2008-08-12 Microsoft Corporation Event consumers for an event management system
WO2001097362A3 (en) * 2000-06-09 2002-04-04 Gen Electric System and method for utility enterprise management
US6665822B1 (en) * 2000-06-09 2003-12-16 Cisco Technology, Inc. Field availability monitoring
US7490145B2 (en) * 2000-06-21 2009-02-10 Computer Associates Think, Inc. LiveException system
US6868539B1 (en) * 2000-06-28 2005-03-15 Microsoft Corp. System and method providing single application image
US7278103B1 (en) * 2000-06-28 2007-10-02 Microsoft Corporation User interface to display and manage an entity and associated resources
US6785666B1 (en) * 2000-07-11 2004-08-31 Revenue Science, Inc. Method and system for parsing navigation information
US6799213B1 (en) * 2000-08-31 2004-09-28 Sprint Communications Company, L.P. System and method for performing interactive server load testing through use of one or more virtual users being configured as a server client capable of transmitting one or more server test actions
US20020116491A1 (en) * 2000-09-01 2002-08-22 Boyd Eric L. Method and system for probing a network
US6961681B1 (en) * 2000-09-12 2005-11-01 Microsoft Corporation System and method providing virtual applications architecture
WO2002023364A1 (en) * 2000-09-15 2002-03-21 Wonderware Corporation An industrial process control data access server supporting multiple client data exchange protocols
EP1360608A2 (en) * 2000-09-28 2003-11-12 Oracle Corporation Enterprise web mining system and method
US7117208B2 (en) * 2000-09-28 2006-10-03 Oracle Corporation Enterprise web mining system and method
US8145742B1 (en) 2000-10-31 2012-03-27 Red Hat, Inc. Method of and apparatus for network administration
US7032015B1 (en) 2000-10-31 2006-04-18 General Electric Company System and method for integrating a power system over a network
US6950868B1 (en) * 2000-10-31 2005-09-27 Red Hat, Inc. Method of and apparatus for remote monitoring
CA2327211A1 (en) * 2000-12-01 2002-06-01 Nortel Networks Limited Management of log archival and reporting for data network security systems
WO2002048830A9 (en) * 2000-12-11 2003-04-24 Phlair Inc System and method for detecting and reporting online activity using real-time content-based network monitoring
US7711533B2 (en) * 2000-12-12 2010-05-04 Uri Wilensky Distributed agent network using object based parallel modeling language to dynamically model agent activities
US7937470B2 (en) * 2000-12-21 2011-05-03 Oracle International Corp. Methods of determining communications protocol latency
US7577701B1 (en) 2001-01-22 2009-08-18 Insightete Corporation System and method for continuous monitoring and measurement of performance of computers on network
US7225361B2 (en) * 2001-02-28 2007-05-29 Wily Technology, Inc. Detecting a stalled routine
US7082465B1 (en) * 2001-03-27 2006-07-25 Cisco Technology, Inc. Web based management of host computers in an open protocol network
US7792948B2 (en) * 2001-03-30 2010-09-07 Bmc Software, Inc. Method and system for collecting, aggregating and viewing performance data on a site-wide basis
US7461369B2 (en) * 2001-03-30 2008-12-02 Bmc Software, Inc. Java application response time analyzer
US7506047B2 (en) * 2001-03-30 2009-03-17 Bmc Software, Inc. Synthetic transaction monitor with replay capability
US20040205489A1 (en) * 2001-04-09 2004-10-14 Ncr Corporation Operation of web sites on internet
US7260827B1 (en) * 2001-04-23 2007-08-21 Unisys Corporation Manual mode method of testing a video server for a video-on-demand system
US6961766B2 (en) * 2001-04-24 2005-11-01 Oracle International Corp. Method for extracting personalization information from web activity
US20020167942A1 (en) * 2001-05-04 2002-11-14 Cathy Fulton Server-site response time computation for arbitrary applications
US20020170004A1 (en) * 2001-05-08 2002-11-14 Shugart Technology, Inc. Storage area network monitor device and networked monitor system
US20020169863A1 (en) * 2001-05-08 2002-11-14 Robert Beckwith Multi-client to multi-server simulation environment control system (JULEP)
US6738933B2 (en) 2001-05-09 2004-05-18 Mercury Interactive Corporation Root cause analysis of server system performance degradations
US7197559B2 (en) * 2001-05-09 2007-03-27 Mercury Interactive Corporation Transaction breakdown feature to facilitate analysis of end user performance of a server system
US20020198985A1 (en) * 2001-05-09 2002-12-26 Noam Fraenkel Post-deployment monitoring and analysis of server performance
US7197557B1 (en) * 2001-05-29 2007-03-27 Keynote Systems, Inc. Method and system for evaluating quality of service for streaming audio and video
US6874099B1 (en) * 2001-05-31 2005-03-29 Sprint Communications Company L.P. Method and software for testing and performance monitoring
US7546354B1 (en) * 2001-07-06 2009-06-09 Emc Corporation Dynamic network based storage with high availability
US20030088644A1 (en) * 2001-07-06 2003-05-08 Computer Associates Think, Inc. Method and system for providing a virtual user interface
GB0118665D0 (en) * 2001-07-31 2001-09-19 Hewlett Packard Co Remote monitoring of computer devices
US7424526B1 (en) * 2001-07-31 2008-09-09 Sprint Communications Company L.P. Internet service node incorporating a bandwidth measurement device and associated methods for evaluating data transfers
US7111204B1 (en) * 2001-08-01 2006-09-19 Agilent Technologies, Inc. Protocol sleuthing system and method for load-testing a network server
CA2455079A1 (en) * 2001-08-06 2003-02-20 Mercury Interactive Corporation System and method for automated analysis of load testing results
US6871293B2 (en) * 2001-08-07 2005-03-22 American Management Systems, Inc. Gap detector detecting gaps between transactions transmitted by clients and transactions processed by servers
JP4294912B2 (en) 2001-08-13 2009-07-15 ブラザー工業株式会社 Terminal information notification system, a terminal information notification method and a network terminal unit
US20030074606A1 (en) * 2001-09-10 2003-04-17 Udi Boker Network-based control center for conducting performance tests of server systems
US7257516B2 (en) * 2001-09-20 2007-08-14 International Business Machines Corporation Method, apparatus, and program for eliminating thread skew in multithreaded performance benchmarks
US6961769B2 (en) * 2001-09-20 2005-11-01 International Business Machines Corporation Method, apparatus, and program for measuring server performance using multiple clients
US7552056B2 (en) 2001-09-25 2009-06-23 Emc Corporation Scalable storage service registration application
US8055555B2 (en) * 2001-09-25 2011-11-08 Emc Corporation Mediation device for scalable storage service
US7376730B2 (en) * 2001-10-10 2008-05-20 International Business Machines Corporation Method for characterizing and directing real-time website usage
US6993748B2 (en) * 2001-10-26 2006-01-31 Capital One Financial Corporation Systems and methods for table driven automation testing of software programs
US20030097445A1 (en) * 2001-11-20 2003-05-22 Stephen Todd Pluggable devices services and events for a scalable storage service architecture
US7035922B2 (en) * 2001-11-27 2006-04-25 Microsoft Corporation Non-invasive latency monitoring in a store-and-forward replication system
US7437450B1 (en) * 2001-11-30 2008-10-14 Cisco Technology Inc. End-to-end performance tool and method for monitoring electronic-commerce transactions
US8549048B2 (en) * 2001-12-19 2013-10-01 Emc Corporation Workflow database for scalable storage service
US20030128231A1 (en) * 2002-01-09 2003-07-10 Stephane Kasriel Dynamic path analysis
US6963874B2 (en) * 2002-01-09 2005-11-08 Digital River, Inc. Web-site performance analysis system and method utilizing web-site traversal counters and histograms
US7631035B2 (en) * 2002-01-09 2009-12-08 Digital River, Inc. Path-analysis toolbar
US20030131097A1 (en) * 2002-01-09 2003-07-10 Stephane Kasriel Interactive path analysis
US8086720B2 (en) 2002-01-31 2011-12-27 International Business Machines Corporation Performance reporting in a network environment
US7043549B2 (en) * 2002-01-31 2006-05-09 International Business Machines Corporation Method and system for probing in a network environment
US7130902B2 (en) * 2002-03-15 2006-10-31 Ge Mortgage Holdings, Llc Methods and apparatus for detecting and providing notification of computer system problems
US7047291B2 (en) 2002-04-11 2006-05-16 International Business Machines Corporation System for correlating events generated by application and component probes when performance problems are identified
US7412502B2 (en) * 2002-04-18 2008-08-12 International Business Machines Corporation Graphics for end to end component mapping and problem-solving in a network environment
US20030202009A1 (en) * 2002-04-24 2003-10-30 Stephane Kasriel Integration toolbar
US7490148B1 (en) 2002-05-30 2009-02-10 At&T Intellectual Property I, L.P. Completion performance analysis for internet services
US7159148B2 (en) * 2002-06-11 2007-01-02 Motorola, Inc. Method for performance and fault management in a telecommunication network
US20030233446A1 (en) * 2002-06-12 2003-12-18 Earl William J. System and method for managing a distributed computing system
US20030233453A1 (en) * 2002-06-18 2003-12-18 Institute For Information Industry Topology probing method for mobile IP system
US7877435B2 (en) * 2002-06-20 2011-01-25 International Business Machines Corporation Method and system for transaction pipeline decomposition
US8266270B1 (en) 2002-07-16 2012-09-11 At&T Intellectual Property I, L.P. Delivery performance analysis for internet services
US7310798B1 (en) 2002-08-19 2007-12-18 Sprint Communications Company L.P. Simulator tool for testing software in development process
US7269651B2 (en) * 2002-09-26 2007-09-11 International Business Machines Corporation E-business operations measurements
US7640342B1 (en) * 2002-09-27 2009-12-29 Emc Corporation System and method for determining configuration of one or more data storage systems
US20040064531A1 (en) * 2002-10-01 2004-04-01 Wisner Steven P. System and process for projecting hardware requirements for a web site
US6792460B2 (en) 2002-10-02 2004-09-14 Mercury Interactive Corporation System and methods for monitoring application server performance
US7216164B1 (en) * 2002-10-09 2007-05-08 Cisco Technology, Inc. Methods and apparatus for determining the performance of a server
US7870431B2 (en) * 2002-10-18 2011-01-11 Computer Associates Think, Inc. Transaction tracer
US7353264B2 (en) * 2002-11-13 2008-04-01 Hewlett-Packard Development Company, L.P. Method and apparatus for optimizing client responsiveness and server performance
US7346678B1 (en) * 2002-11-14 2008-03-18 Web Ex Communications, Inc. System and method for monitoring and managing a computing service
US7885974B2 (en) * 2002-11-18 2011-02-08 Aol Inc. Method and apparatus providing omnibus view of online and offline content of various file types and sources
US7457864B2 (en) * 2002-11-27 2008-11-25 International Business Machines Corporation System and method for managing the performance of a computer system based on operational characteristics of the system components
US20040199618A1 (en) * 2003-02-06 2004-10-07 Knight Gregory John Data replication solution
US8726075B1 (en) * 2003-02-14 2014-05-13 At&T Intellectual Property Ii, L.P. Method and apparatus for screenshot archiving to digital video disk (DVD)
US8527620B2 (en) 2003-03-06 2013-09-03 International Business Machines Corporation E-business competitive measurements
US20040205184A1 (en) * 2003-03-06 2004-10-14 International Business Machines Corporation E-business operations measurements reporting
WO2004093384A1 (en) * 2003-04-04 2004-10-28 Computer Associates Think, Inc. Method and system for discovery of remote agents
US7155641B2 (en) * 2003-05-15 2006-12-26 Microsoft Corporation System and method for monitoring the performance of a server
US7627669B2 (en) * 2003-05-21 2009-12-01 Ixia Automated capturing and characterization of network traffic using feedback
JP4276895B2 (en) * 2003-05-26 2009-06-10 フランホーファ−ガゼルシャフト Measurement system
US7337176B1 (en) 2003-08-29 2008-02-26 Sprint Communications Company L.P. Data loading tool for loading a database
US7493387B2 (en) * 2003-09-19 2009-02-17 International Business Machines Corporation Validating software in a grid environment using ghost agents
US7472184B2 (en) * 2003-09-19 2008-12-30 International Business Machines Corporation Framework for restricting resources consumed by ghost agents
US7493386B2 (en) * 2003-09-19 2009-02-17 International Business Machines Corporation Testing applications within a grid environment using ghost agents
US7877736B2 (en) * 2003-10-20 2011-01-25 Oracle International Corp. Computer language interpretation and optimization for server testing
US7337431B1 (en) 2003-12-23 2008-02-26 Sprint Communications Company L.P. Distributed large-scale application benchmark system
KR100599936B1 (en) * 2003-12-24 2006-07-13 한국전자통신연구원 Virtual Environment Network User Simulator System
US7328134B1 (en) 2004-02-26 2008-02-05 Sprint Communications Company L.P. Enterprise integration test tool
WO2005083571A1 (en) * 2004-03-01 2005-09-09 Izuki Corporation A method of controlling the operation of a computing system arranged to interact with other entities
US7216256B2 (en) 2004-03-30 2007-05-08 Bellsouth Intellectual Property Corporation Methods, systems, and products for verifying integrity of web-server served content
US7426556B2 (en) 2004-03-30 2008-09-16 At&T Intellectual Property I, L.P. Methods, systems, and products for verifying integrity of web-server served content
US7363364B2 (en) * 2004-03-30 2008-04-22 At&T Delaware Intellectual Property, Inc. Methods, systems, and products for verifying integrity of web-server served content
US8065410B1 (en) * 2004-03-31 2011-11-22 Compuware Corporation Methods and apparatus for collecting performance metrics from a web site
US7685273B1 (en) * 2004-03-31 2010-03-23 Compuware Corporation Methods and apparatus for collecting and displaying performance metrics from a web site
US20060031521A1 (en) * 2004-05-10 2006-02-09 International Business Machines Corporation Method for early failure detection in a server system and a computer system utilizing the same
US8180864B2 (en) * 2004-05-21 2012-05-15 Oracle International Corporation System and method for scripting tool for server configuration
US7509343B1 (en) * 2004-06-09 2009-03-24 Sprint Communications Company L.P. System and method of collecting and reporting system performance metrics
US7290205B2 (en) * 2004-06-23 2007-10-30 Sas Institute Inc. System and method for management of document cross-reference links
US20060031469A1 (en) * 2004-06-29 2006-02-09 International Business Machines Corporation Measurement, reporting, and management of quality of service for a real-time communication application in a network environment
US7133805B1 (en) 2004-07-07 2006-11-07 Sprint Communications Company L.P. Load test monitoring system
US7346807B1 (en) 2004-07-07 2008-03-18 Sprint Communications Company L.P. Optimizing transaction data for load testing
US20060020699A1 (en) * 2004-07-23 2006-01-26 D Esposito John J Method and computer program for web site performance monitoring and testing by variable simultaneous angulation
US20060064399A1 (en) * 2004-09-21 2006-03-23 Giuseppe De Sio Method and system for testing distributed software applications
KR100813395B1 (en) 2004-09-24 2008-03-12 주식회사 케이티 System for monitoring remote servers based on instant messenger and method thereof
US8171474B2 (en) 2004-10-01 2012-05-01 Serguei Mankovski System and method for managing, scheduling, controlling and monitoring execution of jobs by a job scheduler utilizing a publish/subscription interface
EP1803066B1 (en) * 2004-10-20 2012-01-04 Telecom Italia S.p.A. Method and system for monitoring performance of a client-server architecture
US7590508B1 (en) * 2004-10-22 2009-09-15 Sprint Communications Company L.P. Method and system for forecasting usage costs and computer capacity
KR20060084040A (en) * 2005-01-17 2006-07-21 삼성전자주식회사 Apparatus and method for dynamic qos management
US7546368B2 (en) * 2005-06-01 2009-06-09 Neustar, Inc. Systems and methods for isolating local performance variation in website monitoring
EP1739557A1 (en) * 2005-06-30 2007-01-03 Nortel Networks Limited Method for analyzing browsing and device for implementing the method
US20070019568A1 (en) * 2005-07-22 2007-01-25 Sbc Knowledge Ventures, L.P. Method of monitoring network elements supporting virtual private networks
US8130759B2 (en) 2005-07-29 2012-03-06 Opnet Technologies, Inc. Routing validation
US8140665B2 (en) * 2005-08-19 2012-03-20 Opnet Technologies, Inc. Managing captured network traffic data
US7623463B2 (en) * 2005-09-09 2009-11-24 International Business Machines Corporation Performance evaluation of a network-based application
GB0520633D0 (en) * 2005-10-11 2005-11-16 Agilent Technologies Inc Method and apparatus for testing a telecommunications network
US8171174B2 (en) 2006-01-19 2012-05-01 Dell Products L.P. Out-of-band characterization of server utilization via remote access card virtual media for auto-enterprise scaling
US8078971B2 (en) * 2006-01-24 2011-12-13 Oracle International Corporation System and method for scripting explorer for server configuration
US8676958B1 (en) 2006-02-10 2014-03-18 Open Invention Network, Llc System and method for monitoring the status of multiple servers on a network
US7746794B2 (en) * 2006-02-22 2010-06-29 Federal Signal Corporation Integrated municipal management console
US9346397B2 (en) 2006-02-22 2016-05-24 Federal Signal Corporation Self-powered light bar
US9002313B2 (en) * 2006-02-22 2015-04-07 Federal Signal Corporation Fully integrated light bar
US7476013B2 (en) * 2006-03-31 2009-01-13 Federal Signal Corporation Light bar and method for making
US7810156B2 (en) * 2006-04-20 2010-10-05 Agiliance Inc. Automated evidence gathering
US7805510B2 (en) * 2006-05-11 2010-09-28 Computer Associates Think, Inc. Hierarchy for characterizing interactions with an application
US8051163B2 (en) * 2006-05-11 2011-11-01 Computer Associates Think, Inc. Synthetic transactions based on system history and load
US8656006B2 (en) * 2006-05-11 2014-02-18 Ca, Inc. Integrating traffic monitoring data and application runtime data
US9009680B2 (en) * 2006-11-30 2015-04-14 Ca, Inc. Selecting instrumentation points for an application
US7814191B2 (en) * 2006-05-26 2010-10-12 The Pnc Financial Services Group, Inc. Methods and systems for network management using periodic status messages
US7761550B2 (en) * 2006-05-26 2010-07-20 The Pnc Financial Services Group, Inc. Network management for a plurality of agents using periodic status messages
JP4896593B2 (en) * 2006-06-05 2012-03-14 株式会社日立製作所 Performance monitoring methods, computers and computer systems
US20080004720A1 (en) * 2006-06-29 2008-01-03 Mckinney Howard M System and method for determining unimportant probe locations by examination of byte code by identifying trivial methods
EP1885083A1 (en) * 2006-08-03 2008-02-06 Acterna, LLC Triple play services tester
US8135990B2 (en) 2006-08-11 2012-03-13 Opnet Technologies, Inc. Multi-variate network survivability analysis
US7979320B2 (en) * 2006-08-15 2011-07-12 Microsoft Corporation Automated acquisition and configuration of goods and services via a network
US8055747B2 (en) * 2006-08-15 2011-11-08 Microsoft Corporation Message based network transmission for selection and auditing of internet services
US8090766B2 (en) * 2006-08-15 2012-01-03 Microsoft Corporation System and method to identify, rank, and audit network provided configurables
US20080148242A1 (en) * 2006-12-18 2008-06-19 Computer Associates Think, Inc. Optimizing an interaction model for an application
WO2008077111A1 (en) * 2006-12-19 2008-06-26 Gallup, Inc. A state discovery automation for dynamic web applications
US7917507B2 (en) * 2007-02-12 2011-03-29 Microsoft Corporation Web data usage platform
US8429185B2 (en) * 2007-02-12 2013-04-23 Microsoft Corporation Using structured data for online research
US7779127B2 (en) * 2007-03-09 2010-08-17 Hewlett-Packard Development Company, L.P. System and method for determining a subset of transactions of a computing system for use in determing resource costs
US8095649B2 (en) 2007-05-09 2012-01-10 Opnet Technologies, Inc. Network delay analysis including parallel delay effects
CA2691659A1 (en) * 2007-06-28 2009-01-08 Neustar, Inc. Monitoring web service transactions
US8095650B1 (en) 2007-07-30 2012-01-10 Compuware Corporation Methods and apparatus for real user monitoring including flash monitoring
US20090070744A1 (en) * 2007-08-28 2009-03-12 Sugarcrm Inc. CRM SYSTEM AND METHOD HAVING DRILLDOWNS, ACLs, SHARED FOLDERS, A TRACKER AND A MODULE BUILDER
JP5133423B2 (en) * 2007-10-18 2013-01-30 テレフオンアクチーボラゲット エル エム エリクソン(パブル) Method and apparatus in a mobile communication network
US20090112809A1 (en) * 2007-10-24 2009-04-30 Caterpillar Inc. Systems and methods for monitoring health of computing systems
WO2009052871A1 (en) * 2007-10-26 2009-04-30 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for use in a communications network
US8326970B2 (en) * 2007-11-05 2012-12-04 Hewlett-Packard Development Company, L.P. System and method for modeling a session-based system with a transaction-based analytic model
US8326971B2 (en) 2007-11-30 2012-12-04 International Business Machines Corporation Method for using dynamically scheduled synthetic transactions to monitor performance and availability of E-business systems
US9021505B2 (en) * 2007-12-07 2015-04-28 Ca, Inc. Monitoring multi-platform transactions
US8645570B2 (en) * 2007-12-20 2014-02-04 Fast Health Corporation System and method for the issuance of an emergency text alert in response to the redirection of a website
US8214524B2 (en) * 2007-12-21 2012-07-03 Hostway Corporation System and method for selecting an optimal authoritative name server
US9021082B2 (en) * 2008-01-30 2015-04-28 Case Western Reserve University Internet measurement system application programming interface
US7831695B1 (en) * 2008-02-18 2010-11-09 Sprint Communications Company L.P. System and method for it system migration management
CA2669464A1 (en) * 2008-04-14 2009-10-14 Evertz Microsystems Ltd. Method and system for monitoring and controlling a video signal network
JP5253949B2 (en) * 2008-09-26 2013-07-31 ブラザー工業株式会社 Communication apparatus, and communication program
US8645922B2 (en) * 2008-11-25 2014-02-04 Sap Ag System and method of implementing a concurrency profiler
US8326973B2 (en) 2008-12-23 2012-12-04 Novell, Inc. Techniques for gauging performance of services
US8266477B2 (en) 2009-01-09 2012-09-11 Ca, Inc. System and method for modifying execution of scripts for a job scheduler using deontic logic
US8635694B2 (en) * 2009-01-10 2014-01-21 Kaspersky Lab Zao Systems and methods for malware classification
US8028205B2 (en) * 2009-03-30 2011-09-27 Hartford Fire Insurance Company System for providing performance testing information to users
US8615739B2 (en) * 2009-04-23 2013-12-24 Hewlett-Packard Development Company, L.P. Resource monitoring
US8032791B2 (en) * 2009-07-07 2011-10-04 International Business Machines Corporation Diagnosis of and response to failure at reset in a data processing system
US8738710B1 (en) * 2009-08-05 2014-05-27 Nextel Communications Inc. Systems and methods of providing push-to-application services
US8666996B2 (en) * 2009-12-23 2014-03-04 Mastercard International Incorporated Methods and systems for detecting broken links within a file
JP5458308B2 (en) * 2010-06-11 2014-04-02 株式会社日立製作所 Virtual computer system, monitoring method and a network device of the virtual computer system
US9274842B2 (en) * 2010-06-29 2016-03-01 Microsoft Technology Licensing, Llc Flexible and safe monitoring of computers
US8543868B2 (en) 2010-12-21 2013-09-24 Guest Tek Interactive Entertainment Ltd. Distributed computing system that monitors client device request time and server servicing time in order to detect performance problems and automatically issue alerts
US9009185B2 (en) * 2010-12-28 2015-04-14 Sevone, Inc. Scalable performance management system
US8677324B2 (en) * 2011-01-31 2014-03-18 Hewlett-Packard Development Company, L.P. Evaluating performance of an application using event-driven transactions
US8707111B2 (en) * 2011-02-09 2014-04-22 Ebay Inc. High-volume distributed script error handling
WO2012142144A3 (en) 2011-04-12 2013-05-02 Opnet Technologies, Inc. Assessing application performance with an operational index
US9641247B2 (en) * 2011-05-03 2017-05-02 Monolith Technology Holdings, Llc System and method for monitoring unknown resources
DE102012103654A1 (en) 2011-05-17 2012-11-22 International Business Machines Corp. Installing and testing an application on a heavily used computer platform
US8671108B2 (en) 2011-09-02 2014-03-11 Mastercard International Incorporated Methods and systems for detecting website orphan content
US20130305222A1 (en) * 2012-05-11 2013-11-14 Microsoft Corporation Development System
US9621480B2 (en) 2013-03-04 2017-04-11 Vigo Software Ltd Data acquisition pertaining to connectivity of client applications of a service provider network
US9767668B2 (en) * 2013-03-14 2017-09-19 International Business Machines Corporation Automatic adjustment of metric alert trigger thresholds
US9563907B2 (en) 2013-06-13 2017-02-07 Vigo Software Ltd Offer based provision of fee based network access
US9423921B2 (en) * 2013-06-26 2016-08-23 Nicolas Bissantz System for providing information to a user
US9111037B1 (en) 2013-08-21 2015-08-18 Ca, Inc. Method and apparatus to enable mainframe computer testing for software testing management platform
US9753743B2 (en) 2013-12-05 2017-09-05 Entit Software Llc Identifying a common action flow
US9300679B1 (en) 2013-12-16 2016-03-29 8X8, Inc. System and method for monitoring computing servers for possible unauthorized access
US9306985B1 (en) 2014-03-25 2016-04-05 8X8, Inc. User configurable data storage
US9628436B1 (en) 2014-04-04 2017-04-18 8X8, Inc. User-configurable dynamic DNS mapping for virtual services
US9189377B1 (en) * 2014-06-02 2015-11-17 Bank Of America Corporation Automation testing using descriptive maps
CN105335142A (en) * 2014-07-29 2016-02-17 国际商业机器公司 Method and device for identifying performance bottleneck of transaction in transaction processing system
US9697110B1 (en) 2015-12-28 2017-07-04 Bank Of America Corporation Codeless system and tool for testing applications

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5577197A (en) * 1992-10-29 1996-11-19 Mci Communications Corporation Test system for testing electronic transaction processing services at a common carrier network switch
GB2307318A (en) * 1995-11-14 1997-05-21 Mitsubishi Electric Corp Testing a networked system of servers
US5684945A (en) * 1992-10-23 1997-11-04 International Business Machines Corporation System and method for maintaining performance data in a data processing system
WO2000019320A1 (en) * 1998-09-30 2000-04-06 Netscout Service Level Corporation Evaluating computer resources by end-user emulation

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5864659A (en) * 1995-03-07 1999-01-26 Intel Corporation Computer server with improved reliability, availability and serviceability
EP0830611A4 (en) 1995-06-02 2007-05-09 Cisco Systems Inc Remote monitoring of computer programs
US5819066A (en) 1996-02-28 1998-10-06 Electronic Data Systems Corporation Application and method for benchmarking a database server
US5812780A (en) 1996-05-24 1998-09-22 Microsoft Corporation Method, system, and product for assessing a server application performance
US5696701A (en) * 1996-07-12 1997-12-09 Electronic Data Systems Corporation Method and system for monitoring the performance of computers in computer networks using modular extensions
US5938729A (en) 1996-07-12 1999-08-17 Microsoft Corporation System and method for monitoring server performance at a client computer
US5781703A (en) 1996-09-06 1998-07-14 Candle Distributed Solutions, Inc. Intelligent remote agent for computer performance monitoring
US5870559A (en) 1996-10-15 1999-02-09 Mercury Interactive Software system and associated methods for facilitating the analysis and management of web sites
US5732218A (en) * 1997-01-02 1998-03-24 Lucent Technologies Inc. Management-data-gathering system for gathering on clients and servers data regarding interactions between the servers, the clients, and users of the clients during real use of a network of clients and servers
US5787254A (en) 1997-03-14 1998-07-28 International Business Machines Corporation Web browser method and system for display and management of server latency
US5958010A (en) * 1997-03-20 1999-09-28 Firstsense Software, Inc. Systems and methods for monitoring distributed applications including an interface running in an operating system kernel
US6006260A (en) 1997-06-03 1999-12-21 Keynote Systems, Inc. Method and apparatus for evalutating service to a user over the internet
US5963963A (en) * 1997-07-11 1999-10-05 International Business Machines Corporation Parallel file system and buffer management arbitration
US5905868A (en) 1997-07-22 1999-05-18 Ncr Corporation Client/server distribution of performance monitoring data
WO1999006935A1 (en) * 1997-08-01 1999-02-11 Monks Robert A G Entreprise simulation module
US6324492B1 (en) * 1998-01-20 2001-11-27 Microsoft Corporation Server stress testing using multiple concurrent client simulation
US6205413B1 (en) 1998-06-11 2001-03-20 Chatschik Bisdikian End-user oriented performance monitoring system for interactive end-to-end data communications
US6189142B1 (en) * 1998-09-16 2001-02-13 International Business Machines Corporation Visual program runtime performance analysis
US6138157A (en) 1998-10-12 2000-10-24 Freshwater Software, Inc. Method and apparatus for testing web sites
US6243105B1 (en) 1998-11-19 2001-06-05 Ncr Corporation Drill-down method to historical data in a performance monitor using a platform independent program
US6446028B1 (en) * 1998-11-25 2002-09-03 Keynote Systems, Inc. Method and apparatus for measuring the performance of a network based application program
US6449739B1 (en) 1999-09-01 2002-09-10 Mercury Interactive Corporation Post-deployment monitoring of server performance

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5684945A (en) * 1992-10-23 1997-11-04 International Business Machines Corporation System and method for maintaining performance data in a data processing system
US5577197A (en) * 1992-10-29 1996-11-19 Mci Communications Corporation Test system for testing electronic transaction processing services at a common carrier network switch
GB2307318A (en) * 1995-11-14 1997-05-21 Mitsubishi Electric Corp Testing a networked system of servers
WO2000019320A1 (en) * 1998-09-30 2000-04-06 Netscout Service Level Corporation Evaluating computer resources by end-user emulation

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
"METHOD FOR PERFORMING AUTOMATED PSEUDO VIDEO RECORDING OF REMOTE COMPUTER SYSTEMS", IBM TECHNICAL DISCLOSURE BULLETIN,US,IBM CORP. NEW YORK, vol. 37, no. 4A, 1 April 1994 (1994-04-01), pages 495, XP000446751, ISSN: 0018-8689 *
C. NOLAN: "A Look at e-Test Suite 3.1 by RSW", SOFTWARE TESTING & QUALITY ENGINEERING, July 1999 (1999-07-01), pages 60 - 61, XP002155308, Retrieved from the Internet <URL:http://www.rswsoftware.com/news/articles/ja99.pdf> [retrieved on 20001128] *
LARSEN A K: "ALL EYES ON IP TRAFFIC. NEW APPS CAN MONITOR INTERNET AND INTRANET TRADDIC, BUT DO THEY DELIVER ENOUGH DATA TO HOLD ISPS TO THEIR PROMISES?", DATA COMMUNICATIONS,US,MCGRAW HILL. NEW YORK, vol. 26, no. 4, 21 March 1997 (1997-03-21), pages 54,56 - 60,62, XP000659549, ISSN: 0363-6399 *

Also Published As

Publication number Publication date Type
WO2001016753A2 (en) 2001-03-08 application
EP1214657A2 (en) 2002-06-19 application
US20020184575A1 (en) 2002-12-05 application
US6564342B2 (en) 2003-05-13 grant
JP2003508849A (en) 2003-03-04 application
CA2380358A1 (en) 2001-03-08 application
US6449739B1 (en) 2002-09-10 grant

Similar Documents

Publication Publication Date Title
Sittig et al. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems
Cohen et al. Correlating Instrumentation Data to System States: A Building Block for Automated Diagnosis and Control.
Gold et al. A national survey of the arrangements managed-care plans make with physicians
Kalra Medical errors: impact on clinical laboratories and other critical areas
US6633908B1 (en) Enabling application response measurement
Marx et al. Assessing patient safety risk before the injury occurs: an introduction to sociotechnical probabilistic risk modelling in health care
US6174283B1 (en) Apparatus and method for monitoring a system and displaying the status of the system
Binkley et al. Validation of the coupling dependency metric as a predictor of run-time failures and maintenance measures
US7369967B1 (en) System and method for monitoring and modeling system performance
US20060173715A1 (en) Health information system and method
US20020143563A1 (en) System for clinical trial subject compliance
US20070143795A1 (en) Application trace for distributed systems environment
US20050010461A1 (en) Information technology service request level of service monitor
Hoff et al. The importance of the command-physician in trauma resuscitation
US20050120332A1 (en) Method, system, and software for mapping and displaying process objects at different levels of abstraction
Van der Voet et al. Integration of probabilistic exposure assessment and probabilistic hazard characterization
US20070094281A1 (en) Application portfolio assessment tool
US20050182655A1 (en) System and methods to collect, store, analyze, report, and present data
Hripcsak et al. WebCIS: large scale deployment of a Web-based clinical information system.
US7725574B2 (en) Web browser-based programming language error determination and reporting
Rialle et al. Telemonitoring of patients at home: a software agent approach
US20060074695A1 (en) System and method for reporting and delivering sales and market research data
US20080086345A1 (en) Asset Data Collection, Presentation, and Management
Dehaene Temporal oscillations in human perception
Littlewood et al. Software reliability and dependability: a roadmap

Legal Events

Date Code Title Description
AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ CZ DE DE DK DK DM DZ EE EE ES FI FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ CZ DE DE DK DK DM DZ EE EE ES FI FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

WWE Wipo information: entry into national phase

Ref document number: 2380358

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 71123/00

Country of ref document: AU

ENP Entry into the national phase in:

Ref country code: JP

Ref document number: 2001 520640

Kind code of ref document: A

Format of ref document f/p: F

WWE Wipo information: entry into national phase

Ref document number: 2000959879

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2000959879

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWG Wipo information: grant in national office

Ref document number: 71123/00

Country of ref document: AU

WWW Wipo information: withdrawn in national office

Ref document number: 2000959879

Country of ref document: EP