GB2496809A - Scalability breakpoint calculator for a software product - Google Patents

Scalability breakpoint calculator for a software product Download PDF

Info

Publication number
GB2496809A
GB2496809A GB1303159.6A GB201303159A GB2496809A GB 2496809 A GB2496809 A GB 2496809A GB 201303159 A GB201303159 A GB 201303159A GB 2496809 A GB2496809 A GB 2496809A
Authority
GB
United Kingdom
Prior art keywords
transactions
software product
breakpoint
scalability
performance metrics
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB1303159.6A
Other versions
GB2496809B (en
GB201303159D0 (en
Inventor
Ray Y Lai
Anjaneya Vara Vankayala Venkata
Hari Ravi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Intuit Inc
Original Assignee
Intuit Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intuit Inc filed Critical Intuit Inc
Publication of GB201303159D0 publication Critical patent/GB201303159D0/en
Publication of GB2496809A publication Critical patent/GB2496809A/en
Application granted granted Critical
Publication of GB2496809B publication Critical patent/GB2496809B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3452—Performance evaluation by statistical analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/448—Execution paradigms, e.g. implementations of programming paradigms
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3414—Workload generation, e.g. scripts, playback
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Prevention of errors by analysis, debugging or testing of software
    • G06F11/3604—Analysis of software for verifying properties of programs
    • G06F11/3616—Analysis of software for verifying properties of programs using software metrics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00—Digital computers in general; Data processing equipment in general
    • G06F15/16—Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/70—Software maintenance or management
    • G06F8/77—Software metrics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3419—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment by assessing time
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/87—Monitoring of transactions

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Debugging And Monitoring (AREA)

Abstract

During a technique for estimating a scalability breakpoint of a software product, performance load tests of the software product are performed with different numbers of simulated concurrent users. For a given number of simulated concurrent users, a performance load test may include an associated set of transactions that are executed by the software product. Furthermore, during the performance load tests performance metrics for the transactions in the associated sets of transactions are measured. Then estimated total performance metrics for the transactions in the associated sets of transactions for the different numbers of simulated concurrent users are determined based on the measured performance metrics and the associated sets of transactions. Next, using the determined estimated total performance metrics, the estimated scalability breakpoint is calculated.
GB1303159.6A 2010-08-23 2011-05-26 Scalability breakpoint calculator for a software product Active GB2496809B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12/861,709 US8732299B2 (en) 2010-08-23 2010-08-23 Scalability breakpoint calculator for a software product
PCT/US2011/038091 WO2012027004A1 (en) 2010-08-23 2011-05-26 Scalability breakpoint calculator for a software product

Publications (3)

Publication Number Publication Date
GB201303159D0 GB201303159D0 (en) 2013-04-10
GB2496809A true GB2496809A (en) 2013-05-22
GB2496809B GB2496809B (en) 2019-02-13

Family

ID=45594933

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1303159.6A Active GB2496809B (en) 2010-08-23 2011-05-26 Scalability breakpoint calculator for a software product

Country Status (4)

Country Link
US (1) US8732299B2 (en)
DE (1) DE112011102479T5 (en)
GB (1) GB2496809B (en)
WO (1) WO2012027004A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9053070B1 (en) 2012-12-10 2015-06-09 Amazon Technologies, Inc. Automated tuning of a service configuration using load tests on hosts
US10289539B1 (en) * 2013-09-18 2019-05-14 Amazon Technologies, Inc. Performance testing in a software deployment pipeline
US10102103B2 (en) * 2015-11-11 2018-10-16 International Business Machines Corporation System resource component utilization
US11182282B2 (en) 2020-02-28 2021-11-23 International Business Machines Corporation Executing tests in deterministic order
US11023368B1 (en) 2020-02-28 2021-06-01 International Business Machines Corporation Reduction of testing space for system testing infrastructure using combinatorics

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6029257A (en) * 1996-12-06 2000-02-22 Intergraph Corporation Apparatus and method for testing computer systems
US6086618A (en) * 1998-01-26 2000-07-11 Microsoft Corporation Method and computer program product for estimating total resource usage requirements of a server application in a hypothetical user configuration
US20030158930A1 (en) * 2002-01-22 2003-08-21 Mc Bride Edmund Joseph Executable application network impact and load characteristic estimation system
US6801940B1 (en) * 2002-01-10 2004-10-05 Networks Associates Technology, Inc. Application performance monitoring expert

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6782421B1 (en) * 2001-03-21 2004-08-24 Bellsouth Intellectual Property Corporation System and method for evaluating the performance of a computer application
US7035919B1 (en) * 2001-03-21 2006-04-25 Unisys Corporation Method for calculating user weights for thin client sizing tool
US20030172198A1 (en) * 2002-02-21 2003-09-11 Ashutosh Tiwary Workload playback for a system for performance testing of N-tiered computer systems using recording and playback of workloads
US7669204B2 (en) * 2004-10-14 2010-02-23 International Business Machines Corporation Autonomic SMT System tuning
US20070083630A1 (en) * 2005-09-27 2007-04-12 Bea Systems, Inc. System and method for performance testing framework
US7412349B2 (en) * 2005-12-09 2008-08-12 Sap Ag Interface for series of tests
US8170859B1 (en) * 2006-04-28 2012-05-01 Intel Corporation Methods, apparatuses and computer program products for simulating arbitrary unmodified code
US8001521B2 (en) * 2006-06-12 2011-08-16 Sap Ag Meta-date driven implementation of business objects and their transactional behavior
US8813063B2 (en) * 2006-12-06 2014-08-19 International Business Machines Corporation Verification of successful installation of computer software
US8856804B2 (en) * 2008-02-08 2014-10-07 Microsoft Corporation Performance indicator for measuring responsiveness of user interface applications to user input
US8464224B2 (en) * 2009-06-30 2013-06-11 Sap Ag Integrated performance and load testing tool for application servers
US9092253B2 (en) * 2009-12-15 2015-07-28 Microsoft Technology Licensing, Llc Instrumentation of hardware assisted transactional memory system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6029257A (en) * 1996-12-06 2000-02-22 Intergraph Corporation Apparatus and method for testing computer systems
US6086618A (en) * 1998-01-26 2000-07-11 Microsoft Corporation Method and computer program product for estimating total resource usage requirements of a server application in a hypothetical user configuration
US6801940B1 (en) * 2002-01-10 2004-10-05 Networks Associates Technology, Inc. Application performance monitoring expert
US20030158930A1 (en) * 2002-01-22 2003-08-21 Mc Bride Edmund Joseph Executable application network impact and load characteristic estimation system

Also Published As

Publication number Publication date
GB2496809B (en) 2019-02-13
US8732299B2 (en) 2014-05-20
DE112011102479T5 (en) 2013-07-04
US20120047250A1 (en) 2012-02-23
WO2012027004A1 (en) 2012-03-01
GB201303159D0 (en) 2013-04-10

Similar Documents

Publication Publication Date Title
WO2014150306A8 (en) System and method for coordinating field user testing results for a mobile application across various mobile devices
GB201207326D0 (en) Preemptive memory repair based on multi-symbol, multi-scrub cycle analysis
GB2496809A (en) Scalability breakpoint calculator for a software product
EA201291142A1 (en) MACHINES, SYSTEMS, COMPUTER IMPLEMENTED METHODS AND COMPUTER SOFTWARE PRODUCTS FOR TESTING AND CERTIFICATION OF OIL AND GAS EQUIPMENT
WO2008087535A3 (en) Network oriented control of self-optimization measurements
NZ598077A (en) System and method for usage pattern analysis and simulation
WO2014047361A3 (en) Determining a dominant hand of a user of a computing device
GB201021781D0 (en) Apparatus and method for selecting candidate for failure component
MX2014007127A (en) Methods of calibration transfer for a testing instrument.
IN2013MU03313A (en)
WO2007098406A3 (en) Trust evaluation
MX336069B (en) Method for analyzing link failure cause, and network optimizing method and device thereof.
EP2583225A4 (en) System for testing and certifying a virtual appliance on a customer computer system
Coin A goodness-of-fit test for normality based on polynomial regression
GB2509647A (en) Testing transaction applications
MX2014013337A (en) Methods and systems for measurement and verification weighting with temperature distribution.
IN2013MU01951A (en)
IN2013MU02533A (en)
Goegebeur et al. Goodness-of-fit testing for Weibull-type behavior
IN2013MU03023A (en)
GB201304364D0 (en) Method, program, and device for grouping plurality of elements
Lemonte et al. Improved likelihood inference in Birnbaum–Saunders regressions
GB201201593D0 (en) Evaluating and optimizing a trajectory function
GB2494071A (en) Network testing
PH12014501806A1 (en) Apparatuses for performing consumer research and methods for using same