MY176486A - Automated test environment deployment with metric recommender for performance testing on iaas cloud - Google Patents

Automated test environment deployment with metric recommender for performance testing on iaas cloud

Info

Publication number
MY176486A
MY176486A MYPI2012005289A MYPI2012005289A MY176486A MY 176486 A MY176486 A MY 176486A MY PI2012005289 A MYPI2012005289 A MY PI2012005289A MY PI2012005289 A MYPI2012005289 A MY PI2012005289A MY 176486 A MY176486 A MY 176486A
Authority
MY
Malaysia
Prior art keywords
metric
test
performance
recommender
agent module
Prior art date
Application number
MYPI2012005289A
Inventor
Zakaria Alli Mohamad
Ikhwan Ismail Bukhary
Original Assignee
Mimos Berhad
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mimos Berhad filed Critical Mimos Berhad
Priority to MYPI2012005289A priority Critical patent/MY176486A/en
Priority to PCT/MY2013/000218 priority patent/WO2014088398A1/en
Publication of MY176486A publication Critical patent/MY176486A/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3664—Environments for testing or debugging software
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3414—Workload generation, e.g. scripts, playback
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466—Performance evaluation by tracing or monitoring
    • G06F11/3476—Data logging
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3684—Test management for test design, e.g. generating new test cases
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/815—Virtual

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

Automated test environment deployment for performance testing on laaS Cloud is provided by utilizing metric recommender. The system and method of the present invention comprising a user interface (104) for setting up test performance; a Metric Agent Module (106, 206) for introducing list of suitable metrics to be captured according to performance goals; an Interface Agent Module (212) for interfacing with API (Application Programming Interface) of Performance Test Tool and Cloud Controller; a Deployment Agent Module (108, 208) for provisioning test environment based on test scripts; a Reporting Agent Module (110, 210) for collecting and aggregating test result from Data Store (220) and displaying in portal; a Metric Store (102, 202) for storing list of metrics; a Metric Logger (216) for monitoring and collecting required metrics during test execution; a Data Store (118, 220) for storing test results from Performance Test Tool (114, 218) and Metric Logger (216). The present invention utilizes a metric recommender wherein the performance test metric is automated using physical resources of virtual machine in which the complexity of setting up test environment will be overcome by providing cloud computing to set up test virtual environment. Metrics are aggregated using metric agents to achieve performance goals by iteration to validate and verify all quantitative and qualitative attributes as reliability, stability or resource utilization of the applications. The most Illustrative drawing is FIG. 2.0.
MYPI2012005289A 2012-12-06 2012-12-06 Automated test environment deployment with metric recommender for performance testing on iaas cloud MY176486A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
MYPI2012005289A MY176486A (en) 2012-12-06 2012-12-06 Automated test environment deployment with metric recommender for performance testing on iaas cloud
PCT/MY2013/000218 WO2014088398A1 (en) 2012-12-06 2013-11-29 Automated test environment deployment with metric recommender for performance testing on iaas cloud

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
MYPI2012005289A MY176486A (en) 2012-12-06 2012-12-06 Automated test environment deployment with metric recommender for performance testing on iaas cloud

Publications (1)

Publication Number Publication Date
MY176486A true MY176486A (en) 2020-08-12

Family

ID=50073398

Family Applications (1)

Application Number Title Priority Date Filing Date
MYPI2012005289A MY176486A (en) 2012-12-06 2012-12-06 Automated test environment deployment with metric recommender for performance testing on iaas cloud

Country Status (2)

Country Link
MY (1) MY176486A (en)
WO (1) WO2014088398A1 (en)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9274782B2 (en) 2013-12-20 2016-03-01 International Business Machines Corporation Automated computer application update analysis
US10860458B2 (en) 2014-07-31 2020-12-08 Micro Focus Llc Determining application change success ratings
US9619371B2 (en) 2015-04-16 2017-04-11 International Business Machines Corporation Customized application performance testing of upgraded software
US10031831B2 (en) 2015-04-23 2018-07-24 International Business Machines Corporation Detecting causes of performance regression to adjust data systems
US9886367B2 (en) 2015-04-29 2018-02-06 International Business Machines Corporation Unified processing test structure
WO2017142393A1 (en) * 2016-02-17 2017-08-24 Mimos Berhad System for managing user experience test in controlled test environment and method thereof
CN109075991A (en) * 2016-02-26 2018-12-21 诺基亚通信公司 Cloud verifying and test automation
CN105843725B (en) * 2016-03-17 2018-10-23 广州杰赛科技股份有限公司 A kind of monitoring method and device of IaaS platforms
CN107291611A (en) * 2016-04-11 2017-10-24 中兴通讯股份有限公司 Call the test system and method for third-party testing instrument
US11650797B2 (en) * 2020-04-17 2023-05-16 Jpmorgan Chase Bank, N.A. Cloud portability code scanning tool
US11102081B1 (en) * 2020-09-28 2021-08-24 Accenture Global Solutions Limited Quantitative network testing framework for 5G and subsequent generation networks
CN112395176A (en) * 2020-11-16 2021-02-23 公安部第三研究所 Method, device, system, equipment, processor and storage medium for testing distributed cloud storage performance
CN112699041B (en) * 2021-01-04 2024-03-26 中车青岛四方车辆研究所有限公司 Automatic deployment method, system and equipment for embedded software
CN117055905A (en) * 2023-10-12 2023-11-14 北京谷器数据科技有限公司 Method for rapidly and locally deploying SaaS platform

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6975965B2 (en) * 2004-01-12 2005-12-13 International Business Machines Corporation System and method for heuristically optimizing a large set of automated test sets

Also Published As

Publication number Publication date
WO2014088398A1 (en) 2014-06-12

Similar Documents

Publication Publication Date Title
MY176486A (en) Automated test environment deployment with metric recommender for performance testing on iaas cloud
Liang et al. Caiipa: Automated large-scale mobile app testing through contextual fuzzing
US20180253373A1 (en) Systems and methods for automated web performance testing for cloud apps in use-case scenarios
US10482001B2 (en) Automated dynamic test case generation
Tan et al. Mochi: visual log-analysis based tools for debugging hadoop
WO2014150306A8 (en) System and method for coordinating field user testing results for a mobile application across various mobile devices
US9582391B2 (en) Logistics of stress testing
JP2017516181A5 (en)
WO2015015297A3 (en) Profile-based sla guarantees under workload migration in a distributed cloud
JP2016512631A5 (en)
WO2012075526A3 (en) End-user performance monitoring for mobile applications
Adriansyah et al. Mining process performance from event logs
IN2013CH00165A (en)
CN102662828A (en) A method and device for achieving software automatic testing
CN103838663A (en) Application testing method and device
WO2014031454A3 (en) Transaction-level health monitoring of online services
JP6363152B2 (en) Apparatus, method, computer program, and storage medium for data flow analysis
WO2015130675A3 (en) Apparatus and method for testing computer program implementation against a design model
Canfora et al. A case study of automating user experience-oriented performance testing on smartphones
Prathibhan et al. An automated testing framework for testing android mobile applications in the cloud
US20170024305A1 (en) Client application profiling
CN105760307A (en) Testing method, device and system of intelligent terminal
CN103729293A (en) GUI testing method based on UML activity diagrams
Shekhar et al. Understanding performance interference benchmarking and application profiling techniques for cloud-hosted latency-sensitive applications
US20140215269A1 (en) Test infrastructure simulation