CN105068934A - Benchmark test system and method for cloud platform - Google Patents
Benchmark test system and method for cloud platform Download PDFInfo
- Publication number
- CN105068934A CN105068934A CN201510545704.1A CN201510545704A CN105068934A CN 105068934 A CN105068934 A CN 105068934A CN 201510545704 A CN201510545704 A CN 201510545704A CN 105068934 A CN105068934 A CN 105068934A
- Authority
- CN
- China
- Prior art keywords
- cloud platform
- test
- benchmark
- engine
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The present invention discloses a benchmark test system and method for a cloud platform, and belongs to the field of cloud platform management technologies. According to the present invention, the benchmark system can be applied to an operating system benchmark test on an open source or closed source cloud platform and perform operating system verification in environments of development, testing and production. Performance of virtual machine life-cycle management, virtual hard disk management and virtual network management on the cloud platform is tested and evaluated so as to determine whether the constructed cloud platform meets production demands of a customer.
Description
Technical field
The present invention discloses a kind of Benchmark test system for cloud platform and method, belongs to cloud platform management technical field.
Background technology
Cloud computing is a kind of account form based on internet, and in this way, the software and hardware resources shared and information can be supplied to computing machine and other equipment as required.Typical cloud computing provider often provides general Network application, can be visited, and software and data all stores on the server by the softwares such as browser or other Web services.Cloud computing service provides the general online business application by browser access usually, and software and data can be stored in data center.Cloud computation data center is a kind of based on cloud computing framework, and calculate, store and Internet resources loose coupling, the various information technoloy equipment of Full-virtualization, the degree of modularity is higher, automaticity is higher, possess the new types of data center of higher green energy conservation degree.Cloud platform: cloud platform provides the service based on " cloud ", adopts when creating application for developer.The basis of oneself need not be built, cloud platform can be relied on completely to create new SaaS application.Platform allows developers or the program finished writing is placed on " cloud " inner operation, or " cloud " the inner service provided of use, or the two is all.Cloud computation data center is a kind of based on cloud computing framework, and calculate, store and Internet resources loose coupling, the various information technoloy equipment of Full-virtualization, the degree of modularity is higher, automaticity is higher, possess the new types of data center of higher green energy conservation degree.
Cloud data center height virtual, comprise server, storage, network, application etc. virtual, make user can call various resource as required; Next is automatic management degree, comprises the management to physical server, virtual server, manages, to automatic managements such as the charges of customer service to the automatic flow of related service.
Current, cloud computing is approved by industry gradually, and cloud data center operation system realizes gradually and tries out, and social production and sphere of life play more and more important effect.At the development and testing of cloud platform product, continuous integrating or Persisting exploitation, production is reached the standard grade in test scene, is the benchmark test data that developer or client need to understand cloud platform environment.The benchmark test data understood are needed mainly to comprise but the function of user management, Virtual Machine Manager, virtual disk management, network management etc. and performance.In order to more efficient and carry out benchmark test to cloud platform environment fast, we have proposed a kind of Benchmark test system for cloud platform and method, this baseline system can be used for increasing income or close source cloud platform operating system benchmark test, verify in exploitation, test, production environment.Test the performance of the management of the virtual machine life cycle management in cloud platform, virtual hard disk management, virtual network and assess, whether the cloud platform evaluating construction with this meets the Production requirement of client.
Summary of the invention
The present invention is more efficient and carries out benchmark test to cloud platform environment fast, a kind of Benchmark test system for cloud platform and method are provided, can be used for increasing income or close the operating system benchmark test of source cloud platform, verify in exploitation, test, production environment.
The concrete scheme that the present invention proposes is:
For a Benchmark test system for cloud platform, comprise and start administration module, deployment engine, authentication module, benchmark engine;
Start administration module and initiate call instruction for terminal program to system, start and management standard test;
Deployment engine, for disposing cloud platform environment, carries out context initialization simultaneously;
Authentication module runs integration testing use-case on cloud platform, detect cloud whether normal, collect test result, form readable report;
Benchmark engine is used for testing results use-case, allows the test scene of tester's programming parametric simultaneously.This baseline system can be used for tide cloud sea operating system benchmark test, in exploitation, test, verify in production environment.This system also can be used for other benchmark test of increasing income or closing source cloud platform simultaneously.
Described startup administration module utilizes same command line or restAPI interface or interface operation to initiate call instruction by terminal program to system, starts and management standard test.
The test script of json form supported by described benchmark engine.Script benchmark engine that can be compatible for other is also supported.
A kind of reference test method for cloud platform, a kind of Benchmark test system for cloud platform described in utilization, deployment engine disposes initialization data script, for the basic data of initialization benchmark test, create virtual machine, benchmark engine test scene script, execute the task by starting administration module, after tasks carrying, authentication module collects the data in test process, and analysis task performs data.
Data in described collection test process comprise the response time of each request, and use-case performs always consuming time.
Usefulness of the present invention is:
The present invention proposes a kind of Benchmark test system for cloud platform and method, can dispose cloud platform, carries out platform validation, writes test script, exports test report.This system is used for development and testing, test scene is reached the standard grade in continuous integrating or Persisting exploitation, production.This Benchmark test system can be applicable to increase income or close source cloud platform operating system benchmark test, verify in exploitation, test, production environment.Test the performance of the management of the virtual machine life cycle management in cloud platform, virtual hard disk management, virtual network and assess simultaneously, whether the cloud platform evaluating construction with this meets the Production requirement of client.
Accompanying drawing explanation
Fig. 1 present system logical organization schematic diagram.
Embodiment
For a Benchmark test system for cloud platform, comprise and start administration module, deployment engine, authentication module, benchmark engine;
Start administration module and initiate call instruction for terminal program to system, start and management standard test;
Deployment engine, for disposing cloud platform environment, carries out context initialization simultaneously;
Authentication module runs integration testing use-case on cloud platform, detect cloud whether normal, collect test result, form readable report;
Benchmark engine is used for testing results use-case, allows the test scene of tester's programming parametric simultaneously.
Wherein starting administration module can utilize same command line or restAPI interface or interface operation to initiate call instruction by terminal program to system, starts and management standard test.
A kind of reference test method for cloud platform, utilize a kind of Benchmark test system for cloud platform, deployment engine disposes initialization data script, for the basic data of initialization benchmark test, create virtual machine, benchmark engine test scene script, execute the task by starting administration module, after tasks carrying, authentication module collects the data in test process, and analysis task performs data.
With reference to the accompanying drawings 1, for the benchmark test of tide cloud sea operating system system.Content of the present invention is described.
Tester uses deployment engine to carry out the deployment of tide cloud sea operating system.Need according to system requirements during deployment, write deployment script and cloud platform initialization data script.Initialization data script is mainly used in the basic data of initialization benchmark test, the data such as such as user, role, tissue.
Tester writes benchmark test scene script, and the data layout of json supported by script.It is below the test script false code creating virtual machine.
Create virtual machine .json
{
" establishment virtual machine ":
" parameter ":
" length of name ": 10
}，
" RUN ":
" type ": " constant ",
" number of times ": 100,
" concurrent ": 100
}
}
}
Tester is executed the task by order line, and order example is as follows:
#benchtaskstart creates virtual machine .json
After tasks carrying, will collect the data in test process, mainly comprise the response time of each request, use-case performs always consuming time.
Tester's analysis task performs data.Tester, according to the above-mentioned test data collected, generates chart, forms the benchmark test data of sea of clouds OS.According to these benchmark test data, cloud sea operating system can be assessed and whether meet re-set target.And analytic system bottleneck, for system optimization provides reference frame.
Claims (5)
1., for a Benchmark test system for cloud platform, it is characterized in that comprising startup administration module, deployment engine, authentication module, benchmark engine;
Start administration module and initiate call instruction for terminal program to system, start and management standard test;
Deployment engine, for disposing cloud platform environment, carries out context initialization simultaneously;
Authentication module runs integration testing use-case on cloud platform, detect cloud whether normal, collect test result, form readable report;
Benchmark engine is used for testing results use-case, allows the test scene of tester's programming parametric simultaneously.
2. a kind of Benchmark test system for cloud platform according to claim 1, it is characterized in that described startup administration module utilizes same command line or restAPI interface or interface operation to initiate call instruction by terminal program to system, start and management standard test.
3. a kind of Benchmark test system for cloud platform according to claim 1 and 2, is characterized in that the test script of json form supported by described benchmark engine.
4. the reference test method for cloud platform, it is characterized in that a kind of Benchmark test system for cloud platform utilized described in any one of claim 1-3, deployment engine disposes initialization data script, for the basic data of initialization benchmark test, create virtual machine, benchmark engine test scene script, execute the task by starting administration module, after tasks carrying, authentication module collects the data in test process, and analysis task performs data.
5. a kind of Benchmark test system for cloud platform according to claim 1 or 4, is characterized in that the data in described collection test process comprise the response time of each request, and use-case performs always consuming time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510545704.1A CN105068934A (en) | 2015-08-31 | 2015-08-31 | Benchmark test system and method for cloud platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510545704.1A CN105068934A (en) | 2015-08-31 | 2015-08-31 | Benchmark test system and method for cloud platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105068934A true CN105068934A (en) | 2015-11-18 |
Family
ID=54498311
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510545704.1A Pending CN105068934A (en) | 2015-08-31 | 2015-08-31 | Benchmark test system and method for cloud platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105068934A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017157203A1 (en) * | 2016-03-18 | 2017-09-21 | 阿里巴巴集团控股有限公司 | Reference test method and device for supervised learning algorithm in distributed environment |
| CN107729255A (en) * | 2017-11-10 | 2018-02-23 | 北京奇虎科技有限公司 | Method for testing software, apparatus and system |
| CN108334327A (en) * | 2018-03-01 | 2018-07-27 | 深圳市泛海三江科技发展有限公司 | A kind for the treatment of method and apparatus for Internet of Things cloud platform |
| CN109075991A (en) * | 2016-02-26 | 2018-12-21 | 诺基亚通信公司 | Cloud verifying and test automation |
| CN110851309A (en) * | 2019-10-31 | 2020-02-28 | 广东安可云科技有限公司 | Integrated verification system and method |
| CN110968495A (en) * | 2018-09-29 | 2020-04-07 | 浙江大学 | Container cloud platform performance evaluation method and device |
| CN111338866A (en) * | 2020-02-20 | 2020-06-26 | 上海仪电（集团）有限公司中央研究院 | Cloud host pressure testing method and system based on shadow body-divided virtual machine |
| CN114721922A (en) * | 2022-05-16 | 2022-07-08 | 北京并行科技股份有限公司 | Performance evaluation method of server cluster, computing equipment and storage medium |
| WO2023060508A1 (en) * | 2021-10-14 | 2023-04-20 | Intel Corporation | A concept for controlling parameters of a hypervisor |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102902769A (en) * | 2012-09-26 | 2013-01-30 | 曙光信息产业(北京)有限公司 | Database benchmark test system of cloud computing platform and method thereof |
| CN103559134A (en) * | 2013-11-11 | 2014-02-05 | 曙光信息产业(北京)有限公司 | Configuration method and device for benchmark test component |
| US20150019707A1 (en) * | 2013-07-09 | 2015-01-15 | Oracle International Corporation | Cloud services performance tuning and benchmarking |
-
2015
- 2015-08-31 CN CN201510545704.1A patent/CN105068934A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102902769A (en) * | 2012-09-26 | 2013-01-30 | 曙光信息产业(北京)有限公司 | Database benchmark test system of cloud computing platform and method thereof |
| US20150019707A1 (en) * | 2013-07-09 | 2015-01-15 | Oracle International Corporation | Cloud services performance tuning and benchmarking |
| CN103559134A (en) * | 2013-11-11 | 2014-02-05 | 曙光信息产业(北京)有限公司 | Configuration method and device for benchmark test component |
Non-Patent Citations (2)
| Title |
|---|
| MIKHAIL DUBOV: "Rally", 《HTTPS//WIKI.OPENSTACK.ORG/W/INDEX.PHP?TITLE=RALLY&DIRECTION=NEXT&OLDID=81090》 * |
| 小小的编码人: "openstack基准测试项目Rally介绍", 《BLOG.CSDN.NET/JOELOVEGREEN/ARTICLE/DETAILS/46345025》 * |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109075991A (en) * | 2016-02-26 | 2018-12-21 | 诺基亚通信公司 | Cloud verifying and test automation |
| WO2017157203A1 (en) * | 2016-03-18 | 2017-09-21 | 阿里巴巴集团控股有限公司 | Reference test method and device for supervised learning algorithm in distributed environment |
| CN107203467A (en) * | 2016-03-18 | 2017-09-26 | 阿里巴巴集团控股有限公司 | The reference test method and device of supervised learning algorithm under a kind of distributed environment |
| CN107729255A (en) * | 2017-11-10 | 2018-02-23 | 北京奇虎科技有限公司 | Method for testing software, apparatus and system |
| CN107729255B (en) * | 2017-11-10 | 2021-04-09 | 北京奇虎科技有限公司 | Software testing method, device and system |
| CN108334327A (en) * | 2018-03-01 | 2018-07-27 | 深圳市泛海三江科技发展有限公司 | A kind for the treatment of method and apparatus for Internet of Things cloud platform |
| CN110968495A (en) * | 2018-09-29 | 2020-04-07 | 浙江大学 | Container cloud platform performance evaluation method and device |
| CN110851309A (en) * | 2019-10-31 | 2020-02-28 | 广东安可云科技有限公司 | Integrated verification system and method |
| CN110851309B (en) * | 2019-10-31 | 2024-03-19 | 广东安可云科技有限公司 | Integrated verification system and method |
| CN111338866A (en) * | 2020-02-20 | 2020-06-26 | 上海仪电（集团）有限公司中央研究院 | Cloud host pressure testing method and system based on shadow body-divided virtual machine |
| CN111338866B (en) * | 2020-02-20 | 2024-04-09 | 上海仪电（集团）有限公司中央研究院 | Cloud host pressure testing method and system based on shadow virtual machine |
| WO2023060508A1 (en) * | 2021-10-14 | 2023-04-20 | Intel Corporation | A concept for controlling parameters of a hypervisor |
| CN114721922A (en) * | 2022-05-16 | 2022-07-08 | 北京并行科技股份有限公司 | Performance evaluation method of server cluster, computing equipment and storage medium |
| CN114721922B (en) * | 2022-05-16 | 2022-10-04 | 北京并行科技股份有限公司 | Performance evaluation method of server cluster, computing equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105068934A (en) | Benchmark test system and method for cloud platform | |
| US10210074B1 (en) | Performance testing platform that enables reuse of automation scripts and performance testing scalability | |
| Chowdhury et al. | Greenoracle: Estimating software energy consumption with energy measurement corpora | |
| Aggarwal et al. | The power of system call traces: Predicting the software energy consumption impact of changes | |
| US9959336B2 (en) | Compiling extract, transform, and load job test data cases | |
| US11429434B2 (en) | Elastic execution of machine learning workloads using application based profiling | |
| JP5689400B2 (en) | Computer program verification of unexpected responses to access requests | |
| US10489005B2 (en) | Usability analysis for user interface based systems | |
| US20220100632A1 (en) | Detecting performance degradation in remotely deployed applications | |
| KR101751515B1 (en) | Apparatus, method, and computer program for testing | |
| US10057331B2 (en) | Automatic abstraction of flow of control in a distributed virtualization platform | |
| Evangelinou et al. | Enterprise applications cloud rightsizing through a joint benchmarking and optimization approach | |
| Mercl et al. | Public cloud kubernetes storage performance analysis | |
| US20170161176A1 (en) | Trace recovery via statistical reasoning | |
| US20120311542A1 (en) | Dynamic interface reduction for software model checking | |
| Jia et al. | Using the 5W+ 1H model in reporting systematic literature review: A case study on software testing for cloud computing | |
| US11467947B2 (en) | Automated mocking of computer system deployments | |
| Willnecker et al. | Full-stack performance model evaluation using probabilistic garbage collection simulation | |
| Schmieders et al. | Architectural runtime models for privacy checks of cloud applications | |
| CN115840691A (en) | Remote repair of crash processes | |
| US11526828B2 (en) | Calculating developer time during development process | |
| FR3019918A1 (en) | METHOD OF ANALYZING THE OPERATION OF A BINARY EXECUTABLE PROGRAM AND INSTALLATION FOR IMPLEMENTING SAID METHOD | |
| Svorobej et al. | Towards automated data-driven model creation for cloud computing simulation | |
| Kakkar et al. | Risk analysis in mobile application development | |
| CN107872497A (en) | Lucidification disposal end application synchronization sharing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20151118 |
|
| RJ01 | Rejection of invention patent application after publication |