CN104333488A - Cloud service platform performance test method - Google Patents
Cloud service platform performance test method Download PDFInfo
- Publication number
- CN104333488A CN104333488A CN201410614010.4A CN201410614010A CN104333488A CN 104333488 A CN104333488 A CN 104333488A CN 201410614010 A CN201410614010 A CN 201410614010A CN 104333488 A CN104333488 A CN 104333488A
- Authority
- CN
- China
- Prior art keywords
- test
- performance
- cloud service
- service platform
- virtual machine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention belongs to the technical field of computer cloud services, relates to a cloud service platform performance test method, and aims to solve the problem of the existing test tools and test projects of being incapable of meeting cloud service platform performance test requirements. The cloud service platform performance test method tests a service interface layer, a platform management layer and a virtual resource layer of a cloud service platform. The cloud service platform performance test method includes virtualization performance test, resource management ability test and service supply ability test. The virtualization performance test is used for testing the performance of virtual resources at the bottom layer of the cloud service platform. The resource management ability test is used for testing the management ability of the cloud service platform on the virtual resources. The service supply ability test is used for testing the ability of the cloud service platform of supplying services to external users. The cloud service platform performance test method is used for testing and evaluating the cloud service platform.
Description
Technical field
The invention belongs to computer cloud service technical field, relate to a kind of cloud service platform performance test methods.
Background technology
Since entering the new century, it is very rapid that information technology and IT industry develop, and traditional computation schema has been difficult to the demand deacclimatizing ever-increasing data processing, therefore needs a kind of novel, efficient computation schema.Cloud computing can provide general efficient computing platforms and memory space, is that the effective data of large data age calculate solution, and significantly can saves cost.
Cloud computing technology has broken the restriction of traditional server, user only needs a terminal equipment to be connected with network, just can obtain the physical resource such as processor resource, storage resources and the various software resource operating in high in the clouds environment, but also can take as required with telescopic flexible resource pattern as acquisition coal gas, water power.According to the definition of NTSI, cloud computing can be divided into three kinds of service mode: IaaS to provide hardware services such as comprising storage, virtual server in conjunction with the service of cloud computing provider and Consumer's Experience angle; PaaS provides the service than IaaS more top, as Software Development Platform based on IaaS usually; SaaS provide a kind of specific, via the software service of the Internet.At present about the definition that cloud service platform is ununified, each cloud service supplier releases relevant cloud service platform scheme according to the business of oneself enterprise.Sensu lato cloud service platform should comprise the application service from the hardware enclosure of bottom to top layer, as shown in the cloud service platform framework map of Fig. 1.
But, along with cloud computing developing rapidly and universal, also bringing much new problem, is wherein a wherein vital aspect to the evaluation and test of the aspect of performance of cloud service platform.Due to compared with traditional calculations platform, the complexity of cloud service platform is higher, and scale is also huger, is therefore a very difficult task to the performance test of cloud service platform.
Summary of the invention
The present invention seeks to the problem that cannot meet cloud service platform performance evaluating in order to solve existing testing tool and test event, providing a kind of cloud service platform performance test methods.
Cloud service platform performance test methods of the present invention, described cloud service platform comprises service interface layer, platform management layer, virtual resource layer and physical resource layer, physical resource layer is the physical hardware of bottom, virtual resource layer is used for virtual for the physical resource of bottom, platform management layer is used for scheduling virtual machine, monitoring performance and management resource, and service interface layer is used for that the computing capability of cloud service platform is packaged into service interface and is supplied to external user;
Described cloud service platform performance test methods, this performance test methods is tested the service interface layer of cloud service platform, platform management layer and virtual resource layer; This method of testing comprises virtualizing performance test, resource management capacity test and service provision capacity test;
Virtualizing performance test is for testing the performance of the virtual resource of cloud service platform bottom;
Resource management capacity test is for testing the managerial ability of cloud service platform to virtual resource;
Service provision capacity test to provide the ability of service to external user for testing cloud service platform.
The detailed process of virtualizing performance test is:
Step one, log in cloud service platform, by Controlling vertex to computing node request virtual machine;
Step 2, computing node start virtual machine according to the parameter configuration of request;
Step 3, test parameter is set according to the configuration of test event and virtual machine;
Step 4, the order of testing tool is become an automatic test script with the Command encapsulate of testing results instrument, and test script is uploaded on virtual machine;
Step 5, on a virtual machine testing results script are tested, and obtain test index.
The detailed process of resource management capacity test is:
Step one, cloud service platform send request according to test event to management node;
Step 2, management node are tested according to the corresponding test module of request call, carry out corresponding configuration to cloud service platform virtual machine simultaneously;
Step 3, acquisition test index, return management node.
Advantage of the present invention: the present invention is in conjunction with cloud service platform framework, cloud service platform method of testing is proposed, from three levels, performance test is carried out to cloud service platform, test the virtualizing performance of cloud service platform, resource management capacity and service provision capacity respectively, distinguish the virtual resource layer of corresponding cloud service platform, platform management layer and application service interface layer, be provided with multiple test event and corresponding test index respectively at each level.In the test process of each test event, the property indices of performance monitoring function to testing server of serviceability monitoring tools and cloud service platform is monitored simultaneously, obtains various performance parameter.The overall hierarchy of cloud service platform performance test methods as shown in Figure 2.
Accompanying drawing explanation
Fig. 1 is the framework map of cloud service platform;
Fig. 2 is the overall hierarchy schematic diagram of cloud service platform performance test methods;
Fig. 3 be in cloud service platform performance test methods service provision capacity test based on LoadRunner load testing Tool Framework FIGURE.
Embodiment
Embodiment one: present embodiment is described below in conjunction with Fig. 2, cloud service platform performance test methods described in present embodiment, described cloud service platform comprises service interface layer, platform management layer, virtual resource layer and physical resource layer, physical resource layer is the physical hardware of bottom, virtual resource layer is used for virtual for the physical resource of bottom, platform management layer is used for scheduling virtual machine, monitoring performance and management resource, and service interface layer is used for that the computing capability of cloud service platform is packaged into service interface and is supplied to external user;
Described cloud service platform performance test methods, this performance test methods is tested the service interface layer of cloud service platform, platform management layer and virtual resource layer; This method of testing comprises virtualizing performance test, resource management capacity test and service provision capacity test;
Virtualizing performance test is for testing the performance of the virtual resource of cloud service platform bottom;
Resource management capacity test is for testing the managerial ability of cloud service platform to virtual resource;
Service provision capacity test to provide the ability of service to external user for testing cloud service platform.
In present embodiment, physical resource layer represents the physical hardware of bottom, comprises computer, memory and the network facilities etc.; Virtual resource layer can provide resource rapidly, dynamically; Platform management layer is responsible for scheduling virtual machine, performance monitoring and Resource Management, and the virtual resource of management, scheduling lower floor is also for the application on upper strata provides support; The computing capability of cloud service platform is packaged into service interface by service interface layer, is supplied to outside user and uses.
Embodiment two: present embodiment is described further execution mode one, the detailed process of virtualizing performance test is:
Step one, log in cloud service platform, by Controlling vertex to computing node request virtual machine;
Step 2, computing node start virtual machine according to the parameter configuration of request;
Step 3, test parameter is set according to the configuration of test event and virtual machine;
Step 4, the order of testing tool is become an automatic test script with the Command encapsulate of testing results instrument, and test script is uploaded on virtual machine;
Step 5, on a virtual machine testing results script are tested, and obtain test index.
Embodiment three: present embodiment is described further execution mode two, the test event of described virtualizing performance test comprises virtual machine performance test, cluster virtual machine performance test and virtualizing performance loss test;
The content measurement of virtual machine performance test comprises processor performance test, applied in network performance test, internal memory performance test and disk performance test;
The test index of processor performance test is the computation-intensive task processing time; The test index of applied in network performance test is network delay and packet loss; The test index of internal memory performance test is memory bandwidth; The test index of disk performance test is disk read-write speed.
In present embodiment, cloud computing be virtual at all, in cloud service platform, by Intel Virtualization Technology, physical resource is abstracted into virtual resource and is supplied to user, the utilance of physical resource and the flexibility of utilization can be increased.But virtual is add a virtual management layer between physical hardware and VME operating system, will certainly affect to some extent performance, simultaneously due to the feature such as dynamic assignment, multiple users share of virtual resource, compared with physical platform, the Intel Virtualization Technology of cloud service platform may cause hydraulic performance decline to a certain degree and instability, therefore needs to test virtualizing performance.The test event of virtualizing performance test is as shown in table 1.
Table 1 virtualizing performance is tested
Virtual machine is the important representative of cloud service platform virtual resource.Virtual machine in cloud service platform both directly can be supplied to user as service item, also can as the underlying services device of cloud service for cloud service provides can the virtual resource of flexible utilization, it is necessary for therefore testing the performance of virtual machine.Mainly the following aspects is divided into the reference performance test of virtual machine:
Processor performance: processor performance reflects the speed of service, the operational capability that cloud service platform is supplied to the virtual instance of user, processor performance computing capability that is usual and virtual machine has very large relation.By moving calculation intensive procedure, the performance of the time evaluation processor tested.
Network performance: different virtual machine intercoms mutually needs high-quality network, also needs high-quality virtual machine network communication capacity when multiple virtual machine is finished the work jointly.Network performance is investigated from indexs such as network throughput, network delay, network jitter and data packetloss rates.
Internal memory performance: internal memory performance has a significant impact the speed that virtual machine performs various task.Internal memory performance is investigated by test memory bandwidth.
Disk performance: disk performance stores data, file read-write all has a great impact.By test, the order of the file of different size is read and write, the speed of random read-write investigates disk performance.
Embodiment four: present embodiment is described further execution mode two, the test event of described virtualizing performance test comprises virtual machine performance test, cluster virtual machine performance test and virtualizing performance loss test;
The content measurement of cluster virtual machine performance test comprises PC cluster performance test and trunking communication performance test;
The test index of PC cluster performance test is floating number computational speed; The test index of trunking communication performance test is cluster arithmetic speed.
In present embodiment, when processing a lot of large-scale task, needing multiple stage virtual machine to carry out common operational, therefore needing to test the overall performance of cluster virtual machine, this part tests the performance such as calculating, communication of main integration test cluster virtual machine, the arithmetic speed of test cluster.
Embodiment five: present embodiment is described further execution mode two, the test event of virtualizing performance test comprises virtual machine performance test, cluster virtual machine performance test and virtualizing performance loss test;
The content measurement of virtualizing performance loss test comprises the test with the performance gap of same configures physical machine;
Calculation task processing time, network transfer speeds, internal memory and disk read-write speed, Unixbench total score is comprised with the test index of the test of the performance gap of same configures physical machine.
In present embodiment, owing to there being the existence of Virtual Machine Manager layer in cloud service platform between physical resource layer and virtual resource layer, therefore compared with the physical machine configured on an equal basis, the performance of virtual machine has certain loss.This part test investigates the virtual performance loss that bring with the gap of physical machine mainly through the virtual machine of more identical configuration in processor performance, network performance etc.
Embodiment six: present embodiment is described further execution mode one, the detailed process of resource management capacity test is:
Step one, cloud service platform send request according to test event to management node;
Step 2, management node are tested according to the corresponding test module of request call, carry out corresponding configuration to cloud service platform virtual machine simultaneously;
Step 3, acquisition test index, return management node.
Embodiment seven: present embodiment is described further execution mode six, the test event of described resource management capacity test comprises the test of cloud service platform autgmentability, the test of virtual machine performance isolation, virtual machine performance stability test and virtual machine (vm) migration performance test;
The content measurement of cloud service platform autgmentability test comprises virtual resource and adds time test, automatic expansion test and virtual machine extension test;
The test index that virtual resource adds time test is the time that heat adds virtual hardware; The test index of automatic expansion test is from monitoring overload to the time of having expanded; The test index of virtual machine extension test is Unixbench total score.
Resource management capacity tests the platform management level of corresponding cloud service platform, the platform management layer of cloud service platform is responsible for dispatching the virtual resource of cloud service platform, managing, achieve the dynamic management to various cloud service platform resource, guarantee the distribution that resource is effective and reasonable and ensure that the service level of upper layer application, can produce a very large impact the performance of whole cloud service platform, therefore will test this part.The inner managerial ability to every resource of paper examines cloud service platform, test item is as shown in table 2:
Table 2 resource management capacity is tested
Cloud service platform autgmentability is tested: extensibility is a key character of cloud service platform, represent the feature of cloud service platform on-demand service, autgmentability reflects the extended capability of cloud service platform system scale and service, by test autgmentability, the performance condition of system under larger scale can be predicted.Because the scheduling mechanism of different cloud service platforms is different, the degree therefore affecting autgmentability is also each different.The autgmentability of cloud service platform can be embodied in many aspects, in the part of resource management capacity test, and main test several aspect below:
Virtual resource adds the time: test increases or reduce the time that resource consumes, as added a virtual machine or adding the virtual resource such as CPU, the internal memory time used to existing virtual machine.
Automatic expansion: when the overload that virtual machine runs, cloud service platform can be that the virtual machine of user increases resource automatically, and this is the one embodiment of cloud service platform resilient expansion ability.Automatic expansion has two kinds of modes, and one upwards expands (scale up), and the resource (such as increase virutal machine memory capacity, increase core cpu number etc.) referred to by increasing single virtual machine is expanded; Another kind is to external expansion (scale out), referring to the number by increasing virtual machine, the average load of each virtual machine being reduced, reaches the object of resource expansion with this.To the test of automatic expansion time, the time that paper examines terminates from overload (certain index of setting in advance reaches threshold value) to expansion.
Virtual machine extension: virtual machine extension test paper examines two aspects, one is whether test single virtual machine can obtain corresponding performance boost by resource; Another is the virtual machine quantity that test increases cluster, and whether the performance of cluster has corresponding lifting.
Embodiment eight: present embodiment is described further execution mode six, described test event comprises the test of cloud service platform autgmentability, the test of virtual machine performance isolation, virtual machine performance stability test and virtual machine (vm) migration performance test;
The content measurement of virtual machine performance isolation test comprises the test of computing power isolation, the test of network performance isolation and the test of memory property isolation, the test index of these three content measurements is identical, interferes with each other the calculation task processing time in situation, network transfer speeds and disk read-write speed for multiple virtual machine.
In present embodiment, virtual machine performance isolation: Intel Virtualization Technology achieves multiple virtual server and is incorporated into a physical host, and Same Physical machine can exist the different virtual machine of multiple user, improves the utilance of resource.But the various resources of multiple virtual machine meeting contention physical host, have impact to performance each other.Virtual machine performance isolation is exactly for evaluating this index affected each other.Mainly the following aspects is comprised to the test of virtual machine performance isolation:
Calculated performance isolation: the impact that the resources such as test virtual machine sharing CPU cause calculated performance.
Network performance isolation: impact during test virtual machine shared network, network service performance caused.
Memory property isolation: the impact on data memory property during test virtual machine shared storage device.
Embodiment nine: present embodiment is described further execution mode six, described test event comprises the test of cloud service platform autgmentability, the test of virtual machine performance isolation, virtual machine performance stability test and virtual machine (vm) migration performance test;
The content measurement of virtual machine performance stability test comprises computing power stability test, network performance stability test and memory property stability test;
The test index of computing power stability test is the calculation task processing time; Network performance stability test is network transfer speeds; Memory property stability test is disk read-write speed.
In present embodiment, virtual machine performance stability: different from traditional physical server, because the resource on cloud service platform is shared by multiple user, and virtual resource is in dynamic change, the performance of virtual server may have unstable place, and from user perspective, yes wishes that the performance of virtual machine can reach stable.Virtual machine performance stability mainly refers to the performance inconsistency situation of virtual machine under the pressure condition keeping higher in the long period.The following content of this part test paper examines:
Calculated performance stability: test virtual machine stability of calculated performance during moving calculation intensive procedure within one period of continuous time.
Network performance stability: the stability of testing the internal network communication performance between one section of continuous time virtual machine.
Memory property stability: test virtual machine stability of memory property during service data operations-intensive program within one period of continuous time.
Embodiment ten: present embodiment is described further execution mode six, described test event comprises the test of cloud service platform autgmentability, the test of virtual machine performance isolation, virtual machine performance stability test and virtual machine (vm) migration performance test;
The content measurement of virtual machine (vm) migration performance test comprises active migration performance test and automatic load balancing test;
The test index of active migration performance test is the virtual machine (vm) migration time; The test index of automatic load balancing test is from monitoring load imbalance heavily to the time of load balancing.
In present embodiment, virtual machine (vm) migration performance: virtual machine migration technology can realize the virtualization services across physical server, virtual machine can switch between different physical servers or physical store, can realize the high availability of cloud service platform based on migrating technology.The time performance of the dynamic migration operation of this part test paper examines virtual machine, so-called dynamic migration refers to and ensures that the business that virtual machine runs can not be interrupted by the virtual machine (vm) migration of running status to different physical platforms.The test of this part is divided into active migration to test and Autonomic Migration Framework test.
Performance when user independently carries out migration operation is investigated in active migration test, comprise following some:
Single virtual machine (vm) migration: investigate single virtual machine (non-loaded, computation-intensive load, data store intensive load) under different load conditions, stores in the difference of same host, performance that the shared storage of different main frame and the difference of different main frame are moved between storing.Time needed for main test migration operation.
Multi-dummy machine moves: consider the migration simultaneously of multiple virtual machine, the target of migration is Same Physical machine or storage.The migration performance of (non-loaded, computation-intensive load, data store intensive load) under answering contrast test different loads state during test.Time needed for main test migration operation.
Autonomic Migration Framework investigation cloud service platform carries out performance during virtual machine (vm) migration operation automatically, the following content of main test:
Automatic load balancing: so-called automatic load balancing, if refer to the virtual machine overload that the virtual machine that a certain physical host in cluster runs is too much or run, on physical host lighter for load in virtual machine (vm) migration to same cluster the automatic physical host heavy from load of cloud service platform meeting.User can arrange a threshold value, allows cloud service platform automatically start load balancing operation when reaching this threshold value.This part test paper examines cluster operates to completing automatic load balancing the time spent from monitoring laod unbalance.
Embodiment 11: present embodiment is described further execution mode one, service provision capacity test comprises service ability testing, service extension test and service stability test;
The test index of service ability testing is maximum concurrent user number, response time, number of transactions per second and service failure rate; The test index of service extension test is number of transactions per second; The test index of service stability test is the response time.
In present embodiment, three kinds of service modes of cloud service: IaaS, PaaS and SaaS are all inherently certain resource is served the most be supplied to user.From the angle of user, all functions that cloud service platform provides can be counted as a kind of service.Service provision capacity test is exactly the angle from user, investigates the performance of cloud service platform entirety.This part test event is as shown in table 3:
Table 3 service provision capacity is tested
Service ability: investigate the ability that cloud service platform can be met consumers' demand, investigate the service ability of cloud service platform from many aspects, comprise following index:
Maximum concurrent user number: the feature of cloud service platform is exactly multiple user's shared resources, what this part test was investigated is exactly the maximum calling party quantity that can carry of cloud service platform.
Response time: refer to a user from a certain service of application to the time obtained required for this service.The response time of cloud service platform service can be subject to various factors, and the system complexity of cloud service platform inside and the network service of data center are all the key factors affecting the response time.Response time is divided into maximum response time, Best-case Response Time, average response time and 90% transaction response time.
Number of transactions per second: the cloud service platform number of transactions that can process per second is more, illustrates that the service provision capacity of cloud service platform is stronger.The number of transactions of the number of transactions that number of transactions per second comprises submission per second, the number of transactions passed through and failure.
Service failure rate: failed number of transactions accounts for the ratio of total number of transactions.When concurrent user number increases, the component requests of user may be caused to lose efficacy due to reasons such as network congestion, service failure rate is exactly investigate the failure conditions of user's request under different loading conditions.
Service extension: from the autgmentability providing the angle of service to investigate cloud service platform.Cloud service platform can allow multiple concurrent user to access simultaneously, but may decline to some extent along with the performance of the increase cloud service platform service of number of users.The increase of this part test paper examines concurrent user quantity is on the impact of cloud service platform performance.
Service stability: due to cloud service platform resource virtualizing, serve by features such as network provide, the stability of service is the performance index that cloud service platform user is particularly concerned about.This part test paper examines cloud service platform provides the stability of service within one period of continuous time.
In the present invention, the realization of testing tool and testing tool is as follows:
1, for the test of virtualizing performance, mainly utilize various testing tool, by a series of benchmark test, measure the performance of virtualized each side from the result of test.Tester's initial landing cloud service platform, by Controlling vertex to computing node request virtual machine.Computing node can start virtual machine according to the parameter configuration of the requirement of tester.Tester arranges every test parameter according to the requirement of test and the configuring condition of virtual machine, afterwards the order disposing testing tool is become an automatic test script with the Command encapsulate of testing results instrument, is uploaded on virtual machine by test script.Testing results script is tested on a virtual machine.In test process, tester can the passage administration various performance parameters of performance monitoring tool to virtual machine on a virtual machine monitor in real time.
Virtualizing performance test for VMware platform and CloudStack platform mainly tests test event as shown in table 4.Corresponding different test event and different testing tools, write different test scripts.In order to ensure the correctness of testing, another test can not be run when running the test of a certain item simultaneously.
Table 4 virtualizing performance test event
The step of test has all been come by automatic test script, and the flow process in script is as follows:
Testing tool and necessary composing software is obtained from the http-server built in advance
Configure required translation and compiling environment, the composing softwares such as gcc, g++, gfortran are installed
Decompress(ion) Wireless Test Toolset also compiles installation
According to the parameter testing results of setting in advance, partial test can set circular flow repeatedly
Generate test result file
In the process of test, serviceability monitoring tools monitors the various performance parameters of virtual machine in real time.The utilization rate of paper examines CPU usage and internal memory, can be used for the loading condition judging virtual machine.The performance monitoring instrument Nmon released by installing and using IBM Corporation on virtual server monitors system, and cloud service platform also carries performance monitoring function to monitor cloud service platform physical host performance simultaneously.
The testing tool used in test is in this section as shown in table 5:
Table 5 virtualizing performance test suite
| Benchmark | Version | Content measurement |
| Sysbench | 0.4.1 | The computation-intensive task processing time |
| Netperf | 2.6.0 | Throughput, data transmission bauds etc. |
| Iperf | 3.0.1 | Network delay, network packet loss rate etc. |
| Stream | 5.10 | Memory bandwidth |
| Iozone | 3.42 | Disk read-write speed |
| HPL/Linpack | 2.1.0 | PC cluster performance/processor performance |
| NPB | 3.3 | PC cluster, communication performance |
| Unixbench | 5.1.2 | Virtual loss, virtual machine extension |
| Nmon | 14g | Systematic function is monitored |
(1) time required for all prime numbers within the Sysbench value N that certain pre-sets by measuring and calculation investigates calculated performance.
(2) Netperf is a kind of network service performance measurement tool, has two kinds of applied in network performance test patterns, and one is bulk data transfer pattern, and under this pattern, test client one-sidely can send data to service end; Another kind is request/answer-mode, client and service end can back and forth transmission of information to weigh the request/response performance of given packet size.
(3) Iperf is an applied in network performance test instrument, can postpone, shakes and the situation such as packet loss, the network bandwidth by test network.
(4) Stream carrys out the performance of test memory by copy, scale, add and triad tetra-kinds of operations.Utilize Stream can test out the memory bandwidth of sustainable operation.
(5) Iozone is a disk performance testing tool, the readwrite performance of disk in the operating system that available test is different.Iozone has multiple testing pattern, comprises the test patterns such as order is read/read again, sequential write/rewriting, random read/write.
(6) Linpack is international high-performance calculation performance test program, and adopt Gaussian elimination method to solve unitary N dense linear algebraic equation systems to evaluate the floating number computing capability of computer, HPL is the up-to-date parallel version of Linpack test program.
(7) NPB and HPL is equally international parallel computation benchmark.NPB is provided by NASA, and be the performance evaluating program in a scientific algorithm field, it is made up of 8 conventional scientific programs, and each test has 6 kinds of scales, and different scales test data set size used is different.
(8) Unixbench is the comprehensive testing tool of a test class Unix operating system performance, has multiple test event, comprises Whetstone and Execl Throughput.The test result of each result of testing and a baseline system compares by Unixbench, obtains an index value (index), and the index value of all items gathers and obtains a total test result.
2, for the test of cloud service platform resource management capacity, mainly through utilizing every management function of cloud service platform, different test scenes being set cloud service platform management, scheduling performance are tested.Design different test scenes according to different test target, then request is sent to management node.Management node, according to request, calls self corresponding functional module and operates, and configure accordingly cloud service platform virtual machine.The result of test can turn back to management node, and tester can check test result by login management node.In test process, the various performance parameters of cloud service platform can be monitored in real time by performance monitoring tool.
Resource management capacity on VMware platform and CloudStack platform tests the test event shown in main test chart 6.In each test event, write different automatic test scripts and various testing tool is performed by the test plan formulated in advance.In order to ensure the correctness of testing, another test can not be run when running the test of a certain item simultaneously.
The test of resource management capacity is used to the function of some cloud service platforms self, tested by the resource management capacity of certain module to cloud service platform calling the platform management layer of cloud service platform.
Table 6 resource management capacity is tested
For the test of resource management capacity, mainly utilize the management function of cloud service platform self, the performance under simultaneously using some load testing instruments to carry out test different types load.The testing tool used in test is in this section as shown in table 7.
Sysbench is when carrying out cpu test, and increasing calculating scale can produce higher load to CPU.Netperf can produce a large amount of Internet Transmissions and produce load to network.Memtester is a memory pressure testing tool, by carry out XOR, with or, arithmetic etc. internally deposits into row pressure test, can reach very high memory usage.Iozone can test disk performance, while test, have very high disk utilization rate, can as the loading tool of disk.Nmon is the performance monitoring tool that IBM releases, and itself takies resource few, can check the service condition of the CPU of system, internal memory, disk etc.
Table 7 resource management capacity test suite
| Benchmark | Version | Content measurement |
| Sysbench | 0.4.1 | Produce load |
| Linpack | 2.1.0 | Test floating number computational speed |
| Netperf | 2.6.0 | Produce load, testing characteristics of network |
| Memtester | 4.2.2 | Produce load |
| Iozone | 5.10 | Produce load, test disk speed |
| Nmon | 14g | Systematic function is monitored |
3, in order to test the service provision capacity of dissimilar cloud service platform, need a kind of widely applicable, hardware requirement is lower, can represent typical cloud service platform service and can the testing tool of Reality simulation offered load.
LoadRunner can the behavior of analog subscriber, and implement large-scale concurrent load to goal systems, can also monitor in real time system, be the performance testing tool of all extensive application in worldwide simultaneously.Therefore the present invention's a set of cloud service platform load testing instrument that utilized LoadRunner to design and Implement.This testing tool uses LoadRunner as load generating means, the distributed search system based on SOA of independent development is as goal systems, utilize LoadRunner Analysis and cloud service platform performance monitoring function as transacter, effectively can carry out load testing to the service of cloud service platform.
Cloud service platform load testing instrument based on LoadRunner is that an operating load drives, the performance testing tool of cloud service-oriented platform service performance.The assembly of this testing tool can be divided into load generation module, goal systems and data collection module, and overall Organization Chart as shown in Figure 3.
Workload generation module is realized by LoadRunner testing software, can produce different scales, the operating load of dynamic change.LoadRunner utilizes Virtual User generator (VuGen) catch customer service flow process and create automated performance testing script.LoadRunner control desk (Controller) Reality simulation creating environments test scene also arranges running load plan, and control load generator (Load Generator) produces the request establishment load of virtual client afterwards.The operation that virtual client performs is that the script created according to VuGen performs.
Data collection module collects the data of application performance situation test run process and resources of virtual machine utilization power from load generation client and cloud service platform virtual machine service end.In client, the Analysis test result analysis device that data collection module is carried by LoadRunner realizes, and it can be preserved the execution result of test scene and automatically generate relevant test result chart.In cloud server terminal, the powerful performance monitoring instrument utilizing cloud service platform to carry, can to the performance index of host's physical server of virtual server and virtual machine, the utilization rate etc. of such as CPU and internal memory is monitored, the load state of display current service end.
Goal systems adopts the distributed search system based on SOA framework to realize.Goal systems is built on cloud service platform, and LoadRunner investigates the service provision capacity of cloud computing platform by simulating a large amount of Virtual User access destination system.
The workflow of whole testing tool is as follows: goal systems built on the virtual server of cloud service platform, and imports test data to back end.Use VuGen Reality simulation user behavior to create test script at load generation module, Controller formulates load testing plan and control Load Generator generating virtual user tests goal systems.In data collection module, the performance index of cloud service platform performance monitoring tool to server are monitored in real time, and Analysis collects test result, and generate test resolution preservation.
Cloud service platform load testing instrument based on LoadRunner has multifrequency nature: possess high efficiency, can utilize client resource efficiently, load is directly acted on goal systems; Possess the property monitored, correctly can reflect the soft and hardware performance of target cloud service platform; Be convenient to transplant, goal systems is deployed in cloud service platform virtual environment, can transplant between identical hypervisor; High concurrency, LoadRunner can simulate the concurrent operations of user up to ten thousand, produces a large amount of loads.Owing to having these characteristics, the very applicable service provision capacity to cloud service platform of cloud service platform load testing instrument based on LoadRunner is tested.
Claims (6)
1. cloud service platform performance test methods, described cloud service platform comprises service interface layer, platform management layer, virtual resource layer and physical resource layer, physical resource layer is the physical hardware of bottom, virtual resource layer is used for virtual for the physical resource of bottom, platform management layer is used for scheduling virtual machine, monitoring performance and management resource, and service interface layer is used for that the computing capability of cloud service platform is packaged into service interface and is supplied to external user;
Described cloud service platform performance test methods, is characterized in that, this performance test methods is tested the service interface layer of cloud service platform, platform management layer and virtual resource layer; This method of testing comprises virtualizing performance test, resource management capacity test and service provision capacity test;
Virtualizing performance test is for testing the performance of the virtual resource of cloud service platform bottom;
Resource management capacity test is for testing the managerial ability of cloud service platform to virtual resource;
Service provision capacity test to provide the ability of service to external user for testing cloud service platform.
2. cloud service platform performance test methods according to claim 1, is characterized in that, the detailed process of virtualizing performance test is:
Step one, log in cloud service platform, by Controlling vertex to computing node request virtual machine;
Step 2, computing node start virtual machine according to the parameter configuration of request;
Step 3, test parameter is set according to the configuration of test event and virtual machine;
Step 4, the order of testing tool is become an automatic test script with the Command encapsulate of testing results instrument, and test script is uploaded on virtual machine;
Step 5, on a virtual machine testing results script are tested, and obtain test index.
3. cloud service platform performance test methods according to claim 2, is characterized in that, the test event of described virtualizing performance test comprises virtual machine performance test, cluster virtual machine performance test and virtualizing performance loss test;
The content measurement of virtual machine performance test comprises processor performance test, applied in network performance test, internal memory performance test and disk performance test; The test index of processor performance test is the computation-intensive task processing time; The test index of applied in network performance test is network delay and packet loss; The test index of internal memory performance test is memory bandwidth; The test index of disk performance test is disk read-write speed;
The content measurement of cluster virtual machine performance test comprises PC cluster performance test and trunking communication performance test; The test index of PC cluster performance test is floating number computational speed; The test index of trunking communication performance test is cluster arithmetic speed.
4. cloud service platform performance test methods according to claim 1, is characterized in that, the detailed process of resource management capacity test is:
Step one, cloud service platform send request according to test event to management node;
Step 2, management node are tested according to the corresponding test module of request call, carry out corresponding configuration to cloud service platform virtual machine simultaneously;
Step 3, acquisition test index, return management node.
5. cloud service platform performance test methods according to claim 4, it is characterized in that, the test event of resource management capacity test comprises the test of cloud service platform autgmentability, the test of virtual machine performance isolation, virtual machine performance stability test and virtual machine (vm) migration performance test;
The content measurement of virtual machine performance isolation test comprises the test of computing power isolation, the test of network performance isolation and the test of memory property isolation, the test index of these three content measurements is identical, interferes with each other the calculation task processing time in situation, network transfer speeds and disk read-write speed for multiple virtual machine;
The content measurement of virtual machine performance stability test comprises computing power stability test, network performance stability test and memory property stability test; The test index of computing power stability test is the calculation task processing time; Network performance stability test is network transfer speeds; Memory property stability test is disk read-write speed;
The content measurement of virtual machine (vm) migration performance test comprises active migration performance test and automatic load balancing test; The test index of active migration performance test is the virtual machine (vm) migration time; The test index of automatic load balancing test is from monitoring load imbalance heavily to the time of load balancing.
6. cloud service platform performance test methods according to claim 1, is characterized in that, service provision capacity test comprises service ability testing, service extension test and service stability test;
The test index of service ability testing is maximum concurrent user number, response time, number of transactions per second and service failure rate; The test index of service extension test is number of transactions per second; The test index of service stability test is the response time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410614010.4A CN104333488B (en) | 2014-11-04 | 2014-11-04 | Cloud service platform performance test methods |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410614010.4A CN104333488B (en) | 2014-11-04 | 2014-11-04 | Cloud service platform performance test methods |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104333488A true CN104333488A (en) | 2015-02-04 |
| CN104333488B CN104333488B (en) | 2017-06-20 |
Family
ID=52408146
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410614010.4A Active CN104333488B (en) | 2014-11-04 | 2014-11-04 | Cloud service platform performance test methods |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104333488B (en) |
Cited By (50)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104639402A (en) * | 2015-03-05 | 2015-05-20 | 浪潮电子信息产业股份有限公司 | Method for server cluster system network test |
| CN104735063A (en) * | 2015-03-11 | 2015-06-24 | 广东电子工业研究院有限公司 | Security evaluating and detecting method used for cloud infrastructure |
| CN104794058A (en) * | 2015-05-07 | 2015-07-22 | 合肥云中信息科技有限公司 | Testing method for cloud desktop virtual environment performance |
| CN105141473A (en) * | 2015-08-10 | 2015-12-09 | 机械工业仪器仪表综合技术经济研究所 | Method and system for evaluating communication reliability of online analytical instrument |
| CN105187269A (en) * | 2015-08-14 | 2015-12-23 | 上海交通大学 | Method for evaluating performances of cloud platform based on performance model |
| CN105281979A (en) * | 2015-10-29 | 2016-01-27 | 贵州电网有限责任公司电力调度控制中心 | Load test method for virtualization application platform |
| CN105357067A (en) * | 2015-10-14 | 2016-02-24 | 广州杰赛科技股份有限公司 | Test method and system for cloud platform |
| CN105446846A (en) * | 2015-11-30 | 2016-03-30 | 中电科华云信息技术有限公司 | Cloud desktop based performance test method |
| CN105630575A (en) * | 2015-12-23 | 2016-06-01 | 一兰云联科技股份有限公司 | Performance evaluation method aiming at KVM virtualization server |
| CN105847088A (en) * | 2016-05-18 | 2016-08-10 | 浪潮电子信息产业股份有限公司 | Virtual machine performance testing system based on cloud service |
| CN106445759A (en) * | 2016-10-28 | 2017-02-22 | 浪潮软件集团有限公司 | Universal cloud server testing method |
| CN107070981A (en) * | 2017-01-23 | 2017-08-18 | 努比亚技术有限公司 | The equipment collaboration control system and method for multiple terminals |
| CN107168880A (en) * | 2017-05-31 | 2017-09-15 | 中标软件有限公司 | Virtual machine method of testing and instrument |
| CN107220126A (en) * | 2017-05-27 | 2017-09-29 | 中国南方电网有限责任公司调峰调频发电公司 | X86 servers dynamic hard partitioning method, device, storage medium and computer equipment |
| CN107257290A (en) * | 2017-05-15 | 2017-10-17 | 中国电力科学研究院 | A kind of method of testing and system of open SOA Service-Oriented Architecture Baseds |
| CN107547261A (en) * | 2017-07-24 | 2018-01-05 | 华为技术有限公司 | Cloud platform performance test methods and device |
| CN107704370A (en) * | 2017-09-28 | 2018-02-16 | 四川长虹电器股份有限公司 | Affairs successful rate statistics method based on response time and the double dimensions of running status |
| CN107707663A (en) * | 2017-10-17 | 2018-02-16 | 长沙准光里电子科技有限公司 | A kind of virtual resources integration platform |
| CN107908512A (en) * | 2017-11-14 | 2018-04-13 | 郑州云海信息技术有限公司 | The test method and test device of a kind of disk performance |
| CN107979876A (en) * | 2017-11-16 | 2018-05-01 | 广州市百果园网络科技有限公司 | Data transmission method and terminal |
| CN108011779A (en) * | 2017-11-30 | 2018-05-08 | 四川长虹电器股份有限公司 | The test method of Cloud Server task throughput under limited resources supplIes |
| CN108696448A (en) * | 2018-08-16 | 2018-10-23 | 安徽云才信息技术有限公司 | A kind of service current limliting down method based on gateway SOA framework |
| CN108763042A (en) * | 2018-05-24 | 2018-11-06 | 广东睿江云计算股份有限公司 | A kind of Cloud Server performance data acquisition method and device based on python |
| CN108923997A (en) * | 2018-05-24 | 2018-11-30 | 广东睿江云计算股份有限公司 | A kind of cloud service node automatic test approach and device based on python |
| CN109302305A (en) * | 2018-08-08 | 2019-02-01 | 杭州安恒信息技术股份有限公司 | A kind of clustering performance test method based on industrial control system |
| CN109327553A (en) * | 2018-12-06 | 2019-02-12 | 郑州云海信息技术有限公司 | A kind of operation management system and method towards IaaS cloud platform |
| CN109491754A (en) * | 2017-09-12 | 2019-03-19 | 北京京东尚科信息技术有限公司 | The performance test methods and device of virtual server |
| CN109728938A (en) * | 2018-12-11 | 2019-05-07 | 国云科技股份有限公司 | A kind of method of assessment system service level |
| CN109800113A (en) * | 2018-12-29 | 2019-05-24 | 北京奇安信科技有限公司 | One kind being based on virtual platform performance test methods, system, equipment and medium |
| CN110247817A (en) * | 2019-05-13 | 2019-09-17 | 华中科技大学 | A kind of method and system that measurement virtual network function intersexuality can be interfered |
| CN110457197A (en) * | 2019-08-19 | 2019-11-15 | 中国工商银行股份有限公司 | Service test method, device, computer equipment and storage medium |
| WO2019237576A1 (en) * | 2018-06-13 | 2019-12-19 | 平安科技（深圳）有限公司 | Method and apparatus for verifying communication performance of virtual machine |
| CN110716875A (en) * | 2019-09-26 | 2020-01-21 | 北京计算机技术及应用研究所 | Concurrency test method based on feedback mechanism in domestic office environment |
| US10671508B2 (en) | 2014-09-25 | 2020-06-02 | Hewlett Packard Enterprise Development Lp | Testing a cloud service |
| CN111224848A (en) * | 2020-01-17 | 2020-06-02 | 腾讯科技（深圳）有限公司 | Network quality testing method, device, equipment and storage medium |
| CN111258867A (en) * | 2015-12-30 | 2020-06-09 | 华为技术有限公司 | Public cloud dial testing method and device |
| CN111382080A (en) * | 2020-03-16 | 2020-07-07 | 深圳市吉祥腾达科技有限公司 | Stability test method for equipment cloud management platform system |
| CN111447103A (en) * | 2020-03-09 | 2020-07-24 | 杭州海康威视系统技术有限公司 | Virtual device management system, electronic device, virtual device management method, and medium |
| CN111612373A (en) * | 2020-05-29 | 2020-09-01 | 杭州电子科技大学 | Public cloud system performance consistency adjusting method |
| US10838840B2 (en) | 2017-09-15 | 2020-11-17 | Hewlett Packard Enterprise Development Lp | Generating different workload types for cloud service testing |
| CN112162891A (en) * | 2020-10-14 | 2021-01-01 | 腾讯科技（深圳）有限公司 | Performance test method in server cluster and related equipment |
| CN112346977A (en) * | 2020-11-10 | 2021-02-09 | 中国信息通信研究院 | Quantum cloud computing platform software function evaluation method and device |
| CN112579399A (en) * | 2020-12-28 | 2021-03-30 | 上海蓝云网络科技有限公司 | Cloud service testing method and device, electronic equipment and computer storage medium |
| CN113434281A (en) * | 2021-07-19 | 2021-09-24 | 上海幻电信息科技有限公司 | Equipment scheduling method and cloud platform |
| CN113507399A (en) * | 2021-07-09 | 2021-10-15 | 西安电子科技大学 | Network performance evaluation device and method for different levels of cloud platform |
| CN113609027A (en) * | 2021-08-31 | 2021-11-05 | 北京百度网讯科技有限公司 | ARM cloud server testing method and device, electronic equipment and storage medium |
| CN113656161A (en) * | 2021-08-17 | 2021-11-16 | 中正信评(深圳)技术服务有限公司 | Method, device and system for scheduling pressure generation service in performance test |
| CN114070754A (en) * | 2021-11-15 | 2022-02-18 | 迈普通信技术股份有限公司 | Method and system for testing migration performance of virtual machine in Overlay network |
| CN114257527A (en) * | 2021-11-01 | 2022-03-29 | 北京思特奇信息技术股份有限公司 | Network bearing capacity estimation method |
| CN115277471A (en) * | 2022-08-01 | 2022-11-01 | 珠海金山数字网络科技有限公司 | Index monitoring method, system and device and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101969475A (en) * | 2010-11-15 | 2011-02-09 | 张军 | Business data controllable distribution and fusion application system based on cloud computing |
| CN101986280A (en) * | 2010-11-29 | 2011-03-16 | 浙江大学 | Automatic testing platform for virtual computing system |
| WO2013006708A1 (en) * | 2011-07-07 | 2013-01-10 | Vce Company, Llc | System of automatic monitoring of a physical computing platform and just- in-time allocation of resources |
-
2014
- 2014-11-04 CN CN201410614010.4A patent/CN104333488B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101969475A (en) * | 2010-11-15 | 2011-02-09 | 张军 | Business data controllable distribution and fusion application system based on cloud computing |
| CN101986280A (en) * | 2010-11-29 | 2011-03-16 | 浙江大学 | Automatic testing platform for virtual computing system |
| WO2013006708A1 (en) * | 2011-07-07 | 2013-01-10 | Vce Company, Llc | System of automatic monitoring of a physical computing platform and just- in-time allocation of resources |
Cited By (67)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10671508B2 (en) | 2014-09-25 | 2020-06-02 | Hewlett Packard Enterprise Development Lp | Testing a cloud service |
| CN104639402A (en) * | 2015-03-05 | 2015-05-20 | 浪潮电子信息产业股份有限公司 | Method for server cluster system network test |
| CN104735063A (en) * | 2015-03-11 | 2015-06-24 | 广东电子工业研究院有限公司 | Security evaluating and detecting method used for cloud infrastructure |
| CN104735063B (en) * | 2015-03-11 | 2018-01-02 | 广东电子工业研究院有限公司 | A kind of safe evaluating method for cloud infrastructure |
| CN104794058A (en) * | 2015-05-07 | 2015-07-22 | 合肥云中信息科技有限公司 | Testing method for cloud desktop virtual environment performance |
| CN104794058B (en) * | 2015-05-07 | 2017-10-10 | 合肥中科云巢科技有限公司 | A kind of method of testing of cloud desktop virtual environments performance |
| CN105141473B (en) * | 2015-08-10 | 2018-08-24 | 机械工业仪器仪表综合技术经济研究所 | A kind of online analytical instrument communication reliability evaluating method and system |
| CN105141473A (en) * | 2015-08-10 | 2015-12-09 | 机械工业仪器仪表综合技术经济研究所 | Method and system for evaluating communication reliability of online analytical instrument |
| CN105187269A (en) * | 2015-08-14 | 2015-12-23 | 上海交通大学 | Method for evaluating performances of cloud platform based on performance model |
| CN105357067A (en) * | 2015-10-14 | 2016-02-24 | 广州杰赛科技股份有限公司 | Test method and system for cloud platform |
| CN105281979A (en) * | 2015-10-29 | 2016-01-27 | 贵州电网有限责任公司电力调度控制中心 | Load test method for virtualization application platform |
| CN105446846A (en) * | 2015-11-30 | 2016-03-30 | 中电科华云信息技术有限公司 | Cloud desktop based performance test method |
| CN105446846B (en) * | 2015-11-30 | 2018-07-10 | 中电科华云信息技术有限公司 | Performance test methods based on cloud desktop |
| CN105630575A (en) * | 2015-12-23 | 2016-06-01 | 一兰云联科技股份有限公司 | Performance evaluation method aiming at KVM virtualization server |
| CN105630575B (en) * | 2015-12-23 | 2019-02-15 | 兰雨晴 | For the performance estimating method of KVM virtualization server |
| CN111258867B (en) * | 2015-12-30 | 2022-04-22 | 华为技术有限公司 | Public cloud dial testing method and device |
| CN111258867A (en) * | 2015-12-30 | 2020-06-09 | 华为技术有限公司 | Public cloud dial testing method and device |
| CN105847088A (en) * | 2016-05-18 | 2016-08-10 | 浪潮电子信息产业股份有限公司 | Virtual machine performance testing system based on cloud service |
| CN106445759A (en) * | 2016-10-28 | 2017-02-22 | 浪潮软件集团有限公司 | Universal cloud server testing method |
| CN107070981A (en) * | 2017-01-23 | 2017-08-18 | 努比亚技术有限公司 | The equipment collaboration control system and method for multiple terminals |
| CN107070981B (en) * | 2017-01-23 | 2020-02-04 | 努比亚技术有限公司 | Multi-terminal equipment cooperative control system and method |
| CN107257290A (en) * | 2017-05-15 | 2017-10-17 | 中国电力科学研究院 | A kind of method of testing and system of open SOA Service-Oriented Architecture Baseds |
| CN107220126A (en) * | 2017-05-27 | 2017-09-29 | 中国南方电网有限责任公司调峰调频发电公司 | X86 servers dynamic hard partitioning method, device, storage medium and computer equipment |
| CN107168880A (en) * | 2017-05-31 | 2017-09-15 | 中标软件有限公司 | Virtual machine method of testing and instrument |
| CN107547261A (en) * | 2017-07-24 | 2018-01-05 | 华为技术有限公司 | Cloud platform performance test methods and device |
| CN107547261B (en) * | 2017-07-24 | 2020-10-27 | 华为技术有限公司 | Cloud platform performance test method and device |
| CN109491754A (en) * | 2017-09-12 | 2019-03-19 | 北京京东尚科信息技术有限公司 | The performance test methods and device of virtual server |
| US10838840B2 (en) | 2017-09-15 | 2020-11-17 | Hewlett Packard Enterprise Development Lp | Generating different workload types for cloud service testing |
| CN107704370A (en) * | 2017-09-28 | 2018-02-16 | 四川长虹电器股份有限公司 | Affairs successful rate statistics method based on response time and the double dimensions of running status |
| CN107707663A (en) * | 2017-10-17 | 2018-02-16 | 长沙准光里电子科技有限公司 | A kind of virtual resources integration platform |
| CN107908512A (en) * | 2017-11-14 | 2018-04-13 | 郑州云海信息技术有限公司 | The test method and test device of a kind of disk performance |
| CN107979876A (en) * | 2017-11-16 | 2018-05-01 | 广州市百果园网络科技有限公司 | Data transmission method and terminal |
| CN108011779A (en) * | 2017-11-30 | 2018-05-08 | 四川长虹电器股份有限公司 | The test method of Cloud Server task throughput under limited resources supplIes |
| CN108923997A (en) * | 2018-05-24 | 2018-11-30 | 广东睿江云计算股份有限公司 | A kind of cloud service node automatic test approach and device based on python |
| CN108763042A (en) * | 2018-05-24 | 2018-11-06 | 广东睿江云计算股份有限公司 | A kind of Cloud Server performance data acquisition method and device based on python |
| CN108923997B (en) * | 2018-05-24 | 2021-07-20 | 广东睿江云计算股份有限公司 | Cloud service node automatic testing method and device based on python |
| WO2019237576A1 (en) * | 2018-06-13 | 2019-12-19 | 平安科技（深圳）有限公司 | Method and apparatus for verifying communication performance of virtual machine |
| CN109302305A (en) * | 2018-08-08 | 2019-02-01 | 杭州安恒信息技术股份有限公司 | A kind of clustering performance test method based on industrial control system |
| CN108696448B (en) * | 2018-08-16 | 2021-07-23 | 安徽云才信息技术有限公司 | Service current limiting degradation method based on gateway SOA architecture |
| CN108696448A (en) * | 2018-08-16 | 2018-10-23 | 安徽云才信息技术有限公司 | A kind of service current limliting down method based on gateway SOA framework |
| CN109327553A (en) * | 2018-12-06 | 2019-02-12 | 郑州云海信息技术有限公司 | A kind of operation management system and method towards IaaS cloud platform |
| CN109728938A (en) * | 2018-12-11 | 2019-05-07 | 国云科技股份有限公司 | A kind of method of assessment system service level |
| CN109800113A (en) * | 2018-12-29 | 2019-05-24 | 北京奇安信科技有限公司 | One kind being based on virtual platform performance test methods, system, equipment and medium |
| CN110247817B (en) * | 2019-05-13 | 2021-02-12 | 华中科技大学 | Method and system for measuring performance interference between virtual network functions |
| CN110247817A (en) * | 2019-05-13 | 2019-09-17 | 华中科技大学 | A kind of method and system that measurement virtual network function intersexuality can be interfered |
| CN110457197B (en) * | 2019-08-19 | 2023-05-09 | 中国工商银行股份有限公司 | Service testing method, device, computer equipment and storage medium |
| CN110457197A (en) * | 2019-08-19 | 2019-11-15 | 中国工商银行股份有限公司 | Service test method, device, computer equipment and storage medium |
| CN110716875A (en) * | 2019-09-26 | 2020-01-21 | 北京计算机技术及应用研究所 | Concurrency test method based on feedback mechanism in domestic office environment |
| CN111224848A (en) * | 2020-01-17 | 2020-06-02 | 腾讯科技（深圳）有限公司 | Network quality testing method, device, equipment and storage medium |
| CN111224848B (en) * | 2020-01-17 | 2022-04-01 | 腾讯科技（深圳）有限公司 | Network quality testing method, device, equipment and storage medium |
| CN111447103B (en) * | 2020-03-09 | 2022-01-28 | 杭州海康威视系统技术有限公司 | Virtual device management system, electronic device, virtual device management method, and medium |
| CN111447103A (en) * | 2020-03-09 | 2020-07-24 | 杭州海康威视系统技术有限公司 | Virtual device management system, electronic device, virtual device management method, and medium |
| CN111382080A (en) * | 2020-03-16 | 2020-07-07 | 深圳市吉祥腾达科技有限公司 | Stability test method for equipment cloud management platform system |
| CN111612373B (en) * | 2020-05-29 | 2023-06-30 | 杭州电子科技大学 | Public cloud system performance consistency adjustment method |
| CN111612373A (en) * | 2020-05-29 | 2020-09-01 | 杭州电子科技大学 | Public cloud system performance consistency adjusting method |
| CN112162891A (en) * | 2020-10-14 | 2021-01-01 | 腾讯科技（深圳）有限公司 | Performance test method in server cluster and related equipment |
| CN112346977A (en) * | 2020-11-10 | 2021-02-09 | 中国信息通信研究院 | Quantum cloud computing platform software function evaluation method and device |
| CN112579399A (en) * | 2020-12-28 | 2021-03-30 | 上海蓝云网络科技有限公司 | Cloud service testing method and device, electronic equipment and computer storage medium |
| CN112579399B (en) * | 2020-12-28 | 2024-04-09 | 上海蓝云网络科技有限公司 | Cloud service testing method and device, electronic equipment and computer storage medium |
| CN113507399A (en) * | 2021-07-09 | 2021-10-15 | 西安电子科技大学 | Network performance evaluation device and method for different levels of cloud platform |
| CN113434281A (en) * | 2021-07-19 | 2021-09-24 | 上海幻电信息科技有限公司 | Equipment scheduling method and cloud platform |
| CN113656161A (en) * | 2021-08-17 | 2021-11-16 | 中正信评(深圳)技术服务有限公司 | Method, device and system for scheduling pressure generation service in performance test |
| CN113609027A (en) * | 2021-08-31 | 2021-11-05 | 北京百度网讯科技有限公司 | ARM cloud server testing method and device, electronic equipment and storage medium |
| CN114257527A (en) * | 2021-11-01 | 2022-03-29 | 北京思特奇信息技术股份有限公司 | Network bearing capacity estimation method |
| CN114257527B (en) * | 2021-11-01 | 2024-02-02 | 北京思特奇信息技术股份有限公司 | Network bearing capacity estimation method |
| CN114070754A (en) * | 2021-11-15 | 2022-02-18 | 迈普通信技术股份有限公司 | Method and system for testing migration performance of virtual machine in Overlay network |
| CN115277471A (en) * | 2022-08-01 | 2022-11-01 | 珠海金山数字网络科技有限公司 | Index monitoring method, system and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104333488B (en) | 2017-06-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104333488A (en) | Cloud service platform performance test method | |
| Grozev et al. | Performance modelling and simulation of three-tier applications in cloud and multi-cloud environments | |
| Liu et al. | Performance and energy modeling for live migration of virtual machines | |
| Apparao et al. | Characterization & analysis of a server consolidation benchmark | |
| US8424059B2 (en) | Calculating multi-tenancy resource requirements and automated tenant dynamic placement in a multi-tenant shared environment | |
| Li et al. | {CloudCmp}: Shopping for a Cloud Made Easy | |
| US10977086B2 (en) | Workload placement and balancing within a containerized infrastructure | |
| US8332847B1 (en) | Validating manual virtual machine migration | |
| Sudevalayam et al. | Affinity-aware modeling of cpu usage for provisioning virtualized applications | |
| Roytman et al. | {PACMan}: Performance Aware Virtual Machine Consolidation | |
| US9154366B1 (en) | Server maintenance modeling in cloud computing | |
| Sinha et al. | Comparison of various cloud simulation tools available in cloud computing | |
| US9888063B2 (en) | Combining application and data tiers on different platforms to create workload distribution recommendations | |
| JP2016103179A (en) | Allocation method for computer resource and computer system | |
| Lu et al. | vhaul: Towards optimal scheduling of live multi-vm migration for multi-tier applications | |
| Mehrotra et al. | Performance evaluation of Amazon elastic compute cloud for NASA high‐performance computing applications | |
| Ludwig et al. | Optimizing multi‐tier application performance with interference and affinity‐aware placement algorithms | |
| AU2021104528A4 (en) | Task scheduling and load balancing in cloud computing using firefly algorithm | |
| Pons et al. | Cloud white: Detecting and estimating qos degradation of latency-critical workloads in the public cloud | |
| Boza et al. | A case for performance-aware deployment of containers | |
| Lloyd et al. | Dynamic scaling for service oriented applications: implications of virtual machine placement on IaaS clouds | |
| US20210286647A1 (en) | Embedded persistent queue | |
| Bond et al. | Profiling the performance of virtualized databases with the TPCx-V benchmark | |
| Sridharan | A performance comparison of hypervisors for cloud computing | |
| Popiolek et al. | Monitoring and analysis of performance impact in virtualized environments |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |