CN113760672A - Performance test method, equipment and storage medium for multi-cloud platform resources - Google Patents

Performance test method, equipment and storage medium for multi-cloud platform resources Download PDF

Info

Publication number
CN113760672A
CN113760672A CN202011289195.8A CN202011289195A CN113760672A CN 113760672 A CN113760672 A CN 113760672A CN 202011289195 A CN202011289195 A CN 202011289195A CN 113760672 A CN113760672 A CN 113760672A
Authority
CN
China
Prior art keywords
target
resources
tested
test
cloud
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011289195.8A
Other languages
Chinese (zh)
Inventor
刘辰
白石
韩志鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Wodong Tianjun Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Wodong Tianjun Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Wodong Tianjun Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Priority to CN202011289195.8A priority Critical patent/CN113760672A/en
Publication of CN113760672A publication Critical patent/CN113760672A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466—Performance evaluation by tracing or monitoring
    • G06F11/3495—Performance evaluation by tracing or monitoring for systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3688—Test management for test execution, e.g. scheduling of test suites

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The embodiment of the invention provides a method, equipment and a storage medium for testing the performance of a multi-cloud platform resource, wherein a preset test program is respectively sent to target resources on a plurality of cloud platforms to be tested; respectively sending a test starting instruction to a plurality of cloud platforms to be tested at a preset test starting moment so as to enable a preset test program to run on target resources on each of the plurality of cloud platforms to be tested; acquiring an operation result of a preset test program from target resources on a plurality of cloud platforms to be tested; and acquiring target performance parameters corresponding to a plurality of cloud platforms to be tested according to the operation result. According to the embodiment of the invention, the real target performance parameters corresponding to the plurality of cloud platforms to be tested are finally obtained by synchronously testing the target resources of the plurality of cloud platforms to be tested, so that a user can accurately know and compare the performance of each cloud platform resource, and the user can be guided to effectively adjust the cloud platform resources in a multi-cloud scene.

Description

Performance test method, equipment and storage medium for multi-cloud platform resources
Technical Field
The embodiment of the invention relates to the technical field of computers, in particular to a method and equipment for testing the performance of a multi-cloud platform resource and a storage medium.
Background
The multi-cloud technology is that a user can simultaneously own a plurality of cloud platforms, including public clouds, private clouds, proprietary clouds and the like provided by various suppliers, and the user can effectively organize and manage resources on the cloud platforms based on the amount of the resources purchased by the user and build a business system of the user on the resources. The multi-cloud technology has the advantages that the user does not need to be bound with any cloud platform supplier, and the problem that the whole service system fails due to the fact that a certain cloud platform fails is prevented. In addition, the business system is dispersed on a plurality of cloud platforms, so that users distributed in various places can be better served.
However, a plurality of different cloud platforms are introduced in the application of the multi-cloud technology, and the actual performance of resources in the different cloud platforms may be different, so that a user cannot accurately know the actual performance of the purchased cloud platform resources, and the user cannot timely and effectively adjust the cloud resources when using the cloud resources.
Disclosure of Invention
The embodiment of the invention provides a method, equipment and a storage medium for testing the performance of a multi-cloud platform resource, which are used for accurately obtaining the performance parameters of each cloud platform in a multi-cloud scene so as to guide a user to effectively adjust the cloud platform resource in the multi-cloud scene.
In a first aspect, an embodiment of the present invention provides a method for testing performance of a resource on a cloud platform, including:
respectively sending a preset test program to target resources on a plurality of cloud platforms to be tested;
at a preset test starting moment, respectively sending a test starting instruction to the plurality of cloud platforms to be tested so as to enable the preset test program to run on target resources on each of the plurality of cloud platforms to be tested;
acquiring the running results of the preset test programs from the target resources on the plurality of cloud platforms to be tested;
and acquiring target performance parameters corresponding to the plurality of cloud platforms to be tested according to the operation result.
In a second aspect, an embodiment of the present invention provides a device for testing performance of a multi-cloud platform resource, including:
the testing module is used for respectively sending a preset testing program to target resources on a plurality of cloud platforms to be tested; at a preset test starting moment, respectively sending a test starting instruction to the plurality of cloud platforms to be tested so as to enable the preset test program to run on target resources on each of the plurality of cloud platforms to be tested;
the acquisition module is used for acquiring the running results of the preset test programs from the target resources on the plurality of cloud platforms to be tested;
and the processing module is used for acquiring target performance parameters corresponding to the plurality of cloud platforms to be tested according to the operation result.
In a third aspect, an embodiment of the present invention provides a computer device, including: at least one processor; and a memory;
the memory stores computer-executable instructions;
the at least one processor executing the computer-executable instructions stored by the memory causes the at least one processor to perform the method of the first aspect.
In a fourth aspect, the present invention provides a computer-readable storage medium, in which computer-executable instructions are stored, and when the computer-executable instructions are executed by a processor, the method according to the first aspect is implemented.
According to the performance testing method, the performance testing equipment and the storage medium for the multi-cloud platform resources, which are provided by the embodiment of the invention, the preset testing program is respectively sent to the target resources on the multiple cloud platforms to be tested; at a preset test starting moment, respectively sending a test starting instruction to a plurality of cloud platforms to be tested so as to enable a preset test program to run on target resources on each of the plurality of cloud platforms to be tested; acquiring an operation result of a preset test program from target resources on a plurality of cloud platforms to be tested; and acquiring target performance parameters corresponding to a plurality of cloud platforms to be tested according to the operation result. According to the embodiment of the invention, the preset test program is operated on the target resources of the multiple cloud platforms to be tested, so that the multiple cloud platforms to be tested can be synchronously tested, the required real target performance parameters corresponding to the multiple cloud platforms to be tested are finally obtained, and the target performance parameters corresponding to the multiple cloud platforms to be tested can be displayed to the user, so that the user can accurately know and compare the performance of the cloud platform resources, and the user can be guided to effectively adjust the cloud platform resources in a multi-cloud scene.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a schematic application scenario diagram of a performance testing method for a multi-cloud platform resource according to an embodiment of the present invention;
fig. 2 is a flowchart of a method for testing performance of a resource on a multi-cloud platform according to an embodiment of the present invention;
fig. 3 is a flowchart of a method for testing performance of a resource on a multi-cloud platform according to another embodiment of the present invention;
fig. 4 is a flowchart of a method for testing performance of a resource on a multi-cloud platform according to another embodiment of the present invention;
fig. 5 is a flowchart of a method for testing performance of a resource on a multi-cloud platform according to another embodiment of the present invention;
fig. 6 is a block diagram of a performance testing apparatus for a multi-cloud platform resource according to an embodiment of the present invention;
fig. 7 is a block diagram of a computer device for executing a performance testing method for a resource of a multi-cloud platform according to an embodiment of the present invention.
With the foregoing drawings in mind, certain embodiments of the disclosure have been shown and described in more detail below. These drawings and written description are not intended to limit the scope of the disclosed concepts in any way, but rather to illustrate the concepts of the disclosure to those skilled in the art by reference to specific embodiments.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The existing multi-cloud technology application introduces a plurality of different cloud platforms, such as public cloud, private cloud, and proprietary cloud, etc., a user can effectively organize and manage IaaS (Infrastructure as a Service) and/or PaaS (Platform as a Service) resources on each cloud Platform based on the amount of resources purchased by the user, and build a business system on the user, and the actual performance of the resources in different cloud platforms may be different, for example, the performance of a cloud host stored in 2-core-4 GB of an a cloud Platform and the performance of a cloud host stored in 2-core-4 GB of a B cloud Platform may be different, because each cloud manufacturer may oversell or oversubscribe the resources to adapt to multiple scenarios. Therefore, it is very important for the user to accurately know the actual performance of the cloud platform resources purchased by the user, and accurate guidance can be provided for the use of the cloud resources.
In the prior art, due to the fact that the super-matching ratio and the scheduling strategy of a plurality of cloud platforms are different, the service flow born in different time periods is different, and the cloud platform supplier cannot disclose the relevant information of the cloud platforms to the outside in real time, so that a customer knows the resource performance of each cloud platform very opaque.
The user can obtain the performance of the cloud host of each different cloud platform provider through data published by a third-party platform such as IDC (Internet data center), but the performance data are not specific to the resources of the real user, often do not conform to the actual situation and do not have accurate reference value; in addition, the data of the third-party platform is not timely updated for the performance data of each cloud platform, may not be the current performance data of each cloud platform, and cannot guide the user to timely and effectively adjust the cloud platform resources in a multi-cloud scene.
In view of the above technical problems, embodiments of the present invention provide a method for testing performance of resources of a cloud platform, which may determine target resources on a plurality of cloud platforms to be tested in advance, and may also determine a preset test start time in advance, where the target resources and the preset test start time may be determined in a random manner or by using other strategies, and then send preset test programs to the target resources on the plurality of cloud platforms to be tested, respectively; at a preset test starting moment, respectively sending a test starting instruction to a plurality of cloud platforms to be tested, and controlling a preset test program to run on target resources on each of the plurality of cloud platforms to be tested; acquiring an operation result of a preset test program from target resources on a plurality of cloud platforms to be tested; and acquiring target performance parameters corresponding to the multiple cloud platforms to be tested according to the operation result, and displaying the target performance parameters corresponding to the multiple cloud platforms to be tested. According to the embodiment of the invention, the multiple cloud platforms to be tested are synchronously tested through the preset test program, the required target performance parameters corresponding to the multiple cloud platforms to be tested are obtained, and then the target performance parameters corresponding to the multiple cloud platforms to be tested can be displayed to the user, so that the user can accurately know and compare the performance of each cloud platform resource, and the user can be guided to effectively adjust the cloud platform resources in a multi-cloud scene.
The embodiment of the invention is suitable for the application scenario shown in fig. 1, and the application scenario comprises a plurality of cloud platforms to be tested, a multi-cloud management and control platform and a test platform. The multi-cloud management and control platform is in communication connection with the multiple cloud platforms to be tested and is used for managing and controlling the multiple cloud platforms in a unified mode to form unified interfaces and interfaces, and automatic management of all cloud platform resources in a multi-cloud environment is facilitated. The test platform is connected with the multi-cloud control platform, or the test platform can be deployed on the multi-cloud control platform and integrated with the multi-cloud control platform, and as a part of the multi-cloud control platform, the multi-cloud control platform interacts with the multiple cloud platforms to be tested, so that performance test on the multiple cloud platform resources to be tested is realized. The plurality of cloud platforms to be tested can include, but are not limited to, public clouds, private clouds, proprietary clouds, and the like.
Under the condition that the performance of the multi-cloud platform resources needs to be tested, the testing platform can respectively send preset testing programs to target resources on a plurality of cloud platforms to be tested; at a preset test starting moment, respectively sending a test starting instruction to a plurality of cloud platforms to be tested so as to enable a preset test program to run on target resources on each of the plurality of cloud platforms to be tested; acquiring an operation result of a preset test program from target resources on a plurality of cloud platforms to be tested; and acquiring target performance parameters corresponding to a plurality of cloud platforms to be tested according to the operation result. Optionally, the target performance parameters include, but are not limited to, at least one of: testing result data of a target testing project in the target resource, a first cost performance parameter of the target testing project, a second cost performance parameter corrected according to the fault condition of the target testing project and statistical result data of the fault condition of the target testing project; wherein the target test item comprises at least one of: computing resources, storage resources, network resources and PaaS layer resources in the target resources. The test platform sends a preset test program to target resources on the multiple cloud platforms to be tested respectively, sends a test starting instruction to the multiple cloud platforms to be tested respectively, and obtains an operation result of the preset test program from the target resources on the multiple cloud platforms to be tested, and interaction between the test platform and the multiple cloud platforms to be tested can be achieved through the multi-cloud management and control platform.
The test platform can also comprise a display unit which is used for displaying the target performance parameters corresponding to the cloud platforms to be tested, so that a user can visually compare the performance of the resources of the cloud platforms and effectively adjust the resources of the cloud platforms.
The following describes the technical solutions of the present invention and how to solve the above technical problems with specific embodiments. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present invention will be described below with reference to the accompanying drawings.
Fig. 2 is a flowchart of a performance testing method for a multi-cloud platform resource according to an embodiment of the present invention. The embodiment provides a method for testing the performance of a multi-cloud platform resource, which comprises the following specific steps:
s201, respectively sending the preset test programs to target resources on a plurality of cloud platforms to be tested.
In this embodiment, the plurality of cloud platforms to be tested may include IaaS resources and/or PaaS resources, where the IaaS resources may specifically include, but are not limited to, a service layer that provides computing, storage, and network services on the cloud platform, such as a cloud host, and the PaaS resources may specifically include, but are not limited to, a service layer that provides system development capability support services on the cloud platform, such as a database, a message queue, a cache, a big data platform, and the like.
When a plurality of cloud platforms to be tested need to be tested, target resources, such as computing resources, storage resources, network resources and the like for testing, can be created on the plurality of cloud platforms to be tested in advance, and then preset test programs are sent to the target resources on the cloud platforms to be tested respectively, so that the preset test programs can be run on the target resources. The preset test programs may include, but are not limited to, test programs for one or more of calculation, storage, and network service of the IaaS resource, test programs for PaaS resource, such as test programs for a database, test programs for a message queue, and the like.
More specifically, the target resource includes at least one of: the method comprises the following steps that computing resources, storage resources, network resources and PaaS layer resources can be realized according to the following strategies when target resources are established on a plurality of cloud platforms to be tested:
respectively selecting pre-established fixed resources on each cloud platform to be tested of the plurality of cloud platforms to be tested as target resources on the plurality of cloud platforms to be tested; or
Creating new resources on each cloud platform to be tested of the plurality of cloud platforms to be tested according to a preset specification to serve as target resources on the plurality of cloud platforms to be tested; or
Respectively randomly creating new resources from a resource pool on each cloud platform to be tested of the plurality of cloud platforms to be tested according to a random specification, and using the new resources as target resources on the plurality of cloud platforms to be tested;
if new resources need to be created randomly, new resource information including but not limited to specification parameters and regions, available areas, and subnet positions is generated randomly. And before each test, new resources can be created randomly again, the new resource information generated this time and the new resource information generated last time are independent events, and the generated new resource information can be different. Further, the time consumption, success state and the like of resource creation can be recorded.
In this embodiment, by temporarily creating the target resource before the test, it is possible to prevent each cloud platform from performing targeted performance adjustment for the resource performance test to cause inaccurate test, and randomly sampling the resource of the cloud platform to be tested through the creation process to ensure fairness of the test. Particularly, by adopting a mode of randomly creating new resources, the targeted performance adjustment of each cloud platform can be further avoided, and the fairness of the test can be better ensured.
Further, if the cloud platform only has IaaS resources, only target resources of the IaaS are created; if only PaaS resources exist in the cloud platform, only target resources of the PaaS are created; if the cloud platform has both IaaS resources and PaaS resources, target resources of the IaaS and target resources of the PaaS need to be created, wherein if the PaaS resources depend on the IaaS resources, the target resources of the IaaS are created first, and then the target resources of the PaaS are created, and if the PaaS resources depend on the IaaS resources, the order of creation of the target resources of the IaaS and creation of the target resources of the PaaS is not limited.
In addition, before the preset test program is respectively sent to the target resources on the multiple cloud platforms to be tested, whether the target resources are created completely or not can be checked, if not, the creation process of the target resources is carried out again, and the target resources which are not created successfully are created again; if all the creation is successful, the subsequent transmission of the preset test program and the subsequent test process can be executed.
It should be noted that, optionally, the creating of the target resource may be performed by the multi-cloud management and control platform, and the created target resource is recovered by the multi-cloud management and control platform after the performance test is completed.
S202, at a preset test starting moment, respectively sending a test starting instruction to the multiple cloud platforms to be tested so that the preset test program can run on the target resources on each of the multiple cloud platforms to be tested.
In this embodiment, in order to enable each cloud platform to be tested to perform performance testing synchronously, a test start instruction is sent to the multiple cloud platforms to be tested at a preset test start time, and each cloud platform to be tested controls a preset test program to run on a target resource according to the test start instruction. For example, if the cloud platform to be tested has a CPU, running a CPU performance test program; if the cloud platform to be tested is provided with a GPU cloud host and a GPU physical machine, operating a GPU performance testing program; if the storage system of the cloud platform to be tested has a Solid State Disk (SSD), the storage system performance test program can be run under two conditions of closing the cache of the Solid State Disk and opening the cache of the Solid State Disk; in addition, a network transmission performance test program can be operated to test the network transmission performance of the internal network and/or the external network; for the PaaS resources, a corresponding preset test program can be operated to test the performance of the PaaS resources.
When a plurality of cloud platforms to be tested need to be tested, a preset test starting time can be determined in advance, and then test starting instructions are sent to the plurality of cloud platforms to be tested respectively at the preset test starting time. When the preset test starting moment is determined, the method can be implemented according to the following strategies:
dividing the whole test time interval into a plurality of time periods; and selecting a fixed time or randomly selecting a time in each time period as the preset test starting time.
In this embodiment, the whole testing time interval may be T (for example, one day or one week), the whole testing time interval is divided into K segments (for example, each segment is 1 hour), and T and K are adjusted according to the actual requirements of the user, so that the selection of time meets the requirements of the user on performance evaluation of resources of the multi-cloud platform. Further, a preset test starting time can be determined in each time period, and the finally obtained target performance parameters can only represent performance parameters corresponding to the target resources on the multiple cloud platforms to be tested in each time period. Determining a preset test starting moment in a certain time period t, wherein a fixed moment can be selected in the time period, for example, at the 1 st second every 1 hour; of course, a random manner may also be adopted to select a time from the time period, and the randomly selected time in each time period may be the same or different.
In this embodiment, by temporarily determining the preset test start time, it is possible to prevent each cloud platform from performing targeted performance adjustment for resource performance test to cause inaccurate test, and randomly sampling resources of the cloud platform to be tested through the creation process to ensure fairness of the test. Especially, the preset test starting time is determined by adopting the random time, the performance adjustment of the pertinence of each cloud platform can be further avoided, and the test fairness can be better ensured. In this embodiment, a user can conveniently grasp the current real performance of each cloud platform to be tested in time through periodic retesting of a plurality of cloud platforms to be tested.
It should be noted that, for determining the preset test starting time and creating the target resource in the foregoing embodiment, the sequence of the two processes is not limited. As an optional embodiment, the preset test starting time may be determined first, and then the target resource may be created, or the target resource may be created after the preset test starting time is reached.
S203, obtaining the running result of the preset test program from the target resources on the plurality of cloud platforms to be tested.
In this embodiment, a preset test program is run on each of the target resources on the multiple cloud platforms to be tested, so that a running result of the preset test program can be obtained.
For example, for computing resources such as a CPU, a GPU, and the like, the running time and the running performance of a preset test program, such as the time taken to run a target operand, may be obtained; for storage resources such as a cloud hard disk, object storage, file storage, and the like, the running time and running performance of a preset test program, such as throughput and IOPS (Input/Output Operations Per Second, the number of times of performing read-write Operations Per Second), may be acquired; for network resources such as internet links, VPCs, peer-to-peer connections and the like, the running time and running performance of a preset test program, such as throughput and IOPS, can be acquired; however, for PaaS resources such as a database, a message queue, a cache, a big data platform, and the like, the running time and the running performance of the preset test program, such as the time for completing the target number of transactions, can be obtained. Of course, the operation result is not limited to the above example, and the corresponding operation result may be obtained according to the specific situation of the preset test program, which is not described in detail herein.
Optionally, in this embodiment, it may also be detected whether all the preset test programs have been completely run, and if there is a preset test program that has not been successfully run, the preset test program is run again to test the corresponding resource.
And S204, acquiring target performance parameters corresponding to the plurality of cloud platforms to be tested according to the operation result.
In this embodiment, after the operation result is obtained, the operation result may be processed to obtain target performance parameters corresponding to a plurality of cloud platforms to be tested, including but not limited to relevant parameters such as performance, stability, and function, the target performance parameters may visually reflect performances of computing resources, storage resources, network resources, PaaS layer resources, and the like of each cloud platform to be tested, and may measure actual technical values of various resources on the cloud platform for a user, so that the user may adjust the cloud platform resources according to a plurality of target performance parameters corresponding to the cloud platforms to be tested.
Optionally, the target performance parameters include, but are not limited to, at least one of: testing result data of a target testing project in the target resource, a first cost performance parameter of the target testing project, a second cost performance parameter corrected according to the fault condition of the target testing project and statistical result data of the fault condition of the target testing project; wherein the target test item comprises at least one of: and computing resources, storage resources, network resources and PaaS layer resources in the target resources.
Furthermore, after the target performance parameters corresponding to the multiple cloud platforms to be tested are obtained according to the operation result, the target performance parameters corresponding to the multiple cloud platforms to be tested can be displayed; and/or determining an adjustment strategy for cloud platform resources according to the target performance parameters corresponding to the multiple cloud platforms to be tested, for example, increasing the cloud platform resources with high use cost ratio and reducing the cloud platform resources with low use cost ratio.
In the performance testing method for the multi-cloud platform resources provided by the embodiment, the preset testing program is respectively sent to the target resources on the multiple cloud platforms to be tested; at a preset test starting moment, respectively sending a test starting instruction to a plurality of cloud platforms to be tested so as to enable a preset test program to run on target resources on each of the plurality of cloud platforms to be tested; acquiring an operation result of a preset test program from target resources on a plurality of cloud platforms to be tested; and acquiring target performance parameters corresponding to a plurality of cloud platforms to be tested according to the operation result. In the embodiment, the preset test program is run on the target resources of the multiple cloud platforms to be tested, so that the multiple cloud platforms to be tested can be synchronously tested, the required real target performance parameters corresponding to the multiple cloud platforms to be tested are finally obtained, and the target performance parameters corresponding to the multiple cloud platforms to be tested can be displayed to the user, so that the user can accurately know and compare the performance of the cloud platform resources, and the user can be guided to effectively adjust the cloud platform resources in a multi-cloud scene.
As a further refinement of the above embodiment, the target performance parameters include, but are not limited to, at least one of: testing result data of a target testing project in the target resource, a first cost performance parameter of the target testing project, a second cost performance parameter corrected according to the fault condition of the target testing project and statistical result data of the fault condition of the target testing project; wherein the target test item comprises at least one of: and computing resources, storage resources, network resources and PaaS layer resources in the target resources.
Further, as shown in fig. 3, in step S204, obtaining the target performance parameters corresponding to the multiple cloud platforms to be tested according to the operation result may specifically include:
s301, acquiring initial test result data of the target test item from the operation result;
s302, carrying out unified measurement unit on the initial test result data to obtain first test result data of the target test item;
s303, normalizing the first test result data to obtain second test result data of the target test item;
s304, taking the first test result data and/or the second test result data as the test result data of the target test item.
In this embodiment, only part of the data in the operation result is the data required for obtaining the target performance parameters, and the data required for different target test items are different, so that the data required for each target test item needs to be extracted from the operation result, and the data is used as the initial test result data of the target test item, for example, for the computing resources such as a CPU or a GPU, the initial test result data may include that k 8-bit operations are completed within t time, because the target resource specifications created by different cloud platforms may be different, the initial test result data needs to be uniformly metered, the different cloud platforms have comparability under the uniform standard, for example, for the computing resources such as the CPU or the GPU, the uniform metered units are performed by using the number of cores or other parameters, for example, the CPU in the target resources is 2 cores, and the k 8-bit operations are completed within t time, then, after the measurement units are unified, the single-core operation speed k/(t × 2) of the CPU can be obtained and used as first test result data of a target test item (CPU); while the capacity of resources such as storage, network, etc. is measured in terms of throughput and IOPS. PaaS resources such as a database instance and the like are also uniformly measured according to the number of CPU cores, for example, if a database instance with 4 cores and 8GB memory completes k transactions within t time, the PaaS resources are measured to be the capacity value k/(t x 4) under the 8GB memory and serve as first test result data of a target test item (database instance).
In order to further increase the comparability of the first test result data of each target test item, normalization processing can be further performed on the first test result data of each target test item. Specifically, standardized test result data may be obtained in advance, where the standardized test result data is obtained by performing unified measurement on initial test result data of a target test item running the preset test program in a resource in a standardized environment, and a ratio of the first test result data to the standardized test result data may be obtained as second test result data of the target test item. For example, if the first test result data of the CPU in a certain cloud platform target resource is x, and the standardized test result data obtained by running a preset test program on the CPU in the standardized environment and exciting the CPU in the same lange unit is y, the second test result data of the CPU in the target resource is x/y after normalization processing.
As shown in fig. 4, the obtaining process of the normalized test result data may be as follows:
s401, sending a preset test program to the resource in the standardized environment so that the resource in the standardized environment runs the preset test program;
s402, obtaining an operation result of the preset test program from the resources in the standardized environment;
s403, acquiring initial test result data of the target test item in the resource under the standardized environment from the operation result;
s404, carrying out unified measurement unit on the initial test result data to obtain the standardized test result data of the target test item.
In this embodiment, the standardized environment may be composed of a physical server or a designated virtual server, and is used as a reference frame of the cloud platform to be tested, where the standardized environment includes computing resources, storage resources, network resources, PaaS layer resources, and the like, that is, at least each target test item in the cloud platform to be tested is included, it should be noted that the standardized environment may be deployed alone, may also be deployed on a multi-cloud management and control platform or a test platform, and may also be deployed on any cloud platform. The preset test program running in the standardized environment needs to be the same as the preset test program running on the cloud platform to be tested, the subsequent processes of obtaining initial test result data of the target test item from the running result and carrying out the unified measurement unit on the initial test result data are also the same as the processes of the embodiment on the cloud platform to be tested, and the standardized test result data of the target test item can be obtained by carrying out the unified measurement unit on the initial test result data.
On the basis of the foregoing embodiment, the obtaining, according to the operation result, the target performance parameters corresponding to the multiple cloud platforms to be tested in S204 may further include:
and acquiring a first cost performance parameter of the target test item according to the second test result data of the target test item and the price information of the target test item.
In this embodiment, after the second test result data of the target test item is obtained, a ratio of the second test result data of the target test item to the price of the target test item may be calculated as the first cost performance parameter of the target test item, for example, if the second test result data of the CPU in the target resource of a certain cloud platform is 0.8, and the price of a CPU core is m yuan/hour, the first cost performance parameter of the CPU is 0.8/m.
On the basis of the foregoing embodiment, as shown in fig. 5, the obtaining target performance parameters corresponding to the multiple cloud platforms to be tested according to the operation result further includes:
s501, acquiring the fault condition of the target test item, and determining a target fault category corresponding to the fault condition of the target test item;
s502, determining a target correction value corresponding to the target fault type according to a comparison relation between the preset fault type and the preset correction value, wherein the preset correction value is less than 1;
s503, obtaining the product of the first cost performance parameter of the target test item and the target correction value, and taking the product as the second cost performance parameter corrected according to the fault condition of the target test item.
In this embodiment, a certain cloud platform may have a fault in the test process, so that the fault condition may be recorded and marked, and then the fault condition may be classified to determine the corresponding target fault category, such as alarm, single-point fault, multi-point fault, small-area fault, large-area fault, and the like. For a cloud platform with a fault, the cost performance of the cloud platform is affected, for example, even if the cloud platform has a large storage resource throughput, the cloud platform is not suitable for use and the cost performance is correspondingly reduced if the cloud platform frequently fails, so that in the embodiment, on the basis of the first cost performance parameter of the target test item, the first cost performance parameter is corrected according to the fault condition, the more serious faults are corrected, that is, the more the cost performance is reduced, specifically, the comparison relationship between the preset fault category and the preset correction value can be configured, and the corresponding correction value is queried according to the fault category, where the correction value is a numerical value smaller than 1, such as alarm 0.99, single-point fault 0.9, multi-point fault 0.8, small-area fault 0.7, and large-area fault 0.5. If the first cost performance parameter of a certain target test item of a certain cloud platform is 0.8/m, but a multi-point fault occurs, and the target correction value corresponding to the multi-point fault is 0.5, multiplying the first cost performance parameter by the target correction value 0.5 to obtain a second cost performance parameter of the cloud platform which is 0.5 x 0.8/m; it should be noted that the larger the number of failures or the more serious the failures occur within a certain time range, the smaller the value will be. For example, statistics is performed on failure conditions in one week, and it is assumed that various failure conditions occurring in one week of a certain cloud platform are as follows: 2 single point failures and 1 small area failure, where the first cost performance parameter is k, and based on the above example correction value, the final second cost performance parameter is: 0.9 × 0.7 × k, it should be noted that the fault outside the statistical time range may not be included in the statistical result.
On the basis of the embodiment, after the target performance parameters corresponding to the multiple cloud platforms to be tested are obtained, the target performance parameters are displayed in the display interface, specifically, the same project performance parameters of the multiple cloud platforms to be tested can be displayed in a contrast mode in an arbitrary chart mode, so that a user can conveniently compare the target performance parameters, the user can objectively and clearly know the operation conditions and performance conditions of the cloud platforms, and the user can conveniently and effectively adjust the cloud platform resources. The displayed content includes, but is not limited to, test result data of a target test item in the target resource, a first cost performance parameter of the target test item, a second cost performance parameter corrected according to a fault condition of the target test item, and statistical result data of the fault condition of the target test item, and the display mode is not limited in this embodiment.
Fig. 6 is a structural diagram of a performance testing apparatus for a multi-cloud platform resource according to an embodiment of the present invention. The performance testing device for the multiple cloud platform resources provided in this embodiment may execute the processing flow provided in the performance testing method for the multiple cloud platform resources, as shown in fig. 6, where the performance testing device 600 for the multiple cloud platform resources includes: a testing module 601, an obtaining module 602, and a processing module 603.
The testing module 601 is configured to send a preset testing program to target resources on a plurality of cloud platforms to be tested respectively; at a preset test starting moment, respectively sending a test starting instruction to the plurality of cloud platforms to be tested so as to enable the preset test program to run on target resources on each of the plurality of cloud platforms to be tested;
an obtaining module 602, configured to obtain an operation result of the preset test program from target resources on the multiple cloud platforms to be tested;
the processing module 603 is configured to obtain target performance parameters corresponding to the multiple cloud platforms to be tested according to the operation result.
On the basis of any of the above embodiments, the target performance parameter includes at least one of:
testing result data of a target testing project in the target resource, a first cost performance parameter of the target testing project, a second cost performance parameter corrected according to the fault condition of the target testing project and statistical result data of the fault condition of the target testing project;
wherein the target test item comprises at least one of: and computing resources, storage resources, network resources and PaaS layer resources in the target resources.
On the basis of any of the above embodiments, when the processing module 603 obtains the target performance parameters corresponding to the multiple cloud platforms to be tested according to the operation result, the processing module is configured to:
acquiring initial test result data of a target test item from the operation result;
carrying out a unified measurement unit on the initial test result data to obtain first test result data of the target test item;
normalizing the first test result data to obtain second test result data of the target test item;
and taking the first test result data and/or the second test result data as the test result data of the target test item.
On the basis of any of the above embodiments, when the processing module 603 performs normalization processing on the first test result data to obtain second test result data of the target test item, the processing module is configured to:
acquiring the ratio of the first test result data to the standardized test result data as second test result data of the target test item;
and the standardized test result data is obtained after the target test item in the resources under the standardized environment runs the initial test result data of the preset test program and is subjected to unified measurement unit.
On the basis of any of the above embodiments, when the processing module 603 obtains the target performance parameters corresponding to the multiple cloud platforms to be tested according to the operation result, the processing module is further configured to:
and acquiring a first cost performance parameter of the target test item according to the second test result data of the target test item and the price information of the target test item.
On the basis of any of the above embodiments, when the processing module 603 obtains the target performance parameters corresponding to the multiple cloud platforms to be tested according to the operation result, the processing module is further configured to:
acquiring the fault condition of the target test item, and determining a target fault category corresponding to the fault condition of the target test item;
determining a target correction value corresponding to the target fault type according to a comparison relation between a preset fault type and the preset correction value, wherein the preset correction value is smaller than 1;
and acquiring the product of the first cost performance parameter of the target test item and the target correction value, and taking the product as the second cost performance parameter corrected according to the fault condition of the target test item.
On the basis of any of the above embodiments, before the testing module 601 sends the test start instruction to the multiple cloud platforms to be tested respectively at the preset test start time, the testing module is further configured to:
dividing the whole test time interval into a plurality of time periods;
and selecting a fixed time or randomly selecting a time in each time period as the preset test starting time.
On the basis of any of the above embodiments, before sending a preset test program to target resources on a plurality of cloud platforms to be tested, the test module 601 is further configured to:
respectively selecting pre-established fixed resources on each cloud platform to be tested of the plurality of cloud platforms to be tested as target resources on the plurality of cloud platforms to be tested; or
Creating new resources on each cloud platform to be tested of the plurality of cloud platforms to be tested according to a preset specification to serve as target resources on the plurality of cloud platforms to be tested; or
Respectively randomly creating new resources from a resource pool on each cloud platform to be tested of the plurality of cloud platforms to be tested according to a random specification, and using the new resources as target resources on the plurality of cloud platforms to be tested;
wherein the target resource comprises at least one of: computing resources, storage resources, network resources, PaaS layer resources.
On the basis of any of the above embodiments, the test module 601 is further configured to send a preset test program to the resource in the standardized environment, so that the resource in the standardized environment runs the preset test program;
the obtaining module 602 is further configured to obtain an operation result of the preset test program from a resource in the standardized environment;
the processing module 603 is further configured to obtain initial test result data of the target test item in the resource in the standardized environment from the operation result; and carrying out unified measurement units on the initial test result data to obtain the standardized test result data of the target test item.
On the basis of any of the above embodiments, after obtaining the target performance parameters corresponding to the multiple cloud platforms to be tested according to the operation result, the method further includes:
displaying target performance parameters corresponding to the plurality of cloud platforms to be tested; and/or
And determining an adjustment strategy for the cloud platform resources according to the target performance parameters corresponding to the plurality of cloud platforms to be tested.
The performance test device for the multi-cloud platform resource provided in the embodiment of the present invention may be specifically configured to execute the method embodiments provided in fig. 2 to 5, and specific functions are not described herein again.
The performance test equipment for the multi-cloud platform resources, provided by the embodiment of the invention, respectively sends the preset test programs to the target resources on the multiple cloud platforms to be tested; at a preset test starting moment, respectively sending a test starting instruction to a plurality of cloud platforms to be tested so as to enable a preset test program to run on target resources on each of the plurality of cloud platforms to be tested; acquiring an operation result of a preset test program from target resources on a plurality of cloud platforms to be tested; and acquiring target performance parameters corresponding to a plurality of cloud platforms to be tested according to the operation result. In the embodiment, the preset test program is run on the target resources of the multiple cloud platforms to be tested, so that the multiple cloud platforms to be tested can be synchronously tested, the required real target performance parameters corresponding to the multiple cloud platforms to be tested are finally obtained, and the target performance parameters corresponding to the multiple cloud platforms to be tested can be displayed to the user, so that the user can accurately know and compare the performance of the cloud platform resources, and the user can be guided to effectively adjust the cloud platform resources in a multi-cloud scene.
Fig. 7 is a schematic structural diagram of a computer device according to an embodiment of the present invention. The computer device provided in the embodiment of the present invention may execute the processing flow provided in the embodiment of the performance testing method for the resource of the cloud platform, as shown in fig. 7, the computer device 70 includes a memory 71, a processor 72, a computer program, and a communication interface 73; wherein the computer program is stored in the memory 71 and configured to be executed by the processor 72 for performing the performance testing method of the multi-cloud platform resource as described in the above embodiments.
In addition, the computer device 70 may further include a display for displaying the target performance parameters corresponding to the multiple cloud platforms to be tested to the user, so that the user can accurately know and compare the performance of each cloud platform resource, and can guide the user to effectively adjust the cloud platform resource in a multi-cloud scenario.
The computer device of the embodiment shown in fig. 7 can be used to implement the technical solution of the above method embodiment, and the implementation principle and technical effect are similar, which are not described herein again.
In addition, the present embodiment also provides a non-transitory computer readable storage medium including instructions, for example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, on which a computer program is stored, and the computer program is executed by a processor to implement the performance testing method of the multi-cloud platform resource according to the above embodiment.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to execute some steps of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
It is obvious to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be performed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to perform all or part of the above described functions. For the specific working process of the device described above, reference may be made to the corresponding process in the foregoing method embodiment, which is not described herein again.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the embodiments of the present invention, and are not limited thereto; although embodiments of the present invention have been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (13)

1. A performance test method for multi-cloud platform resources is characterized by comprising the following steps:
respectively sending a preset test program to target resources on a plurality of cloud platforms to be tested;
at a preset test starting moment, respectively sending a test starting instruction to the plurality of cloud platforms to be tested so as to enable the preset test program to run on target resources on each of the plurality of cloud platforms to be tested;
acquiring the running results of the preset test programs from the target resources on the plurality of cloud platforms to be tested;
and acquiring target performance parameters corresponding to the plurality of cloud platforms to be tested according to the operation result.
2. The method of claim 1, wherein the target performance parameters comprise at least one of:
testing result data of a target testing project in the target resource, a first cost performance parameter of the target testing project, a second cost performance parameter corrected according to the fault condition of the target testing project and statistical result data of the fault condition of the target testing project;
wherein the target test item comprises at least one of: and computing resources, storage resources, network resources and PaaS layer resources in the target resources.
3. The method according to claim 2, wherein the obtaining target performance parameters corresponding to the plurality of cloud platforms to be tested according to the operation result comprises:
acquiring initial test result data of a target test item from the operation result;
carrying out a unified measurement unit on the initial test result data to obtain first test result data of the target test item;
normalizing the first test result data to obtain second test result data of the target test item;
and taking the first test result data and/or the second test result data as the test result data of the target test item.
4. The method of claim 3, wherein the normalizing the first test result data to obtain second test result data of the target test item comprises:
acquiring the ratio of the first test result data to the standardized test result data as second test result data of the target test item;
and the standardized test result data is obtained after the target test item in the resources under the standardized environment runs the initial test result data of the preset test program and is subjected to unified measurement unit.
5. The method according to claim 3, wherein the obtaining target performance parameters corresponding to the plurality of cloud platforms to be tested according to the operation result further comprises:
and acquiring a first cost performance parameter of the target test item according to the second test result data of the target test item and the price information of the target test item.
6. The method according to claim 5, wherein the obtaining target performance parameters corresponding to the plurality of cloud platforms to be tested according to the operation result further comprises:
acquiring the fault condition of the target test item, and determining a target fault category corresponding to the fault condition of the target test item;
determining a target correction value corresponding to the target fault type according to a comparison relation between a preset fault type and the preset correction value, wherein the preset correction value is smaller than 1;
and acquiring the product of the first cost performance parameter of the target test item and the target correction value, and taking the product as the second cost performance parameter corrected according to the fault condition of the target test item.
7. The method according to any one of claims 1 to 6, wherein before sending the test start instruction to the plurality of cloud platforms to be tested respectively at the preset test start time, the method further comprises:
dividing the whole test time interval into a plurality of time periods;
and selecting a fixed time or randomly selecting a time in each time period as the preset test starting time.
8. The method according to any one of claims 1 to 6, wherein before sending the preset test program to the target resources on the plurality of cloud platforms to be tested, the method further comprises:
respectively selecting pre-established fixed resources on each cloud platform to be tested of the plurality of cloud platforms to be tested as target resources on the plurality of cloud platforms to be tested; or
Creating new resources on each cloud platform to be tested of the plurality of cloud platforms to be tested according to a preset specification to serve as target resources on the plurality of cloud platforms to be tested; or
Respectively randomly creating new resources from a resource pool on each cloud platform to be tested of the plurality of cloud platforms to be tested according to a random specification, and using the new resources as target resources on the plurality of cloud platforms to be tested;
wherein the target resource comprises at least one of: computing resources, storage resources, network resources, PaaS layer resources.
9. The method of claim 4, further comprising:
sending a preset test program to the resource in the standardized environment so that the resource in the standardized environment runs the preset test program;
acquiring an operation result of the preset test program from the resources in the standardized environment;
acquiring initial test result data of a target test item in the resource under the standardized environment from the operation result;
and carrying out unified measurement units on the initial test result data to obtain the standardized test result data of the target test item.
10. The method according to any one of claims 1 to 6, wherein after obtaining the target performance parameters corresponding to the plurality of cloud platforms to be tested according to the operation result, the method further comprises:
displaying target performance parameters corresponding to the plurality of cloud platforms to be tested; and/or
And determining an adjustment strategy for the cloud platform resources according to the target performance parameters corresponding to the plurality of cloud platforms to be tested.
11. A performance testing device for multi-cloud platform resources is characterized by comprising:
the testing module is used for respectively sending a preset testing program to target resources on a plurality of cloud platforms to be tested; at a preset test starting moment, respectively sending a test starting instruction to the plurality of cloud platforms to be tested so as to enable the preset test program to run on target resources on each of the plurality of cloud platforms to be tested;
the acquisition module is used for acquiring the running results of the preset test programs from the target resources on the plurality of cloud platforms to be tested;
and the processing module is used for acquiring target performance parameters corresponding to the plurality of cloud platforms to be tested according to the operation result.
12. A computer device, comprising: at least one processor; and a memory;
the memory stores computer-executable instructions;
the at least one processor executing the computer-executable instructions stored by the memory causes the at least one processor to perform the method of any one of claims 1-10.
13. A computer-readable storage medium having computer-executable instructions stored therein which, when executed by a processor, implement the method of any one of claims 1-10.
CN202011289195.8A 2020-11-17 2020-11-17 Performance test method, equipment and storage medium for multi-cloud platform resources Pending CN113760672A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011289195.8A CN113760672A (en) 2020-11-17 2020-11-17 Performance test method, equipment and storage medium for multi-cloud platform resources

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011289195.8A CN113760672A (en) 2020-11-17 2020-11-17 Performance test method, equipment and storage medium for multi-cloud platform resources

Publications (1)

Publication Number Publication Date
CN113760672A true CN113760672A (en) 2021-12-07

Family

ID=78786126

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011289195.8A Pending CN113760672A (en) 2020-11-17 2020-11-17 Performance test method, equipment and storage medium for multi-cloud platform resources

Country Status (1)

Country Link
CN (1) CN113760672A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105357067A (en) * 2015-10-14 2016-02-24 广州杰赛科技股份有限公司 Test method and system for cloud platform
CN107493310A (en) * 2016-06-13 2017-12-19 腾讯科技（深圳）有限公司 A kind of cloud resource processing method and cloud management platform
CN107861869A (en) * 2017-11-01 2018-03-30 国云科技股份有限公司 The interface test system and its implementation of a kind of multi-mode suitable for cloud platform
WO2019019975A1 (en) * 2017-07-24 2019-01-31 华为技术有限公司 Method and device for cloud platform performance testing
CN111478823A (en) * 2020-02-29 2020-07-31 新华三大数据技术有限公司 Multi-cloud management platform testing method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105357067A (en) * 2015-10-14 2016-02-24 广州杰赛科技股份有限公司 Test method and system for cloud platform
CN107493310A (en) * 2016-06-13 2017-12-19 腾讯科技（深圳）有限公司 A kind of cloud resource processing method and cloud management platform
WO2019019975A1 (en) * 2017-07-24 2019-01-31 华为技术有限公司 Method and device for cloud platform performance testing
CN107861869A (en) * 2017-11-01 2018-03-30 国云科技股份有限公司 The interface test system and its implementation of a kind of multi-mode suitable for cloud platform
CN111478823A (en) * 2020-02-29 2020-07-31 新华三大数据技术有限公司 Multi-cloud management platform testing method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
张敏;朱勇;王方;: "云主机性能测试指标及测试方法研究", 信息技术与标准化, no. 06, 10 June 2018 (2018-06-10) *

Similar Documents

Publication Publication Date Title
US9584364B2 (en) Reporting performance capabilities of a computer resource service
US8782215B2 (en) Performance testing in a cloud environment
EP2766810A1 (en) Methods and systems for planning execution of an application in a cloud computing system
WO2015179575A1 (en) Load generation application and cloud computing benchmarking
US20130282354A1 (en) Generating load scenarios based on real user behavior
CN109324962B (en) Method and equipment for testing application program based on cloud Internet of things technology
US11057280B2 (en) User interface with expected response times of commands
WO2019178957A1 (en) Distributed system test method and device, computer device and storage medium
US9811447B2 (en) Generating a fingerprint representing a response of an application to a simulation of a fault of an external service
CN114564374A (en) Operator performance evaluation method and device, electronic equipment and storage medium
US9565060B2 (en) Managing a network connection for use by a plurality of application program processes
WO2020238965A1 (en) Production environment performance evaluation method and apparatus, and storage medium
US20120209584A1 (en) Advanced Metering Infrastructure Simulation
CN109597724A (en) Service stability measurement method, device, computer equipment and storage medium
CN113849356A (en) Equipment testing method and device, electronic equipment and storage medium
EP4152715A1 (en) Method and apparatus for determining resource configuration of cloud service system
CN112817869A (en) Test method, test device, test medium, and electronic apparatus
CN113760672A (en) Performance test method, equipment and storage medium for multi-cloud platform resources
CN115858114A (en) Scheduling method and device of idle task, electronic equipment and readable storage medium
CN109726086A (en) The method and apparatus of testing server performance
CN113742083A (en) Scheduling simulation method and device, computer equipment and storage medium
CN109324802B (en) Method and device for configuring server
CN112465604A (en) Order distribution method and device, computer equipment and computer readable storage medium
CN113489708B (en) Detection method and device, electronic equipment and computer readable storage medium
CN115543768A (en) System interface test method, device and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination