CN112162927A - Test method, medium and device of cloud computing platform and computing equipment - Google Patents
Test method, medium and device of cloud computing platform and computing equipment Download PDFInfo
- Publication number
- CN112162927A CN112162927A CN202011093229.6A CN202011093229A CN112162927A CN 112162927 A CN112162927 A CN 112162927A CN 202011093229 A CN202011093229 A CN 202011093229A CN 112162927 A CN112162927 A CN 112162927A
- Authority
- CN
- China
- Prior art keywords
- test
- cloud
- test case
- computing platform
- testing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000010998 test method Methods 0.000 title claims description 5
- 238000012360 testing method Methods 0.000 claims abstract description 469
- 238000000034 method Methods 0.000 claims abstract description 110
- 230000008569 process Effects 0.000 claims abstract description 78
- 238000011084 recovery Methods 0.000 claims description 12
- 238000013508 migration Methods 0.000 claims description 6
- 230000005012 migration Effects 0.000 claims description 6
- 230000008520 organization Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 238000004590 computer program Methods 0.000 description 4
- 238000012795 verification Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 235000019580 granularity Nutrition 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000013142 basic testing Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 101150071927 AANAT gene Proteins 0.000 description 1
- 108010001267 Protein Subunits Proteins 0.000 description 1
- XSQUKJJJFZCRTK-NJFSPNSNSA-N UREA C 14 Chemical compound N[14C](N)=O XSQUKJJJFZCRTK-NJFSPNSNSA-N 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 235000019987 cider Nutrition 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000004064 recycling Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
- 230000000391 smoking effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3676—Test management for coverage analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the invention provides a testing method of a cloud computing platform. The method comprises the following steps: acquiring test configuration information aiming at a cloud computing platform; generating at least one test case according to the test configuration information; respectively distributing a test process for each test case in at least one test case so as to execute the test case by the test process and obtain a test result; wherein, executing the test case comprises: sending a test instruction to a control end of the cloud computing platform to instruct the control end to create test resources, wherein the test resources comprise a cloud host, a cloud network and a cloud hard disk; and executing the control plane test and/or the data plane test based on the test resources to obtain a test result. In addition, the embodiment of the invention provides a testing device, a medium and computing equipment of a cloud computing platform.
Description
Technical Field
The embodiment of the invention relates to the technical field of computers, in particular to a testing method, a testing medium, a testing device and a testing equipment for a cloud computing platform.
Background
This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.
Iaas (infrastructure as a service), which is an infrastructure as a service, refers to a service mode in which IT infrastructure is provided as a service through a network and a charge is made according to the actual usage or occupancy of resources by a user.
In the related technology, a community open-source tempest testing framework is adopted when cloud computing IaaS integrated testing is performed, and the framework can realize basic testing of management and control services such as basic cloud computing components keystone, nova, cider, neutron, and glance.
Disclosure of Invention
However, the tempest test framework mainly aims at verifying a pipe control service API (Application Programming Interface), and the test coverage on the data plane is insufficient.
For this reason, an improved testing method for a cloud computing platform is highly needed to implement testing of a control plane and a data plane of the cloud computing platform.
In this context, embodiments of the present invention are intended to provide a testing method, medium, apparatus and computing device for a cloud computing platform.
In a first aspect of the embodiments of the present invention, a method for testing a cloud computing platform is provided, including: acquiring test configuration information aiming at a cloud computing platform; generating at least one test case according to the test configuration information; respectively distributing a test process for each test case in the at least one test case so as to execute the test case by the test process and obtain a test result; wherein the executing the test case comprises: sending a test instruction to a control end of the cloud computing platform to instruct the control end to create test resources, wherein the test resources comprise a cloud host, a cloud network and a cloud hard disk; and executing a control plane test and/or a data plane test based on the test resources to obtain the test result
In one embodiment of the invention, the configuration information comprises at least one of the following information: node information, network type, service test parameters and test regression coverage type of the at least one test node.
In another embodiment of the present invention, before the sending the test instruction to the control end of the cloud computing platform, the method further includes: and sending an initialization instruction to the control end through a preset program interface of the control end, and initializing a test environment and a test case.
In yet another embodiment of the present invention, the performing the control plane test comprises: acquiring the resource state of the test resource; verifying whether the resource state is consistent with an expected state; and determining that the test result is a failure if the resource state is inconsistent with the expected state.
In yet another embodiment of the present invention, the performing the data plane test includes: logging in the cloud host; and executing at least one test script through the logged cloud host to obtain a test result, wherein each test script in the at least one test script is used for executing at least one test item, and the test item comprises: verifying the specification of the cloud host, testing the connectivity of the cloud network, verifying the correctness of the read-write content of each volume in the cloud hard disk, verifying the setting of network bandwidth qos, testing the connectivity of a plurality of gateways in the network, testing the creation and/or recovery operation of a cloud host mirror image, testing the creation and/or recovery operation of a cloud host snapshot, or testing the migration operation of the cloud host.
In another embodiment of the present invention, the logging in the cloud host includes: under the condition that the cloud host is configured with an external network IP address, logging in the cloud host through the external network IP address; and under the condition that the cloud host is not configured with an external network IP address, establishing connection with a board jumper, and logging in the cloud host through the board jumper, wherein the board jumper and the cloud host belong to the same subnet.
In another embodiment of the present invention, the allocating a test process to each test case includes: respectively aiming at each test case, executing the following operations: if at least one idle process exists in the process pool, determining an idle process from the at least one idle process, and distributing the idle process to the test case; and if the process pool does not have the idle process, after the execution of the non-idle process is finished, distributing the test process for the test case.
In yet another embodiment of the present invention, the method further comprises: and under the condition that the execution of the test case is finished, cleaning the test resources corresponding to the test case, and recycling the test process distributed to the test case.
In yet another embodiment of the present invention, the method further comprises: recording the test result and the execution time of each test case; generating statistical data according to the test result and the execution time of each test case; if the test result of the test case is failure, failure information corresponding to the test case is displayed, wherein the failure information comprises at least one of an assertion failure point, a context and an execution log.
In a second aspect of embodiments of the present invention, there is provided a medium having stored thereon executable instructions which, when executed by a processor, cause the processor to implement a method as described above.
In a third aspect of the embodiments of the present invention, there is provided a testing apparatus for a cloud computing platform, including: the acquisition module is used for acquiring test configuration information aiming at the cloud computing platform; the generating module is used for generating at least one test case according to the test configuration information; the distribution module is used for distributing a test process to each test case in the at least one test case respectively so that the test case is executed by the test process and a test result is obtained; wherein the executing the test case comprises: sending a test instruction to a control end of the cloud computing platform to instruct the control end to create test resources, wherein the test resources comprise a cloud host, a cloud network and a cloud hard disk; and executing a control plane test and/or a data plane test based on the test resources to obtain the test result.
In one embodiment of the invention, the configuration information comprises at least one of the following information: node information, network type, service test parameters and test regression coverage type of the at least one test node.
In another embodiment of the present invention, the apparatus further comprises: and the initialization module is used for sending an initialization instruction to the control end through a preset program interface of the control end before sending the test instruction to the control end of the cloud computing platform, and initializing a test environment and a test case.
In yet another embodiment of the present invention, the performing the control plane test comprises: acquiring the resource state of the test resource; verifying whether the resource state is consistent with an expected state; and determining that the test result is a failure if the resource state is inconsistent with the expected state.
In yet another embodiment of the present invention, the performing the data plane test includes: logging in the cloud host; and executing at least one test script through the logged cloud host to obtain a test result, wherein each test script in the at least one test script is used for executing at least one test item, and the test item comprises: verifying the specification of the cloud host, testing the connectivity of the cloud network, verifying the correctness of the read-write content of each volume in the cloud hard disk, verifying the setting of network bandwidth qos, testing the connectivity of a plurality of gateways in the network, testing the creation and/or recovery operation of a cloud host mirror image, testing the creation and/or recovery operation of a cloud host snapshot, or testing the migration operation of the cloud host.
In another embodiment of the present invention, the logging in the cloud host includes: under the condition that the cloud host is configured with an external network IP address, logging in the cloud host through the external network IP address; and under the condition that the cloud host is not configured with an external network IP address, establishing connection with a board jumper, and logging in the cloud host through the board jumper, wherein the board jumper and the cloud host belong to the same subnet.
In yet another embodiment of the present invention, the assignment module is further configured to: respectively aiming at each test case, executing the following operations: if at least one idle process exists in the process pool, determining an idle process from the at least one idle process, and distributing the idle process to the test case; and if the process pool does not have the idle process, after the execution of the non-idle process is finished, distributing the test process for the test case.
In yet another embodiment of the present invention, the apparatus further comprises: and the recovery module is used for clearing the test resources corresponding to the test case and recovering the test process distributed to the test case under the condition that the test case is completely executed.
In yet another embodiment of the present invention, the apparatus further comprises: the recording module is used for recording the test result and the execution time of each test case; the statistical module is used for generating statistical data according to the test result and the execution time of each test case; the display module is used for displaying failure information corresponding to the test case under the condition that the test result of the test case is failure, wherein the failure information comprises at least one of an assertion failure point, a context and an execution log.
In a fourth aspect of embodiments of the present invention there is provided a computing device, the computer program comprising computer executable instructions for implementing a method as described above when executed.
According to the testing method and device for the cloud computing platform, the cloud computing platform can be subjected to control plane and data plane testing, the testing coverage is wide, and better experience is brought to users.
Drawings
The above and other objects, features and advantages of exemplary embodiments of the present invention will become readily apparent from the following detailed description read in conjunction with the accompanying drawings. Several embodiments of the invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:
fig. 1 schematically illustrates an exemplary application scenario in which a testing method of a cloud computing platform may be applied according to an embodiment of the present disclosure;
FIG. 2 schematically illustrates a flow diagram of a method of testing a cloud computing platform, in accordance with an embodiment of the present disclosure;
fig. 3 schematically shows a flow chart of a method of performing a control plane test according to an embodiment of the present disclosure;
FIG. 4 schematically illustrates a flow chart of a method of performing data plane testing in accordance with an embodiment of the present disclosure;
FIG. 5 schematically illustrates a schematic diagram of executing a test case according to another embodiment of the present disclosure;
FIG. 6 schematically illustrates a program product schematic of a test of a cloud computing platform according to an embodiment of the present disclosure;
FIG. 7 schematically illustrates a block diagram of a testing apparatus of a cloud computing platform, in accordance with an embodiment of the present disclosure; and
fig. 8 depicts a computing device for testing of a cloud computing platform according to an embodiment of the present disclosure.
In the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
Detailed Description
The principles and spirit of the present invention will be described with reference to a number of exemplary embodiments. It is understood that these embodiments are given solely for the purpose of enabling those skilled in the art to better understand and to practice the invention, and are not intended to limit the scope of the invention in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
As will be appreciated by one skilled in the art, embodiments of the present invention may be embodied as a system, apparatus, device, method, or computer program product. Accordingly, the present disclosure may be embodied in the form of: entirely hardware, entirely software (including firmware, resident software, micro-code, etc.), or a combination of hardware and software.
According to the embodiment of the invention, a test method, a test medium, a test device and computing equipment of a cloud computing platform are provided.
In this document, it is to be understood that any number of elements in the figures are provided by way of illustration and not limitation, and any nomenclature is used for differentiation only and not in any limiting sense.
The principles and spirit of the present invention are explained in detail below with reference to several representative embodiments of the invention.
Summary of The Invention
The inventor finds that in the running process of the cloud computing platform, due to reasons such as configuration errors and abnormal service, part of computing nodes cause conditions such as failure in creation of a cloud host, network abnormality, failure in hanging and unloading of a cloud hard disk of a user and the like. The regression verification can not be performed on each computing node according to the characteristics of cloud computing adopted by the related technology. The invention adds the configuration information of the computing nodes on the framework level, and generates the test cases (for example, different network types, mount and unload volume types and the like) suitable for each computing node type according to the configuration. And then, executing the test case on each computing node, thereby ensuring the effective coverage of the test.
In addition, the test framework adopted in the related art cannot realize concurrent regression verification of the control plane and the data plane, so that it takes a long time to perform regression test on a newly online computing node or a newly online environment.
According to the invention, the test framework and the cloud computing platform are decoupled, the test is scheduled on the layer of the framework, and the test cases are executed through two dimensions of the label and the file organization, so that the concurrent execution among the test cases of different types, different granularities and different test ranges can be realized according to the requirements, the execution speed is effectively improved, and the execution time is shortened.
Having described the general principles of the invention, various non-limiting embodiments of the invention are described in detail below.
Application scene overview
Reference is first made to fig. 1. Fig. 1 schematically illustrates an exemplary application scenario 100 in which a testing method of a cloud computing platform may be applied according to an embodiment of the present disclosure. It should be noted that fig. 1 is only an example of an application scenario in which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.
As shown in fig. 1, a Model represents a Model, Hosts represents a mapping relationship between a website domain name and its corresponding IP address, Metadata represents Metadata, testcase represents a test case, worker pool represents a process pool, and a circle represents a process. According to the embodiment of the invention, the test cases can be generated according to the Model, the Hosts and the Metadata, then, for each test case, an idle process is determined from the process pool, the idle process is distributed to the test case, and then the idle process executes the test case, so that the cloud computing platform is tested.
Exemplary method
In the following, a testing method of a cloud computing platform according to an exemplary embodiment of the present invention is described with reference to fig. 2 in conjunction with an application scenario of fig. 1. It should be noted that the above application scenarios are merely illustrated for the convenience of understanding the spirit and principles of the present invention, and the embodiments of the present invention are not limited in this respect. Rather, embodiments of the present invention may be applied to any scenario where applicable.
Fig. 2 schematically shows a flow chart of a testing method of a cloud computing platform according to an embodiment of the present disclosure.
As shown in fig. 2, the method includes acquiring test configuration information for a cloud computing platform in operation S210.
According to an embodiment of the present disclosure, the configuration information may include, for example, node information of at least one test node, a network type, a service test parameter, a test regression coverage type, and the like.
According to the embodiment of the disclosure, by adding the configuration information of the computing nodes, test cases (including different network types, mount and unload volume types, and the like) suitable for each computing node type are generated according to the configuration. And then, executing the test case on each computing node according to a node list (node _ list) contained in the test node information, thereby ensuring the effective coverage of the test.
According to embodiments of the present disclosure, a test regression coverage type may include tags (labels), for example, each tag corresponding to a type of use case set. The test regression coverage type may be used to determine which type of case set the regression performed when the regression test was performed (e.g., testing regression cloud host-related, or network-related operations, etc.). By introducing the test regression coverage type, regression testing can be performed on different components, and decoupling of testing among different components is achieved.
According to the embodiment of the disclosure, besides the information, basic information of the test environment can be configured by configuring service test parameters, for example, information including test tenant information, a user name and a password of a keystone tenant, a test cloud host browser, a mirror id and the like can be included. Exemplarily, in the present embodiment, the test environment basic information may be configured under the/etc/directory.
Then, in operation S220, at least one test case is generated according to the test configuration information.
For example, in this embodiment, the computing node and the corresponding mount volume information used for the regression test may be configured under the node _ list.
For example, the node _ list includes the following configuration information:
dongguan1.perf_vpc2：pubbeta2-nova90.dg.163.org ceph，nbs，lvm
dongguan1.perf_vpc2：pubbeta2-nova92.dg.163.org ceph，nbs
wherein dongguan1.perf _ vpc2 is the available region where the node is located and the identification of the available domain, pubbeta2-nova90.dg.163.org and pubbeta2-nova92.dg.163.org are the names of the nodes, ceph, nbs and lvm are the types of mount and unload volumes. The cloud hard disk volume device supports various types of cloud hard disk volume devices, and the coverage of heterogeneous scenes can be fully guaranteed by testing various types.
The configuration information is finally converted into the following test cases for regression testing.
[
(′dongguan1.perf_vpc2：pubbeta2-nova90.dg.163.org′，′ceph′)，
(′dongguan1.perf_vpc2：pubbeta2-nova90.dg.163.org′，′nbs′)，
(′dongguan1.perf_vpc2：pubbeta2-nova90.dg.163.org′，′1vm′)，
(′dongguan1.perf_vpc2：pubbeta2-nova92.dg.163.org′，′ceph′)，
(′dongguan1.perf_vpc2：pubbeta2-nova92.dg.163.org′，′nbs′)
]
In operation S230, a test process is respectively allocated to each test case of the at least one test case, so that the test case is executed by the test process and a test result is obtained.
According to an embodiment of the present disclosure, assigning a test to each test case may include, for example: and for each test case, if at least one idle process exists in the process pool, selecting one idle process from the at least one idle process and distributing the idle process to the test case. The process selection mode may be random selection, or selection according to other modes. And if the idle process does not exist in the process pool, after the execution of the non-idle process is finished, distributing the test process for the test case. It should be noted that the operation of assigning a test process to each test case may be executed serially or in parallel.
According to an embodiment of the present disclosure, executing a test case may include, for example: and sending a test instruction to a control end of the cloud computing platform by the test server to instruct the control end to create a test resource. Control plane testing and/or data plane testing is then performed based on the test resources to obtain test results.
According to an embodiment of the present disclosure, the test resources may include, for example, a cloud host, a cloud network, a cloud hard disk, and the like. According to further embodiments of the present disclosure, the test resources may further include authentication service components, mirroring service components, and the like.
A test framework according to embodiments of the present disclosure may execute test cases from both file organization and label dimensions. By using case execution control of two dimensions of the test file and the label, the test can be more flexibly and more finely controlled.
The following further describes the execution of test cases from both file organization and label dimensions in conjunction with specific embodiments.
In this embodiment, for example, the test case of the cloud host is stored in test _ server _ ops.py, the test case of the cloud network is stored in test _ net _ ops.py, and the test case of the cloud hard disk is stored in test _ volume _ ops.py.
If the test case of the cloud network needs to be executed independently, the following instructions can be executed to implement the execution of the test case of the cloud network from the dimension of file organization:
pytest-n 24--durations＝10-v-s pytest_case/test_net_ops.py
wherein, the test represents a test instruction, the parameter is "-n 24-duration ═ 10-v-s", and the test _ case/test _ net _ ops is a test case storage location of the cloud network.
If the test case of the cloud hard disk needs to be executed independently, the following instructions can be executed to implement the execution of the test case of the cloud hard disk from the dimension of file organization:
pytest-n 24--durations＝10-v-s pytest_case/test_volumes_ops.py
the "pytest _ case/test _ volumes _ ops" is a file path of a test case of the cloud hard disk.
In addition, when the test case is written, a label can be set for the test case, and execution can be performed according to the dimension of the label.
For example, when a computing node is newly added, test cases such as a created cloud host case in the test cases related to the cloud host and a network connectivity test case in the test cases related to the network need to be regressed, and these test cases are divided into different files and may be collectively referred to as smoking test cases. Based on this, somke tags may be set for these test cases. Similarly, the labels such as volume (capacity test), computer (computational test) and the like can be set according to different test requirements.
When executing, the following instructions may be used to execute the corresponding test case.
pytest-n 24--durations＝10-v-s pytest_case/-m smoke
pytest-n 24--durations＝10-v-s pytest_case/-m volume
pytest-n 24--durations＝10-v-s pytest_case/-m compute
Use cases including creating cloud hosts, cloud host migration, network connectivity verification, hanging volumes, etc. for basic verification may be performed through the label dimension. It can be seen that these test cases are a part of test _ server _ ops.py, and do not contain all the cases in test _ server _ ops.py. Therefore, the regression test can be performed in a targeted manner according to the requirement in a tag execution mode, so that the efficiency of the regression test is improved, and the time is saved.
According to the testing method of the cloud computing platform provided by the embodiment of the invention, the control plane and the data plane of the cloud computing platform can be tested, and the testing coverage is wider. In addition, the test framework is decoupled from the cloud computing platform, the test is scheduled on the framework layer, and the test cases are executed through two dimensions of the label and the file organization, so that the concurrent execution among the test cases of different types, different granularities and different test ranges can be realized according to the requirements, the execution speed is effectively improved, the execution time is shortened, and better experience is brought to users.
Fig. 3 schematically shows a flow chart of a method of performing a control plane test according to an embodiment of the present disclosure. As shown in fig. 3, performing a control plane test according to an embodiment of the present disclosure may include operations S310 to S320, for example.
More specifically, in operation S310, a resource status of a test resource is acquired.
In operation S320, it is verified whether the resource state is consistent with the expected state, and in case that the resource state is not consistent with the expected state, the test result is determined to be a failure, and in case that the resource state is consistent with the expected state, the test result is determined to be a pass.
FIG. 4 schematically shows a flow chart of a method of performing data plane testing according to an embodiment of the present disclosure. As shown in FIG. 4, performing the data plane test may include, for example, operations S410-S420.
More specifically, in operation S410, a cloud host is logged in.
According to the embodiment of the disclosure, when the cloud host is configured with the external network IP address, the cloud host can be logged in through the external network IP address. When the cloud host is located in the private network, the cloud host is not configured with an external network IP address, so that machines which are not in the same private network cannot be directly connected to the cloud host through ssh. Based on the method, the springboard machine which belongs to the same private network with the cloud host can be determined firstly, connection with the springboard machine is established, and the cloud host is logged in through the springboard machine.
In operation S420, at least one test script is executed by the logged cloud host to obtain a test result. Wherein each of the at least one test script is for executing at least one test item.
According to an embodiment of the present disclosure, the test items may include, for example: verifying the specification of a cloud host, testing the connectivity of a cloud network, verifying the correctness of read-write contents of each volume in a cloud hard disk, verifying the setting of a network bandwidth qos, testing the connectivity of a plurality of gateways in the network, testing the creation and/or recovery operation of a cloud host mirror image, testing the creation and/or recovery operation of a cloud host snapshot, or testing the migration operation of the cloud host, and the like.
According to the embodiment of the disclosure, before the test instruction is sent to the control end of the cloud computing platform, the initialization instruction can be sent to the control end through the preset program interface of the control end, and the test environment and the test case are initialized.
According to embodiments of the present disclosure, the provisioning service may include, for example, an authentication service, a computing service, a volume service, a web service, a mirroring service, and the like.
Exemplarily, in the present embodiment, on the test host, through the restful api interface, the iaas basic components, including nova, circular, proton, glance, keystone, and other services, are requested, and the basic test environment is initialized, including tenant identity pre-check, test image pre-check, openstack basic service pre-check, node volume type check, network initialization, snat creation, and other operations.
According to another embodiment of the disclosure, under the condition that the test case is executed, the test resources corresponding to the test case can be cleaned, and the test processes distributed to the test case are recovered.
According to another embodiment of the present disclosure, a test result and an execution time of each test case may be recorded, where the test result may include, for example, a total number of test cases, a number of failed cases, a number of cases passing a test (pass), and the like, and the execution time is a time length taken by a test process. And generating statistical data according to the test result and the execution time of each test case.
In addition, if the test result of the test case is failure, failure information corresponding to the test case can be displayed, so that the test personnel can conveniently check. The failure information may include, for example, assertion failure points, contexts, execution logs, and the like.
Referring to FIG. 5, a method for executing a test case on a test node is further described with reference to the specific embodiments. Those skilled in the art will appreciate that the following example embodiments are only for the understanding of the present disclosure, and the present disclosure is not limited thereto.
FIG. 5 schematically shows a schematic diagram of executing a test case according to another embodiment of the present disclosure.
As shown in fig. 5, a test service (test server) initializes a test environment, which may specifically include creating a vpc (virtual network), creating an extranet gateway instance, and creating a dedicated line gateway instance.
Then, calling a management and control terminal interface to create vm-1, vm-2, vm-3 and other virtual machines in the vpc (virtual private cloud).
Wherein vm-1 is connected with an external network, and vm-1 is configured with an external network IP (public ip). Vm-1 can be used as a trigger to connect vm-2 and vm-3 which are not connected with an external network through the trigger to execute ssh commands, and the following tests are executed through the ssh commands: 1. the connectivity of vm-2 to vm-3 and vm-1 is verified to validate the VXLAN network. 2. Connectivity of vm-2 to 114.114.114.114 is verified to verify that the NGW (extranet gateway) is normal. 3. And verifying the connectivity of vm-2 to an out-of-cloud physical machine (physical server) to verify whether the DGW (private line gateway) is normal. 4. Connectivity of vm-2 to www.163.com is verified to verify that the DNS resolution service is normal.
And the test host machine compares the returned result with the expected state to define whether a certain test case passes or not. And reclaiming the test resources and the dependent resources.
And recording the test result into a log. And completing the test of one case.
And after all the test cases are executed, counting the test results.
Exemplary Medium
Having described the method of the exemplary embodiment of the present invention, the media of the exemplary embodiment of the present invention will be further described with reference to FIG. 6.
In some possible embodiments, aspects of the present invention may also be implemented in the form of a program product including program code for causing a computing device to perform the steps in the method for testing a cloud computing platform according to various exemplary embodiments of the present invention described in the "exemplary method" section above in this specification when the program product is run on the computing device, for example, the computing device may perform operation S210 as shown in fig. 2, obtaining test configuration information for the cloud computing platform; operation S220, generating at least one test case according to the test configuration information; and operation S230, allocating a test process to each test case in the at least one test case, so that the test case is executed by the test process and a test result is obtained.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
As shown in fig. 6, a program product 60 for testing of a cloud computing platform according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a computing device, such as a personal computer. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
Exemplary devices
Having described the medium of an exemplary embodiment of the present invention, a test apparatus of a cloud computing platform of an exemplary embodiment of the present invention will be further described with reference to fig. 7.
Fig. 7 schematically illustrates a block diagram of a testing apparatus of a cloud computing platform according to an embodiment of the present disclosure.
As shown in fig. 7, the apparatus 700 includes an acquisition module 710, a generation module 720, and an assignment module 730.
The obtaining module 710 is configured to obtain test configuration information for the cloud computing platform.
A generating module 720, configured to generate at least one test case according to the test configuration information.
The allocating module 730 is configured to allocate a test process to each test case in the at least one test case, so that the test process executes the test case and obtains a test result.
Wherein, the executing the test case may include, for example: sending a test instruction to a control end of the cloud computing platform to instruct the control end to create test resources, wherein the test resources comprise a cloud host, a cloud network and a cloud hard disk; and executing a control plane test and/or a data plane test based on the test resources to obtain the test result.
According to the testing device of the cloud computing platform, the control plane and the data plane can be tested on the cloud computing platform, the testing coverage is wide, and better experience is brought to users. In addition, the test framework is decoupled from the cloud computing platform, the test is scheduled on the framework layer, and the test cases are executed through two dimensions of the label and the file organization, so that the concurrent execution among the test cases of different types, different granularities and different test ranges can be realized according to the requirements, the execution speed is effectively improved, the execution time is shortened, and better experience is brought to users.
According to an embodiment of the invention, the configuration information may for example comprise at least one of the following information: node information, network type, service test parameters and test regression coverage type of the at least one test node.
According to another embodiment of the present invention, the apparatus may further include: and the initialization module is used for sending an initialization instruction to the control end through a preset program interface of the control end before sending the test instruction to the control end of the cloud computing platform, and initializing a test environment and a test case.
According to a further embodiment of the invention, the performing of the control plane test may for example comprise: acquiring the resource state of the test resource; verifying whether the resource state is consistent with an expected state; and determining that the test result is a failure if the resource state is inconsistent with the expected state.
According to yet another embodiment of the invention, the performing the data plane test may comprise, for example: logging in the cloud host; and executing at least one test script through the logged cloud host to obtain a test result, wherein each test script in the at least one test script is used for executing at least one test item, and the test item comprises: verifying the specification of the cloud host, testing the connectivity of the cloud network, verifying the correctness of the read-write content of each volume in the cloud hard disk, verifying the setting of network bandwidth qos, testing the connectivity of a plurality of gateways in the network, testing the creation and/or recovery operation of a cloud host mirror image, testing the creation and/or recovery operation of a cloud host snapshot, or testing the migration operation of the cloud host.
According to a further embodiment of the present invention, the logging in the cloud host may comprise, for example: under the condition that the cloud host is configured with an external network IP address, logging in the cloud host through the external network IP address; and under the condition that the cloud host is not configured with an external network IP address, establishing connection with a board jumper, and logging in the cloud host through the board jumper, wherein the board jumper and the cloud host belong to the same subnet.
According to yet another embodiment of the invention, the allocation module may be further configured to: respectively aiming at each test case, executing the following operations: if at least one idle process exists in the process pool, determining an idle process from the at least one idle process, and distributing the idle process to the test case; and if the process pool does not have the idle process, after the execution of the non-idle process is finished, distributing the test process for the test case.
According to still another embodiment of the present invention, the apparatus may further include: and the recovery module is used for clearing the test resources corresponding to the test case and recovering the test process distributed to the test case under the condition that the test case is completely executed.
According to still another embodiment of the present invention, the apparatus may further include: the recording module is used for recording the test result and the execution time of each test case; the statistical module is used for generating statistical data according to the test result and the execution time of each test case; the display module is used for displaying failure information corresponding to the test case under the condition that the test result of the test case is failure, wherein the failure information comprises at least one of an assertion failure point, a context and an execution log.
Any number of modules, sub-modules, units, sub-units, or at least part of the functionality of any number thereof according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of or a suitable combination of software, hardware, and firmware implementations. Alternatively, one or more of the modules, sub-modules, units, sub-units according to embodiments of the disclosure may be at least partially implemented as a computer program module, which when executed may perform the corresponding functions.
For example, any of the obtaining module 710, the generating module 720 and the allocating module 730 may be combined and implemented in one module, or any one of them may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the obtaining module 710, the generating module 720 and the allocating module 730 may be implemented at least partially as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in hardware or firmware by any other reasonable manner of integrating or packaging a circuit, or may be implemented in any one of three implementations of software, hardware and firmware, or in a suitable combination of any of them. Alternatively, at least one of the obtaining module 710, the generating module 720 and the allocating module 730 may be at least partially implemented as a computer program module, which when executed may perform a corresponding function.
Exemplary computing device
Having described the method, medium, and apparatus of exemplary embodiments of the present invention, a computing device of exemplary embodiments of the present invention is further described with reference to FIG. 7.
The embodiment of the invention also provides the computing equipment. As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
In some possible embodiments, a computing device according to the present invention may include at least one processing unit, and at least one memory unit. Wherein the storage unit stores program code that, when executed by the processing unit, causes the processing unit to perform the steps in the method for testing a cloud computing platform according to various exemplary embodiments of the present invention described in the "exemplary methods" section above in this specification. For example, the processing unit may perform operation S210 as shown in fig. 2, acquiring test configuration information for the cloud computing platform; operation S220, generating at least one test case according to the test configuration information; and operation S230, allocating a test process to each test case in the at least one test case, so that the test case is executed by the test process and a test result is obtained.
A computing device 80 for testing of a cloud computing platform according to this embodiment of the invention is described below with reference to fig. 8. The computing device 80 shown in FIG. 8 is only one example and should not be taken to limit the scope of use and functionality of embodiments of the present invention.
As shown in fig. 8, computing device 80 is embodied in the form of a general purpose computing device. Components of computing device 80 may include, but are not limited to: the at least one processing unit 801, the at least one memory unit 802, and a bus 803 that couples various system components including the memory unit 802 and the processing unit 801.
The storage unit 802 may include readable media in the form of volatile memory, such as Random Access Memory (RAM)8021 and/or cache memory 8022, and may further include Read Only Memory (ROM) 8023.
It should be noted that although in the above detailed description several units/modules or sub-units/modules of the testing apparatus of the cloud computing platform are mentioned, such division is merely exemplary and not mandatory. Indeed, the features and functionality of two or more of the units/modules described above may be embodied in one unit/module according to embodiments of the invention. Conversely, the features and functions of one unit/module described above may be further divided into embodiments by a plurality of units/modules.
Moreover, while the operations of the method of the invention are depicted in the drawings in a particular order, this does not require or imply that the operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.
While the spirit and principles of the invention have been described with reference to several particular embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, nor is the division of aspects, which is for convenience only as the features in such aspects may not be combined to benefit. The invention is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.
Claims (10)
1. A testing method of a cloud computing platform comprises the following steps:
acquiring test configuration information aiming at a cloud computing platform;
generating at least one test case according to the test configuration information; and
respectively distributing a test process for each test case in the at least one test case so as to execute the test case by the test process and obtain a test result;
wherein the executing the test case comprises:
sending a test instruction to a control end of the cloud computing platform to instruct the control end to create test resources, wherein the test resources comprise a cloud host, a cloud network and a cloud hard disk; and
and executing a control plane test and/or a data plane test based on the test resources to obtain the test result.
2. The method of claim 1, wherein the configuration information comprises at least one of: node information, network type, service test parameters and test regression coverage type of the at least one test node.
3. The method of claim 1, further comprising, before the sending the test instruction to the control end of the cloud computing platform:
and sending an initialization instruction to the control end through a preset program interface of the control end, and initializing a test environment and a test case.
4. The method of claim 1, wherein the performing a control plane test comprises:
acquiring the resource state of the test resource;
verifying whether the resource state is consistent with an expected state; and
determining that the test result is a failure if the resource state is inconsistent with an expected state.
5. The method of claim 1, wherein the performing a data plane test comprises:
logging in the cloud host; and
executing at least one test script through the logged cloud host to obtain a test result,
wherein each of the at least one test script is to execute at least one test item, the test item including:
the specification of the cloud host is verified,
testing the connectivity of the cloud network,
verifying the correctness of the read-write contents of each volume in the cloud hard disk,
the network bandwidth qos setting is verified,
testing the connectivity of a plurality of gateways in a network,
testing the creation and/or recovery operations of the cloud host image,
testing creation and/or recovery operations of cloud host snapshots, or
And testing the migration operation of the cloud host.
6. The method of claim 5, wherein the logging in to the cloud host comprises:
under the condition that the cloud host is configured with an external network IP address, logging in the cloud host through the external network IP address; and
and under the condition that the cloud host is not configured with an external network IP address, establishing connection with a board jumper, and logging in the cloud host through the board jumper, wherein the board jumper and the cloud host belong to the same subnet.
7. The method of claim 1, wherein the assigning of a test procedure to each test case comprises:
respectively aiming at each test case, executing the following operations:
if at least one idle process exists in the process pool, determining an idle process from the at least one idle process, and distributing the idle process to the test case; and
and if the process pool does not have the idle process, after the execution of the non-idle process is finished, distributing a test process for the test case.
8. A testing apparatus of a cloud computing platform, comprising:
the acquisition module is used for acquiring test configuration information aiming at the cloud computing platform;
the generating module is used for generating at least one test case according to the test configuration information; and
the distribution module is used for distributing a test process for each test case in the at least one test case respectively so as to execute the test case by the test process and obtain a test result;
wherein the executing the test case comprises:
sending a test instruction to a control end of the cloud computing platform to instruct the control end to create test resources, wherein the test resources comprise a cloud host, a cloud network and a cloud hard disk; and
and executing a control plane test and/or a data plane test based on the test resources to obtain the test result.
9. A computing device, comprising:
one or more processors;
a storage device for storing one or more programs,
wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of any of claims 1 to 7.
10. A medium having stored thereon executable instructions which, when executed by a processor, cause the processor to carry out the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011093229.6A CN112162927B (en) | 2020-10-13 | 2020-10-13 | Testing method, medium, device and computing equipment of cloud computing platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011093229.6A CN112162927B (en) | 2020-10-13 | 2020-10-13 | Testing method, medium, device and computing equipment of cloud computing platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112162927A true CN112162927A (en) | 2021-01-01 |
| CN112162927B CN112162927B (en) | 2024-04-26 |
Family
ID=73866794
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011093229.6A Active CN112162927B (en) | 2020-10-13 | 2020-10-13 | Testing method, medium, device and computing equipment of cloud computing platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112162927B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112597058A (en) * | 2021-01-08 | 2021-04-02 | 北京联创信安科技股份有限公司 | Web page testing method, device, equipment and storage medium based on volume creation |
| CN112968812A (en) * | 2021-02-22 | 2021-06-15 | 北京华胜天成科技股份有限公司 | Network performance testing method, device, equipment and storage medium |
| CN113010422A (en) * | 2021-03-17 | 2021-06-22 | 北京金山云网络技术有限公司 | Mirror image file testing method and device, electronic equipment and readable storage medium |
| CN113434281A (en) * | 2021-07-19 | 2021-09-24 | 上海幻电信息科技有限公司 | Equipment scheduling method and cloud platform |
| WO2022205696A1 (en) * | 2021-03-31 | 2022-10-06 | 公安部第三研究所 | Cloud computing big data platform function and interface testing method and system |
| CN116303067A (en) * | 2023-03-24 | 2023-06-23 | 安超云软件有限公司 | Testing method, device, equipment and medium based on cloud testing platform |
Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030126586A1 (en) * | 2001-12-27 | 2003-07-03 | International Business Machines Corporation | Organization of test cases |
| US20070263834A1 (en) * | 2006-03-29 | 2007-11-15 | Microsoft Corporation | Execution of interactive voice response test cases |
| JP2010134643A (en) * | 2008-12-03 | 2010-06-17 | Hitachi Software Eng Co Ltd | Test case selection method and selection system |
| CN105357067A (en) * | 2015-10-14 | 2016-02-24 | 广州杰赛科技股份有限公司 | Test method and system for cloud platform |
| CN107704392A (en) * | 2017-09-30 | 2018-02-16 | 华为技术有限公司 | The processing method and server of a kind of test case |
| US20180167285A1 (en) * | 2016-12-08 | 2018-06-14 | Ixia | Deploying a networking test tool in a cloud computing system |
| CN108183820A (en) * | 2017-12-26 | 2018-06-19 | 普华基础软件股份有限公司 | A kind of test system of automobile bus |
| US10162740B1 (en) * | 2017-11-07 | 2018-12-25 | Fmr Llc | Automated intelligent execution of computer software test cases |
| CN109308266A (en) * | 2018-11-30 | 2019-02-05 | 北京微播视界科技有限公司 | Construction method, test method, device, equipment and the medium of test case |
| CN109446071A (en) * | 2018-09-26 | 2019-03-08 | 深圳壹账通智能科技有限公司 | Interface test method, interface test device, electronic equipment and storage medium |
| CN109471796A (en) * | 2018-10-16 | 2019-03-15 | 平安证券股份有限公司 | Interface test method, device, computer equipment and storage medium |
| CN109656802A (en) * | 2017-10-10 | 2019-04-19 | 大连飞创信息技术有限公司 | Test case design system based on high coupling automatic matching technology |
| CN109783392A (en) * | 2019-01-28 | 2019-05-21 | 新华三云计算技术有限公司 | Cloud net fusion architecture system detection method and device |
| CN110287117A (en) * | 2019-06-27 | 2019-09-27 | 江苏满运软件科技有限公司 | RESTful interface test method, system, equipment and storage medium |
| CN110765026A (en) * | 2019-10-31 | 2020-02-07 | 北京东软望海科技有限公司 | Automatic testing method and device, storage medium and equipment |
| CN111104321A (en) * | 2019-12-16 | 2020-05-05 | 烽火通信科技股份有限公司 | Docker-based cloud platform stability testing method and system |
| CN111124867A (en) * | 2018-10-30 | 2020-05-08 | 中移(苏州)软件技术有限公司 | OpenStack testing method and device |
| CN111159046A (en) * | 2019-12-31 | 2020-05-15 | 斑马网络技术有限公司 | Test method, test device, electronic equipment, test system and storage medium |
| CN111338930A (en) * | 2019-12-19 | 2020-06-26 | 烽火通信科技股份有限公司 | Automatic test system and method based on multiple processes and multiple tenants |
| CN111522738A (en) * | 2020-03-30 | 2020-08-11 | 拉扎斯网络科技（上海）有限公司 | Test method and device of micro-service system, storage medium and electronic equipment |
-
2020
- 2020-10-13 CN CN202011093229.6A patent/CN112162927B/en active Active
Patent Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030126586A1 (en) * | 2001-12-27 | 2003-07-03 | International Business Machines Corporation | Organization of test cases |
| US20070263834A1 (en) * | 2006-03-29 | 2007-11-15 | Microsoft Corporation | Execution of interactive voice response test cases |
| JP2010134643A (en) * | 2008-12-03 | 2010-06-17 | Hitachi Software Eng Co Ltd | Test case selection method and selection system |
| CN105357067A (en) * | 2015-10-14 | 2016-02-24 | 广州杰赛科技股份有限公司 | Test method and system for cloud platform |
| US20180167285A1 (en) * | 2016-12-08 | 2018-06-14 | Ixia | Deploying a networking test tool in a cloud computing system |
| CN107704392A (en) * | 2017-09-30 | 2018-02-16 | 华为技术有限公司 | The processing method and server of a kind of test case |
| CN109656802A (en) * | 2017-10-10 | 2019-04-19 | 大连飞创信息技术有限公司 | Test case design system based on high coupling automatic matching technology |
| US10162740B1 (en) * | 2017-11-07 | 2018-12-25 | Fmr Llc | Automated intelligent execution of computer software test cases |
| CN108183820A (en) * | 2017-12-26 | 2018-06-19 | 普华基础软件股份有限公司 | A kind of test system of automobile bus |
| CN109446071A (en) * | 2018-09-26 | 2019-03-08 | 深圳壹账通智能科技有限公司 | Interface test method, interface test device, electronic equipment and storage medium |
| CN109471796A (en) * | 2018-10-16 | 2019-03-15 | 平安证券股份有限公司 | Interface test method, device, computer equipment and storage medium |
| CN111124867A (en) * | 2018-10-30 | 2020-05-08 | 中移(苏州)软件技术有限公司 | OpenStack testing method and device |
| CN109308266A (en) * | 2018-11-30 | 2019-02-05 | 北京微播视界科技有限公司 | Construction method, test method, device, equipment and the medium of test case |
| CN109783392A (en) * | 2019-01-28 | 2019-05-21 | 新华三云计算技术有限公司 | Cloud net fusion architecture system detection method and device |
| CN110287117A (en) * | 2019-06-27 | 2019-09-27 | 江苏满运软件科技有限公司 | RESTful interface test method, system, equipment and storage medium |
| CN110765026A (en) * | 2019-10-31 | 2020-02-07 | 北京东软望海科技有限公司 | Automatic testing method and device, storage medium and equipment |
| CN111104321A (en) * | 2019-12-16 | 2020-05-05 | 烽火通信科技股份有限公司 | Docker-based cloud platform stability testing method and system |
| CN111338930A (en) * | 2019-12-19 | 2020-06-26 | 烽火通信科技股份有限公司 | Automatic test system and method based on multiple processes and multiple tenants |
| CN111159046A (en) * | 2019-12-31 | 2020-05-15 | 斑马网络技术有限公司 | Test method, test device, electronic equipment, test system and storage medium |
| CN111522738A (en) * | 2020-03-30 | 2020-08-11 | 拉扎斯网络科技（上海）有限公司 | Test method and device of micro-service system, storage medium and electronic equipment |
Non-Patent Citations (2)
| Title |
|---|
| (美)布赖恩.奥肯: "《pytest测试实战》", 华中科技大学出版社, pages: 36 - 42 * |
| 黄晓玲;陈桂林;赵生慧;: "基于云计算的并行测试方案设计与实现", 计算机工程, no. 24, 20 December 2012 (2012-12-20), pages 36 - 42 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112597058A (en) * | 2021-01-08 | 2021-04-02 | 北京联创信安科技股份有限公司 | Web page testing method, device, equipment and storage medium based on volume creation |
| CN112968812A (en) * | 2021-02-22 | 2021-06-15 | 北京华胜天成科技股份有限公司 | Network performance testing method, device, equipment and storage medium |
| CN113010422A (en) * | 2021-03-17 | 2021-06-22 | 北京金山云网络技术有限公司 | Mirror image file testing method and device, electronic equipment and readable storage medium |
| WO2022205696A1 (en) * | 2021-03-31 | 2022-10-06 | 公安部第三研究所 | Cloud computing big data platform function and interface testing method and system |
| CN113434281A (en) * | 2021-07-19 | 2021-09-24 | 上海幻电信息科技有限公司 | Equipment scheduling method and cloud platform |
| CN113434281B (en) * | 2021-07-19 | 2024-05-28 | 上海幻电信息科技有限公司 | Equipment scheduling method and cloud platform |
| CN116303067A (en) * | 2023-03-24 | 2023-06-23 | 安超云软件有限公司 | Testing method, device, equipment and medium based on cloud testing platform |
| CN116303067B (en) * | 2023-03-24 | 2024-03-22 | 安超云软件有限公司 | Testing method, device, equipment and medium based on cloud testing platform |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112162927B (en) | 2024-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10642725B2 (en) | Automated test generation for multi-interface enterprise virtualization management environment | |
| CN112162927B (en) | Testing method, medium, device and computing equipment of cloud computing platform | |
| US10545781B2 (en) | Dynamically deployed virtual machine | |
| US20220191226A1 (en) | Aggregating results from multiple anomaly detection engines | |
| US9697068B2 (en) | Building an intelligent, scalable system dump facility | |
| US10158743B2 (en) | Compute node cluster management | |
| US20130191105A1 (en) | Virtual systems testing | |
| US10489281B2 (en) | Application monitoring with a decoupled monitoring tool | |
| US20130326510A1 (en) | Virtualization-based environments for problem resolution | |
| US9471352B1 (en) | Capability based placement | |
| US20180307575A1 (en) | Automated test generation for multi-interface and multi-platform enterprise virtualization management environment | |
| US11175962B2 (en) | Optimizing a workflow of a storlet architecture | |
| US20100162047A1 (en) | System, method and computer program product for testing a boot image | |
| US11379290B2 (en) | Prioritizing and parallelizing the capture of data for debugging computer programs | |
| US9971589B2 (en) | Upgrade management for a shared pool of configurable computing resources | |
| US10176067B1 (en) | On-demand diagnostics in a virtual environment | |
| CN114629831A (en) | Network card performance test method, device, equipment and storage medium | |
| US10360614B1 (en) | Assessing and rating deployments of resources | |
| US11048618B2 (en) | Environment modification for software application testing | |
| US11093371B1 (en) | Hidden input detection and re-creation of system environment | |
| CN115774742A (en) | Data storage newly-increased method, device, equipment, medium and product of private cloud | |
| US10394589B2 (en) | Vertical replication of a guest operating system | |
| US20200327026A1 (en) | Circuit-cycle reproduction | |
| US11983147B2 (en) | Deduplicating data integrity checks across systems | |
| US20240020389A1 (en) | Fuzzing guided binary hardening |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |