CN113297072B - Container testing method and device - Google Patents
Container testing method and device Download PDFInfo
- Publication number
- CN113297072B CN113297072B CN202110536845.2A CN202110536845A CN113297072B CN 113297072 B CN113297072 B CN 113297072B CN 202110536845 A CN202110536845 A CN 202110536845A CN 113297072 B CN113297072 B CN 113297072B
- Authority
- CN
- China
- Prior art keywords
- container
- item
- model
- test
- configuration parameters
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 277
- 230000006870 function Effects 0.000 claims description 19
- 238000010276 construction Methods 0.000 claims description 18
- 238000003860 storage Methods 0.000 claims description 13
- 238000000034 method Methods 0.000 description 25
- 230000008569 process Effects 0.000 description 13
- 238000012545 processing Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 238000013112 stability test Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000000739 chaotic effect Effects 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 238000012217 deletion Methods 0.000 description 3
- 238000004880 explosion Methods 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 238000013468 resource allocation Methods 0.000 description 3
- 230000037430 deletion Effects 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000013522 software testing Methods 0.000 description 2
- 238000012430 stability testing Methods 0.000 description 2
- 238000010998 test method Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000004931 aggregating effect Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 229910002056 binary alloy Inorganic materials 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000008713 feedback mechanism Effects 0.000 description 1
- 238000011990 functional testing Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000011056 performance test Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3676—Test management for coverage analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Abstract
The embodiment of the specification provides a container testing method and a device, wherein the container testing method is applied to a testing platform and comprises the steps of constructing a plurality of container project models comprising at least one operation based on project information; configuring a corresponding configuration parameter set for each operation in each container item model according to a preset configuration rule; determining a testing thread from the container item models and the configuration parameter set, wherein the selected container item model to be operated and the configuration parameter corresponding to each operation in the container item model to be operated; and acquiring an operation result of the test thread for creating and operating the container based on the container item model to be operated and the configuration parameters corresponding to each operation of the container item model to be operated, and testing the container based on the operation result.
Description
Technical Field
The embodiment of the specification relates to the technical field of computers, in particular to a container testing method. One or more embodiments of the present specification also relate to a container testing apparatus, a computing device, and a computer-readable storage medium.
Background
Currently, container technology is rapidly evolving, gradually becoming the standard for various applications and project delivery. As an infrastructure for the application bottom layer, the stability of the container is critical to the quality of service of the upper layer applications and projects. At present, containers are all based on open source technology, and an open source community (such as docker, kata-containers, kubenetes and the like) test infrastructure provides CI, function test, compatibility test, consistency test, metrics and other performance tests, and lacks a stability test scheme.
Disclosure of Invention
In view of this, the present description embodiments provide a container testing method. One or more embodiments of the present specification are also directed to a container testing device, a computing apparatus, and a computer-readable storage medium that address the technical shortcomings of the prior art.
According to a first aspect of embodiments of the present disclosure, there is provided a container testing method, applied to a testing platform, including:
constructing a plurality of container item models including at least one operation based on the item information;
configuring a corresponding configuration parameter set for each operation in each container item model according to a preset configuration rule;
determining a testing thread from the container item models and the configuration parameter set, wherein the selected container item model to be operated and the configuration parameter corresponding to each operation in the container item model to be operated;
And acquiring an operation result of the test thread for creating and operating the container based on the container item model to be operated and the configuration parameters corresponding to each operation of the container item model to be operated, and testing the container based on the operation result.
According to a second aspect of embodiments of the present disclosure, there is provided a container testing device, for use with a testing platform, comprising:
a model building module configured to build a plurality of container item models including at least one operation based on the item information;
the parameter construction module is configured to configure a corresponding configuration parameter set for each operation in each container item model according to a preset configuration rule;
a scene construction module configured to determine a container item model to be run and configuration parameters corresponding to each operation in the container item model to be run, which are selected by a test thread from the plurality of container item models and the configuration parameter set;
the testing module is configured to acquire an operation result of the testing thread for creating and operating the container based on the container item model to be operated and the configuration parameters corresponding to each operation of the container item model to be operated, and test the container based on the operation result.
According to a third aspect of embodiments of the present specification, there is provided a computing device comprising:
a memory and a processor;
the memory is configured to store computer-executable instructions that, when executed by the processor, perform the steps of the container testing method described above.
According to a fourth aspect of embodiments of the present specification, there is provided a computer readable storage medium storing computer executable instructions which, when executed by a processor, implement the steps of the container testing method described above.
One embodiment of the present specification implements a container testing method applied to a testing platform, including constructing a plurality of container project models including at least one operation based on project information; configuring a corresponding configuration parameter set for each operation in each container item model according to a preset configuration rule; determining a testing thread from the container item models and the configuration parameter set, wherein the selected container item model to be operated and the configuration parameter corresponding to each operation in the container item model to be operated; and acquiring an operation result of the test thread for creating and operating the container based on the container item model to be operated and the configuration parameters corresponding to each operation of the container item model to be operated, and testing the container based on the operation result. Specifically, the container testing method simulates continuously-changed container items through the combination of the randomly-generated container item model and the configuration parameters, builds complex item scenes of concurrent operation of a large number of differently-configured containers by using the testing threads, and increases testing coverage so as to improve the stability of the containers.
Drawings
FIG. 1 is a schematic diagram of a container testing system according to one embodiment of the present disclosure;
FIG. 2 is a flow chart of a method of testing a container provided in one embodiment of the present disclosure;
FIG. 3 is a schematic diagram of the construction of a container project model in a container testing method according to one embodiment of the present disclosure;
FIG. 4 is a schematic view of a container testing device according to one embodiment of the present disclosure;
FIG. 5 is a block diagram of a computing device provided in one embodiment of the present description.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present description. This description may be embodied in many other forms than described herein and similarly generalized by those skilled in the art to whom this disclosure pertains without departing from the spirit of the disclosure and, therefore, this disclosure is not limited by the specific implementations disclosed below.
The terminology used in the one or more embodiments of the specification is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of the specification. As used in this specification, one or more embodiments and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present specification refers to and encompasses any or all possible combinations of one or more of the associated listed items.
It should be understood that, although the terms first, second, etc. may be used in one or more embodiments of this specification to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first may also be referred to as a second, and similarly, a second may also be referred to as a first, without departing from the scope of one or more embodiments of the present description. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context.
First, terms related to one or more embodiments of the present specification will be explained.
A container: the container is the packaging of software into standardized units for development, delivery, and deployment.
Vessel life cycle: the whole process from creation to deletion of the container.
Container item model: a combination of all operations within a single container lifecycle.
Project scene: a plurality of randomly varied container item models and configuration data thereof are combined to perform long-time mixed operation.
Stability test: the ability of a test system (e.g., a test platform) to operate stably in varying degrees of environments. Typically include stability of function operation over time, and stability of function operation under concurrent pressure.
Chaos engineering: is a complex technical means for improving the elastic capability of the technical architecture. The Chaos engineering (i.e. chaotic engineering) can ensure the usability of the system through experiments. Chaotic engineering aims to swaddle faults, i.e. identify them before they cause an interruption. By actively manufacturing faults, the behavior of the test system under various pressures identifies and repairs the fault problems, avoiding serious consequences.
Fuzzy test: fuzzing is a software testing technique, typically automatic or semi-automatic, involving the provision of invalid, unexpected or random data to the input of a computer program. The program is then monitored for anomalies such as crashes, built-in code assertions failing or looking up potential memory leaks.
cpu: generally referred to as a central processing unit. The central processing unit (central processing unit, abbreviated as cpu) is used as an operation and control core of the computer system and is a final execution unit for information processing and program running.
memory: a memory (memory) is one of important components of a computer, and is also called an internal memory and a main memory, and is used for temporarily storing operation data in a cpu and exchanging data with an external memory such as a hard disk.
virtoiofsd: also in the qemu warehouse: a scheme for sharing a file system between guests. The main use scenes include: 9p was replaced in the kata-container scene as container rootfs.
overlayfs: is a stacked file system that relies on and builds on other file systems (e.g., ext4fs and xfs, etc.) and does not directly participate in the partitioning of disk space structures, simply "merging" the different directories in the original underlying file system and then presenting to the user, i.e., a joint mount technique.
devmapper: the mapping mechanism from the logic device to the physical device is a mapping mechanism, and under the mapping mechanism, a user can conveniently manage storage resources according to own needs.
ip vlan: the network card virtualization technology provided by the linux kernel can virtualize a plurality of virtual network cards from a physical network card. Multiple virtual network cards have the same mac address but have independent IPs.
enci truncating: it is a normal elastic network card, and in the scheme, it plays the role of a communication channel.
The Internet: the Internet (Internet) is a collection of global information resources.
vpc: virtual Private Cloud, VPC for short, chinese is fully called: a private network.
The testing tools for improving the stability of the software comprise chaotic engineering and fuzzy testing, wherein the chaotic engineering is a common tool for verifying the stability and the usability of the system, and can trigger faults at random positions (including containers) in the whole system, check whether the service has anti-failure capability and help to maintain the healthy operation of the system. For example, kube-monkey can quickly verify whether the constructed k8s service is robust, can elastically expand capacity, can handle unplanned faults and the like. The fuzzy test, also called as Fuzz test, is a test for mining software security holes and detecting software robustness, and is realized by inputting a large number of random and illegal fields into software and observing whether the tested software is abnormal or not. The method can solve the problems that test input cannot be enumerated and exhausted, manual test consideration is incomplete and the like, generate test input combinations based on feedback mechanism variation, and improve test coverage rate. It is one of the most effective means in the fields of software testing and vulnerability discovery.
However, the target of the Kube-monkey test is not a container. The stability of the k8s service cluster under various pressures can be improved through active manufacturing faults. The method is mainly used for testing the fault processing and recovering capacity of the service cluster aiming at the stability and the usability of the k8s service cluster, and the emphasis is not on improving the stability of the container. And, traditional fuzzy test is tightly coupled with test product codes, and the test coverage is increased through a large number of random and invalid inputs, so that the quality of software is improved. It introduces a lot of invalid tests while increasing coverage, even if the test data is too large resulting in a test explosion. In addition, the method tests the source code and the binary program, generates test data and is strongly bound with the software programming language, is mainly used for automatically generating functional test cases, and is rarely used for constructing complex project scene tests.
As can be seen, the stability test schemes related to container technology are relatively lacking, and no commercial mechanism is available to provide stable container products for use in production environments, so that it is highly desirable to construct efficient container stability test schemes to enhance the stability of container technology for use in production environments.
In this specification, a container testing method is provided. One or more embodiments of the present specification relate to a container testing device, a computing apparatus, and a computer-readable storage medium, which are described in detail in the following embodiments.
Referring to fig. 1, fig. 1 shows a schematic architecture of a container testing system provided according to one embodiment of the present disclosure.
As shown in fig. 1, the container test system includes an item model library 102, a container configuration library 104, and a thread pool 106, wherein,
the project model library 102 is configured to construct a plurality of container project models including at least one operation based on project information, and construct the project model library 102 based on the plurality of container project models;
the container configuration library 104 is configured to configure a corresponding configuration parameter set for each operation of each container item model in the item model library according to a preset configuration rule, and construct the container configuration library 104 based on the configuration parameter set;
The thread pool 106 is configured to determine a test thread, and select a container item model to be run and configuration parameters corresponding to each operation in the container item model to be run from the item model library and the container configuration library based on the test thread; and acquiring an operation result of the test thread for creating and operating the container based on the container item model to be operated and configuration parameters corresponding to each operation of the container item model to be operated, and testing the container based on the operation result.
Among these items are, but are not limited to, data processing items (e.g., data query items, data increment items, etc.), resource processing items (e.g., payment items, collection items), etc. Specifically, the items may be set according to practical applications, which are not limited in this specification.
And the operations include, but are not limited to, a create operation, a start operation, a delete operation, a pause operation, a resume operation, a stop operation, and the like. A container item model may then be understood as a container item model formed by one, two or more operations.
For example, container item model 1 is: create- > start- > stop- > rm (create operation-start operation-stop operation-delete operation).
The container item model 2 is: run- > exec- > restart- > stats- > pause- > unpause- > update- > stop- > rm (run operation-execute operation-restart operation-view container operation-pause operation-resume operation-update operation-delete operation).
The configuration parameters corresponding to each operation of each container item model can be understood as cpu, memory, etc. of the container.
In specific implementation, firstly, an item model library and a container configuration library are constructed according to rules, wherein the rules can be understood as rules defined according to characteristics of an item, for example, if a container used by a certain container item model corresponding to the item is smaller, fewer operations in the container item model can be defined; if a container item model corresponding to the item uses a larger container, operations in the container item model may be defined more or less. Specifically, the rule has the starting point that the test simulates a real project scene as much as possible, so that the validity of the test is ensured, and a large number of invalid tests introduced by the fuzzy test are reduced. Based on the principle, the online project can directly extract the corresponding container project model and the configuration parameter set of each operation in each container project model through project monitoring and journaling to construct a project model library and a container configuration library; if the new project is a new project, the rules are defined by combining the requirements of the product and the interface documents and the actual requirements of the project (different project emphasis points are different, for example, the ratio of a container cpu to a memory is 2:1, the maximum specification is not more than 16 cores, and the storage scheme adopts virtifsd and the like project restrictions).
Secondly, based on the project model library and the container configuration library constructed in the mode, the test system dynamically determines the size of a concurrent test thread pool according to hardware resources (such as cpu and memory) and the like, each test thread in the test thread pool randomly builds and runs containers from the project model library and the container configuration library, the configuration parameters of each operation in the container project model and each container project model are selected, real project scenes of concurrent running of a plurality of containers are simulated, the container configuration is continuously and randomly changed in the test running process, the test thread also randomly operates a single container or a plurality of containers, and along with the end of a life cycle, the test thread randomly builds and runs containers of different types, so that the stability test of the containers is realized.
The container testing system of the embodiments of the present description creatively uses the idea of fuzzy testing for system stability testing, providing a universal container stability testing scheme. On one hand, continuously-changed container items are simulated through the combination of a dynamically-randomly-generated container item model and configuration parameters, a large number of complicated item scenes of concurrent operation of differently-configured containers are constructed by using a thread pool on the basis, and test coverage is increased, so that the stability of products is improved; on the other hand, the test definition rule defines reasonable container project scenes and configuration data combinations, so that the test is close to the real project scenes, a large number of invalid tests generated by conventional fuzzy tests are avoided, and more importantly, the inexhaustible test combinations are prevented from causing test explosion; finally, the test object is converted into a project scene of a higher layer from the source code or binary system of the bottom layer software, so that the realization of the test is only dependent on a universal container function interface, the container product of any programming language is supported, the method is suitable for open source and closed source software, the technical problems that the conventional fuzzy test is strongly dependent on the code and programming language of the tested object and the partial fuzzy test only supports the open source software and the like are solved.
Referring to fig. 2, fig. 2 shows a flowchart of a container testing method according to an embodiment of the present disclosure, where the container testing method is applied to a testing platform, and specifically includes the following steps.
Step 202: a plurality of container project models including at least one operation are constructed based on the project information.
The detailed explanation of the project, operation and container project model can be referred to the above embodiments, and will not be repeated here.
Specifically, the project information includes, but is not limited to, information such as project requests, project monitoring, and logs of online projects, and information such as product demand documents and interface documents of offline projects.
Thus, for the construction of a container project model, one specific implementation of a method is as follows:
the building a plurality of container item models including at least one operation based on item information includes:
determining an item state of an item, constructing a plurality of initial container item models based on operation information of the item under the condition that the item state is an operation state, and determining an operation included in each initial container item model;
the same operation of the initial container item models is aggregated to obtain a container item model comprising at least one operation.
The running state may be understood as an on-line state, that is, an item may start running, an item operation may be performed based on a received item processing request, and the like.
At this time, the running information of the project can be understood as information such as project request, project monitoring and generated project log of the project in the running process.
Specifically, in the case where the item status is the running status, a plurality of initial container item models may be constructed based on the running information of the item, for example, the running information of the item is a data query request, and then the initial container item models may be: create-query-delete.
After determining a plurality of initial container item models, obtaining operations included in each initial container item model, and aggregating the initial container item models having the same operations to obtain a final container item model including at least one operation.
For example, initial container item model 1 is: create-query-delete, initial container item model 2 is: create-query-update-delete, initial container item model 3 is: creation-query-deletion, it may be determined that the operations of initial container item model 1 and initial container item model 3 are the same, and then the initial container item model 1 and initial container item model 3 are aggregated (e.g., initial container item model 3 is deleted) to obtain a final container item model including at least one operation: an initial container item model 1 and an initial container item model 2.
In the embodiment of the present disclosure, in order to consider the problem of testing efficiency, container item models that operate the same may be combined, and only the most compact and effective container item model that is close to the real container item model is reserved. In addition, in order to enrich subsequent project scenes, the initial container project model can be reasonably expanded based on the product requirements of the projects, so that a plurality of subsequent project scenes can be generated randomly, and the container test accuracy is improved.
The specific implementation of another method is as follows:
the building a plurality of container item models including at least one operation based on item information includes:
and determining the project state of a project, and constructing a plurality of container project models comprising at least one operation through preset construction rules based on project document information of the project under the condition that the project state is a state to be operated.
The state to be operated is understood as a state of not being online, that is, the project only does the product requirement document or the design document, and the like, and the online operation is not started yet.
At this time, the project document information of the project can be understood as a product demand document, an interface document, and the like at the time of project design.
Specifically, in the case that the project state is a state to be operated, a plurality of project models including at least one operation initial container can be constructed through a preset construction rule based on project document information of the project; the preset construction rule can be set according to practical application, and the specification does not limit the setting, for example, the function setting can be realized according to the items in the product requirement document and the interface document.
In the embodiment of the specification, under the condition that the project is in an offline state, no existing project flow is used as a reference, and a container project model is built by providing a custom rule based on a product requirement document and an interface document of the project, so that a project scene can be built based on the container project model and configuration data later, and the stability test of the container is realized.
Referring to fig. 3, fig. 3 is a schematic diagram illustrating construction of a container item model in a container testing method according to an embodiment of the present disclosure.
As shown in fig. 3, the method specifically includes the states of mirroring, created, running, deleted, suspended, exited, etc., wherein before the container is created, the required mirror is pulled from a public mirror warehouse or a user mirror warehouse, and then the container can be created and run through different container item models and configuration parameters of each operation in each container item model, so as to realize the testing of the container.
Creation, running, starting, deleting, forced deleting, suspending, resuming, stopping/killing, container process exiting/service hanging, viewing processes, viewing containers, executing, restarting, updating, renaming, etc. in fig. 3 may be understood as operations of the containers. In practice, multiple operations may construct a container project model, e.g., the container project model is: create-start-stop-delete, etc. Specifically, each operation in each container item model corresponds to an operational state.
The complete process from creation to deletion of the container is the life cycle of the container, different container operations change the state of the container in the process, meanwhile, the container in different states can only perform specified container operations, and the set of all container operations in the middle of the whole life cycle of the container is the path of the life of the container (namely, a container project model), and is the embodiment of the container in a real project scene. Based on fig. 3 and rules defined according to product requirement tests (such as container longtime running, containers in different states can only operate normally, cpu resource allocation does not exceed rules of 32 cores and the like) and paths of randomly generated container life cycles, the method is used for testing and simulating the performance of a single container in a real project scene.
Step 204: and configuring a corresponding configuration parameter set for each operation in each container item model according to a preset configuration rule.
The preset configuration rule may be set according to practical application, which is not limited in the embodiment of the present disclosure. For example, in the case where the project state is an operational state, a corresponding set of configuration parameters may be configured for each operation in each container project model according to the historical operational parameters of the project.
Specifically, the configuring the corresponding configuration parameter set for each operation in each container item model according to the preset configuration rule includes:
and configuring a plurality of corresponding groups of configuration parameters for each operation in each container item model in an equivalence class division and function point orthogonality mode according to the historical operation parameters of the items, and forming a configuration parameter set based on the plurality of groups of configuration parameters.
The historical operation parameters include, but are not limited to, parameters such as cpu and memory occupation consumed by processing any one item function (such as a data query function or a data update function).
Specifically, multiple groups of configuration parameters corresponding to each operation in each container item model can be configured according to the historical operation parameters of the items in an equivalent class division and function point orthogonality mode, and multiple groups of configuration parameters corresponding to each operation are formed into a configuration parameter set corresponding to the operation. That is, each operation in each container project model can correspond to multiple groups of configuration parameters, and in practical application, when project scenes are constructed, the configuration parameters of each operation in each container project model are different, so that a different project scene can be constructed.
In the embodiment of the specification, the test coverage can be ensured and the test can be controlled within an effective test range by the mode of equivalent class division and functional point orthogonality.
The resource configurations divided by equivalence classes are orthogonal to the function points, and finally, parameter combinations of each operation in a large number of container item models with different types and different configurations can be generated for subsequent container creation. The resource allocation comprises an effective value, a boundary value and an ineffective value; the function points include: storage scheme, network scheme, start type, network access. See in particular table 1.
TABLE 1
| Resource allocation | Storage scheme | Network scheme | Type of start-up | Network access |
| Effective value | overlayfs | Network card straight-through | Cold start | internet |
| Boundary value | devmapper | ipvlan | Warm start | vpc |
| Invalid value | virtiofs | enitrunking | Hot start | Internet+vpc |
In the embodiment of the present disclosure, a suitable plurality of groups of configuration parameters may be configured for each operation in each container project model according to the historical operation parameters of the project in an equivalence class classification and function point orthogonality manner, so as to improve the effectiveness of the subsequent project scenario.
In another case, in the case that the project state is the to-be-run state, the project does not have a historical running parameter, and then a corresponding configuration parameter set can be configured for each operation in each container project model based on the configuration parameters of the test platform. The specific implementation mode is as follows:
The configuring the corresponding configuration parameter set for each operation in each container item model according to the preset configuration rule includes:
and configuring a plurality of corresponding groups of configuration parameters for each operation in each container item model in an equivalence class division and function point orthogonality mode based on the configuration parameters of the test platform, and forming a configuration parameter set based on the plurality of groups of configuration parameters.
The test platform may be understood as a test machine, and then the configuration parameters of the test platform may be understood as cpu and memory space of the test machine.
In practical application, when the test platform tests the container, the resources of the container operated by all test threads of the test platform cannot exceed the resources of the test platform, so that when the configuration parameters are configured for each operation in each container project model, the configuration parameters of the test platform are considered, so that the test explosion caused by the test threads of the subsequent test platform when the container is operated is avoided.
Specifically, under the condition that the project does not have historical operation parameters, corresponding multiple groups of configuration parameters can be configured for each operation in each container project model based on the configuration parameters of the test platform in an equivalent class division and function point orthogonality mode, so that the stability of the test threads of the subsequent test platform on the container test is ensured.
Step 206: and determining the selected container item model to be operated and configuration parameters corresponding to each operation in the container item model to be operated from the plurality of container item models and the configuration parameter set by a test thread.
In practical application, the test thread can be determined based on the configuration parameters of the test platform, or can be preset manually; the test thread is explained based on the configuration parameter determination of the test platform, and the specific implementation manner is as follows:
the determining, by the test thread, a container item model to be run and configuration parameters corresponding to each operation in the container item model to be run, where the configuration parameters correspond to each operation in the container item model to be run, includes:
determining at least one test thread based on configuration parameters of the test platform;
and determining the selected container item model to be operated and the configuration parameters corresponding to each operation in the container item model to be operated from the container item models and the configuration parameter set by each test thread.
The configuration parameters of the test platform may be referred to the description of the above embodiments, and are not described herein.
Specifically, the number of test threads can be dynamically determined according to hardware resources (such as cpu and memory) of the test platform, and then the determined test threads are placed in a constructed thread pool, so that subsequent application is facilitated.
After determining the test threads, each test thread randomly selects a container item model to be operated and configuration parameters corresponding to each operation in the container item model to be operated from a plurality of container item models and the configuration parameter sets, simulates a real item scene of concurrency of a plurality of containers, and realizes the test of the containers.
In the embodiment of the specification, during specific testing, the number of the test threads can be reasonably determined according to the hardware resources of the test platform, so that the stability of the container can be tested based on the test threads.
In another case, the determining, by the test thread, from the plurality of container item models and the configuration parameter set, a selected container item model to be run and a configuration parameter corresponding to each operation in the container item model to be run includes:
determining at least one test thread based on a preset configuration rule;
and determining the selected container item model to be operated and the configuration parameters corresponding to each operation in the container item model to be operated from the container item models and the configuration parameter set by each test thread.
The preset configuration rule may be set according to an actual application, and the specification does not limit the application, for example, the preset configuration rule is to determine a test thread or the like according to the number of container item models or is a real running scene of an item.
Taking a preset configuration rule as an example of a real operation scene of an item, if 30 containers usually run simultaneously in the real operation scene of the item, 30 test threads can be set, but resources of containers corresponding to the 30 test threads are set based on hardware resources of a test platform, and the total consumed resources of the 30 containers in the test operation process cannot exceed the hardware resources of the test platform. The number of the test threads can be 10 or 200 according to the actual situation of each user, and the number of the concurrent containers is large according to the project situation, so that the resources of a single container are certainly small, and if a large container runs, one container can be executed concurrently through a plurality of test threads.
In specific implementation, each test thread only operates one container to be the most basic scene, and another scene is that 30 containers are created first, then each test thread operates on any container in the 30 containers, and a scene that a plurality of test threads operate the same container or a single thread operates a plurality of containers is simulated.
In the embodiment of the specification, the project scenes of a plurality of containers running on the same machine can be simulated through the test threads in the thread pool, the concurrency combination of the random container project models and the configuration parameters can automatically generate project scenes as many as possible, even some conflicts and extreme cases which are not easy to construct are found, more problems can be found in the test process, and the more comprehensive container test is realized.
Step 208: and acquiring an operation result of the test thread for creating and operating the container based on the container item model to be operated and the configuration parameters corresponding to each operation of the container item model to be operated, and testing the container based on the operation result.
Specifically, each test thread creates and runs a container after selecting a container item model to be run and configuration parameters corresponding to each operation of the container item model to be run. The test platform may test the containers based on the results of the operation of each container.
The testing of the container based on the operation results includes:
determining the ending state of the container based on the operation result, and acquiring the target operation of a container item model corresponding to the container;
And testing the container based on the corresponding relation between the ending state and the target operation.
The end state of the container may be understood as a state returned after the container performs an operation in the corresponding container item model, such as a pause state or a delete state.
The target operation of the container item model corresponding to the container may be understood as the last operation of the container item model, for example, the container item model is: create-update-pause, then the target operation is a pause operation.
In practical applications, if the state of the container after operation meets the expectations (e.g., after the container is paused, the ending state of the container is paused), it may be determined that the container test passes.
In one implementation, the container may also be tested according to configuration parameters after the container is run, such as:
the testing of the container based on the operation results includes:
determining operation parameters of the container based on the operation result, and acquiring configuration parameters corresponding to each operation in the container item model to be operated, which corresponds to the container;
and comparing the operation parameters with the configuration parameters, and testing the container based on the comparison result.
The operation parameters are understood to be parameters obtained after the container is operated based on the container item model and the corresponding configuration parameters.
Specifically, if the configuration parameters of the container are consistent with the operation parameters, the state of the container is stable. If the configuration parameters of the container are inconsistent with the operation parameters, the container has certain problems in the operation process, and the unstable performance of the container can be determined.
In the embodiment of the present disclosure, by determining whether the operation parameters of the container are consistent with the configuration parameters, it may be quickly determined whether the container is in a normal state.
In specific implementation, the test threads always run according to preset cycle times, and each test thread can select a container project model and configuration parameters of each operation in each container project model from the project model library and the container configuration library in each cycle to create and run a container. Specifically, if the first operation of the container item model is creation, a container is created at this time, then other operations of the container (such as restarting, pausing, executing commands, checking the container state, etc.) are performed according to the selected container item model, and finally the container is deleted and the next cycle is entered until the number of cycles is completed. The specific cyclic test patterns are as follows:
After determining the test thread, from the plurality of container item models and the configuration parameter set, the selected container item model to be run and the configuration parameter corresponding to each operation in the container item model to be run, further includes:
determining the item model of the container to be operated and the selection times of configuration parameters corresponding to each operation in the item model to be operated, which are selected by the test thread from the item model library and the configuration parameter set;
judging whether the selection times are larger than a preset times threshold value,
if yes, comparing the configuration parameters before the test platform operates with the configuration parameters after the test platform operates, testing the container based on the comparison result,
if not, acquiring an operation result of the test thread for creating and operating the container based on the selected container item model and the configuration parameters corresponding to each operation of the container item model, and testing the container based on the operation result.
The number of selections may be set according to the actual application, for example, 10 times or 20 times.
In practical application, the test threads always run according to preset cycle times, and each test thread can select a container project model and configuration parameters of each operation in each container project model from a project model library and a container configuration library in each cycle to create and run a container. Specifically, if the first operation of the container item model is creation, a container is created at this time, then other operations of the container (such as restarting, pausing, executing commands, checking the container state, etc.) are performed according to the selected container item model, and finally the container is deleted and the next cycle is entered until the number of cycles is completed. And each step in the cycle checks whether the container operation is in line with expectations (e.g., whether the container is in a suspended state after suspending the container) to determine whether the container is in a normal state. After the whole cycle is finished, whether the resources (cpu, memory and the like) of the whole test platform are correctly recovered or not is checked, and whether the resources (cpu, memory and the like) of the whole test platform remain, such as container processes, control groups and the like, and if the resources are normal, the test process is free from errors, and the test is passed.
According to the container testing method provided by the embodiment of the specification, through the combination of the container item model and the configuration parameters which are randomly generated, continuously-changed container items are simulated, a large number of complicated item scenes of concurrent operation of differently configured containers are constructed by using testing threads, and testing coverage is increased, so that the stability of the containers is improved.
In addition, the container test method decouples the fuzzy test and the test product code, is applied to project scene test, and on one hand inherits the capability of effectively exploring the problem of the fuzzy test to improve the stability of container products, and on the other hand improves the universality of the fuzzy test, and supports various types (different languages, open source and closed source) of container products. And the project model library and the container configuration library can be defined based on rules, so that the test is close to a real project scene, a large number of invalid tests are avoided, and the test effectiveness is improved.
Corresponding to the above method embodiments, the present disclosure further provides an embodiment of a container testing device, and fig. 4 shows a schematic structural diagram of a container testing device provided in one embodiment of the present disclosure. As shown in fig. 4, the apparatus includes:
a model building module 402 configured to build a plurality of container item models including at least one operation based on the item information;
A parameter construction module 404 configured to configure a corresponding set of configuration parameters for each operation in each container item model according to a preset configuration rule;
a scenario construction module 406 configured to determine a container item model to be run and configuration parameters corresponding to each operation in the container item model to be run selected by a test thread from the plurality of container item models and the configuration parameter set;
and a test module 408 configured to obtain an operation result of the test thread for creating and operating a container based on the selected container item model and the configuration parameters corresponding to each operation of the container item model, and test the container based on the operation result.
Optionally, the model building module 402 is further configured to:
determining an item state of an item, constructing a plurality of initial container item models based on operation information of the item under the condition that the item state is an operation state, and determining an operation included in each initial container item model;
the same operation of the initial container item models is aggregated to obtain a container item model comprising at least one operation.
Optionally, the model building module 402 is further configured to:
And determining the project state of a project, and constructing a plurality of container project models comprising at least one operation through preset construction rules based on project document information of the project under the condition that the project state is a state to be operated.
Optionally, the parameter construction module 404 is further configured to:
and configuring a plurality of corresponding groups of configuration parameters for each operation in each container item model in an equivalence class division and function point orthogonality mode according to the historical operation parameters of the items, and forming a configuration parameter set based on the plurality of groups of configuration parameters.
Optionally, the parameter construction module 404 is further configured to:
and configuring a plurality of corresponding groups of configuration parameters for each operation in each container item model in an equivalence class division and function point orthogonality mode based on the configuration parameters of the test platform, and forming a configuration parameter set based on the plurality of groups of configuration parameters.
Optionally, the scene construction module 406 is further configured to:
determining at least one test thread based on configuration parameters of the test platform;
and determining the selected container item model to be operated and the configuration parameters corresponding to each operation in the container item model to be operated from the container item models and the configuration parameter set by each test thread.
Optionally, the scene construction module 406 is further configured to:
determining at least one test thread based on a preset configuration rule;
and determining the selected container item model to be operated and the configuration parameters corresponding to each operation in the container item model to be operated from the container item models and the configuration parameter set by each test thread.
Optionally, the test module 408 is further configured to:
determining the ending state of the container based on the operation result, and acquiring the target operation of a container item model corresponding to the container;
and testing the container based on the corresponding relation between the ending state and the target operation.
Optionally, the apparatus further comprises:
a loop module configured to:
determining the item model of the container to be operated and the selection times of configuration parameters corresponding to each operation in the item model to be operated, which are selected by the test thread from the item model library and the configuration parameter set;
judging whether the selection times are larger than a preset times threshold value,
if yes, comparing the configuration parameters before the test platform operates with the configuration parameters after the test platform operates, testing the container based on the comparison result,
If not, acquiring an operation result of the test thread for creating and operating the container based on the selected container item model and the configuration parameters corresponding to each operation of the container item model, and testing the container based on the operation result.
According to the container testing device provided by the embodiment of the specification, through the combination of the container item model and the configuration parameters which are randomly generated, continuously-changed container items are simulated, a complex item scene of concurrent operation of a large number of differently configured containers is constructed by using a testing thread, and the testing coverage is increased, so that the stability of the containers is improved.
The above is a schematic solution of a container testing device of the present embodiment. It should be noted that, the technical solution of the container testing device and the technical solution of the container testing method belong to the same conception, and details of the technical solution of the container testing device, which are not described in detail, can be referred to the description of the technical solution of the container testing method.
Fig. 5 illustrates a block diagram of a computing device 500 provided in accordance with one embodiment of the present description. The components of the computing device 500 include, but are not limited to, a memory 510 and a processor 520. Processor 520 is coupled to memory 510 via bus 530 and database 550 is used to hold data.
Computing device 500 also includes access device 540, access device 540 enabling computing device 500 to communicate via one or more networks 560. Examples of such networks include the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the internet. The access device 540 may include one or more of any type of network interface, wired or wireless (e.g., a Network Interface Card (NIC)), such as an IEEE802.11 Wireless Local Area Network (WLAN) wireless interface, a worldwide interoperability for microwave access (Wi-MAX) interface, an ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a bluetooth interface, a Near Field Communication (NFC) interface, and so forth.
In one embodiment of the present description, the above-described components of computing device 500, as well as other components not shown in FIG. 5, may also be connected to each other, such as by a bus. It should be understood that the block diagram of the computing device shown in FIG. 5 is for exemplary purposes only and is not intended to limit the scope of the present description. Those skilled in the art may add or replace other components as desired.
Computing device 500 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), mobile phone (e.g., smart phone), wearable computing device (e.g., smart watch, smart glasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or PC. Computing device 500 may also be a mobile or stationary server.
Wherein the processor 520 is configured to execute computer-executable instructions that, when executed by the processor, perform the steps of the container testing method described above.
The foregoing is a schematic illustration of a computing device of this embodiment. It should be noted that, the technical solution of the computing device and the technical solution of the container testing method belong to the same concept, and details of the technical solution of the computing device, which are not described in detail, can be referred to the description of the technical solution of the container testing method.
An embodiment of the present disclosure also provides a computer-readable storage medium storing computer instructions that, when executed by a processor, implement the steps of the container testing method described above.
The above is an exemplary version of a computer-readable storage medium of the present embodiment. It should be noted that, the technical solution of the storage medium and the technical solution of the container testing method described above belong to the same concept, and details of the technical solution of the storage medium which are not described in detail can be referred to the description of the technical solution of the container testing method described above.
The foregoing describes specific embodiments of the present disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
The computer instructions include computer program code that may be in source code form, object code form, executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a Read-Only memory (ROM), a random access memory (RAM, randomAccess memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth. It should be noted that the computer readable medium contains content that can be appropriately scaled according to the requirements of jurisdictions in which such content is subject to legislation and patent practice, such as in certain jurisdictions in which such content is subject to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.
It should be noted that, for simplicity of description, the foregoing method embodiments are all expressed as a series of combinations of actions, but it should be understood by those skilled in the art that the embodiments are not limited by the order of actions described, as some steps may be performed in other order or simultaneously according to the embodiments of the present disclosure. Further, those skilled in the art will appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily all required for the embodiments described in the specification.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to the related descriptions of other embodiments.
The preferred embodiments of the present specification disclosed above are merely used to help clarify the present specification. Alternative embodiments are not intended to be exhaustive or to limit the invention to the precise form disclosed. Obviously, many modifications and variations are possible in light of the teaching of the embodiments. The embodiments were chosen and described in order to best explain the principles of the embodiments and the practical application, to thereby enable others skilled in the art to best understand and utilize the invention. This specification is to be limited only by the claims and the full scope and equivalents thereof.
Claims (12)
1. A container testing method is applied to a testing platform and comprises the following steps:
constructing a plurality of container item models including at least one operation based on the item information;
configuring a plurality of corresponding groups of configuration parameters for each operation in each container item model according to a preset configuration rule, and forming a configuration parameter set based on the plurality of groups of configuration parameters;
determining at least one test thread, and determining a container item model to be operated and configuration parameters corresponding to each operation in the container item model to be operated, which are selected from a plurality of container item models and the configuration parameter set by each test thread;
And acquiring an operation result of creating and operating the container by each test thread based on the container item model to be operated and configuration parameters corresponding to each operation of the container item model to be operated, and testing the container based on the operation result.
2. The container testing method of claim 1, the constructing a plurality of container item models including at least one operation based on item information, comprising:
determining an item state of an item, constructing a plurality of initial container item models based on operation information of the item under the condition that the item state is an operation state, and determining an operation included in each initial container item model;
the same operation of the initial container item models is aggregated to obtain a container item model comprising at least one operation.
3. The container testing method of claim 1, the constructing a plurality of container item models including at least one operation based on item information, comprising:
and determining the project state of a project, and constructing a plurality of container project models comprising at least one operation through preset construction rules based on project document information of the project under the condition that the project state is a state to be operated.
4. The container testing method according to claim 2, wherein the configuring the corresponding configuration parameter set for each operation in each container item model according to the preset configuration rule includes:
and configuring a plurality of corresponding groups of configuration parameters for each operation in each container item model in an equivalence class division and function point orthogonality mode according to the historical operation parameters of the items, and forming a configuration parameter set based on the plurality of groups of configuration parameters.
5. The container testing method according to claim 1, wherein the configuring the corresponding plurality of sets of configuration parameters for each operation in each container item model according to the preset configuration rule, and forming the configuration parameter set based on the plurality of sets of configuration parameters, includes:
and configuring a plurality of corresponding groups of configuration parameters for each operation in each container item model in an equivalence class division and function point orthogonality mode based on the configuration parameters of the test platform, and forming a configuration parameter set based on the plurality of groups of configuration parameters.
6. The container testing method according to claim 1, wherein the determining at least one test thread and determining a container item model to be run and a configuration parameter corresponding to each operation in the container item model to be run, which are selected from a plurality of container item models and the configuration parameter set by each test thread, includes:
Determining at least one test thread based on configuration parameters of the test platform;
and determining a container item model to be operated selected by each test thread from a plurality of container item models and the configuration parameter set and configuration parameters corresponding to each operation in the container item model to be operated.
7. The container testing method according to claim 1, wherein the determining at least one test thread and determining a container item model to be run and a configuration parameter corresponding to each operation in the container item model to be run, which are selected from a plurality of container item models and the configuration parameter set by each test thread, includes:
determining at least one test thread based on a preset configuration rule;
and determining a container item model to be operated selected by each test thread from a plurality of container item models and the configuration parameter set and configuration parameters corresponding to each operation in the container item model to be operated.
8. The container testing method of claim 1, the testing the container based on the operation result, comprising:
determining the ending state of the container based on the operation result, and acquiring the target operation of a container item model corresponding to the container;
And testing the container based on the corresponding relation between the ending state and the target operation.
9. The container testing method according to claim 8, wherein after determining the selected container item model to be run and the configuration parameters corresponding to each operation in the container item model to be run from the plurality of container item models and the configuration parameter set, each testing thread further comprises:
determining the item model of the container to be operated selected by each test thread from the item model library and the configuration parameter set and the selection times of the configuration parameters corresponding to each operation in the container item model to be operated;
judging whether the selection times are larger than a preset times threshold value,
if yes, comparing the configuration parameters before the test platform operates with the configuration parameters after the test platform operates, testing the container based on the comparison result,
if not, acquiring an operation result of creating and operating the container by each test thread based on the selected container project model and the configuration parameters corresponding to each operation of the container project model, and testing the container based on the operation result.
10. A container testing device for a testing platform, comprising:
a model building module configured to build a plurality of container item models including at least one operation based on the item information;
the parameter construction module is configured to configure corresponding multiple groups of configuration parameters for each operation in each container item model according to a preset configuration rule, and form a configuration parameter set based on the multiple groups of configuration parameters;
the scene construction module is configured to determine at least one test thread and determine a container item model to be operated and configuration parameters corresponding to each operation in the container item model to be operated, wherein each test thread is selected from a plurality of container item models and the configuration parameter set;
the testing module is configured to acquire an operation result of the testing thread for creating and operating the container based on the container item model to be operated and the configuration parameters corresponding to each operation of the container item model to be operated, and test the container based on the operation result.
11. A computing device, comprising:
a memory and a processor;
the memory is configured to store computer executable instructions, and the processor is configured to execute the computer executable instructions, which when executed by the processor, implement the steps of the container testing method of any one of claims 1-9.
12. A computer readable storage medium storing computer executable instructions which when executed by a processor perform the steps of the container testing method of any one of claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110536845.2A CN113297072B (en) | 2021-05-17 | 2021-05-17 | Container testing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110536845.2A CN113297072B (en) | 2021-05-17 | 2021-05-17 | Container testing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113297072A CN113297072A (en) | 2021-08-24 |
| CN113297072B true CN113297072B (en) | 2023-11-03 |
Family
ID=77322537
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110536845.2A Active CN113297072B (en) | 2021-05-17 | 2021-05-17 | Container testing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113297072B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114791846B (en) * | 2022-05-23 | 2022-10-04 | 北京同创永益科技发展有限公司 | Method for realizing observability aiming at cloud-originated chaos engineering experiment |
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101788908A (en) * | 2010-01-26 | 2010-07-28 | 浪潮(山东)电子信息有限公司 | Batch data processing method supporting breakpoint reget |
| US7992133B1 (en) * | 2006-02-14 | 2011-08-02 | Progress Software Corporation | Techniques for debugging distributed applications |
| CN103049384A (en) * | 2012-12-29 | 2013-04-17 | 中国科学院深圳先进技术研究院 | Automatic generating frame of multi-core-based multithread limit energy consumption testing source program |
| WO2017121400A1 (en) * | 2016-01-16 | 2017-07-20 | 平安科技（深圳）有限公司 | Method, system and device for testing and readable storage medium |
| US9916233B1 (en) * | 2015-03-27 | 2018-03-13 | Amazon Technologies, Inc. | Using containers for update deployment |
| CN108628733A (en) * | 2017-03-16 | 2018-10-09 | 中国移动通信集团山西有限公司 | The test method and device of batch service processing operation |
| CN108959080A (en) * | 2018-06-27 | 2018-12-07 | 郑州云海信息技术有限公司 | A kind of automated testing method executed parallel based on UnitTest |
| CN109002307A (en) * | 2018-06-27 | 2018-12-14 | 郑州云海信息技术有限公司 | A kind of upgrading and automated testing method automatically |
| CN109062798A (en) * | 2018-07-26 | 2018-12-21 | 浙江数链科技有限公司 | A kind of test method and device based on Dubbo frame |
| DE102017120016A1 (en) * | 2017-08-31 | 2019-02-28 | Dspace Digital Signal Processing And Control Engineering Gmbh | A method of configuring a test device set up to test an electronic controller and a configuration system |
| CN109783354A (en) * | 2018-12-14 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Function test method, terminal device and the medium of application system |
| CN109815114A (en) * | 2018-12-14 | 2019-05-28 | 深圳壹账通智能科技有限公司 | Test method, management server, test equipment, computer equipment and medium |
| CN110008106A (en) * | 2018-01-04 | 2019-07-12 | 北京奇虎科技有限公司 | Code test method, device and computer readable storage medium |
| CN110377462A (en) * | 2019-06-17 | 2019-10-25 | 中国平安人寿保险股份有限公司 | Interface test method, device and terminal device |
| CN110795336A (en) * | 2019-09-25 | 2020-02-14 | 腾讯科技（深圳）有限公司 | Application program control method, device, equipment and readable storage medium |
| CN111124850A (en) * | 2019-11-12 | 2020-05-08 | 上海移远通信科技有限公司 | MQTT server performance testing method, system, computer equipment and storage medium |
| CN112286802A (en) * | 2020-10-23 | 2021-01-29 | 上海淇玥信息技术有限公司 | Method and device for testing program performance and electronic equipment |
| CN112612681A (en) * | 2020-12-29 | 2021-04-06 | 中国科学院空天信息创新研究院 | Automatic management method for deep learning model test evaluation full process based on container |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100023294A1 (en) * | 2008-07-28 | 2010-01-28 | Credence Systems Corporation | Automated test system and method |
| US20180322037A1 (en) * | 2017-05-04 | 2018-11-08 | Microsoft Technology Licensing, Llc | Impersonation in test automation |
| US11100084B2 (en) * | 2017-05-05 | 2021-08-24 | Servicenow, Inc. | Configuration management identification rule testing |
| US11307967B2 (en) * | 2019-02-04 | 2022-04-19 | Oracle International Corporation | Test orchestration platform |
-
2021
- 2021-05-17 CN CN202110536845.2A patent/CN113297072B/en active Active
Patent Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7992133B1 (en) * | 2006-02-14 | 2011-08-02 | Progress Software Corporation | Techniques for debugging distributed applications |
| CN101788908A (en) * | 2010-01-26 | 2010-07-28 | 浪潮(山东)电子信息有限公司 | Batch data processing method supporting breakpoint reget |
| CN103049384A (en) * | 2012-12-29 | 2013-04-17 | 中国科学院深圳先进技术研究院 | Automatic generating frame of multi-core-based multithread limit energy consumption testing source program |
| US9916233B1 (en) * | 2015-03-27 | 2018-03-13 | Amazon Technologies, Inc. | Using containers for update deployment |
| WO2017121400A1 (en) * | 2016-01-16 | 2017-07-20 | 平安科技（深圳）有限公司 | Method, system and device for testing and readable storage medium |
| CN108628733A (en) * | 2017-03-16 | 2018-10-09 | 中国移动通信集团山西有限公司 | The test method and device of batch service processing operation |
| DE102017120016A1 (en) * | 2017-08-31 | 2019-02-28 | Dspace Digital Signal Processing And Control Engineering Gmbh | A method of configuring a test device set up to test an electronic controller and a configuration system |
| CN110008106A (en) * | 2018-01-04 | 2019-07-12 | 北京奇虎科技有限公司 | Code test method, device and computer readable storage medium |
| CN109002307A (en) * | 2018-06-27 | 2018-12-14 | 郑州云海信息技术有限公司 | A kind of upgrading and automated testing method automatically |
| CN108959080A (en) * | 2018-06-27 | 2018-12-07 | 郑州云海信息技术有限公司 | A kind of automated testing method executed parallel based on UnitTest |
| CN109062798A (en) * | 2018-07-26 | 2018-12-21 | 浙江数链科技有限公司 | A kind of test method and device based on Dubbo frame |
| CN109783354A (en) * | 2018-12-14 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Function test method, terminal device and the medium of application system |
| CN109815114A (en) * | 2018-12-14 | 2019-05-28 | 深圳壹账通智能科技有限公司 | Test method, management server, test equipment, computer equipment and medium |
| CN110377462A (en) * | 2019-06-17 | 2019-10-25 | 中国平安人寿保险股份有限公司 | Interface test method, device and terminal device |
| CN110795336A (en) * | 2019-09-25 | 2020-02-14 | 腾讯科技（深圳）有限公司 | Application program control method, device, equipment and readable storage medium |
| CN111124850A (en) * | 2019-11-12 | 2020-05-08 | 上海移远通信科技有限公司 | MQTT server performance testing method, system, computer equipment and storage medium |
| CN112286802A (en) * | 2020-10-23 | 2021-01-29 | 上海淇玥信息技术有限公司 | Method and device for testing program performance and electronic equipment |
| CN112612681A (en) * | 2020-12-29 | 2021-04-06 | 中国科学院空天信息创新研究院 | Automatic management method for deep learning model test evaluation full process based on container |
Non-Patent Citations (4)
| Title |
|---|
| Docker云平台的资源调度算法研究;李连万;《中国优秀硕士学位论文全文数据库 信息科技辑》;全文 * |
| 基于DevOps能力模型的持续集成方法;董昕;郭勇;王杰;;计算机工程与设计(第07期);全文 * |
| 船舶领域面向对象软件的测试;陈曦;;中国舰船研究(第01期);全文 * |
| 运用类复制变异和JPF技术生成类间测试用例;钟诚;唐春艳;;小型微型计算机系统(第08期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113297072A (en) | 2021-08-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2019200046B2 (en) | Utilizing artificial intelligence to test cloud applications | |
| CN112101562B (en) | Implementation method and system of machine learning modeling process | |
| US11036576B2 (en) | Automatically reconfiguring a performance test environment | |
| US10198344B2 (en) | Build failure management in continuous integration environments for distributed systems | |
| CN109034394B (en) | Updating method and device of machine learning model | |
| CN104461693B (en) | Virtual machine update method and system under a kind of desktop cloud computing environment | |
| US20160162800A1 (en) | Parallel Development and Deployment for Machine Learning Models | |
| CN107656705B (en) | Computer storage medium and data migration method, device and system | |
| CN109672740B (en) | The method of deployment configuration information is obtained in a kind of large-scale cluster environment | |
| US20160259713A1 (en) | Method and system for determining functional tests to execute based on code coverage | |
| KR20180009352A (en) | Method and apparatus for data processing for mobile games | |
| CN111309734B (en) | Method and system for automatically generating table data | |
| US11809882B2 (en) | Interface calling method and apparatus, and computer-readable storage medium | |
| CN113297072B (en) | Container testing method and device | |
| CN112702225B (en) | Cloud platform performance testing device and method, computer terminal and readable storage medium | |
| US20200319855A1 (en) | Parameter modification of virtual entities for client applications | |
| CN112559525A (en) | Data checking system, method, device and server | |
| CN114201382A (en) | Test case generation method and device, storage medium and electronic equipment | |
| Henrix et al. | Performance improvement in automata learning | |
| US20200327364A1 (en) | Clustering simulation failures for triage and debugging | |
| CN115203008A (en) | Test method, test device, storage medium and equipment | |
| JP2023541510A (en) | Systems, methods, and servers for optimizing containerized application deployment | |
| CN117573730B (en) | Data processing method, apparatus, device, readable storage medium, and program product | |
| US11741058B2 (en) | Systems and methods for architecture embeddings for efficient dynamic synthetic data generation | |
| JP2019144873A (en) | Block diagram analyzer |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40057913 Country of ref document: HK |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240306 Address after: # 03-06, Lai Zan Da Building 1, 51 Belarusian Road, Singapore Patentee after: Alibaba Innovation Co. Country or region after: Singapore Address before: Room 01, 45th Floor, AXA Building, 8 Shanton Road, Singapore Patentee before: Alibaba Singapore Holdings Ltd. Country or region before: Singapore |
|
| TR01 | Transfer of patent right |