CN112765014A - Automatic test system for multi-user simultaneous operation and working method - Google Patents
Automatic test system for multi-user simultaneous operation and working method Download PDFInfo
- Publication number
- CN112765014A CN112765014A CN202110004299.8A CN202110004299A CN112765014A CN 112765014 A CN112765014 A CN 112765014A CN 202110004299 A CN202110004299 A CN 202110004299A CN 112765014 A CN112765014 A CN 112765014A
- Authority
- CN
- China
- Prior art keywords
- service
- function
- module
- test
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 217
- 238000000034 method Methods 0.000 title claims abstract description 27
- 230000006870 function Effects 0.000 claims abstract description 215
- 238000004088 simulation Methods 0.000 claims abstract description 48
- 230000003993 interaction Effects 0.000 claims abstract description 27
- 238000012795 verification Methods 0.000 claims abstract description 15
- 230000002452 interceptive effect Effects 0.000 claims description 26
- 230000000694 effects Effects 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 11
- 230000008569 process Effects 0.000 claims description 10
- 238000012986 modification Methods 0.000 claims description 9
- 230000004048 modification Effects 0.000 claims description 9
- 238000004364 calculation method Methods 0.000 claims description 6
- 238000012790 confirmation Methods 0.000 claims description 6
- 238000001514 detection method Methods 0.000 claims description 6
- 230000036632 reaction speed Effects 0.000 claims description 6
- 230000000977 initiatory effect Effects 0.000 claims description 4
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000003860 storage Methods 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 30
- 238000004590 computer program Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 4
- 238000007689 inspection Methods 0.000 description 4
- 230000007547 defect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013100 final test Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Abstract
The invention provides an automatic test system for simultaneous operation of multiple users and a working method. The scheme comprises an operation simulation subsystem, a script checking subsystem, a service checking subsystem and an inter-service connectivity testing subsystem; the operation simulation subsystem comprises an environment simulation module to be tested and a multi-user access test module, the script checking subsystem comprises an automatic operation script module and a function numbering module, the service checking subsystem comprises a service function checking module and a service execution efficiency checking module, and the inter-service connectivity test subsystem comprises a service mutual checking module and an inter-service interaction information accuracy verification module; the scheme provides a simulation environment and basic data for user operation through multi-level data test division, performs service self-check and mutual query, and solves the problem that the memory is easy to make mistakes in on-line operation test of multiple users simultaneously based on the modes of temporary storage space, shared data pool and the like.
Description
Technical Field
The invention relates to the technical field of internet, in particular to an automatic test system for simultaneous operation of multiple users and a working method.
Background
At present, with the continuous development of internet technology, more and more management systems are built on the internet. Since the management systems in the internet store a lot of information and many new functions may appear during the use, and the service functions and the stored information are very important, the management systems need to be tested comprehensively for the service functions, the storage capacity, the computing capacity, the communication speed, and the like before being used or after being used for a period of time. Although the forms of these management systems vary, they all share a common or similar structure. This allows for centralized testing.
However, the existing scheme has the following defects: generally, there is no system for performing automatic testing by multiple users, but in actual use, it is very common that multiple users operate simultaneously in a management system and multiple users perform service functions simultaneously. If some traditional manual testing methods of single users are adopted, situations such as conflict between memory addresses and service function operations in the testing process may occur.
Disclosure of Invention
In view of the above problems, the present invention provides an automatic test system and a working method for multi-user simultaneous operation, which can effectively avoid the situations of operation conflicts of memory addresses and service functions in the test process caused by the manual test of the traditional single user.
According to an embodiment of the present invention, there is provided an automatic test system for simultaneous operation of multiple users, the system including: the system comprises an operation simulation subsystem, a script checking subsystem, a service checking subsystem and an inter-service connectivity testing subsystem; the operation simulation subsystem comprises an environment simulation module to be tested and a multi-user access test module, the script checking subsystem comprises an automatic operation script module and a function numbering module, the service checking subsystem comprises a service function checking module and a service execution efficiency checking module, and the inter-service connectivity test subsystem comprises a service mutual checking module and an inter-service interaction information accuracy verification module; the operation simulation subsystem provides a simulation environment and a plurality of user operation basic data for the script checking subsystem, the service checking subsystem performs service function and execution efficiency checking, and the inter-service connectivity testing subsystem performs service mutual checking and interactive query.
In one or more embodiments, preferably, the environment under test simulation module includes:
the to-be-tested environment acquisition submodule is used for inputting all to-be-tested environments to be tested;
the repeated environment removing sub-module is used for removing repeated environments to be detected;
the to-be-tested environment classification submodule is used for classifying the to-be-tested environment to obtain a to-be-tested environment classification table;
the to-be-tested environment building submodule is used for generating a to-be-tested environment test packet;
and the environment simulation submodule is used for combining the to-be-tested environment classification table and the to-be-tested environment test packet to form a simulation environment.
In one or more embodiments, preferably, the multi-user access test module includes:
the shared data pool is used for researching and inputting basic data of the process to be tested of each user;
the temporary users are used for establishing temporary test users one by one according to the test scheme of the user to be tested and setting a test principle;
the temporary data pool extracts and stores the user test schemes with the function conflict in the shared data pool as temporary data;
the modification confirmation submodule is used for generating a determined test scheme according to the temporary data and storing the test scheme to the shared data pool;
and the user operation basic data establishing sub-module establishes a plurality of user operation basic data according to the final data of the shared data pool.
In one or more embodiments, preferably, the automatic operation script module includes:
the function generation submodule generates each function test scheme according to all functions to be tested;
the function checking sub-module forms a corresponding test program according to each function test scheme;
the function splitting submodule is used for obtaining a test program with the processing time length exceeding half of the average test time and splitting the test program into 2 test functions;
the function merging submodule acquires submodules with similar functions and merges the submodules into a standard test function;
the function execution sub-module obtains the relation between input and output according to the function of each sub-module;
and the automatic processing submodule generates a list of functions to be executed according to the input-output relationship of the function execution submodule.
In one or more embodiments, preferably, the function numbering module includes:
the function service classification submodule classifies the list of the functions to be executed according to the service functions and decomposes the list into a single service function and an interactive service;
the function list user classification submodule is divided into a multi-user test and a single-user test according to the number of initiating users and sorts the tests from small to large according to the number of the user tests;
and the sequence numbering submodule generates a single service function test list and an interactive service function list.
In one or more embodiments, preferably, the service function checking module includes:
the functional effect classification submodule classifies the test functional effects into indexable functions and non-indexable functions;
the function effect verification submodule is used for testing the final execution effect of the service function and storing the final execution effect as a final service function operation index;
and the functional efficiency degree analysis submodule is used for comparing the final service function operation index with the service function index to generate a function execution efficiency check result, wherein the function execution efficiency check result comprises a completed proportion, an excess completed proportion, an incomplete proportion and a completed proportion.
In one or more embodiments, preferably, the service execution efficiency checking module includes:
executing the node checking submodule to obtain all detection stages of the service function test scheme;
the node execution efficiency calculation submodule is used for obtaining the difference between the time nodes of all detection stages of the service function test scheme and the initial time of the service function so as to obtain the node execution efficiency;
the total execution efficiency calculation submodule is used for obtaining the difference between the time node of the last stage of the service function test scheme and the initial time of the service function so as to obtain the total execution efficiency;
and the efficiency verification sub-module is used for acquiring the execution standard of the service function and comparing the total execution efficiency with the size relationship between the node execution efficiency and the execution standard of the service function.
In one or more embodiments, preferably, the service mutual-check module includes:
the inter-check function list submodule generates an inter-check function list according to the interactive service function list;
the third cycle query sub-module is used for carrying out third cycle on tasks needing more than 2 times of interaction in the mutual query function list and confirming that the service function is correct;
and the service hedge testing submodule is used for testing whether the interaction is normal or not when 2 users only carry out the hedge interaction operation in different services at the same time.
In one or more embodiments, preferably, the inter-service interaction information accuracy verification module includes:
the data sending module is used for sending data among services;
the data receiving module is used for acquiring service data return of the interactive party;
the timing module is used for recording the interaction speed and the reaction speed among the services;
and the data comparison module is used for comparing the interaction speed and the reaction speed with the required time of the interaction function between the services.
Further, an embodiment of the present invention provides a working method for an automatic test system that is operated by multiple users simultaneously, where the method includes:
determining whether all subsystems in the automatic test system for multi-user simultaneous operation have been successfully deployed;
executing the to-be-tested environment simulation module in the operation simulation subsystem to obtain a simulation environment;
running the multi-user access test module under the simulation environment to obtain a plurality of user running basic data;
running an automatic operation script module to obtain a group of continuous function lists to be executed according to the plurality of user running basic data;
according to the function list to be executed, the function numbering module is utilized to classify the services, and a single service function test list and an interactive service function list are obtained;
utilizing a service checking subsystem to check service functions and execution efficiency according to the single service function test list;
and performing service inter-inspection and interactive query by utilizing the inter-service connectivity test subsystem according to the interactive service function list.
The technical scheme provided by the embodiment of the invention can have the following beneficial effects:
in the embodiment of the invention, the scheme provides an automatic test system and a working method for multi-user simultaneous operation, a multi-level subsystem is designed through multi-level data test division, a simulation environment and user operation basic data are provided, service self-checking and mutual inquiry are carried out, the problem of memory error in multi-user simultaneous online operation test is solved based on temporary storage space, a shared data pool and the like, and the test efficiency and the data reliability are improved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a block diagram of an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
Fig. 2 is a block diagram of an environment simulation module under test in an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
FIG. 3 is a block diagram of a multiple user access test module for use in an automatic test system with multiple simultaneous users, in accordance with one embodiment of the present invention.
Fig. 4 is a block diagram of an automatic operation script module in an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
FIG. 5 is a diagram of function numbering modules in an automatic test system for simultaneous operation of multiple users, in accordance with an embodiment of the present invention.
Fig. 6 is a block diagram of a service function checking module in an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
Fig. 7 is a block diagram of a service execution efficiency checking module in an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
Fig. 8 is a block diagram of a service cross-checking module in an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
Fig. 9 is a block diagram of an inter-service interaction information accuracy verification module in an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
FIG. 10 is a logic diagram illustrating simultaneous multi-user operation in an automatic test system for simultaneous multi-user operation, in accordance with an embodiment of the present invention.
FIG. 11 is a logical relationship diagram of multi-user automatic test in an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
FIG. 12 is a flow chart of a method for operating an automatic test system for simultaneous operation of multiple users, in accordance with an embodiment of the present invention.
Detailed Description
In some of the flows described in the present specification and claims and in the above figures, a number of operations are included that occur in a particular order, but it should be clearly understood that these operations may be performed out of order or in parallel as they occur herein, with the order of the operations being indicated as 101, 102, etc. merely to distinguish between the various operations, and the order of the operations by themselves does not represent any order of performance. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first", "second", etc. in this document are used for distinguishing different messages, devices, modules, etc., and do not represent a sequential order, nor limit the types of "first" and "second" to be different.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
At present, with the continuous development of internet technology, more and more management systems are built on the internet. Since the management systems in the internet store a lot of information and many new functions may appear during the use, and the service functions and the stored information are very important, the management systems need to be tested comprehensively for the service functions, the storage capacity, the computing capacity, the communication speed, and the like before being used or after being used for a period of time. Although the forms of these management systems vary, they all share a common or similar structure. This allows for centralized testing.
However, the existing scheme has the following defects: generally, there is no system for performing automatic testing by multiple users, but in actual use, it is very common that multiple users operate simultaneously in a management system and multiple users perform service functions simultaneously. If some traditional manual testing methods of single users are adopted, situations such as conflict between memory addresses and service function operations in the testing process may occur.
The embodiment of the invention provides an automatic test system for multi-user simultaneous operation, which simplifies the test flow through multi-level data test division, ensures no memory conflict in the operation process based on a mode that multiple users simultaneously operate and independently use a temporary storage space and share a data pool in the system, and realizes the online operation compatibility of multiple users.
Fig. 1 is a block diagram of an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
In one or more embodiments, as shown in fig. 1, preferably, according to an embodiment of the present invention, there is provided an automatic test system for multi-user simultaneous operation, the system including: an operation simulation subsystem 101, a script checking subsystem 102, a service checking subsystem 103 and an inter-service connectivity testing subsystem 104; the operation simulation subsystem 101 includes an environment simulation module 105 to be tested and a multi-user access test module 106, the script checking subsystem 102 includes an automatic operation script module 107 and a function numbering module 108, the service checking subsystem 103 includes a service function checking module 109 and a service execution efficiency checking module 110, and the inter-service connectivity test subsystem 104 includes a service inter-service mutual checking module 111 and an inter-service interaction information accuracy verification module 112; the operation simulation subsystem 101 provides a simulation environment and a plurality of user operation basic data to the script checking subsystem 102, the service checking subsystem 103 performs service function and execution efficiency checking, and the inter-service connectivity testing subsystem 104 performs service mutual checking and interactive query.
In the embodiment of the invention, the provided integral system architecture is the basis for disassembling the sub-modules subsequently, firstly, the operation simulation subsystem provides a simulation environment and a plurality of user operation basic data for the script checking subsystem, then the service checking subsystem is used for carrying out single service test on the test script obtained by the script checking subsystem, and further the service connectivity test subsystem is used for carrying out the communication between systems, the service function execution efficiency and the like, and finally, the automatic test of a universal multi-type system can be realized.
Further, fig. 2 to 12 respectively describe specific modules in the embodiment of the present invention.
Fig. 2 is a block diagram of an environment simulation module under test in an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
As shown in fig. 2, in one or more embodiments, preferably, the environment under test simulation module 105 includes:
the to-be-tested environment acquisition submodule 201 is used for inputting all to-be-tested environments to be tested;
a repeated environment removing sub-module 202 for removing repeated environments to be detected;
the to-be-tested environment classification submodule 203 is used for classifying the to-be-tested environment to obtain a to-be-tested environment classification table;
the to-be-tested environment building submodule 204 is used for generating a to-be-tested environment test packet;
and the environment simulation submodule 205 is used for combining the to-be-tested environment classification table and the to-be-tested environment test packet to form a simulation environment.
In the embodiment of the invention, the simulation of the external environment is the basis of the test, the to-be-tested environment acquisition submodule provides test environments according to all requirements, but the test environments have sequence and classification, so the finally formed simulation environment comprises classification, namely different regions provide different test environments. The environment to be tested provided secondly will have a certain sequentiality, that is, the environment to be tested will have some changes in different tests. Therefore, the generated environment-under-test packet is an environment which is not needed initially, but may be called during the test process. By the mode, rapid and automatic testing can be realized, and repeated preparation work of waiting for the environment to be tested is not needed.
FIG. 3 is a block diagram of a multiple user access test module for use in an automatic test system with multiple simultaneous users, in accordance with one embodiment of the present invention.
As shown in fig. 3, in one or more embodiments, the multi-user access test module 106 preferably includes:
a shared data pool 301 for investigating the input basic data of the process to be tested of each user;
the temporary user 302 is used for establishing temporary test users one by one according to the test scheme of the user to be tested and setting a test principle;
a temporary data pool 303, which extracts and stores the user test schemes with function conflicts in the shared data pool 301 as temporary data;
the modification confirmation submodule 304 is configured to generate a determined test scheme according to the temporary data, and store the test scheme in the shared data pool 301;
the user operation basic data creating sub-module 305 creates a plurality of user operation basic data according to the final data of the shared data pool 301.
In the embodiment of the invention, a foundation is laid for establishing the basic multi-user simultaneous operation through the temporary data pool, the shared data pool and the modification confirmation submodule. Specifically, when one user operates a certain block address, the temporary data pool is operated first, and then the temporary data pool is replaced into the system by using the modification confirmation submodule, so that other users cannot be affected at this time, but the shared data pool will be changed. And after the change is confirmed, respectively and periodically sharing the new shared data pool to other simultaneous operation users who do not use the sub-modules with modification confirmation. The mode can effectively avoid the data compatibility risk brought by simultaneous operation.
Fig. 4 is a block diagram of an automatic operation script module in an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
As shown in FIG. 4, in one or more embodiments, the automation script module 107 preferably includes:
the function generation submodule 401 generates each function test scheme according to all functions to be tested;
a function checking sub-module 402 for forming a corresponding test program according to each function test scheme;
a function splitting submodule 403 for obtaining a test program with a processing time length exceeding half of the average test time, and splitting the test program into 2 test functions;
a function merging submodule 404, which acquires submodules with similar functions and merges the submodules into a standard test function;
a function execution submodule 405 for obtaining a relation between input and output according to the function of each submodule;
and the automatic processing submodule 406 generates a list of functions to be executed according to the input-output relationship of the function execution submodule 405.
In the embodiment of the invention, because of the normally provided automatic test function, certain redundant and repeated parts exist, the main purpose of the function generation, the function check and the function split is to split the original function into the parts which are redistributed according to certain rules, and then the function combination, the function execution and the automatic processing sub-modules are used for generating a list of the functions to be executed which is more efficient and deletes the redundant parts.
FIG. 5 is a diagram of function numbering modules in an automatic test system for simultaneous operation of multiple users, in accordance with an embodiment of the present invention.
As shown in fig. 5, in one or more embodiments, preferably, the function numbering module 108 includes:
a function service classification submodule 501, configured to classify the list of functions to be executed according to service functions, and decompose the list into a single service function and an interactive service;
the function list user classification sub-module 502 is divided into a multi-user test and a single-user test according to the number of initiating users, and the tests are sorted from small to large according to the number of the user tests;
the sequence numbering sub-module 503 generates a single service function test list and an interactive service function list.
In the embodiment of the invention, the function numbering module determines whether each test belongs to a single-service test or an interactive test one by one according to the initiating number and the service number of the user, analyzes whether the test relates to the condition of simultaneous operation of multiple users, and generates a function list to provide data basis for subsequent tests.
Fig. 6 is a block diagram of a service function checking module in an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
As shown in fig. 6, in one or more embodiments, preferably, the service function checking module 109 includes:
the functional effect classification submodule 601 is used for classifying the test functional effects into an indexable function and an non-indexable function;
a function effect verification sub-module 602, configured to test a final execution effect of the service function, and store the final execution effect as a final service function operation index;
and the functional efficiency degree analysis sub-module 603 compares the final service function operation index with the service function index to generate a function execution efficiency check result, wherein the function execution efficiency check result comprises a completed proportion, an excess completed proportion, an incomplete proportion and a completed proportion.
In the embodiment of the present invention, in order to obtain a clear test result, the test functions are classified according to the effect of the function, specifically, if the test result of a single function is only completed and not completed, the function is a function that cannot be indexed, and when the test result can be completed by 10%, 20%, 100%, or even excessive, the function is a function that can be standardized, and finally the function is divided into a completion ratio.
Fig. 7 is a block diagram of a service execution efficiency checking module in an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
As shown in fig. 7, in one or more embodiments, preferably, the service execution efficiency checking module 110 includes:
executing the node checking submodule 701 to obtain all detection stages of the service function test scheme;
the node execution efficiency calculation sub-module 702 obtains the difference between the time nodes of all detection stages of the service function test scheme and the initial time of the service function, and obtains the node execution efficiency;
the total execution efficiency calculation sub-module 703 obtains the difference between the time node of the last stage of the service function test scheme and the start time of the service function, and obtains the total execution efficiency;
and the efficiency verification sub-module 704 is used for acquiring the execution standard of the service function and comparing the total execution efficiency with the size relationship between the node execution efficiency and the execution standard of the service function.
In the embodiment of the invention, the final test not only comprises whether the test can be completed or not, but also comprises the test efficiency, and particularly, the test of the total time of the whole task function and the efficiency test of part of important nodes can be respectively carried out. These execution efficiencies are an important part of the test results automatically obtained by the automatic test system.
Fig. 8 is a block diagram of a service cross-checking module in an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
As shown in fig. 8, in one or more embodiments, preferably, the service mutual-check module 111 includes:
the inter-inspection function list sub-module 801 generates an inter-inspection function list according to the interactive service function list;
the third-cycle query sub-module 802 performs a third cycle on the tasks requiring more than 2 interactions in the inter-inspection function list to confirm that the service function is correct;
the service hedge test sub-module 803 tests whether the interaction is normal or not when 2 users only interact hedge operation in different services at the same time.
In the embodiment of the invention, the service inquired by the mutual checking system comprises a conflict test, namely, users of both parties send a specified command to the server of the other party at the same time to judge whether the command can be normally fed back or not, and in addition, the condition that the repeated cycle inquiry is left for many times, whether the inquiry can be normally operated or not is also required to be tested, and the data conflict situation cannot occur.
Fig. 9 is a block diagram of an inter-service interaction information accuracy verification module in an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention.
As shown in fig. 9, in one or more embodiments, preferably, the inter-service interaction information accuracy verification module 112 includes:
a data sending module 901, which sends data between services;
a data receiving module 902, which obtains the service data return of the interactive party;
a timing module 903, which records the interaction speed and the reaction speed between services;
and a data comparison module 904, comparing the interaction speed and the reaction speed with the required time of the service interaction function.
In the embodiment of the invention, the final interaction among services mainly tests the communication capacity according to the actual requirement, and when the data transmission and the data operation cannot be completed within the required time, the capacity cannot be met.
FIG. 10 is a logic diagram illustrating simultaneous multi-user operation in an automatic test system for simultaneous multi-user operation, in accordance with an embodiment of the present invention. As shown in fig. 10, in one or more embodiments, preferably, the graph is a memory space relationship in an operation process of a plurality of users, where the temporary data pool 1002, the temporary data pool 1003, the temporary data pool 1004, and the temporary data pool 1005 are data pools currently operated by a user 1006, a user 1007, a user 1008, and a user 1009, respectively, after one of the users submits data, other users cannot submit the data in a short time, and can submit the data only after waiting for updating of the respective temporary data pool according to the latest shared data pool 1001, so that security of the data is ensured.
FIG. 11 is a logical relationship diagram of multi-user automatic test in an automatic test system for multi-user simultaneous operation according to an embodiment of the present invention. As shown in fig. 11, in one or more embodiments, preferably, the relationship indicates a test scenario when multiple users perform multiple service scenario operations simultaneously, which is a case in the embodiment of the present invention, and is a test scenario of the most complicated automatic test system at present, in this case. The invention will still perform the test of single service and interactive service, mainly to ensure the reliability of each service function and not to generate mutual influence.
FIG. 12 is a flow chart of a method for operating an automatic test system for simultaneous operation of multiple users, in accordance with an embodiment of the present invention.
As shown in fig. 12, further, an embodiment of the present invention provides an operating method of an automatic test system for simultaneous operation of multiple users, where the method includes:
s1201, determining whether all subsystems in the automatic test system for multi-user simultaneous operation are deployed successfully;
s1202, executing the to-be-tested environment simulation module 105 in the operation simulation subsystem 101 to obtain a simulation environment;
s1203, operating the multi-user access test module 106 in the simulation environment to obtain a plurality of user operation basic data;
s1204, according to the plurality of user operation basic data, operating the automatic operation script module 107 to obtain a group of continuous function lists to be executed;
s1205, according to the function list to be executed, utilizing the function numbering module 108 to classify the services, and obtaining a single service function test list and an interactive service function list;
s1206, utilizing the service checking subsystem 103 to check service functions and execution efficiency according to the single service function test list;
s1207, utilizing the inter-service connectivity test subsystem 104 to carry out service mutual check and interactive query according to the interactive service function list.
In the embodiment of the invention, based on the system, the execution working method of the system is designed in a matching way, and the main purpose is to be capable of clearly displaying the operation relation between data processed in the subsystems.
In the technical scheme of the embodiment, an automatic test system and a working method for multi-user simultaneous operation are provided, a multi-level subsystem is designed through multi-level data test division, a simulation environment and user operation basic data are provided, service self-checking and mutual query are performed, the problem of memory error in multi-user simultaneous online operation test is solved based on temporary storage space, a shared data pool and the like, and test efficiency and data reliability are improved.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. An automatic test system for simultaneous operation by multiple users, comprising: an operation simulation subsystem (101), a script checking subsystem (102), a service checking subsystem (103) and an inter-service connectivity testing subsystem (104); the operation simulation subsystem (101) comprises an environment simulation module (105) to be tested and a multi-user access test module (106), the script checking subsystem (102) comprises an automatic operation script module (107) and a function numbering module (108), the service checking subsystem (103) comprises a service function checking module (109) and a service execution efficiency checking module (110), and the inter-service connectivity test subsystem (104) comprises a service inter-service checking module (111) and an inter-service interaction information accuracy verification module (112); the operation simulation subsystem (101) provides a simulation environment and a plurality of user operation basic data for the script checking subsystem (102), the service checking subsystem (103) performs service function and execution efficiency checking, and the inter-service connectivity testing subsystem (104) performs service mutual checking and interactive query.
2. The automatic test system for multi-user simultaneous operation according to claim 1, wherein the environment under test simulation module (105) comprises:
the to-be-tested environment acquisition submodule (201) is used for inputting all to-be-tested environments to be tested;
a repeated environment removing sub-module (202) for removing repeated environments to be detected;
the to-be-tested environment classification submodule (203) is used for classifying the to-be-tested environment to obtain a to-be-tested environment classification table;
the to-be-tested environment building submodule (204) is used for generating a to-be-tested environment test packet;
and the environment simulation submodule (205) is used for combining the to-be-tested environment classification table and the to-be-tested environment test packet to form a simulation environment.
3. An automatic test system for multiple simultaneous users as claimed in claim 1, wherein said multiple access test module (106) comprises:
the shared data pool (301) is used for researching and inputting basic data of the process to be tested of each user;
the temporary user (302) is used for establishing temporary test users one by one according to the test scheme of the user to be tested and setting a test principle;
a temporary data pool (303) for extracting and storing the user test schemes with conflicting functions in the shared data pool (301) as temporary data;
a modification confirmation submodule (304) for generating a determined test scheme according to the temporary data and storing the test scheme to the shared data pool (301);
and a user operation basic data establishing sub-module (305) for establishing a plurality of user operation basic data according to the final data of the shared data pool (301).
4. An automatic test system for multi-user simultaneous operation according to claim 1, wherein the automatic operation script module (107) comprises:
the function generation submodule (401) generates each function test scheme according to all functions to be tested;
a function checking submodule (402) for forming a corresponding test program according to each function test scheme;
the function splitting submodule (403) obtains a test program with the processing time length exceeding half of the average test time, and splits the test program into 2 test functions;
the function merging submodule (404) obtains submodules with similar functions and merges the submodules into standard test functions;
a function execution submodule (405) for obtaining a relation between input and output according to a function of each submodule;
and the automatic processing sub-module (406) generates a list of functions to be executed according to the input-output relationship of the function execution sub-module (405).
5. The automatic test system for multiple user simultaneous operation according to claim 1, wherein the function numbering module (108) comprises:
a function service classification submodule (501) for classifying the list of functions to be executed according to the service function and decomposing the list into a single service function and an interactive service;
the function list user classification submodule (502) is divided into a multi-user test and a single-user test according to the number of the initiating users, and the tests are sorted from small to large according to the number of the user tests;
and the sequence numbering submodule (503) is used for generating a single service function test list and an interactive service function list.
6. An automatic test system for the simultaneous operation of multiple users according to claim 1, characterized in that said service function checking module (109) comprises:
a function effect classification submodule (601) for classifying the test function effect into an indexable function and an non-indexable function;
a function effect verification submodule (602) for testing the final execution effect of the service function and storing the result as a final service function operation index;
and a functional efficiency degree analysis submodule (603) for comparing the final service function operation index with the service function index and generating a function execution efficiency check result, wherein the function execution efficiency check result comprises a completed proportion, an excess completed proportion, an incomplete proportion and a completed proportion.
7. An automatic test system for multi-user simultaneous operation according to claim 1, characterized in that said service execution efficiency check module (110) comprises:
executing a node checking submodule (701) to obtain all detection stages of a service function test scheme;
a node execution efficiency calculation submodule (702) for obtaining the difference between the time nodes of all detection stages of the service function test scheme and the initial time of the service function, and obtaining the node execution efficiency;
a total execution efficiency calculation submodule (703) for obtaining a difference between a time node of the last stage of the service function test scheme and the start time of the service function, and obtaining a total execution efficiency;
and the efficiency verification sub-module (704) acquires the execution standard of the service function and compares the total execution efficiency with the size relationship between the node execution efficiency and the execution standard of the service function.
8. An automatic test system for multi-user simultaneous operation according to claim 1, characterized in that said service cross-check module (111) comprises:
the mutual check function list submodule (801) generates a mutual check function list according to the interactive service function list;
a third cycle query sub-module (802) which performs a third cycle on tasks needing more than 2 times of interaction in the mutual check function list and confirms that the service function is correct;
and the service hedge testing submodule (803) is used for testing whether the interaction is normal or not when 2 users only carry out the hedge interaction operation in different services at the same time.
9. The automatic test system for multi-user simultaneous operation according to claim 1, wherein the inter-service interaction information accuracy verification module (112) comprises:
a data sending module (901) for sending data among services;
a data receiving module (902) for obtaining service data return of the interactive party;
the timing module (903) is used for recording the interaction speed and the reaction speed among the services;
and the data comparison module (904) is used for comparing the interaction speed and the reaction speed with the required time of the service interaction function.
10. A method of operating an automatic test system for simultaneous operation by multiple users according to claims 1-9, the method comprising:
determining whether all subsystems in the automatic test system for multi-user simultaneous operation have been successfully deployed;
executing the to-be-tested environment simulation module (105) in the operation simulation subsystem (101) to obtain a simulation environment;
operating the multi-user access test module (106) in the simulation environment to obtain a plurality of user operation basic data;
according to the plurality of user operation basic data, operating an automatic operation script module (107) to obtain a group of continuous function lists to be executed;
according to the function list to be executed, the function numbering module (108) is utilized to classify the services, and a single service function test list and an interactive service function list are obtained;
performing service function and execution efficiency check by using a service check subsystem (103) according to the single service function test list;
and performing service mutual check and interactive query by utilizing the inter-service connectivity test subsystem (104) according to the interactive service function list.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110004299.8A CN112765014B (en) | 2021-01-04 | 2021-01-04 | Automatic test system for multi-user simultaneous operation and working method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110004299.8A CN112765014B (en) | 2021-01-04 | 2021-01-04 | Automatic test system for multi-user simultaneous operation and working method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112765014A true CN112765014A (en) | 2021-05-07 |
| CN112765014B CN112765014B (en) | 2024-02-20 |
Family
ID=75699145
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110004299.8A Active CN112765014B (en) | 2021-01-04 | 2021-01-04 | Automatic test system for multi-user simultaneous operation and working method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112765014B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114880219A (en) * | 2022-04-29 | 2022-08-09 | 北京达佳互联信息技术有限公司 | Test node configuration method and device, electronic equipment and storage medium |
| CN116743644A (en) * | 2023-07-21 | 2023-09-12 | 北京中元易尚科技有限公司 | Automatic test method, system, device and medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101605348A (en) * | 2008-11-24 | 2009-12-16 | 中国移动通信集团广东有限公司 | A kind of data service simulation method and application system |
| CN103002490A (en) * | 2011-09-08 | 2013-03-27 | 中国移动通信集团公司 | Service simulation testing system and realizing method thereof |
| CN103544049A (en) * | 2012-07-10 | 2014-01-29 | 百度在线网络技术（北京）有限公司 | Testing environment automatic processing method, and method and device for realizing testing automation |
| CN104331477A (en) * | 2014-11-04 | 2015-02-04 | 哈尔滨工业大学 | Method for testing concurrency property of cloud platform based on federated research |
| CN105045710A (en) * | 2015-06-30 | 2015-11-11 | 吉林大学 | Method for automatically generating test data in cloud computing environment |
| CN105530659A (en) * | 2014-10-22 | 2016-04-27 | 中国移动通信集团公司 | Service test system, method and device of mobile terminal |
| CN109828921A (en) * | 2019-01-18 | 2019-05-31 | 上海极链网络科技有限公司 | HTML5 webpage automated function test method, system and electronic equipment |
| CN110287092A (en) * | 2019-05-10 | 2019-09-27 | 广东电力交易中心有限责任公司 | A kind of electricity transaction system and its automatic test approach based on graphical interfaces |
| CN110784374A (en) * | 2019-10-25 | 2020-02-11 | 上海中通吉网络技术有限公司 | Method, device, equipment and system for monitoring operation state of service system |
| CN111538646A (en) * | 2020-04-02 | 2020-08-14 | 航天恒星科技有限公司 | System and method for testing performance of spatial information network |
-
2021
- 2021-01-04 CN CN202110004299.8A patent/CN112765014B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101605348A (en) * | 2008-11-24 | 2009-12-16 | 中国移动通信集团广东有限公司 | A kind of data service simulation method and application system |
| CN103002490A (en) * | 2011-09-08 | 2013-03-27 | 中国移动通信集团公司 | Service simulation testing system and realizing method thereof |
| CN103544049A (en) * | 2012-07-10 | 2014-01-29 | 百度在线网络技术（北京）有限公司 | Testing environment automatic processing method, and method and device for realizing testing automation |
| CN105530659A (en) * | 2014-10-22 | 2016-04-27 | 中国移动通信集团公司 | Service test system, method and device of mobile terminal |
| CN104331477A (en) * | 2014-11-04 | 2015-02-04 | 哈尔滨工业大学 | Method for testing concurrency property of cloud platform based on federated research |
| CN105045710A (en) * | 2015-06-30 | 2015-11-11 | 吉林大学 | Method for automatically generating test data in cloud computing environment |
| CN109828921A (en) * | 2019-01-18 | 2019-05-31 | 上海极链网络科技有限公司 | HTML5 webpage automated function test method, system and electronic equipment |
| CN110287092A (en) * | 2019-05-10 | 2019-09-27 | 广东电力交易中心有限责任公司 | A kind of electricity transaction system and its automatic test approach based on graphical interfaces |
| CN110784374A (en) * | 2019-10-25 | 2020-02-11 | 上海中通吉网络技术有限公司 | Method, device, equipment and system for monitoring operation state of service system |
| CN111538646A (en) * | 2020-04-02 | 2020-08-14 | 航天恒星科技有限公司 | System and method for testing performance of spatial information network |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114880219A (en) * | 2022-04-29 | 2022-08-09 | 北京达佳互联信息技术有限公司 | Test node configuration method and device, electronic equipment and storage medium |
| CN116743644A (en) * | 2023-07-21 | 2023-09-12 | 北京中元易尚科技有限公司 | Automatic test method, system, device and medium |
| CN116743644B (en) * | 2023-07-21 | 2024-01-30 | 北京中元易尚科技有限公司 | Automatic test method, system, device and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112765014B (en) | 2024-02-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108595157B (en) | Block chain data processing method, device, equipment and storage medium | |
| CN106506283B (en) | Business test method and device of bank and enterprise docking system | |
| CN109344056B (en) | Test method and test device | |
| CN112765014B (en) | Automatic test system for multi-user simultaneous operation and working method | |
| CN107741903A (en) | Application compatibility method of testing, device, computer equipment and storage medium | |
| US8365112B2 (en) | Verification apparatus and design verification program | |
| US20100121668A1 (en) | Automated compliance checking for process instance migration | |
| CN111651365B (en) | Automatic interface testing method and device | |
| CN107579851A (en) | The method and apparatus for determining the execution sequence of resource layout template | |
| CN111752846A (en) | Interface testing method and device | |
| CN113326026B (en) | Method and terminal for generating micro-service business process interface | |
| CN114880312A (en) | Flexibly-set application system service data auditing method | |
| CN112529543A (en) | Method, device and equipment for verifying mutual exclusion relationship of workflow and storage medium | |
| CN114465875B (en) | Fault processing method and device | |
| Meyer et al. | Towards identifying data analytics use cases in product planning | |
| Hunker et al. | A New Data Farming Procedure Model for a Farming for Mining Method in Logistics Networks | |
| CN115713404A (en) | Credit evaluation method for construction industry enterprises | |
| CN114741300A (en) | Test case based test method and device | |
| CN114841281A (en) | Data table identification method, device, equipment, medium and program product | |
| CN113360416A (en) | Test data batch generation method and device | |
| CN113517998B (en) | Processing method, device, equipment and storage medium of early warning configuration data | |
| CN116796206B (en) | Operation data processing method and system based on integrated platform | |
| CN112989823B (en) | Log processing method, device, equipment and storage medium | |
| CN111858324B (en) | Automatic generation method and device for test cases | |
| CN111061640B (en) | Software reliability test case screening method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |