CN113515435A - Method, system, equipment and storage medium for testing user experience under large-scale concurrency - Google Patents
Method, system, equipment and storage medium for testing user experience under large-scale concurrency Download PDFInfo
- Publication number
- CN113515435A CN113515435A CN202110865500.1A CN202110865500A CN113515435A CN 113515435 A CN113515435 A CN 113515435A CN 202110865500 A CN202110865500 A CN 202110865500A CN 113515435 A CN113515435 A CN 113515435A
- Authority
- CN
- China
- Prior art keywords
- test
- testing
- user experience
- engine
- experience
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Testing Of Engines (AREA)
Abstract
The invention provides a method, a system, equipment and a storage medium for testing user experience under large-scale concurrency, wherein the method comprises the steps of synchronously issuing a compiled test script to a tested system and an experience test engine; monitoring the load of the tested system by using a monitoring engine, and acquiring the performance index of the tested system; collecting test data of an experience test engine; and displaying the report in real time according to the acquired performance index and the test data. The invention realizes the combination of the performance test and the user experience test and simulates the page interaction and the user experience in the real environment. Can be compatible with various testing tools. Therefore, testers can obtain user experience test data under large-scale concurrence, and the performance, the usability and the usability of the system can be more accurately evaluated.
Description
Technical Field
The invention belongs to the technical field of software testing, and particularly relates to a method, a system, equipment and a storage medium for testing user experience under large-scale concurrent.
Background
During the whole development process of software, the software generally needs to go through several indispensable stages from development, testing to final delivery or online. Testing is typically done at development time, but before delivery. However, the test method, means and purpose are different, and the test method, means and purpose are divided into various types of tests, most common tests with functions, performance, user experience and the like. In a traditional test mode, the tests of different types are independently developed and are tests with single conditions, so that the difference exists between the tests and a real use scene, especially the user experience test is usually performed under the condition of almost no pressure load, and the difference exists between the tests and an actual situation.
In the actual use of software, pressure load generally exists, and the user experience test under large-scale concurrency can be closer to the actual use scene. The technical scheme closest to the invention in the prior art is that a commercial performance testing tool Loadrunner and an open source UI automatic testing tool Selenium can automatically develop performance testing and UI automatic testing activities. However, these two tools respectively support performance testing or UI automation, are single testing tools, cannot support mixed scenario testing, and cannot provide user experience testing under a certain concurrent load pressure.
Therefore, a testing method for simulating page interaction and user experience in a real environment by combining performance testing and user experience testing is urgently needed.
Disclosure of Invention
The invention aims to provide a large-scale concurrent user experience testing method, and aims to solve the technical problem of combining performance testing and user experience testing to simulate page interaction and user experience in a real environment.
An embodiment of one aspect of the invention discloses a method for testing user experience under large-scale concurrency, which comprises the following steps:
sending the compiled test script to a monitoring engine and an experience test engine; releasing the pressure to the system under test; monitoring the load of the tested system by using a monitoring engine, and acquiring the performance index of the tested system; collecting test data of an experience test engine; and displaying the report in real time according to the acquired performance index and the test data.
According to the large-scale concurrent user experience testing method provided by the embodiment of the application, the testing platform provides a flexible and configurable pressurization strategy, and a press machine cluster is utilized to pressurize the tested system to simulate real system load. In the process, the test platform starts user experience tests at the same time, the experience test engine simulates the real operation behavior of a user, the monitoring engine is used for monitoring the test and response conditions of the tested system in the whole process, data are collected in real time, and reports are automatically generated. The method is compatible with various testing tools, and the combination of performance testing and user experience testing is realized. Therefore, testers can obtain user experience test data under large-scale concurrence, and the performance, the usability and the usability of the system can be more accurately evaluated.
Preferably, before the test script is issued to the experience test engine, the method further includes: selecting a press machine from the press machine cluster according to a preset pressing strategy; and releasing the pressure of the compiling script to the tested system through the selected press.
Preferably, in any one of the above embodiments, the preset pressurization strategy includes task parameters that determine the preset pressurization strategy according to a pressurization task, where the task parameters include a total concurrence number, an experience test time, a number of times of concurrent increment, an interval of concurrent increment, and a number of concurrent increments each time;
according to the existing press cluster resources and the resource occupation situation of the running tasks, a press list of executable current concurrent tasks is calculated through a task scheduling algorithm, and pressure is distributed for the presses according to the principle of reasonably utilizing the idle presses to the maximum extent.
In the embodiment of the invention, a plurality of test strategies are fused, a brand-new user experience test technology is provided based on a performance platform, a plurality of test types are integrated together, a vivid test environment is provided, and more accurate and comprehensive test data are obtained.
In any one of the above embodiments, preferably, the collecting test data of the experience test engine, and automatically collecting the test data by using an automated test tool, where the automated test tool at least includes: selenium, Katalon Studio, UFT.
In another embodiment of the present invention, a user experience testing system based on large-scale concurrency is further provided, which includes a testing platform, a tested system, a monitoring engine and an experience testing engine; the test platform is used for synchronously issuing the compiled test script to the monitoring engine and the experience test engine; collecting test data of an experience test engine; the monitoring engine is used for monitoring the load of the tested system, acquiring the performance index of the tested system and displaying a report in real time according to the acquired performance index and the test data; the experience test engine is used for simulating the real operation behavior of the user.
According to the large-scale concurrent user experience testing system provided by the embodiment of the application, the testing platform provides a flexible and configurable pressurization strategy, and a press machine cluster is utilized to pressurize the tested system to simulate real system load. In the process, the test platform starts user experience tests at the same time, the experience test engine simulates the real operation behavior of a user, the monitoring engine is used for monitoring the test and response conditions of the tested system in the whole process, data are collected in real time, and reports are automatically generated. The method is compatible with various testing tools, and the combination of performance testing and user experience testing is realized. Therefore, testers can obtain user experience test data under large-scale concurrence, and the performance, the usability and the usability of the system can be more accurately evaluated.
Further, preferably, the system also comprises a press machine cluster, wherein the press machine cluster is selected according to a preset pressing strategy; and releasing the pressure of the compiling script to the tested system through the selected press.
Preferably, in any one of the above embodiments, the preset pressurization strategy includes task parameters that determine the preset pressurization strategy according to a pressurization task, where the task parameters include a total concurrence number, an experience test time, a number of times of concurrent increment, an interval of concurrent increment, and a number of concurrent increments each time;
according to the existing press cluster resources and the resource occupation situation of the running tasks, a press list of executable current concurrent tasks is calculated through a task scheduling algorithm, and pressure is distributed for the presses according to the principle of reasonably utilizing the idle presses to the maximum extent.
Preferably, in any one of the above embodiments, the system further includes an automated testing tool, the automated testing tool is configured to automatically collect test data of the experience testing engine, and the automated testing tool at least includes: selenium, Katalon Studio, UFT.
The present invention also provides an apparatus comprising a processor and a memory for storing instructions executable by the processor; the processor is used for executing the large-scale concurrent user experience testing method.
The invention also provides a computer storage medium, wherein a computer program is stored on the computer storage medium, and when being executed by a processor, the computer program realizes the steps of the user experience testing method under the large-scale concurrence.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic diagram of a test in the background of the invention;
FIG. 2 is a flow chart of a method for testing user experience in large-scale concurrency according to the present invention;
FIG. 3 is a block diagram of a large-scale concurrent user experience tester system according to the present invention.
Detailed Description
The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
The following detailed description is exemplary in nature and is intended to provide further details of the invention. Unless otherwise defined, all technical terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of exemplary embodiments according to the invention.
As shown in fig. 2, an embodiment of an aspect of the present invention discloses a method for testing user experience under large-scale concurrency, including:
s1, synchronously sending the compiled test script to a monitoring engine and an experience test engine;
s2, releasing the pressure to the system to be tested; monitoring the load of the tested system by using a monitoring engine, and acquiring the performance index of the tested system;
s3, collecting test data of the experience test engine;
and S4, displaying the report in real time according to the acquired performance index and the test data.
According to the large-scale concurrent user experience testing method provided by the embodiment of the application, the testing platform provides a flexible and configurable pressurization strategy, and a press machine cluster is utilized to pressurize the tested system to simulate real system load. In the process, the test platform starts user experience tests at the same time, the experience test engine simulates the real operation behavior of a user, the monitoring engine is used for monitoring the test and response conditions of the tested system in the whole process, data are collected in real time, and reports are automatically generated. The method is compatible with various testing tools, and the combination of performance testing and user experience testing is realized. Therefore, testers can obtain user experience test data under large-scale concurrence, and the performance, the usability and the usability of the system can be more accurately evaluated.
Specifically, the test principle and the operation step (1) load pressurization
Step A.1, setting a pressurization strategy; preferably, the preset pressurization strategy comprises task parameters of the preset pressurization strategy according to the pressurization task, wherein the task parameters comprise the total concurrence number, the experience testing time, the concurrence increasing times, the concurrence increasing intervals and the concurrence number increasing every time;
according to the existing press cluster resources and the resource occupation situation of the running tasks, a press list of executable current concurrent tasks is calculated through a task scheduling algorithm, and pressure is distributed for the presses according to the principle of reasonably utilizing the idle presses to the maximum extent.
Step A.2, selecting a press machine; selecting a press machine from the press machine cluster according to a preset pressing strategy; and releasing the pressure of the compiling script to the tested system through the selected press.
Step A.3, issuing a test script and pressurizing a tested system;
and step A.4, monitoring the load of the system to be tested through a monitoring engine.
Step A.5 collecting performance index of tested system
(2) User experience testing
B.1, the test platform issues a script to an experience test engine;
b.2, the experience test engine executes the user experience test to the tested system;
b.3, collecting data of an experience test engine;
(3) results display
Step C.1, the experience test engine automatically collects results and returns the results to the test platform;
and C.2, processing the performance test data and the user experience test data by the test platform, and displaying the report in real time.
In the embodiment of the invention, a plurality of test strategies are fused, a brand-new user experience test technology is provided based on a performance platform, a plurality of test types are integrated together, a vivid test environment is provided, and more accurate and comprehensive test data are obtained.
The method comprises the following steps of collecting test data of an experience test engine, and automatically collecting the test data by adopting an automatic test tool, wherein the automatic test tool at least comprises: selenium, Katalon Studio, UFT.
As shown in fig. 3, in another embodiment of the present invention, a user experience testing system based on large-scale concurrency is further provided, including a testing platform, a system under test, a monitoring engine, and an experience testing engine; the test platform is used for synchronously issuing the compiled test script to the monitoring engine and the experience test engine; collecting test data of an experience test engine; the monitoring engine is used for monitoring the load of the tested system, acquiring the performance index of the tested system and displaying a report in real time according to the acquired performance index and the test data; the experience test engine is used for simulating the real operation behavior of the user.
According to the large-scale concurrent user experience testing system provided by the embodiment of the application, the testing platform provides a flexible and configurable pressurization strategy, and a press machine cluster is utilized to pressurize the tested system to simulate real system load. In the process, the test platform starts user experience tests at the same time, the experience test engine simulates the real operation behavior of a user, the monitoring engine is used for monitoring the test and response conditions of the tested system in the whole process, data are collected in real time, and reports are automatically generated. The method is compatible with various testing tools, and the combination of performance testing and user experience testing is realized. Therefore, testers can obtain user experience test data under large-scale concurrence, and the performance, the usability and the usability of the system can be more accurately evaluated.
The system also comprises a press machine cluster, wherein the press machine cluster is used for selecting a press machine according to a preset pressing strategy; and releasing the pressure of the compiling script to the tested system through the selected press. The preset pressurization strategy comprises task parameters of the preset pressurization strategy according to a pressurization task, wherein the task parameters comprise concurrency total number, experience testing time, concurrency increasing times, concurrency increasing intervals and each time of the concurrency increasing times;
according to the existing press cluster resources and the resource occupation situation of the running tasks, a press list of executable current concurrent tasks is calculated through a task scheduling algorithm, and pressure is distributed for the presses according to the principle of reasonably utilizing the idle presses to the maximum extent.
When the user experience test is carried out, the system further comprises an automatic test tool, the automatic test tool is used for automatically collecting test data of the experience test engine, and the automatic test tool at least comprises: selenium, Katalon Studio, UFT.
The present invention also provides an apparatus comprising a processor and a memory for storing instructions executable by the processor; the processor is used for executing the large-scale concurrent user experience testing method.
The invention also provides a computer storage medium, wherein a computer program is stored on the computer storage medium, and when being executed by a processor, the computer program realizes the steps of the user experience testing method under the large-scale concurrence.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be appreciated by those skilled in the art that the invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The embodiments disclosed above are therefore to be considered in all respects as illustrative and not restrictive. All changes which come within the scope of or equivalence to the invention are intended to be embraced therein.
Claims (10)
1. A method for testing user experience under large-scale concurrency is characterized by comprising the following steps:
sending the compiled test script to a monitoring engine and an experience test engine;
releasing the pressure to the system under test;
monitoring the load of the tested system by using a monitoring engine, and acquiring the performance index of the tested system;
collecting test data of an experience test engine;
and displaying the report in real time according to the acquired performance index and the test data.
2. The large-scale concurrent user experience testing method according to claim 1, wherein the executing the test script to release pressure to the system under test further comprises: selecting a press machine from the press machine cluster according to a preset pressing strategy; the compiled script is executed and the pressure is released to the system under test by the selected press.
3. The large-scale concurrent user experience testing method according to claim 2, wherein the preset pressurization strategy comprises the steps of:
determining task parameters of a preset pressurization strategy according to a pressurization task, wherein the task parameters comprise a concurrency total number, experience testing time, concurrency increasing times, concurrency increasing intervals and each time of increasing concurrency;
according to the existing press cluster resources and the resource occupation situation of the running tasks, a press list of executable current concurrent tasks is calculated through a task scheduling algorithm, and pressure is distributed for the presses according to the principle of reasonably utilizing the idle presses to the maximum extent.
4. The large-scale concurrent user experience testing method according to claim 1, wherein the collecting test data of the experience testing engine automatically collects the test data by using an automated testing tool, and the automated testing tool at least comprises: selenium, Katalon Studio, UFT.
5. A user experience testing system based on large-scale concurrence comprises a testing platform, a monitoring engine and an experience testing engine;
the test platform is used for synchronously issuing the compiled test script to the monitoring engine and the experience test engine; collecting test data of an experience test engine;
the monitoring engine is used for monitoring the load of the tested system, acquiring the performance index of the tested system and displaying a report in real time according to the acquired performance index and the test data;
the experience test engine is used for simulating the real operation behavior of the user.
6. The large-scale concurrent user experience testing system according to claim 5, further comprising a cluster of presses, the cluster of presses selecting a press according to a preset pressing strategy; and the selected press is used for releasing the pressure to the tested system under the condition of executing the compiled script.
7. The large-scale concurrent user experience testing system according to claim 6, wherein the preset pressurization strategy comprises:
determining task parameters of a preset pressurization strategy according to a pressurization task, wherein the task parameters comprise a concurrency total number, experience testing time, concurrency increasing times, concurrency increasing intervals and each time of increasing concurrency;
according to the existing press cluster resources and the resource occupation situation of the running tasks, a press list of executable current concurrent tasks is calculated through a task scheduling algorithm, and pressure is distributed for the presses according to the principle of reasonably utilizing the idle presses to the maximum extent.
8. The large-scale concurrent user experience testing system according to claim 5, further comprising an automated testing tool for automatically assembling test data for a collection experience testing engine, the automated testing tool comprising at least: selenium, Katalon Studio, UFT.
9. An apparatus comprising a processor and a memory, the memory for storing instructions executable by the processor; the processor is configured to execute the large-scale concurrent user experience testing method according to any one of claims 1 to 4.
10. A computer storage medium, having a computer program stored thereon, which, when executed by a processor, performs the steps of the method for concurrent user experience testing on a large scale according to any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110865500.1A CN113515435A (en) | 2021-07-29 | 2021-07-29 | Method, system, equipment and storage medium for testing user experience under large-scale concurrency |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110865500.1A CN113515435A (en) | 2021-07-29 | 2021-07-29 | Method, system, equipment and storage medium for testing user experience under large-scale concurrency |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113515435A true CN113515435A (en) | 2021-10-19 |
Family
ID=78067838
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110865500.1A Pending CN113515435A (en) | 2021-07-29 | 2021-07-29 | Method, system, equipment and storage medium for testing user experience under large-scale concurrency |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113515435A (en) |
-
2021
- 2021-07-29 CN CN202110865500.1A patent/CN113515435A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106294120B (en) | Method, apparatus and computer program product for testing code | |
| US10970198B2 (en) | Automatic test system and method thereof | |
| US7636871B1 (en) | Method for comparing customer and test load data with comparative functional coverage hole analysis | |
| CN109684211B (en) | Order scheduling system pressure testing method and device based on shop dimensions | |
| CN106980571B (en) | Method and equipment for constructing test case suite | |
| CN107733735B (en) | Script recording system and method implanted in pressure measurement device | |
| CN110471857B (en) | Automatic test method and device for performance capacity of artificial intelligent model | |
| CN106850330B (en) | Intelligent cloud desktop performance test system and method | |
| CN109871328B (en) | Software testing method and device | |
| CN107038120B (en) | Software testing method and device | |
| CN111159043B (en) | Automatic identification method and system for testing risk | |
| CN107562621A (en) | The method and apparatus for determining manual test use-case and tested code incidence relation | |
| CN114326677A (en) | Vehicle machine testing method and device | |
| CN111966597B (en) | Test data generation method and device | |
| CN111897725B (en) | Automatic test method, medium, equipment and system for middle platform service | |
| CN113515435A (en) | Method, system, equipment and storage medium for testing user experience under large-scale concurrency | |
| CN117608903A (en) | Method, device, equipment and storage medium for automatically generating test report | |
| JP3883449B2 (en) | Software system test plan creation support method and test plan creation support program | |
| CN116527553A (en) | Processing method, system and storage medium for automatic test report of switch | |
| CN113535538A (en) | Application full-link automatic testing method and device, electronic equipment and storage medium | |
| CN110597728A (en) | Method, device and system for constructing test data | |
| CN107992406B (en) | Software testing method, related system and computer readable storage medium | |
| CN115185825A (en) | Interface test scheduling method and device | |
| CN108845945A (en) | Using test optimization method and device | |
| CN111813662A (en) | User behavior driven sustainable integration test method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |