CN116775427A

CN116775427A - Test result determining method, device, equipment and storage medium

Info

Publication number: CN116775427A
Application number: CN202310659785.2A
Authority: CN
Inventors: 晏伟成
Original assignee: Bank of China Ltd
Current assignee: Bank of China Ltd
Priority date: 2023-06-05
Filing date: 2023-06-05
Publication date: 2023-09-19

Abstract

The application provides a test result determining method, a device, equipment and a storage medium, which can be used in the field of big data. The method comprises the following steps: determining at least one second test device, the first test device and the second test device being used for testing a first object; acquiring equipment information of the plurality of second test equipment, wherein the equipment information comprises network addresses of the second test equipment and file paths used for storing test files in the second test equipment; acquiring a plurality of test files from the plurality of second test devices according to the device information of the plurality of second test devices; generating a test result according to the test files in the first test equipment and the plurality of test files acquired from the plurality of second test equipment, and displaying the test result. The method improves the determination efficiency of the test result.

Description

Test result determining method, device, equipment and storage medium

Technical Field

The present application relates to the field of big data, and in particular, to a method, an apparatus, a device, and a storage medium for determining a test result.

Background

With the rapid development of electronic commerce, users put higher demands on service continuity and service timeliness of banking information systems.

The performance test is to simulate various normal, peak and abnormal load conditions by an automatic test tool to test various performance indexes of the system. JMeter, one of the most popular open source tools for performance testing at present, can be used to simulate a huge load on a server, network or object, thereby completing performance testing. In the Jmeter distributed test architecture, one of the machines is selected as a Controller (Controller) and the other machines are selected as agents (agents).

At present, after performance test of a banking information system is completed, test result files and analysis are manually collected from agents, so that the efficiency of performance test work is lower.

Disclosure of Invention

The application provides a test result determining method, a device, equipment and a storage medium, which are used for solving the problem of low efficiency of the existing test result determining method.

In a first aspect, the present application provides a test result determining method, including:

determining at least one second test device, the first test device and the second test device being used for testing a first object;

acquiring equipment information of the plurality of second test equipment, wherein the equipment information comprises network addresses of the second test equipment and file paths used for storing test files in the second test equipment;

acquiring a plurality of test files from the plurality of second test devices according to the device information of the plurality of second test devices;

generating a test result according to the test files in the first test equipment and the plurality of test files acquired from the plurality of second test equipment, and displaying the test result.

In a second aspect, the present application provides a test result determining apparatus, comprising:

a determining module, configured to determine at least one second testing device, where the first testing device and the second testing device are configured to test a first object;

the device information comprises network addresses of the second test devices and file paths used for storing test files in the second test devices;

the acquisition module is also used for acquiring a plurality of test files from the plurality of second test devices according to the device information of the plurality of second test devices;

the generating module is used for generating a test result according to the test files in the first test equipment and the plurality of test files acquired from the plurality of second test equipment and displaying the test result. In a third aspect, the present application provides an electronic device, comprising:

a processor and a memory;

the memory stores computer-executable instructions;

the processor executes computer-executable instructions stored in the memory to cause the electronic device to perform the method of any one of the first aspects.

In a fourth aspect, the present application provides a computer-readable storage medium having stored therein computer-executable instructions for performing the method of any of the first aspects when executed by a processor.

In a fifth aspect, the present application provides a computer program product comprising a computer program which, when executed by a processor, implements the method according to any of the first aspects.

The application provides a test result determining method, a device, equipment and a storage medium, wherein the method comprises the steps of determining at least one second test equipment, wherein the first test equipment and the second test equipment are used for testing a first object; acquiring equipment information of the plurality of second test equipment, wherein the equipment information comprises network addresses of the second test equipment and file paths used for storing test files in the second test equipment; acquiring a plurality of test files from the plurality of second test devices according to the device information of the plurality of second test devices; generating a test result according to the test files in the first test equipment and the plurality of test files acquired from the plurality of second test equipment, and displaying the test result. According to the method, the test file is automatically acquired and the test result is generated according to the network address of the second equipment and the file path for storing the test file in the second test equipment, so that time and labor required for manually acquiring the test result are reduced, and the efficiency of determining the test result is improved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.

FIG. 1 is a specific application scenario diagram of a test result determination method provided by the present application;

FIG. 2a is a flowchart illustrating a method for determining performance of a test system according to an embodiment of the present application;

FIG. 2b is a schematic diagram of a configuration page of the test result determination method according to the present application;

FIG. 3 is a flowchart II of a test result determination method according to an embodiment of the present application;

FIG. 4 is a schematic structural diagram of a performance determining apparatus of a test system according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Specific embodiments of the present application have been shown by way of the above drawings and will be described in more detail below. The drawings and the written description are not intended to limit the scope of the inventive concepts in any way, but rather to illustrate the inventive concepts to those skilled in the art by reference to the specific embodiments.

Detailed Description

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the application. Rather, they are merely examples of apparatus and methods consistent with aspects of the application as detailed in the accompanying claims.

It should be noted that, the user information (including but not limited to user equipment information, user personal information, etc.) and the data (including but not limited to data for analysis, stored data, presented data, etc.) related to the present application are information and data authorized by the user or fully authorized by each party, and the collection, use and processing of the related data need to comply with related laws and regulations and standards, and provide corresponding operation entries for the user to select authorization or rejection.

It should be noted that the method and the device for determining the test result of the present application may be used in the field of big data, and may be used in any field other than the field of big data.

Referring to fig. 1, when a distributed test technology is used for testing, one device is generally selected as a Controller (Controller), and the other devices are selected as agents (agents). As shown in the figure, the controller and three agents (agent A, agent B and agent C) are connected with the tested object. When performance test is carried out, the controller and the three agent machines send test information to the tested object, receive the response sent by the tested object and form a test file according to the response. At present, a manual mode is generally adopted to manually test a result file from the agent machine, and the test file of the control machine is summarized and then processed and analyzed. This solution requires much time and labor, making the performance test less efficient.

The application provides a test result determining method, which comprises the steps of firstly determining at least one second test device and obtaining device information thereof, wherein the device information comprises a network address of the second test device and a file path used for storing test files in the second test device; and the test file is acquired according to the equipment information and the test result is generated, so that the time and labor required for manually acquiring the test result are reduced, and the efficiency of determining the test result is improved.

The application provides a method for determining a test result, which aims to solve the technical problems in the prior art.

The following describes the technical scheme of the present application and how the technical scheme of the present application solves the above technical problems in detail with specific embodiments. The following embodiments may be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.

Fig. 2a is a flowchart of a test result determining method according to an embodiment of the present application. As shown in fig. 2a, the method of the present embodiment includes:

s201, determining at least one second testing device, wherein the first testing device and the second testing device are used for testing a first object;

the execution body of the embodiment of the application can be electronic equipment or a test result determining device arranged in the electronic equipment. Alternatively, the test result determining means may be implemented by software, or may be implemented by a combination of software and hardware.

The method of the embodiment of the application is applied to the first test equipment, namely the control machine, and the second test equipment is the agent machine. In distributed testing, a controller is usually provided with one controller, and a proxy is usually provided with a plurality of controllers. The first object is the device to be tested. The first test device and the plurality of second test devices are connected through a network, and the first test device and the plurality of second test devices are connected with the object to be tested through the network.

Alternatively, a JMeter is used as a tool for performance testing. As one of the most common open source tools for performance testing at present, JMeter is a JAVA application, and consumption of CPU and memory is relatively large, so when it is required to simulate tens of thousands of concurrent users, using a single machine to simulate all concurrent users is somewhat frustrating, and may even cause JAVA memory overflow errors. In order for the JMeter tool to provide greater load capacity, the distributed functionality provided by the JMeter can be used to initiate multiple devices to divide the voltage test. The JMeter is installed in the first test equipment and the second test equipment.

At least one second test device for testing the first object is determined among the plurality of second test devices in preparation for a subsequent operation.

S202, acquiring equipment information of a plurality of second test equipment, wherein the equipment information comprises network addresses of the second test equipment and file paths used for storing test files in the second test equipment;

in order to acquire a test file generated after completion of the performance test from the plurality of second test devices, it is necessary to determine the position of the designated second test device and the position of the test file in the plurality of agents. Therefore, it is necessary to acquire the network address of the second test device and the file path for storing the test file in the second test device. Both the network address and the file path are included in the device information.

Optionally, the method of the present application further comprises:

displaying a configuration page, wherein the configuration page comprises a plurality of equipment information input boxes;

and acquiring the equipment information of the plurality of second test equipment input by the user in the equipment information input box, and storing the equipment information of the plurality of second test equipment.

The schematic diagram of the configuration page of the test result determining method provided by the application is shown in fig. 2b. As shown in fig. 2b, before performance testing, a network address and a file path for storing a test file in the second test device are configured for each second test device through a configuration page. The configuration page comprises three equipment information input boxes which are respectively used for setting test equipment, a network address of the test equipment and a file path corresponding to the test file. The user may configure the plurality of second test devices by entering text in the device information input box and then clicking the ok button. Clicking the reset button, the configuration page resumes the initial setting. And the first test equipment acquires and stores the characters input by the user in the equipment information input box, so that the equipment information of a plurality of second test equipment can be stored.

S203, acquiring a plurality of test files from the plurality of second test devices according to the device information of the plurality of second test devices;

on the basis of determining the network addresses of the plurality of second test devices, the first test device can access the network address device, i.e. the second test device, via the network. On the basis of determining the file path of the test file, the first test device can access the position of the test file at the second test device and acquire the test file.

Optionally, for any one of the plurality of second test devices; the method of the application further comprises the steps of:

obtaining test information of the second test equipment, wherein the test information comprises at least one of the following components: the test progress, test duration or test running state of the second test equipment;

and acquiring a corresponding test file from the second equipment according to the test information.

In the process of acquiring the corresponding test file in the second test equipment, the current test process is firstly required to be judged according to the test content. For example, the load test is to test the change of the performance of the first object by gradually increasing the system load, and finally determine the maximum load amount that the first object can bear on the premise of meeting the performance index. Load testing does not concern the stability of the first object, i.e. the long-term operation of the system, but only the relevant performance indicators under different loads are obtained, and decisions are made and correct conclusions are drawn based on these results. At this time, after the test load of the first object is changed each time, a corresponding test file is acquired. The test progress may be judged by test information including a test progress, a test duration, or a test running state of the second test device. After the test information of the second test equipment is obtained, judging whether the test file needs to be obtained, and then performing the next operation.

Optionally, according to the test information, a corresponding test file is acquired in the second device, and the method of the application further comprises:

when any one of the following conditions is met, acquiring a test file in the second device:

the test progress is greater than or equal to the preset progress;

the test time length is longer than or equal to the preset time length;

the test running state is a running ending state.

When the corresponding test file is acquired in the second device according to the test information, whether the test file is acquired in the second device can be determined by judging whether the following conditions are met: the test progress is greater than or equal to the preset progress; the test time length is longer than or equal to the preset time length; the test running state is three conditions of a running end state. When the test progress is greater than or equal to the preset progress or the test time is greater than or equal to the preset time, the current test file can be obtained by indicating that the current test file already contains the data required in the stage. When the test running state is the running ending state, the current round of test is ended, so that the test file can be acquired in the second equipment.

generating a file acquisition request according to a file path used for storing the test file in the second test equipment, wherein the file acquisition request comprises the file path;

according to the network address of the second test equipment, sending a file acquisition request to the second test equipment;

and receiving a test file sent by the second test equipment.

Optionally, the first test device may acquire device information of the plurality of second devices by sending a file acquisition request to the plurality of second test devices at a time point when the performance test is ended or set. After generating a file path file including the test file and an instruction requesting the second test device to transmit the specified file of the specified location to the first test device, the file acquisition request is transmitted to the second test device according to the network address of the second test device. After receiving the file acquisition request, the second test equipment sends the corresponding test file to the first test equipment according to the source address of the file acquisition request. Then, the first test device can receive the test file sent by the second test device.

S204, generating a test result according to the test files in the first test equipment and the plurality of test files acquired in the plurality of second test equipment, and displaying the test result.

When performing performance testing on the first object, different types of testing including load testing and stress testing will be performed. When the first object is subjected to pressure test, the number of test messages meeting the test requirement can be adopted in a multi-round repeated transmission mode sometimes due to the huge number of test messages. Meanwhile, the format of the test file is complex and not easy to read, and effective data in the test log also needs to be extracted. Therefore, the data of the plurality of test files acquired from the second test device is required to be cleaned, extracted, and the like, and then analyzed and calculated to obtain an index representing the performance of the first object, i.e., a test result. Thereafter, the test results are presented in a variety of ways, including images and forms.

Those skilled in the art will appreciate that the method of the present application may be applied to test result determination for performance testing, as well as to test result determination for other tests.

The embodiment provides a test result determining method, which comprises the steps of determining at least one second test device, wherein the first test device and the second test device are used for testing a first object; acquiring equipment information of a plurality of second test equipment, wherein the equipment information comprises network addresses of the second test equipment and file paths used for storing test files in the second test equipment; acquiring a plurality of test files from the plurality of second test devices according to the device information of the plurality of second test devices; and generating a test result according to the test files in the first test equipment and the plurality of test files acquired in the plurality of second test equipment, and displaying the test result. According to the method, the test file is automatically acquired and the test result is generated according to the network address of the second equipment and the file path for storing the test file in the second test equipment, so that time and labor required for manually acquiring the test result are reduced, and the efficiency of determining the test result is improved.

Fig. 3 is a flowchart of a test result determining method according to an embodiment of the present application. As shown in fig. 3, the method of the present embodiment, based on the embodiment shown in fig. 2a, describes in detail a process of generating a test result according to a test file in a first test device and a plurality of test files acquired in a plurality of second test devices.

S301, determining a plurality of object indexes of a first object;

the content of the test on the first object includes, in addition to performance test, functional test, that is, each function of the first object includes receiving a test message, processing the test message, and sending the test message.

The object index of the first object refers to an evaluation index of the first object after testing, and includes average response time, maximum processing time, minimum processing time, network traffic, transaction number per second and the like of a test message, and generates a result file. It can be seen that different functional modules correspond to different object indicators, for example, the maximum processing time and the minimum processing time are both object indicators corresponding to the processing modules.

S302, integrating the test files in the first test equipment and a plurality of test files acquired from a plurality of second test equipment to obtain target test files;

since the first object is tested for performance, the number of test messages meeting the test requirements is sometimes used in a concurrent and multiple-round repeated manner. For example, when the load test is performed, the load of the first object is gradually increased, the change of the performance of the first object is tested, and finally the maximum load amount which the first object can bear on the premise of meeting the performance index is determined. Therefore, the integration processing needs to be performed on the test files in the first test device and the plurality of test files acquired from the plurality of second test devices to determine the target test file. For example, to determine which test files are generated for the current round and which files are generated when load testing is specified. On this basis, a test log corresponding to each object index needs to be determined in the target test file.

S303, determining the module identification of the functional module corresponding to each test log in the target test file;

each test log in the test file is sequentially stored in the flow sequence of the first object, such as receiving test messages, processing the test messages, sending the test messages and the like. In order to determine the log corresponding to the object index, the test log should be classified according to the module identifier of the functional module.

S304, determining a module identifier of a functional module corresponding to the object index;

the determining the module identifier of the functional module corresponding to the object index, for example, the functional module corresponding to the average response time of the test message includes three functional modules of receiving the test message, processing the test message and sending the test message, so the module identifier corresponding to the object index should be the identifiers of the three modules. The corresponding functional module of the network flow comprises a network monitoring module, and the module corresponding to the object is the identification of the network monitoring module.

S305, determining the test log corresponding to the object index in the target test file according to the module identification of the functional module corresponding to each test log in the target test file and the module identification of the functional module corresponding to the object index.

Knowing the module identifier corresponding to each test log and the module identifier corresponding to each object index, the test log corresponding to each object index can be determined according to the module identifier of each functional module. On the basis, the test log in the target test file can be analyzed, and then a test result is obtained. Therefore, the test logs can be simply and quickly sorted, and the determination efficiency of the test results can be improved.

The embodiment provides a test result determining method, which comprises the steps of determining a plurality of object indexes of a first object; integrating the test files in the first test equipment and a plurality of test files acquired from a plurality of second test equipment to obtain target test files; determining a test log corresponding to each object index in a target test file; determining the module identification of the functional module corresponding to each test log in the target test file; determining a module identifier of a functional module corresponding to the object index; and determining the test log corresponding to the object index in the target test file according to the module identifier of the functional module corresponding to each test log in the target test file and the module identifier of the functional module corresponding to the object index. According to the method, the test logs corresponding to the object indexes are determined through the module identification of the functional module, so that the determination of the test results is simpler and more efficient, and the practicability of the method is improved.

The technical scheme of the application is described in detail below by using a specific embodiment.

When the method for determining the test result is used for testing the bank information system, one control machine is set as a first test object, three agents (agent 1, agent 2 and agent 3) are set as second test objects, and simultaneously, a JMeter is used as a performance test tool.

First, two agents (agent 1 and agent 2) for testing the bank information system are determined among the three agents. And acquiring equipment information of the agent machine. And the configuration page can be opened, and the network addresses of the two agents and the file paths corresponding to the test files can be respectively searched.

And then respectively acquiring the test progress, test duration or test running state of the two agents. And if the functional test is being performed on the bank information system at this time, namely, if the test running states of the two agents are judged to be running end states, the functional test is ended, and the test files stored in the two agents can be acquired. The agent generates two file acquisition requests according to the file paths corresponding to the test files in the two agents obtained in the previous step, and sends the two file acquisition requests to the two agents respectively. The agent 1 receives the file acquisition request, inquires a test file in a designated file path, and transmits the test file to the controller according to the source address of the file acquisition request. The agent 2 also goes through the same flow.

And then, the control machine integrates the test files sent by the two agents and the test files stored by the control machine to obtain target test files. The control machine first determines object indicators of the bank information system, including indicator data of each tested transaction, such as average response time, maximum processing time, minimum processing time, network traffic, number of transactions processed per second, etc. of the transaction. The functional modules referred to herein include a receive test message module, a process test message module, a send test message module, and a network monitor module. In order to determine the test log of each object index, the module identifier of the functional module corresponding to each test log in the target test file and the module identifier of the functional module corresponding to the object index are required to be determined, so that the test log of each object index can be obtained. And then analyzing and integrating the test log to obtain specific data of the object index, and displaying the specific data in the forms of a pie chart, a histogram, a discount chart and a table.

Fig. 4 is a schematic structural diagram of a test result determining apparatus according to an embodiment of the present application. The apparatus of this embodiment may be in the form of software and/or hardware. As shown in fig. 4, a test result determining apparatus 400 provided in an embodiment of the present application is applied to a first test device, and includes a determining module 401, an obtaining module 402 and a generating module 403, where,

a determining module 401 for determining at least one second testing device, the first testing device and the second testing device being for testing the first object;

an obtaining module 402, configured to obtain device information of a plurality of second test devices, where the device information includes a network address of the second test device and a file path in the second test device for storing a test file;

the obtaining module 402 is further configured to obtain a plurality of test files from the plurality of second test devices according to device information of the plurality of second test devices;

the generating module 403 is configured to generate a test result according to the test file in the first test device and the plurality of test files acquired in the plurality of second test devices, and display the test result.

In one possible implementation manner, the acquiring module is specifically configured to:

the test progress is greater than or equal to the preset progress;

the test time length is longer than or equal to the preset time length;

the test running state is a running ending state.

and receiving a test file sent by the second test equipment.

In one possible implementation manner, the generating module is specifically configured to:

determining a plurality of object indicators for the first object;

integrating the test files in the first test equipment and a plurality of test files acquired from a plurality of second test equipment to obtain target test files;

determining a test log corresponding to each object index in a target test file;

and generating a test result according to the test log corresponding to each object index.

determining the module identification of the functional module corresponding to each test log in the target test file;

determining a module identifier of a functional module corresponding to the object index;

and determining the test log corresponding to the object index in the target test file according to the module identifier of the functional module corresponding to each test log in the target test file and the module identifier of the functional module corresponding to the object index.

The device for determining a test result provided in this embodiment may be used to execute the above method embodiment, and its implementation principle and technical effects are similar, and this embodiment will not be described herein.

Referring to fig. 5, an electronic device 20 may include a processor 21 and a memory 22. The processor 21, the memory 22, and the like are illustratively interconnected by a bus 23.

Memory 22 stores computer-executable instructions;

the processor 21 executes computer-executable instructions stored in the memory 22 to cause the electronic device to perform the test result determination method as described above.

It should be understood that the processor 21 may be a central processing unit (in english: central Processing Unit, abbreviated as CPU), or may be other general purpose processors, digital signal processors (in english: digital Signal Processor, abbreviated as DSP), application specific integrated circuits (in english: application Specific Integrated Circuit, abbreviated as ASIC), or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present application may be embodied directly in a hardware processor for execution, or in a combination of hardware and software modules in a processor for execution. The memory 22 may include a high-speed random access memory (in english: random Access Memory, abbreviated as RAM), and may further include a Non-volatile memory (in english: NVM), such as at least one magnetic disk memory, and may also be a U-disk, a removable hard disk, a read-only memory, a magnetic disk, or an optical disk.

The embodiment of the application correspondingly provides a computer readable storage medium, wherein computer execution instructions are stored in the computer readable storage medium, and the computer execution instructions are used for realizing the test result determining method when being executed by a processor.

The embodiment of the application correspondingly provides a computer program product, which comprises a computer program, wherein the computer program realizes the test result determining method when being executed by a processor.

Other embodiments of the application will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.

It is to be understood that the application is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims

1. A test result determination method, characterized by being applied to a first test apparatus, the method comprising:

2. The method of claim 1, wherein for any one of the plurality of second test devices; obtaining a corresponding test file in the second test device, including:

obtaining test information of the second test equipment, wherein the test information comprises at least one of the following: the test progress, test duration or test running state of the second test equipment;

3. The method of claim 2, wherein obtaining the corresponding test file in the second device according to the test information comprises:

acquiring the test file in the second device when any one of the following conditions is met:

the test progress is greater than or equal to a preset progress;

the test time length is longer than or equal to a preset time length;

the test running state is a running ending state.

4. A method according to any one of claims 1-3, wherein for any one of the plurality of second test devices; obtaining a corresponding test file in the second test device, including:

generating a file acquisition request according to a file path used for storing a test file in the second test equipment, wherein the file acquisition request comprises the file path;

according to the network address of the second test equipment, sending the file acquisition request to the second test equipment;

and receiving the test file sent by the second test equipment.

5. The method of any of claims 1-4, wherein generating test results from the test files in the first test device and the plurality of test files acquired in the plurality of second test devices comprises:

determining a plurality of object indicators for the first object;

integrating the test files in the first test equipment and a plurality of test files acquired from the plurality of second test equipment to obtain target test files;

determining a test log corresponding to each object index in the target test file;

and generating the test result according to the test log corresponding to each object index.

6. The method of claim 5, wherein for each object indicator; determining a test log corresponding to the object index in the target test file, including:

7. The method according to claim 5 or 6, characterized in that the method further comprises:

8. A test result determining apparatus, characterized by being applied to a first test device, comprising:

the generating module is used for generating a test result according to the test files in the first test equipment and the plurality of test files acquired from the plurality of second test equipment and displaying the test result.

9. An electronic device, comprising: a processor, and a memory communicatively coupled to the processor;

the memory stores computer-executable instructions;

the processor executes computer-executable instructions stored in the memory to implement the method of any one of claims 1 to 7.

10. A computer readable storage medium having stored therein computer executable instructions which when executed by a processor are adapted to carry out the method of any one of claims 1 to 7.