CN115604144A

CN115604144A - Test method and device, electronic equipment and storage medium

Info

Publication number: CN115604144A
Application number: CN202211185800.6A
Authority: CN
Inventors: 黄悦; 钱正宇; 胡鸣人; 袁正雄; 褚振方; 罗阳; 王国彬; 钱洋; 王宽
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2022-09-27
Filing date: 2022-09-27
Publication date: 2023-01-13
Anticipated expiration: 2042-09-27
Also published as: CN115604144B

Abstract

The disclosure provides a testing method and device, electronic equipment and a storage medium, and relates to the technical field of artificial intelligence, in particular to the technical fields of cloud service, cloud native, micro-service and the like. The implementation scheme is as follows: receiving a first test request, wherein the first test request comprises information of a target test task for testing a service to be tested; in response to the first device refusing to execute the target test task, or the first device agreeing to execute the target test task and the first number of test devices required for executing the target test task being greater than 1, generating at least one second test request based on the first test request; and forwarding the at least one second test request to the at least one second device respectively, so that each second device in the at least one second device responds to the corresponding second test request, and each second device in the at least one second device is any test device except the first device in the distributed test system.

Description

Test method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the technical field of artificial intelligence, and in particular, to the technical fields of cloud services, cloud-native services, micro services, and the like, and in particular, to a test method and apparatus, a test result query method and apparatus, a method and apparatus for constructing a distributed test system, an electronic device, a computer-readable storage medium, and a computer program product.

Background

The program code may be packaged as a service and deployed in a server. For example, an Artificial Intelligence (AI) algorithm may be packaged as an AI service and deployed in a cloud server. The service may receive a request from the user, respond to the request, and return a result of the response to the user. In order to ensure that the service operates normally, the performance of the service is usually tested.

The approaches described in this section are not necessarily approaches that have been previously conceived or pursued. Unless otherwise indicated, it should not be assumed that any of the approaches described in this section qualify as prior art merely by virtue of their inclusion in this section. Similarly, the problems mentioned in this section should not be considered as having been acknowledged in any prior art, unless otherwise indicated.

Disclosure of Invention

The disclosure provides a test method and device, a test result query method and device, a construction method and device of a distributed test system, electronic equipment, a computer readable storage medium and a computer program product.

According to an aspect of the present disclosure, there is provided a test method applied to a first device, where the first device is any test device in a distributed test system, the method including: receiving a first test request, wherein the first test request comprises information of a target test task for testing a service to be tested; in response to the first device refusing to execute the target test task, or the first device agreeing to execute the target test task and a first number of test devices required for executing the target test task is greater than 1, generating at least one second test request based on the first test request; and forwarding the at least one second test request to at least one second device respectively, so that each second device in the at least one second device responds to the corresponding second test request, wherein each second device in the at least one second device is any test device in the distributed test system except the first device.

According to an aspect of the present disclosure, a test result query method is provided, which is applied to any test device in a distributed test system, and the method includes: receiving a test result query request, wherein the test result query request comprises an identifier of a target test task for testing a tested service; broadcasting the test result query request to other test equipment in the distributed test system; receiving and summarizing the test results of the target test task returned by the other test equipment to obtain an overall test result; and outputting the overall test result.

According to an aspect of the present disclosure, a method for constructing a distributed test system is provided, where the method is applied to an authentication device, where the authentication device is any test device in the distributed test system, and the method includes: receiving a registration request of a device to be registered, wherein the registration request comprises first device information and first authentication information of the device to be registered; authenticating the first authentication information to obtain a first authentication result of the first authentication information; in response to the first authentication result indicating that the first authentication information is successfully authenticated, returning second device information and second authentication information of the authentication device to the device to be registered; and responding to the successful authentication of the equipment to be registered on the second authentication information, receiving a message of successful bidirectional authentication returned by the equipment to be registered, and storing the first equipment information so as to add the equipment to be registered to the distributed test system.

According to an aspect of the present disclosure, a method for constructing a distributed test system is provided, which is applied to a device to be registered, and includes: sending a registration request to authentication equipment, wherein the authentication equipment is any testing equipment in a distributed testing system, and the registration request comprises first equipment information and first authentication information of equipment to be registered; receiving second equipment information and second authentication information of the authentication equipment returned by the authentication equipment in response to the authentication of the authentication equipment on the first authentication information; authenticating the second authentication information to obtain a second authentication result of the second authentication information; and responding to the second authentication result indicating that the second authentication information is successfully authenticated, storing the second equipment information, and returning the second authentication result to the authentication equipment so as to add the equipment to be registered to the distributed test system.

According to an aspect of the present disclosure, there is provided a test apparatus applied to a first device, where the first device is any test device in a distributed test system, the apparatus including: a receiving module configured to receive a first test request including information of a target test task for testing a service under test; a generation module configured to, in response to the first device declining to perform the target test task, either, the first equipment agrees to execute the target test task, the first number of test equipment required by the target test task is larger than 1, and at least one second test request is generated based on the first test request; and a forwarding module configured to forward the at least one second test request to at least one second device, respectively, so that each of the at least one second device responds to the corresponding second test request, where each of the at least one second device is any test device in the distributed test system except the first device.

According to an aspect of the present disclosure, there is provided a test result query apparatus, applied to any test device in a distributed test system, the apparatus including: a first receiving module configured to receive a test result query request, the test result query request including an identification of a target test task for testing a service under test; a broadcast module configured to broadcast the test result query request to other test devices in the distributed test system; the second receiving module is configured to receive and summarize the test results of the target test tasks returned by the other test devices to obtain an overall test result; and an output module configured to output the overall test result.

According to an aspect of the present disclosure, a device for constructing a distributed test system is provided, which is applied to an authentication device, where the authentication device is any test device in the distributed test system, and the device includes: the device comprises a receiving module, a registration module and a verification module, wherein the receiving module is configured to receive a registration request of a device to be registered, and the registration request comprises first device information and first authentication information of the device to be registered; an authentication module configured to authenticate the first authentication information to obtain a first authentication result of the first authentication information; a returning module configured to return second device information and second authentication information of the authentication device to the device to be registered in response to the first authentication result indicating that the authentication of the first authentication information is successful; and the storage module is configured to respond to the successful authentication of the equipment to be registered on the second authentication information, receive a message of successful bidirectional authentication returned by the equipment to be registered, and store the first equipment information so as to add the equipment to be registered to the distributed test system.

According to an aspect of the present disclosure, a building apparatus of a distributed test system is provided, which is applied to a device to be registered, and includes: the device comprises a sending module and a registering module, wherein the sending module is configured to send a registering request to a certification device, the certification device is any testing device in a distributed testing system, and the registering request comprises first device information and first authentication information of a device to be registered; a first receiving module, configured to receive, in response to successful authentication of the first authentication information by the authentication device, second device information and second authentication information of the authentication device returned by the authentication device; a first authentication module configured to authenticate the second authentication information to obtain a second authentication result of the second authentication information; and the first storage module is configured to respond to the second authentication result indicating that the second authentication information is successfully authenticated, store the second device information and return the second authentication result to the authentication device so as to add the device to be registered to the distributed test system.

According to an aspect of the present disclosure, there is provided an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any of the above aspects.

According to an aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any of the above aspects.

According to an aspect of the disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the method of any of the above aspects.

According to one or more embodiments of the present disclosure, the flexibility and accuracy of service testing can be improved.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the embodiments and, together with the description, serve to explain the exemplary implementations of the embodiments. The illustrated embodiments are for purposes of illustration only and do not limit the scope of the claims. Throughout the drawings, identical reference numbers designate similar, but not necessarily identical, elements.

FIG. 1 illustrates a schematic diagram of an exemplary system in which various methods described herein may be implemented, according to an embodiment of the present disclosure;

FIG. 2 shows a flow diagram of a testing method according to an embodiment of the present disclosure;

FIG. 3 shows a schematic diagram of a testing process according to an embodiment of the present disclosure;

FIG. 4 shows a flow diagram of a test result query method according to an embodiment of the present disclosure;

FIG. 5 shows a schematic diagram of a test result query process, according to an embodiment of the present disclosure;

FIGS. 6 and 7 respectively illustrate a flow chart of a method of constructing a distributed test system according to some embodiments of the present disclosure;

FIG. 8 shows a schematic diagram of a build process of a distributed test system according to an embodiment of the present disclosure;

FIG. 9 shows a block diagram of a test apparatus according to an embodiment of the present disclosure;

FIG. 10 shows a block diagram of a test result query device according to an embodiment of the present disclosure;

fig. 11 and 12 are respectively block diagrams illustrating a construction apparatus of a distributed test system according to some embodiments of the present disclosure; and

FIG. 13 illustrates a block diagram of an exemplary electronic device that can be used to implement embodiments of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

In the present disclosure, unless otherwise specified, the use of the terms "first", "second", and the like to describe various elements is not intended to limit the positional relationship, the temporal relationship, or the importance relationship of the elements, and such terms are used only to distinguish one element from another. In some examples, a first element and a second element may refer to the same instance of the element, while in some cases they may refer to different instances based on the context of the description.

The terminology used in the description of the various described examples in this disclosure is for the purpose of describing particular examples only and is not intended to be limiting. Unless the context clearly indicates otherwise, if the number of elements is not specifically limited, the elements may be one or more. Furthermore, the term "and/or" as used in this disclosure is intended to encompass any and all possible combinations of the listed items.

In the technical scheme of the disclosure, the collection, storage, use, processing, transmission, provision, disclosure and other processing of the personal information of the related user are all in accordance with the regulations of related laws and regulations and do not violate the good customs of the public order.

The program code may be packaged as a service and deployed in a server. For example, the AI algorithm may be packaged as an AI service and deployed in a cloud server. The service may receive a request from the user, respond to the request, and return a result of the response to the user. The service usually has a large number of unspecified users, and the geographical locations and network conditions of different users are often different.

In order to ensure that the service operates normally, the performance of the service is usually tested.

In the related art, one or more test devices are generally deployed in the same network environment (e.g., a cluster environment, an intranet environment, etc.) to test a service. The test devices simulate the user terminal to initiate a request and receive the response result of the service to the request so as to evaluate the performance of the service. In the scheme, the test equipment for executing the test task and the network environment thereof are fixed, and the request condition of a real user cannot be flexibly simulated, so that the test result is inaccurate.

Further, in the related art, in a case where a plurality of test apparatuses are deployed, one test apparatus may be set as a master apparatus and the other test apparatuses may be set as slave apparatuses. The master device controls the slave device to test the service. In the scheme, the slave devices executing the test tasks are still relatively fixed, and the network environments of the slave devices are still the same, so that the request condition of a real user cannot be simulated, and an accurate test result cannot be obtained. In addition, in the scheme, the master device and the slave device are strongly coupled, a large amount of configuration operation needs to be additionally performed, the deployment, operation and maintenance costs of the test device are high, and the usability is low.

In view of the above problems, embodiments of the present disclosure provide a testing method, where a decentralized distributed testing system is used to test a service, and each testing device in the distributed testing system has a same status (no distinction between a master device and a slave device), so that a request situation of a real user can be simulated, and flexibility and accuracy of a service test are improved.

In addition, the embodiment of the disclosure further provides a method for constructing the distributed test system, and the method can dynamically add new test equipment to the distributed test system, thereby reducing deployment and operation and maintenance difficulties of the distributed test system, and ensuring dynamics, flexibility and high availability of the distributed test system.

Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

Fig. 1 illustrates a schematic diagram of an exemplary system 100 in which various methods and apparatus described herein may be implemented in accordance with embodiments of the present disclosure. Referring to FIG. 1, the system 100 includes a distributed test system 110 and one or more communication networks 130 coupling the distributed test system 110 to a server 120.

The server 120 may provide a service, such as the service 122 shown in FIG. 1. The service 122 may include a non-virtual environment and a virtual environment. In some embodiments, the service 122 may be provided as a web-based service or cloud service, for example, provided to users of client devices (not shown in fig. 1) under a software as a service (SaaS) model.

The distributed test system 110 includes one or more test devices 110-1, 110-2, 110-3, 110-4, 110-5, …, 110-N. The test devices 110-1-110-N may be configured to execute one or more applications. In an embodiment of the present disclosure, test devices 110-1-110-N may be deployed with applications for testing services. By executing the application, the testing devices 110-1 through 110-N may test the service 122 in the server 120.

An application for testing a service may include, for example, a management module and a test unit. The management module is used to manage the testing devices, such as exposing an authentication interface (for registering new devices) and a service interface (for receiving and responding to the testing requests and the testing result query requests), maintaining device information (e.g., IP addresses, port numbers, etc.) of each testing device in the distributed testing system 110, adding or removing the testing devices to or from the distributed testing system 100, forwarding or broadcasting requests, etc. The test unit is configured to execute a test task, execute the test task through relevant information (e.g., test time, test case, request protocol, request mode, request body, etc.) of the test task specified by the user, test the service under test 122, and store a test result.

The test results may be stored in a storage device. Storage devices include, but are not limited to, structured databases such as Mysql, unstructured databases such as mongoDB, file systems, and the like.

In an embodiment of the present disclosure, the distributed test system 110 is a "decentralized" system, i.e., the test devices 110-1 to 110-N in the distributed test system 110 are equally located and have no division between master devices and slave devices. The test equipment 110-1-110-N may be installed with the same application for testing the service 122 to test the service 122 in equal positions.

In embodiments of the present disclosure, test devices 110-1 through 110-N may be distributed in different geographic locations. The testing devices 110-1 to 110-N distributed at different geographic locations can simulate a large number of client devices of the service 122 distributed at different geographic locations, so that the request condition of a real user can be simulated, and the service 122 can be flexibly and accurately tested.

In an embodiment of the disclosure, any of the test devices 110-1 through 110-N may receive a test request for the service 122 from the user terminal 140 via the network 150 and respond to the test request, so that one or more of the test devices 110-1 through 110-N may perform a test task specified by the user terminal 140. The user terminal 140 is a terminal device used by a user having a service test requirement (i.e., a tester of a service). The user terminal 140 may be any type of computer device including, but not limited to, a personal computer, a cell phone, a tablet, a smart wearable device, and the like.

The test devices 110-1-110-N may be any type of computer device, such as portable handheld devices, general purpose computers (such as personal computers and laptop computers), workstation computers, wearable devices, smart screen devices, self-service terminal devices, service robots, gaming systems, thin clients, various messaging devices, sensors or other sensing devices, and so forth. These computer devices may run various types and versions of software applications and operating systems, such as MICROSOFT Windows, APPLE iOS, UNIX-like operating systems, linux, or Linux-like operating systems (e.g., GOOGLE Chrome OS); or include various Mobile operating systems such as MICROSOFT Windows Mobile OS, iOS, windows Phone, android. Portable handheld devices may include cellular telephones, smart phones, tablets, personal Digital Assistants (PDAs), and the like. Wearable devices may include head-mounted displays (such as smart glasses) and other devices. The gaming system may include a variety of handheld gaming devices, internet-enabled gaming devices, and the like. The client device is capable of executing a variety of different applications, such as various Internet-related applications, communication applications (e.g., email applications), short Message Service (SMS) applications, and may use a variety of communication protocols.

The server 120 may include one or more general purpose computers, special purpose server computers (e.g., PC (personal computer) servers, UNIX servers, mid-end servers), blade servers, mainframe computers, server clusters, or any other suitable arrangement and/or combination. The server 120 may include one or more virtual machines running a virtual operating system, or other computing architecture involving virtualization (e.g., one or more flexible pools of logical storage that may be virtualized to maintain virtual storage for the server). In various embodiments, the server 120 may run one or more services or software applications that provide the functionality described below.

The computing units in server 120 may run one or more operating systems including any of the operating systems described above, as well as any commercially available server operating systems. The server 120 may also run any of a variety of additional server applications and/or middle tier applications, including HTTP servers, FTP servers, CGI servers, JAVA servers, database servers, and the like.

In some embodiments, the server 120 may be a server of a distributed system, or a server incorporating a blockchain. The server 120 may also be a cloud server, or a smart cloud computing server or a smart cloud host with artificial intelligence technology. The cloud Server is a host product in a cloud computing service system, and is used for solving the defects of high management difficulty and weak service expansibility in the traditional physical host and Virtual Private Server (VPS) service.

Networks 130 and 150 may be any type of network known to those skilled in the art that may support data communications using any of a variety of available protocols, including but not limited to TCP/IP, SNA, IPX, etc. By way of example only, one or more networks 110 may be a Local Area Network (LAN), an ethernet-based network, a token ring, a Wide Area Network (WAN), the internet, a virtual network, a Virtual Private Network (VPN), an intranet, an extranet, a blockchain network, a Public Switched Telephone Network (PSTN), an infrared network, a wireless network (e.g., bluetooth, wi-Fi), and/or any combination of these and/or other networks.

The system 100 of fig. 1 may be configured and operated in various ways to enable application of the various methods and apparatus described in accordance with this disclosure.

FIG. 2 shows a flow diagram of a testing method 200 according to an embodiment of the present disclosure. The method 200 is applied to, i.e. performed by, a first device. The first device may be any test device in a distributed test system, such as any of test devices 110-1 through 110-N in FIG. 1. As shown in FIG. 2, method 200 includes steps S210-S230.

In step S210, a first test request is received, the first test request including information of a target test task for testing a service under test.

In step S220, in response to the first device refusing to execute the target test task, or the first device agreeing to execute the target test task and the first number of test devices required to execute the target test task is greater than 1, at least one second test request is generated based on the first test request.

In step S230, the at least one second test request is forwarded to the at least one second device, so that each of the at least one second device responds to the corresponding second test request. Each second device in the at least one second device is any test device except the first device in the distributed test system.

According to embodiments of the present disclosure, a distributed test system is employed to test services. The distributed test system is deployed in a decentralized mode, and the positions of all test devices in the system are equal. Both the first device receiving the first test request (which may be a test request sent by a user) and the second device receiving the second test request forwarded by the first device may be any test device in a distributed test system, so that the test device executing the target test task is not fixed, thereby improving the flexibility of service test, simulating the request condition of a real user of the service, and improving the accuracy of the test result.

The various steps of method 200 are described in detail below.

In step S210, the first device receives a first test request.

According to some embodiments, the first test request may be a test request sent by a user, or may be a test request forwarded by other test devices in the distributed test system.

It should be noted that, in the embodiment of the present disclosure, the meaning of the user sending the test request is different from that of the user of the service. The user who sends the test request is the tester of the service, and the user of the service is the user of the service.

And correspondingly to the test request sent by the user as the first test request, the first device is a test device for receiving the test request sent by the user. As described above, the first device may be any test device in the distributed system, and thus in the embodiment of the present disclosure, a user may send a test request to any test device in the distributed test system without sending a test request to a specific test device or sensing all test devices in the distributed test system, so that the usability, flexibility and high fault tolerance of the service test are improved, and a fault or an abnormality of any test device does not affect the service test process.

The first test request includes information for a target test task for testing the service under test. The information of the target test task may include, for example, an identification of the service under test, an identification of the target test task, a test type (e.g., stress test, load test, stability test, etc.), a test case used, a time to perform the test, a request concurrency amount of the stress test, and the like. The identity of the service under test may be, for example, a URL (Uniform Resource Locator) of the service under test.

According to some embodiments, the first number of test devices required to perform the target test task may be determined by the first device based on information of the target test task. For example, the first device may determine a first number of test devices needed to perform the target test task based on information of a test type of the target test task, a time to perform the test, a quantity of requested concurrency, and so on.

According to further embodiments, the first number of test devices required for performing the target test task may also be directly obtained from the first test request, i.e. the first test request further comprises the first number of test devices required for performing the target test task.

In the case where the first test request is a test request sent by a user, the first number is the total number of test devices desired by the user for performing the target test task. This overall number is typically set by the user to an integer greater than 1 so as to better simulate the actual request situation of the user of the service. Generally, in case the test type is a pressure test, the total number of test devices is set larger, e.g. 10, 25, 50, etc.

And under the condition that the first test request is a test request forwarded by other test equipment in the distributed test system, the first quantity is the quantity of the test equipment which is carried in the first test request and is used for executing the target test task. It will be appreciated that the first number of test requests forwarded by the other test devices is less than or equal to the first number of test requests originally sent by the user.

According to some embodiments, steps S210-S230 may be performed in a loop multiple times until the target test task is assigned to the desired number of test devices. The first device is the execution subject of each cycle. It should be noted that the first device in different cycles may refer to different test devices. For example, in a certain cycle, the test device 1 (first device) receives the first test request through step S210 and forwards the second test request to the test device 2 (second device) through step S230. The second test request corresponds to the first test request in the next cycle, and accordingly, the test device 2 that received the second test request will be the first device in the next cycle, and the steps S210 to S230 are continued.

After receiving the first test request, the first device may respond to the first test request to obtain a response result indicating that the first device agrees to execute the target task or refuses to execute the target test task.

According to some embodiments, the method 200 further comprises: and responding the first test request to obtain a response result based on the current working state of the first equipment, wherein the response result is used for representing that the first equipment agrees or refuses to execute the target test task.

According to some embodiments, the current working state of the first device may include a fourth number of test tasks currently executed by the first device, resource occupancy (e.g., utilization of resources such as CPU, memory, bandwidth, etc.), and the like. The current operating state of the first device may be indicative of a current busy level of the first device.

According to some embodiments, the fourth number of test tasks currently executed by the first device may be used as the current working state of the first device, and the first test request may be responded accordingly to determine whether the first device executes the target test task.

According to some embodiments, the first device agrees to perform the target test task in response to the fourth number of currently performed test tasks being less than the threshold. A fourth number of currently executing test tasks being less than the threshold indicates that the first device is currently idle. According to the embodiment, the first device can execute the target test task under the idle condition, and the target test task is guaranteed to have enough computing resource support, so that the target test task can be smoothly executed.

According to some embodiments, the first device refuses to execute the target test task in response to the fourth number of currently executing test tasks being greater than or equal to the threshold. The fourth number of currently executing test tasks being greater than or equal to the threshold indicates that the first device is currently busy. According to the embodiment, the first device can not execute the target test task under the busy condition, so that the problem that the target test task cannot be executed smoothly due to insufficient computing resources can be avoided.

The threshold in the above embodiments may be set to 5, 10, etc., for example. It should be noted that different test devices may correspond to different thresholds.

According to some embodiments, responding to the first test request to obtain the response result based on the current operating state of the first device may include: the method includes determining a third number of available test devices in the distributed test system, responding to the first test request for a response result based on a current operating state of the first device in response to the third number being greater than or equal to the first number of test devices required to perform the target test task, and the at least one second device being a subset of the available test devices.

According to the above embodiment, by determining the third number of available test devices in the distributed test system, it can be determined whether the current distributed test system can meet the current test requirements before performing the test, and the subsequent steps S220-S230 are performed only if the system can meet the current test requirements, thereby avoiding unnecessary response and forwarding operations, and saving computational resources and communication resources.

In the case where the third number is less than the first number, the distributed test system cannot meet the current test requirements. According to some embodiments, a prompt message of test failure can be returned to the user so as to provide feedback to the user in time, thereby saving the time of the user and facilitating the user to perform subsequent operations. In this case, steps S220-S230 are no longer performed.

According to some embodiments, the first device stores respective device information of at least one third device, and each third device in the at least one third device is a test device that performs mutual authentication with the first device in the distributed test system. Accordingly, the third number of available test devices in the distributed test system may be determined according to the following steps: respectively sending a connection request to at least one third device; and taking the third equipment which is successfully connected as available test equipment, and counting to obtain a third number of the available test equipment. The process of mutual authentication will be described in detail below.

According to the embodiment, the first device can judge the connectivity with other test devices (third devices) based on the test request of the user without sensing the states of all the test devices in the distributed test system in real time, so that the operation and maintenance cost of the system can be saved, and the usability of the system can be improved.

In other words, when a certain testing device in the system is unavailable (for example, the testing device is actively logged off from the system, or is forced to go offline from the system due to a network, etc.), the first device does not sense that the testing device is currently unavailable in real time. Only when a test request from a user is received, the first device determines connectivity with the test device, thereby recognizing that the test device is unavailable.

According to some embodiments, in response to the first device agreeing to perform the target test task and the first number equals 1, then one test device required for performing the target test task is already available (i.e., the first device), and therefore the first device need not generate and forward the second test request.

According to some embodiments, each of the at least one second test request comprises information of the target test task and a second number of test devices required to execute the target test task. It should be appreciated that the second test request differs from the first test request only in that the second number and the first number, i.e. the number of included test devices needed to perform the target test task, may differ.

The sum of the respective second numbers of the at least one second test request is equal to the difference between the first number and the execution tag. The execution tag is equal to zero if the first device refuses to execute the target test task and equal to 1 if the first device agrees to execute the target test task. That is, if the first device refuses to execute the target test task, the execution tag is 0, and the sum of the second number corresponding to each of the at least one second test request is equal to the first number. And if the first equipment agrees to execute the target test task, the execution tag is 1, and the sum of the second quantity corresponding to each of the at least one second test request is equal to the sum of the first quantity minus 1.

It should be noted that the present disclosure does not limit the number (fifth number) of the at least one second test request and the specific generation manner thereof, as long as the sum of the second number of the generated at least one second test request is equal to the difference between the first number and the execution tag. It should be appreciated that the at least one second test request may be generated in a number of different ways.

According to some embodiments, at least one of the following is randomly set: a fifth number of at least one second test request, a second number included in each of the at least one second test request. The embodiment can improve the randomness and the flexibility of request forwarding, so that the test equipment for executing the target test task is not fixed. Therefore, the service request condition of a real user can be better simulated, and the accuracy of the service test result is improved.

For example, the first test request includes, information of a target test task1 for testing the service under test (identification service1 of the service under test, test type, test case, time to execute the test, etc.), and a first number 10 of test devices required to execute the target test task. And if the first equipment is busy, the first equipment does not execute the target test task, the execution label is 0, and the sum of the second quantity of the second test requests is equal to the first quantity of 10. 5 second test requests can be generated, and the corresponding second numbers are 1, 2, 3 and 2 respectively; 3 second test requests can also be generated, and the corresponding second numbers of the second test requests are respectively 3, 4 and 3; 6 second test requests can be generated, and the corresponding second number of the second test requests is 2, 3, 1, 2 and 1; and so on.

If the first device is idle, the first device executes the target test task, the execution tag is 1, and the sum of the second number of the second test requests is equal to the first number 10 minus 1, that is, equal to 9. 3 second test requests can be generated, and the corresponding second numbers are 4, 3 and 2 respectively; or 2 second test requests can be set, and the corresponding second numbers are respectively 3 and 6; 5 second test requests can be set, and the corresponding second number of the second test requests is 1, 2, 3 and 1 respectively; and so on.

After generating at least one second test request according to step S220, step S230 is performed. In step S230, the at least one second test request is forwarded to the at least one second device, so that each of the at least one second device responds to the corresponding second test request. Each second device in the at least one second testing device is any testing device except the first device in the distributed testing system, so that the second device is not fixed, the testing device executing the target testing task is not fixed, the testing flexibility can be improved, the service request condition of a real user is simulated, and the accuracy of the service testing result is improved.

It should be appreciated that the second test request forwarded by the first device may be the first test request in the next cycle, and accordingly, the second device receiving the second test request may be the first device in the next cycle, and proceed to perform steps S210-S230.

FIG. 3 shows a schematic diagram of a testing process according to an embodiment of the present disclosure. As shown in FIG. 3, the distributed test process includes steps S340-S351.

In step S340, the testing device 1 (first device) receives a testing request (first testing request) sent by the user terminal 310, where the testing request includes information of a target testing task1 for testing a service under test (identification service1 of the service under test, testing type, testing case, time for executing a test, and the like) and an overall number (first number) 5 of testing devices required for executing the target testing task.

In step S341, the test device 1 (first device) determines that the number of available test devices in the distributed test system 320 is 50, which is greater than the total number 5 desired by the user, so that the distributed test system 320 can meet the test requirements of the user. The testing device 1 further obtains the current working state of itself, and determines that the number of the currently executed testing tasks is 2 and is smaller than the threshold 6, so that the testing device 1 is idle and executes the target testing task1. The number of remaining target test tasks to be allocated is 4, so the test device 1 further generates two test requests req1, req2 (second test requests), and the number of corresponding test devices (second number) is 3, 1, respectively.

In step S342, the test device 1 (first device) forwards the test requests req1, req2 (second test request) to the test device 2 and the test device 3 (second device), respectively.

In step S343, the test device 2 (first device) receives the test request req1 (first test request) forwarded by the test device 1, and the number of test devices (first number) in req1 is 3. The test equipment 2 obtains the current working state of the test equipment, and determines that the number of the currently executed test tasks is 7 and is greater than the threshold 6, so that the test equipment 2 is busy and does not execute the target test task1. The number of remaining target test tasks to be allocated is 3, so the test device 2 further generates two test requests req3, req4 (second test requests), and the number of corresponding test devices (second number) is 2, 1, respectively.

In step S344, the test device 3 (first device) receives the test request req2 (first test request) forwarded by the test device 1, and the number of test devices (first number) in req2 is 1. The test equipment 3 obtains the current working state of the test equipment, and determines that the number of the currently executed test tasks is 2 and is less than the threshold 6, so that the test equipment 3 is idle and executes the target test task1. Since the first number is 1 and the test device 3 executes the target test task1, i.e. the target test task is allocated to be completed, the test device 3 no longer forwards the test request.

In step S345, the test device 2 (first device) forwards the test requests req3, req4 (second test request) to the test device 4 and the test device 5 (second device), respectively.

In step S346, the test device 4 (first device) receives the test request req3 (first test request) forwarded by the test device 2, and the number of test devices (first number) in req3 is 2. The test equipment 4 obtains the current working state of the test equipment 4, and determines that the number of the currently executed test tasks is 5 and is less than the threshold 6, so that the test equipment 4 is idle and executes the target test task1. The number of remaining target test tasks to be allocated is 1, and therefore the test device 4 further generates a test request req5 (second test request), and the number of corresponding test devices (second number) is 1.

In step S347, the test device 5 (first device) receives the test request req4 (first test request) forwarded by the test device 2, and the number of test devices (first number) in req4 is 1. The test equipment 5 obtains the current working state of the test equipment, and determines that the number of the currently executed test tasks is 4 and is smaller than the threshold 6, so that the test equipment 5 is idle and executes the target test task1. Since the first number is 1 and the test device 5 executes the target test task1, i.e. the target test task is allocated to be completed, the test device 5 no longer forwards the test request.

In step S348, the test device 4 (first device) forwards the test request req5 (second test device) to the test device 6 (second device).

In step S349, the test device 6 (first device) receives the test request req5 (first test request) forwarded by the test device 4, and the number of test devices (first number) in req5 is 1. The test equipment 6 obtains the current working state of itself, and determines that the number of the currently executed test tasks is 3 and is smaller than the threshold 6, so that the test equipment 6 is idle and executes the target test task1. Since the first number is 1 and the test device 6 executes the target test task1, i.e. the target test task is allocated to be completed, the test device 6 no longer forwards the test request.

In step S350, the testing device 1, 3, 4, 5, 6 executes the target testing task1, and issues a service request to the service under test 330 to test the service under test 330.

In step S351, the test device 1, 3, 4, 5, 6 receives the response result returned by the service under test 330, and determines and stores the test result of the service under test 330 according to the response result.

According to the embodiment of the disclosure, a test result query method is also provided.

FIG. 4 shows a flow diagram of a test result query method 400 according to an embodiment of the disclosure. The method 400 is applied to any test device in a distributed test system, i.e., the method 400 may be performed by any test device in a distributed test system (e.g., any of the test devices 110-1 through 110-N in FIG. 1). As shown in FIG. 4, method 400 includes steps S410-S440.

In step S410, a test result query request is received, where the test result query request includes an identification of a target test task for testing a service under test.

In step S420, a test result query request is broadcast to other test devices in the distributed test system.

In step S430, the test results of the target test task returned by the other test devices are received and summarized to obtain an overall test result.

In step S440, the overall test result is output.

According to the embodiment of the disclosure, a user can initiate a test result query request to any test device in the distributed test system without sending the query request to a specific test device or sensing all test devices in the distributed test system, so that the usability and flexibility of test result query are improved.

According to some embodiments, for step S430, the execution subject may query whether itself stores the test result of the target test task based on the identification of the target test task. If the test result of the target test task is stored in the test device, the test result of the test device and the test results returned by other test devices are summarized to obtain an overall test result. If the test result of the target test task is not stored, summarizing the test results returned by other equipment to obtain an overall test result.

FIG. 5 shows a schematic diagram of a test result query process, according to an embodiment of the disclosure. As shown in FIG. 5, the query process includes steps S530-S533.

In step S530, the test apparatus 3 receives a test result query request initiated by the user terminal 510. The test result query request includes an identification of a target test task for testing the service under test.

In step S531, the test device 3 broadcasts the inquiry request to the other test devices in the distributed test system 520, i.e., the test devices 1, 2, 4, 5, 6.

In step S532, the test device 3 receives the test result of the target test task returned by the test devices 1, 2, 4, 5, and 6, and summarizes the received test result and the test result (if any) of the target test task stored by itself to obtain an overall test result. It should be understood that only the test device that has executed the target test task can return the test result, and the test device that has not executed the target test task may return, for example, a prompt message "not queried for a relevant test result".

In step S533, the test apparatus 3 returns the overall test result of the service under test to the user terminal 510.

According to the embodiment of the disclosure, a method for constructing the distributed test system is also provided.

FIG. 6 shows a flow diagram of a method 600 of building a distributed test system according to an embodiment of the present disclosure. The method 600 is applied to, i.e. performed by, an authentication device. The certification device may be any test device in a distributed test system (e.g., any of test devices 110-1 through 110-N in fig. 1). As shown in FIG. 6, method 600 includes steps S610-S640.

In step S610, a registration request of a device to be registered is received, where the registration request includes first device information and first authentication information of the device to be registered.

In step S620, the first authentication information is authenticated to obtain a first authentication result of the first authentication information.

In step S630, in response to the first authentication result indicating that the authentication of the first authentication information is successful, the second device information and the second authentication information of the authentication device are returned to the device to be registered.

In step S640, in response to that the device to be registered successfully authenticates the second authentication information, receiving a message that the mutual authentication of the device to be registered succeeds, and storing the first device information, so as to add the device to be registered to the distributed test system.

According to the embodiment of the disclosure, the status of each test device in the distributed test system is equal, and the test device can be used as an authentication device for authenticating a new device (i.e. a device to be registered). The equipment to be registered can be registered and added into the system through any testing equipment in the system, the registration process is simple and flexible, the operation and maintenance difficulty is reduced, and the dynamic property and high availability of the system are ensured.

According to some embodiments, the first device information includes, for example, an Identification (ID) of the device to be registered, an authentication Identification (ID), an IP address, a PORT number (PORT), and the like. The first authentication information may be, for example, a token (token) obtained by encrypting the first device information according to a certain encryption algorithm. The encryption algorithm may be an irreversible encryption algorithm such as hash, salt hash, MD5, etc.

According to some embodiments, in step S620, the authentication device may encrypt the first device information by using the same encryption algorithm, resulting in a first encryption result. And obtaining a first authentication result of the first authentication information by judging whether the first encryption result is the same as the first authentication information. Specifically, if the first encryption result is the same as the first authentication information, the first authentication information is successfully authenticated; and if the first encryption result is different from the first authentication information, the first authentication information fails to authenticate.

And under the condition that the first authentication information is successfully authenticated, the authentication equipment returns the second equipment information and the second authentication information of the authentication equipment to the equipment to be registered.

According to some embodiments, the second device information may include an Identification (ID) of the authentication device, an authentication Identification (ID), an IP address, a PORT number (PORT), and the like, similar to the first device information. The second authentication information may be, for example, a token (token) obtained by encrypting the second device information according to a certain encryption algorithm. The encryption algorithm may be an irreversible encryption algorithm such as hash, salt hash, MD5, etc.

According to some embodiments, after the device to be registered receives the second device information and the second authentication information returned by the authentication device, the same encryption algorithm is used for encrypting the second device information to obtain a second encryption result. And obtaining a first authentication result of the second authentication information by judging whether the second encryption result is the same as the second authentication information. Specifically, if the second encryption result is the same as the second authentication information, the second authentication information is successfully authenticated; and if the second encryption result is different from the second authentication information, the second authentication information fails to authenticate.

And under the condition that the equipment to be registered successfully authenticates the second authentication information, the equipment to be registered and the authentication equipment complete bidirectional authentication, the equipment to be registered stores the second equipment information, and a message of successful bidirectional authentication is returned to the authentication equipment. Correspondingly, the authentication device receives the message of successful mutual authentication returned by the device to be registered, and stores the first device information so as to add the device to be registered to the distributed test system.

According to some embodiments, the method 600 further comprises: and responding to the first authentication result indicating that the first authentication information is successfully authenticated, and forwarding the registration request to other test equipment in the distributed test system so that the other test equipment authenticates the equipment to be registered. Therefore, each test device in the distributed test system stores the information of other test devices and can communicate with each other, and the high availability of the whole system is ensured.

The mutual authentication process between the other testing device and the device to be registered is similar to the above-described mutual authentication process between the authentication device and the device to be registered, and is not described herein again.

FIG. 7 shows a flow diagram of a method 700 of building a distributed test system according to an embodiment of the present disclosure. The method 700 is applied to, i.e., performed by, a device to be registered. As shown in FIG. 7, method 700 includes steps S710-S740.

In step S710, a registration request is sent to an authentication device, where the authentication device is any testing device in the distributed testing system, and the registration request includes first device information and first authentication information of a device to be registered.

In step S720, in response to the authentication device successfully authenticating the first authentication information, the second device information and the second authentication information of the authentication device returned by the authentication device are received.

In step S730, the second authentication information is authenticated to obtain a second authentication result of the second authentication information.

In step S740, in response to the second authentication result indicating that the authentication of the second authentication information is successful, the second device information is stored, and the second authentication result is returned to the authentication device, so that the device to be registered is added to the distributed test system.

According to some embodiments, the authentication device may encrypt the first device information using the same encryption algorithm, resulting in a first encryption result. And obtaining a second authentication result of the first authentication information by judging whether the first encryption result is the same as the first authentication information. Specifically, if the first encryption result is the same as the first authentication information, the first authentication information is successfully authenticated; and if the first encryption result is different from the first authentication information, the first authentication information fails to authenticate.

And under the condition that the first authentication information is successfully authenticated, the authentication equipment returns the second equipment information and the second authentication information of the authentication equipment to the equipment to be registered. Correspondingly, the device to be registered receives the second device information and the second authentication information of the authentication device returned by the authentication device.

According to some embodiments, after receiving the second device information and the second authentication information returned by the authentication device, the device to be registered encrypts the second device information by using the same encryption algorithm to obtain a second encryption result. And obtaining a second authentication result of the second authentication information by judging whether the second encryption result is the same as the second authentication information. Specifically, if the second encryption result is the same as the second authentication information, the second authentication information is successfully authenticated; and if the second encryption result is different from the second authentication information, the second authentication information fails to authenticate.

And under the condition that the equipment to be registered successfully authenticates the second authentication information, the equipment to be registered and the authentication equipment complete bidirectional authentication, the second equipment information is stored, and a second authentication result is returned to the authentication equipment so as to add the equipment to be registered to the distributed test system. Correspondingly, the authentication device receives a second authentication result (the second authentication result indicates that the mutual authentication is successful) returned by the device to be registered, and stores the first device information so as to add the device to be registered to the distributed test system.

According to some embodiments, in a case that the authentication device successfully authenticates the first authentication information, the authentication device further forwards the registration request to other test devices (third devices) in the distributed test system, so that the third devices authenticate the devices to be registered. Accordingly, the method 700 further comprises:

receiving third device information and third authentication information sent by third devices, wherein the third devices are any test devices different from the authentication devices in the distributed test system, and the third device information and the third authentication information are sent by the third devices in response to successful authentication of the first authentication information forwarded by the authentication devices; authenticating the third authentication information to obtain a third authentication result of the third authentication information; and in response to the third authentication result indicating that the authentication of the third authentication information is successful, storing the third device information and returning the third authentication result to the third device.

According to the embodiment, each test device in the distributed test system stores the information of other test devices and can communicate with each other, so that the high availability of the whole system is ensured.

The composition of the third device information is similar to the first device information and the second device information, the composition of the third authentication information is similar to the first authentication information and the second authentication information, the mutual authentication process between the device to be registered and the third device is similar to the mutual authentication process between the device to be registered and the authentication device described above, and details are not repeated here.

It should be noted that the method 600 and the method 700 are used for adding a new test device to the distributed test system when the test device exists in the distributed test system (i.e., when the certification device exists). It should be appreciated that for the first test device in the distributed test system, the test device cannot be added by the

method

600 or 700 described above because there is no distributed test system, i.e., no corresponding certification device, before the test device is added. The first test device in the distributed test system may be added, for example, by manually configuring the device information.

FIG. 8 shows a schematic diagram of a build process of a distributed test system according to an embodiment of the present disclosure. As shown in FIG. 8, the construction process includes steps S831-S840.

In step S831, the device to be registered 810 transmits a registration request to the test device 2 (authentication device) in the distributed test system 820. The registration request includes first device information and first authentication information of the device to be registered 810.

In step S832, the test device 2 authenticates the first authentication information, and obtains a first authentication result. The first authentication result indicates that the first authentication information is successfully authenticated.

In step S833, the test apparatus 2 returns the second apparatus information and the second authentication information of itself to the apparatus to be registered 810.

In step S834, the device to be registered 810 authenticates the second authentication information, and obtains a second authentication result. The second authentication result indicates that the authentication of the second authentication information is successful, so that the device to be registered 810 and the testing device 2 complete bidirectional authentication, and store the second device information of the testing device 2.

In step S835, the device to be registered 810 returns the second authentication result (indicating that the mutual authentication with the test device 2 is successful) to the test device 2, thereby joining the distributed test system 820.

In step S836, after the test device 2 successfully authenticates the first authentication information, the registration request is forwarded to the test device 1 (third device).

In step S837, the test apparatus 1 successfully authenticates the first authentication information.

In step S838, the test device 1 transmits the third device information and the third authentication information of itself to the device to be registered 810.

In step S839, the device to be registered 810 authenticates the third authentication information, and obtains a third authentication result. The third authentication result indicates that the third authentication information is successfully authenticated, so that the device to be registered 810 and the test device 1 complete bidirectional authentication, and store the third device information of the test device 1.

In step S840, the device to be registered 810 returns a third authentication result (indicating that the mutual authentication with the test device 1 is successful) to the test device 1.

According to the embodiment of the disclosure, a test device is also provided. Fig. 9 shows a block diagram of a test apparatus 900 according to an embodiment of the present disclosure. The apparatus 900 is applied to a first device, and the first device is any testing device in a distributed testing system. As shown in fig. 9, the apparatus 900 includes a receiving module 910, a generating module 920, and a forwarding module 930.

The receiving module 910 is configured to receive a first test request including information for a target test task for testing a service under test.

The generating module 920 is configured to generate at least one second test request based on the first test request in response to the first device refusing to execute the target test task or the first device agreeing to execute the target test task and a first number of test devices required to execute the target test task is greater than 1.

The forwarding module 930 is configured to forward the at least one second test request to at least one second device, respectively, so that each of the at least one second device responds to the corresponding second test request, where each of the at least one second device is any test device in the distributed test system except the first device.

According to embodiments of the present disclosure, a distributed test system is employed to test services. The distributed test system is deployed in a decentralized mode, and all test equipment in the system is equal in status. Both the first device receiving the first test request (which may be a test request sent by a user) and the second device receiving the second test request forwarded by the first device may be any test device in a distributed test system, so that the test device executing the target test task is not fixed, thereby improving the flexibility of service test, simulating the request condition of a real user of the service, and improving the accuracy of the test result.

According to some embodiments, the apparatus 900 further comprises: a response module configured to respond to the first test request based on a current working state of the first device to obtain a response result, wherein the response result is used for representing that the first device approves or refuses to execute the target test task.

According to some embodiments, the first test request further comprises: a first number of test devices required to perform the target test task.

According to some embodiments, each of the at least one second test request includes information of the target test task and a second number of test devices required to execute the target test task, a sum of respective second numbers of the at least one second test request is equal to a difference of the first number and an execution tag, the execution tag is equal to zero if the first device refuses to execute the target test task, and is equal to 1 if the first device agrees to execute the target test task.

According to some embodiments, the response module comprises: a determination unit configured to determine a third number of available test devices in the distributed test system; and a response unit configured to respond to the first test request to obtain a response result based on the current working state of the first device in response to the third number being greater than or equal to the first number of test devices required to execute the target test task, wherein the at least one second device is a subset of the available test devices.

According to some embodiments, the first device stores respective device information of at least one third device, each of the at least one third device being a test device in the distributed test system that performs mutual authentication with the first device, and the determining unit includes: a connection subunit configured to transmit connection requests to the at least one third device, respectively; and a determination subunit configured to take the successfully connected third device as the available test device.

According to some embodiments, the response module is further configured to: in response to a fourth number of currently executing test tasks being less than a threshold, agreeing to execute the target test task; and/or, responsive to a fourth number of currently executing test tasks being greater than or equal to a threshold, denying execution of the target test task.

According to some embodiments, at least one of the following is randomly set: a fifth number of the at least one second test request, the second number included in each of the at least one second test request.

According to the embodiment of the disclosure, a test result query device is also provided. Fig. 10 shows a block diagram of a test result query device 1000 according to an embodiment of the disclosure. The apparatus 1000 is applied to any test equipment of a distributed test system. As shown in fig. 10, the apparatus 1000 includes a first receiving module 1010, a broadcasting module 1020, a second receiving module 1030, and an output module 1040.

The first receiving module 1010 is configured to receive a test result query request including an identification of a target test task for testing a service under test.

The broadcast module 1020 is configured to broadcast the test result query request to other test devices in the distributed test system.

The second receiving module 1030 is configured to receive and summarize the test results of the target test task returned by the other test devices to obtain an overall test result.

The output module 1040 is configured to output the overall test result.

According to the embodiment of the disclosure, a device for constructing a distributed test system is also provided. Fig. 11 shows a block diagram of a construction apparatus 1100 of a distributed test system according to an embodiment of the present disclosure. The apparatus 1100 is applied to an authentication device, which is any test device in a distributed test system. As shown in fig. 11, the apparatus 1100 includes a receiving module 1110, an authentication module 1120, a return module 1130, and a storage module 1140.

The receiving module 1110 is configured to receive a registration request of a device to be registered, where the registration request includes first device information and first authentication information of the device to be registered.

The authentication module 1120 is configured to authenticate the first authentication information to obtain a first authentication result of the first authentication information.

The returning module 1130 is configured to return the second device information and the second authentication information of the authentication device to the device to be registered in response to the first authentication result indicating that the authentication of the first authentication information is successful.

The storage module 1140 is configured to receive a message that the mutual authentication of the devices to be registered is successful in response to the devices to be registered successfully authenticating the second authentication information, and store the first device information, so as to add the devices to be registered to the distributed test system.

According to the embodiment of the disclosure, the status of each test device in the distributed test system is equal, and each test device can be used as an authentication device for authenticating a new device (i.e., a device to be registered). The equipment to be registered can be registered and added into the system through any testing equipment in the system, the registration process is simple and flexible, the operation and maintenance difficulty is reduced, and the dynamic property and high availability of the system are ensured.

According to some embodiments, the apparatus 1100 further comprises: and the forwarding module is configured to forward the registration request to other test equipment in the distributed test system in response to the first authentication result indicating that the first authentication information is successfully authenticated, so that the other test equipment authenticates the equipment to be registered.

According to the embodiment of the disclosure, a device for constructing a distributed test system is also provided. Fig. 12 shows a block diagram of a building apparatus 1200 of a distributed test system according to an embodiment of the present disclosure. The apparatus 1200 is applied to a device to be registered. As shown in fig. 12, the apparatus 1200 includes a transmitting module 1210, a first receiving module 1220, a first authenticating module 1230, and a first storing module 1240.

The sending module 1210 is configured to send a registration request to an authentication device, where the authentication device is any test device in the distributed test system, and the registration request includes first device information and first authentication information of a device to be registered.

The first receiving module 1220 is configured to receive, in response to the authentication device successfully authenticating the first authentication information, second device information and second authentication information of the authentication device returned by the authentication device.

The first authentication module 1230 is configured to authenticate the second authentication information to obtain a second authentication result of the second authentication information.

The first storage module 1240 is configured to store the second device information and return the second authentication result to the authentication device in response to the second authentication result indicating that the authentication of the second authentication information is successful, so as to add the device to be registered to the distributed test system.

According to some embodiments, the apparatus 1200 further comprises: a second receiving module, configured to receive third device information and third authentication information sent by a third device, where the third device is any test device in the distributed test system that is different from the authentication device, and the third device information and the third authentication information are sent by the third device in response to successful authentication of the first authentication information forwarded by the authentication device; a second authentication module configured to authenticate the third authentication information to obtain a third authentication result of the third authentication information; and a second storage module configured to store the third device information and return the third authentication result to the third device in response to the third authentication result indicating that the authentication of the third authentication information is successful.

It should be understood that various modules or units of the apparatus 900 shown in fig. 9 may correspond to various steps in the method 200 described with reference to fig. 2, various modules or units of the apparatus 1000 shown in fig. 10 may correspond to various steps in the method 400 described with reference to fig. 4, various modules or units of the apparatus 1100 shown in fig. 11 may correspond to various steps in the method 600 described with reference to fig. 6, and various modules or units of the apparatus 1200 shown in fig. 12 may correspond to various steps in the method 700 described with reference to fig. 7. Thus, the operations, features and advantages described above with respect to method 200 are equally applicable to apparatus 900 and its included modules and units, the operations, features and advantages described above with respect to method 400 are equally applicable to apparatus 1000 and its included modules and units, the operations, features and advantages described above with respect to method 600 are equally applicable to apparatus 1100 and its included modules and units, and the operations, features and advantages described above with respect to method 700 are equally applicable to apparatus 1200 and its included modules and units. Certain operations, features and advantages may not be described in detail herein for the sake of brevity.

Although specific functionality is discussed above with reference to particular modules, it should be noted that the functionality of the various modules discussed herein can be separated into multiple modules and/or at least some of the functionality of multiple modules can be combined into a single module.

It should also be appreciated that various techniques may be described herein in the general context of software hardware elements or program modules. The various modules described above with respect to fig. 9-12 may be implemented in hardware or in hardware in combination with software and/or firmware. For example, the modules may be implemented as computer program code/instructions configured to be executed in one or more processors and stored in a computer-readable storage medium. Alternatively, the modules may be implemented as hardware logic/circuitry. For example, in some embodiments, one or more of the modules 910-1240 may be implemented together in a System on Chip (SoC). The SoC may include an integrated circuit chip (which includes one or more components of a Processor (e.g., a Central Processing Unit (CPU), microcontroller, microprocessor, digital Signal Processor (DSP), etc.), memory, one or more communication interfaces, and/or other circuitry), and may optionally execute received program code and/or include embedded firmware to perform functions.

According to an embodiment of the present disclosure, there is also provided an electronic apparatus including: at least one processor; and a memory communicatively coupled to the at least one processor, the memory storing instructions executable by the at least one processor, the instructions being executable by the at least one processor to enable the at least one processor to perform at least one of a test method, a test result query method, and a method of constructing a distributed test system according to embodiments of the present disclosure.

According to an embodiment of the present disclosure, there is also provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute at least one of a test method, a test result query method, and a method of constructing a distributed test system of an embodiment of the present disclosure.

According to an embodiment of the present disclosure, there is also provided a computer program product including a computer program which, when executed by a processor, implements at least one of a test method, a test result query method, and a construction method of a distributed test system of an embodiment of the present disclosure.

Referring to fig. 13, a block diagram of a structure of an electronic device 1300, which may be a server or a client of the present disclosure, which is an example of a hardware device that may be applied to aspects of the present disclosure, will now be described. Electronic device is intended to represent various forms of digital electronic computer devices, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 13, the electronic device 1300 includes a computing unit 1301 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 1302 or a computer program loaded from a storage unit 1308 into a Random Access Memory (RAM) 1303. In the RAM 1303, various programs and data necessary for the operation of the electronic device 1300 can also be stored. The calculation unit 1301, the ROM 1302, and the RAM 1303 are connected to each other via a bus 1304. An input/output (I/O) interface 1305 is also connected to bus 1304.

A number of components in the electronic device 1300 are connected to the I/O interface 1305, including: input section 1306, output section 1307, storage section 1308, and communication section 1309. The input unit 1306 may be any type of device capable of inputting information to the electronic device 1300, and the input unit 1306 may receive input numeric or character information and generate key signal inputs related to user settings and/or function controls of the electronic device, and may include, but is not limited to, a mouse, a keyboard, a touch screen, a track pad, a track ball, a joystick, a microphone, and/or a remote controller. Output unit 1307 may be any type of device capable of presenting information and may include, but is not limited to, a display, speakers, a video/audio output terminal, a vibrator, and/or a printer. Storage unit 1308 can include, but is not limited to, a magnetic disk, an optical disk. Communications unit 1309 allows electronic device 1300 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunications networks and may include, but is not limited to, a modem, a network card, an infrared communications device, a wireless communications transceiver, and/or a chipset, such as bluetooth ^TM Devices, 802.11 devices, wi-Fi devices, wiMAX devices, cellular communication devices, and/or the like.

Computing unit 1301 may be a variety of general and/or special purpose processing components with processing and computing capabilities. Some examples of computing unit 1301 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. Computing unit 1301 performs the various methods and processes described above, such as

methods

200, 400, 600, and/or 700. For example, in some embodiments,

methods

200, 400, 600, and/or 700 may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 1308. In some embodiments, part or all of the computer program can be loaded and/or installed onto the electronic device 1300 via the ROM 1302 and/or the communication unit 1309. When loaded into RAM 1303 and executed by computing unit 1301, a computer program may perform one or more of the steps of

methods

200, 400, 600 and 700 described above. Alternatively, in other embodiments, computing unit 1301 may be configured in any other suitable manner (e.g., by way of firmware) to perform

methods

200, 400, 600, and/or 700.

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), the internet, and blockchain networks.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server with a combined blockchain.

It should be understood that various forms of the flows shown above, reordering, adding or deleting steps, may be used. For example, the steps described in the present disclosure may be performed in parallel, sequentially or in different orders, and are not limited herein as long as the desired results of the technical aspects of the present disclosure can be achieved.

Although embodiments or examples of the present disclosure have been described with reference to the accompanying drawings, it is to be understood that the methods, systems, and apparatus described above are merely exemplary embodiments or examples and that the scope of the present disclosure is not limited by these embodiments or examples, but only by the claims as issued and their equivalents. Various elements in the embodiments or examples may be omitted or may be replaced with equivalents thereof. Further, the steps may be performed in an order different from that described in the present disclosure. Further, various elements in the embodiments or examples may be combined in various ways. It is important that as technology evolves, many of the elements described herein may be replaced with equivalent elements that appear after the present disclosure.

Claims

1. A testing method is applied to first equipment, wherein the first equipment is any testing equipment in a distributed testing system, and the method comprises the following steps:

receiving a first test request, wherein the first test request comprises information of a target test task for testing a service to be tested;

in response to the first device refusing to execute the target test task, or the first device agreeing to execute the target test task and a first number of test devices required for executing the target test task is greater than 1, generating at least one second test request based on the first test request; and

and forwarding the at least one second test request to at least one second device respectively, so that each second device in the at least one second device responds to the corresponding second test request, wherein each second device in the at least one second device is any test device except the first device in the distributed test system.

2. The method of claim 1, further comprising:

and responding to the first test request to obtain a response result based on the current working state of the first equipment, wherein the response result is used for representing that the first equipment approves or refuses to execute the target test task.

3. The method of claim 1, wherein the first test request further comprises: a first number of test devices required to perform the target test task.

4. The method of claim 3, wherein each of the at least one second test request includes information of the target test task and a second number of test devices required to execute the target test task, a sum of the second number to which each of the at least one second test request corresponds is equal to a difference of the first number and an execution tag, the execution tag is equal to zero if the first device rejects execution of the target test task and is equal to 1 if the first device approves execution of the target test task.

5. The method of claim 2, wherein responding to the first test request for a response result based on the current operating state of the first device comprises:

determining a third number of available test devices in the distributed test system;

responding to the first test request to obtain a response result based on the current working state of the first device in response to the third number being greater than or equal to the first number of test devices required for executing the target test task, wherein the at least one second device is a subset of the available test devices.

6. The method of claim 5, wherein the first device stores device information for each of at least one third device, each of the at least one third device being a test device in the distributed test system that performs mutual authentication with the first device, the determining the third number of available test devices in the distributed test system comprising:

respectively sending a connection request to the at least one third device; and

and taking the third equipment which is successfully connected as the available test equipment.

7. The method of claim 2, wherein responding to the first test request for a response result based on the current operating state of the first device comprises:

in response to a fourth number of currently executing test tasks being less than a threshold, agreeing to execute the target test task; and/or the presence of a gas in the gas,

responsive to a fourth number of currently executing test tasks being greater than or equal to a threshold, denying execution of the target test task.

8. The method of claim 4, wherein at least one of the following is randomly set:

a fifth number of the at least one second test request, a second number included with each of the at least one second test request.

9. A test result query method is applied to any test device in a distributed test system, and comprises the following steps:

receiving a test result query request, wherein the test result query request comprises an identifier of a target test task for testing a service to be tested;

broadcasting the test result query request to other test equipment in the distributed test system;

receiving and summarizing the test results of the target test task returned by the other test equipment to obtain an overall test result; and

and outputting the overall test result.

10. A construction method of a distributed test system is applied to authentication equipment, wherein the authentication equipment is any test equipment in the distributed test system, and the method comprises the following steps:

receiving a registration request of a device to be registered, wherein the registration request comprises first device information and first authentication information of the device to be registered;

authenticating the first authentication information to obtain a first authentication result of the first authentication information;

in response to the first authentication result indicating that the first authentication information is successfully authenticated, returning second device information and second authentication information of the authentication device to the device to be registered; and

and responding to the successful authentication of the equipment to be registered on the second authentication information, receiving a message of successful bidirectional authentication returned by the equipment to be registered, and storing the first equipment information so as to add the equipment to be registered to the distributed test system.

11. The method of claim 10, further comprising:

and in response to the first authentication result indicating that the first authentication information is successfully authenticated, forwarding the registration request to other test equipment in the distributed test system, so that the other test equipment authenticates the equipment to be registered.

12. A construction method of a distributed test system is applied to equipment to be registered, and comprises the following steps:

sending a registration request to authentication equipment, wherein the authentication equipment is any testing equipment in a distributed testing system, and the registration request comprises first equipment information and first authentication information of equipment to be registered;

receiving second equipment information and second authentication information of the authentication equipment, which are returned by the authentication equipment, in response to the authentication of the first authentication information by the authentication equipment;

authenticating the second authentication information to obtain a second authentication result of the second authentication information; and

and responding to the second authentication result indicating that the second authentication information is successfully authenticated, storing the second equipment information, and returning the second authentication result to the authentication equipment so as to add the equipment to be registered to the distributed test system.

13. The method of claim 12, further comprising:

receiving third device information and third authentication information sent by a third device, wherein the third device is any test device in the distributed test system, which is different from the authentication device, and the third device information and the third authentication information are sent by the third device in response to successful authentication of the first authentication information forwarded by the authentication device;

authenticating the third authentication information to obtain a third authentication result of the third authentication information; and

and in response to the third authentication result indicating that the third authentication information is successfully authenticated, storing the third device information and returning the third authentication result to the third device.

14. A test device applied to a first device, wherein the first device is any test device in a distributed test system, and the device comprises:

a receiving module configured to receive a first test request including information of a target test task for testing a service under test;

a generation module configured to generate at least one second test request based on the first test request in response to the first device refusing to execute the target test task or the first device agreeing to execute the target test task and a first number of test devices required to execute the target test task being greater than 1; and

a forwarding module configured to forward the at least one second test request to at least one second device, respectively, so that each of the at least one second device responds to the corresponding second test request, where each of the at least one second device is any test device in the distributed test system except the first device.

15. The apparatus of claim 14, further comprising:

a response module configured to respond to the first test request based on a current working state of the first device to obtain a response result, wherein the response result is used for representing that the first device approves or refuses to execute the target test task.

16. The apparatus of claim 14, wherein the first test request further comprises: a first number of test devices required to perform the target test task.

17. The apparatus of claim 16, wherein each of the at least one second test request includes information of the target test task and a second number of test devices required to execute the target test task, a sum of the second number to which each of the at least one second test request corresponds is equal to a difference of the first number and an execution tag, the execution tag is equal to zero if the first device rejects execution of the target test task and is equal to 1 if the first device approves execution of the target test task.

18. The apparatus of claim 15, wherein the response module comprises:

a determination unit configured to determine a third number of available test devices in the distributed test system; and

a response unit configured to respond to the first test request to obtain a response result based on the current working state of the first device in response to the third number being greater than or equal to a first number of test devices required to execute the target test task, wherein the at least one second device is a subset of the available test devices.

19. The apparatus of claim 18, wherein the first device stores respective device information of at least one third device, each of the at least one third device being a test device in the distributed test system that performs mutual authentication with the first device, and the determining unit includes:

a connection subunit configured to transmit connection requests to the at least one third device, respectively; and

a determination subunit configured to take the successfully connected third device as the available test device.

20. The apparatus of claim 15, wherein the response module is further configured to:

21. The apparatus of claim 17, wherein at least one of the following is randomly set:

a fifth number of the at least one second test request, the second number included in each of the at least one second test request.

22. A test result query device applied to any test equipment in a distributed test system comprises:

a first receiving module configured to receive a test result query request, the test result query request including an identification of a target test task for testing a service under test;

a broadcast module configured to broadcast the test result query request to other test devices in the distributed test system;

the second receiving module is configured to receive and summarize the test results of the target test tasks returned by the other test devices to obtain an overall test result; and

an output module configured to output the overall test result.

23. A construction device of a distributed test system is applied to authentication equipment, wherein the authentication equipment is any test equipment in the distributed test system, and the device comprises:

the device comprises a receiving module and a registering module, wherein the receiving module is configured to receive a registering request of a device to be registered, and the registering request comprises first device information and first authentication information of the device to be registered;

an authentication module configured to authenticate the first authentication information to obtain a first authentication result of the first authentication information;

a returning module configured to return second device information and second authentication information of the authentication device to the device to be registered in response to the first authentication result indicating that the authentication of the first authentication information is successful; and

and the storage module is configured to respond to the successful authentication of the equipment to be registered on the second authentication information, receive a message of successful bidirectional authentication returned by the equipment to be registered, and store the first equipment information so as to add the equipment to be registered to the distributed test system.

24. The apparatus of claim 23, further comprising:

the forwarding module is configured to forward the registration request to other test devices in the distributed test system in response to the first authentication result indicating that the first authentication information is successfully authenticated, so that the other test devices authenticate the device to be registered.

25. A construction device of a distributed test system is applied to equipment to be registered and comprises:

the device comprises a sending module and a registering module, wherein the sending module is configured to send a registering request to a certification device, the certification device is any testing device in a distributed testing system, and the registering request comprises first device information and first authentication information of a device to be registered;

a first receiving module, configured to receive, in response to successful authentication of the first authentication information by the authentication device, second device information and second authentication information of the authentication device returned by the authentication device;

a first authentication module configured to authenticate the second authentication information to obtain a second authentication result of the second authentication information; and

a first storage module configured to store the second device information in response to the second authentication result indicating that the authentication of the second authentication information is successful, and return the second authentication result to the authentication device to add the device to be registered to the distributed test system.

26. The apparatus of claim 25, further comprising:

a second receiving module, configured to receive third device information and third authentication information sent by a third device, where the third device is any test device in the distributed test system that is different from the authentication device, and the third device information and the third authentication information are sent by the third device in response to successful authentication of the first authentication information forwarded by the authentication device;

a second authentication module configured to authenticate the third authentication information to obtain a third authentication result of the third authentication information; and

a second storage module configured to store the third device information and return the third authentication result to the third device in response to the third authentication result indicating that authentication of the third authentication information is successful.

27. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-13.

28. A non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 1-13.

29. A computer program product comprising a computer program, wherein the computer program realizes the method of any one of claims 1-13 when executed by a processor.