CN112860579B

CN112860579B - Service testing method, device, storage medium and equipment

Info

Publication number: CN112860579B
Application number: CN202110286976.XA
Authority: CN
Inventors: 黄斌; 罗章龙; 袁明凯; 王谊; 严明
Original assignee: Shenzhen Tencent Information Technology Co Ltd
Current assignee: Shenzhen Tencent Information Technology Co Ltd
Priority date: 2021-03-17
Filing date: 2021-03-17
Publication date: 2024-03-22
Anticipated expiration: 2041-03-17
Also published as: CN112860579A

Abstract

The embodiment of the application discloses a service testing method, a storage medium and equipment. The method comprises the following steps: acquiring test configuration data associated with a game service, and combining virtual characters and character skills contained in the game service according to the test configuration data to generate M game pair test cases; distributing M game pair test cases to N subprocesses through a main process corresponding to the game service, testing the game pair test cases in the N subprocesses through a simulation game component associated with the game service, and generating game pair test results respectively corresponding to the M game pair test cases. Through this application, can reduce the cost of labor of test to improve efficiency of software testing.

Description

Service testing method, device, storage medium and equipment

Technical Field

The present disclosure relates to the field of testing technologies, and in particular, to a service testing method, device, storage medium, and apparatus.

Background

With the rapid development of entertainment applications, the game entertainment application has become a mainstream application of current entertainment, and a game entertainment application tests game service provided by the game entertainment application in the processes of research, development, running and the like, so that defects are determined and improvement is necessary, and the game player is better improved in higher game experience.

However, in the current game service testing process, a manual testing method is generally adopted, virtual characters in a game are manually combined, corresponding test cases are written for each combination, and manual testing is required for each test case. However, since the number of virtual characters in the game is large, a lot of time is required to combine them manually, which results in excessive cost and low efficiency of the test.

Disclosure of Invention

The technical problem to be solved by the embodiments of the present application is to provide a service testing method, apparatus, storage medium and device, which can reduce labor cost and improve testing efficiency.

An aspect of an embodiment of the present application provides a service testing method, including:

acquiring test configuration data associated with a game service, and combining virtual characters and character skills contained in the game service according to the test configuration data to generate M game pair test cases;

distributing M game test cases to N subprocesses through a main process corresponding to the game service; inter-process communication channels are arranged between the main process and N sub-processes, and M, N is a positive integer;

Testing the game pair test cases in the N subprocesses through the game service-related simulation game components to generate game pair test results respectively corresponding to the M game pair test cases; the game play test results provide a reference basis for matching between the virtual character and the character skills.

The method comprises the steps of obtaining test configuration data associated with a game service, combining virtual characters and character skills contained in the game service according to the test configuration data, and generating M game pair test cases, wherein the M game pair test cases comprise:

responding to uploading operation in a test page, acquiring test configuration data determined by the uploading operation, and acquiring a virtual character and character skills associated with game service in the test configuration data;

and according to the test parameter information in the test configuration data, randomly combining the virtual character and the character skills to generate M game pair test cases.

According to the test parameter information in the test configuration data, the virtual characters and the character skills are randomly combined to generate M game pair test cases, which comprises the following steps:

according to the test parameter information in the test configuration data, carrying out random combination on the virtual characters and character skills to obtain Q candidate game pair combinations; q is a positive integer greater than or equal to M;

Obtaining game play conditions corresponding to game services, and determining candidate game play combinations meeting the game play conditions in the Q candidate game play combinations as M game play combinations;

and performing code conversion on the M game pair combinations to generate game pair test cases corresponding to the M game pair combinations respectively.

The method comprises the steps of combining virtual characters and character skills contained in game service according to test configuration data to generate M game pair test cases, wherein the M game pair test cases comprise:

acquiring character features corresponding to the virtual characters in the test configuration data, and acquiring skill features corresponding to character skills in the test configuration data;

converting the test parameter information in the test configuration data into test parameter characteristics, and splicing character characteristics, skill characteristics and test parameter characteristics into an input characteristic matrix;

inputting the input feature matrix into a game generation model, and outputting a combined evaluation value between the virtual character and the character skill through the game generation model;

and according to the combination evaluation value, M game pair combinations between the virtual character and the character skill are obtained, code conversion is carried out on the M game pair combinations, and game pair test cases respectively corresponding to the M game pair combinations are generated.

The method for distributing M game pair test cases to N subprocesses through the main process corresponding to the game service comprises the following steps:

starting a main process corresponding to the game service, and creating and starting N subprocesses determined by the number M of the test cases through the main process;

according to the data format in the main process, respectively carrying out data conversion on M game check test cases to obtain M game check test cases after format conversion;

distributing M game pair test cases after format conversion to sub-threads in N sub-processes through inter-process communication channels between a main process and N sub-processes; one sub-thread corresponds to one game pair test case.

The game pair test cases in N subprocesses are tested through the game service-related simulated game components, and game pair test results respectively corresponding to the M game pair test cases are generated, and the game pair test results comprise:

based on the test environment configuration data in the test configuration data, carrying out environment update on the initial simulation component to obtain a simulation game component matched with the game service;

testing game pair test cases in N subprocesses through a simulation game component;

When the main process detects that the game pair test cases in the N subprocesses are in an end state, game pair test results corresponding to the M game pair test cases are obtained from the N subprocesses through inter-process communication channels between the main process and the N subprocesses.

The method comprises the following steps:

obtaining analysis indexes corresponding to the game service, analyzing game test results according to the analysis indexes, obtaining a game statistics corresponding to game test results; the analysis indexes at least comprise win probability, excellent balance rate, war loss ratio, virtual character occurrence frequency and opponent number;

if the statistics value of the game statistics meets the statistics threshold, determining virtual characters and character skills in game test cases corresponding to the statistics value of the game statistics meeting the statistics threshold as effective game combination;

if the statistics value does not meet the statistics threshold value, the virtual characters and character skills in the game statistics test cases corresponding to the statistics value which does not meet the statistics threshold value, and determining an invalid game play combination, and setting an alarm identifier for the invalid game play combination in the game service.

An aspect of an embodiment of the present application provides a service testing device, including:

The first generation module is used for acquiring test configuration data associated with the game service, combining virtual characters and character skills contained in the game service according to the test configuration data, and generating M game pair test cases;

the distribution module is used for distributing M game pair test cases to N subprocesses through the main processes corresponding to the game service; inter-process communication channels are arranged between the main process and N sub-processes, and M, N is a positive integer;

the second generation module is used for testing game pair test cases in N subprocesses through the game service-related simulation game components, and generating game pair test results respectively corresponding to the M game pair test cases; the game play test results provide a reference basis for matching between the virtual character and the character skills.

Wherein the first generation module comprises:

the first acquisition unit is used for responding to the uploading operation in the test page, acquiring the test configuration data determined by the uploading operation, and acquiring the virtual character and character skill associated with the game service in the test configuration data;

the first generation unit is used for randomly combining the virtual characters and the character skills according to the test parameter information in the test configuration data to generate M game pair test cases.

Wherein the first generation unit includes:

Wherein the first generation module comprises:

the second acquisition unit is used for acquiring character characteristics corresponding to the virtual characters in the test configuration data and acquiring skill characteristics corresponding to the character skills in the test configuration data;

the input unit is used for converting the test parameter information in the test configuration data into test parameter characteristics, and splicing the character characteristics, the skill characteristics and the test parameter characteristics into an input characteristic matrix;

an output unit for inputting the input feature matrix to the game generation model, outputting a combined evaluation value between the virtual character and the character skill through the game generation model;

And the second generation unit is used for acquiring M game opposite-play combinations between the virtual roles and the role skills according to the combination evaluation values, performing code conversion on the M game opposite-play combinations and generating game opposite-play test cases corresponding to the M game opposite-play combinations respectively.

Wherein the distribution module comprises:

the starting unit is used for starting a main process corresponding to the game service, and creating and starting N subprocesses determined by the number M of the test cases through the main process;

the data conversion unit is used for respectively carrying out data conversion on the M game check test cases according to the data format in the main process to obtain M game check test cases after format conversion;

the distribution unit is used for distributing the M game pair test cases after format conversion to the sub-threads in the N sub-processes through the inter-process communication channels between the main process and the N sub-processes; one sub-thread corresponds to one game pair test case.

Wherein the second generation module comprises:

the updating unit is used for carrying out environment updating on the initial simulation component based on the test environment configuration data in the test configuration data to obtain a simulation game component matched with the game service;

The test unit is used for testing game playing test cases in N subprocesses through the simulation game component;

and the third acquisition unit is used for acquiring game play test results respectively corresponding to the M game play test cases from the N subprocesses through an inter-process communication channel between the main process and the N subprocesses when the main process detects that the game play test cases in the N subprocesses are in an end state.

Wherein the apparatus further comprises:

an analysis module for obtaining the analysis index corresponding to the game service, analyzing the game test result according to the analysis index, obtaining a game statistics corresponding to game test results; the analysis indexes at least comprise win probability, excellent balance rate, war loss ratio, virtual character occurrence frequency and opponent number;

a first determination module for, if the statistics value satisfies the statistics threshold, the virtual character and character skill in the game test case corresponding to the game statistics value meeting the statistics threshold value, determining as valid game play combinations;

a second determining module, configured to, if the statistics of the game statistics does not meet the statistics threshold, determine a virtual character and a character skill in the game test case corresponding to the statistics of the game statistics that does not meet the statistics threshold, and determining an invalid game play combination, and setting an alarm identifier for the invalid game play combination in the game service.

In one aspect, the present application provides a computer device comprising: a processor and a memory;

wherein the memory is used for storing a computer program, and the processor is used for calling the computer program to execute the following steps:

An aspect of the present application provides a computer readable storage medium storing a computer program which, when executed by a processor, performs the steps of:

In one aspect, the present application provides a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method in the above aspect.

In the embodiment of the application, the test configuration data associated with the game service is obtained, and virtual characters and character skills contained in the game service are combined according to the test configuration data, so that M game pair test cases are generated. M game test cases are distributed to N subprocesses through the main processes corresponding to the game service, so that a large number of game test cases can be tested at the same time, the test efficiency is improved, and the labor cost can be reduced. The game counter test cases in N subprocesses are tested through the simulation game components related to the game service, game counter test results corresponding to the M game counter test cases are generated, the simulation game components are generated through simulating the actual game running environment, the game counter test cases can be tested through the simulation game components, and the game counter test cases are not required to be sent to the actual game client side, so that the test efficiency can be improved, and the test cost can be reduced. Through this application, can reduce the cost of labor to improve efficiency of software testing.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic architecture diagram of a service testing system according to an embodiment of the present application;

fig. 2 is a schematic flow chart of a service testing method according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a method for obtaining test configuration data according to an embodiment of the present application;

FIG. 4 is a schematic diagram of acquiring test configuration data according to an embodiment of the present application;

FIG. 5 is a schematic diagram of generating game pair test cases according to an embodiment of the present application;

FIG. 6 is a schematic diagram of generating game pair test results corresponding to M game pair test cases, respectively, according to an embodiment of the present application;

fig. 7 is a schematic diagram of a service testing method according to an embodiment of the present application;

fig. 8 is a schematic flow chart of a service test according to an embodiment of the present application;

FIG. 9 is a schematic diagram of obtaining game play test results according to an embodiment of the present application;

FIG. 10 is a schematic diagram of an analysis result corresponding to a game play test result according to an embodiment of the present application;

fig. 11 is a schematic diagram of a service testing method provided in an embodiment of the present application;

FIG. 12 is a schematic diagram of analyzing game play test results provided by an embodiment of the present application;

FIG. 13 is a schematic diagram of an analysis index according to an embodiment of the present disclosure;

FIG. 14 is a schematic diagram of a game play test result analysis method according to an embodiment of the present application;

FIG. 15 is a schematic diagram of a eudipleural rate analysis provided in an embodiment of the present application;

FIG. 16 is a schematic diagram of a combat damage value analysis provided in an embodiment of the present application;

FIG. 17 is a schematic diagram of a game play test result analysis method according to an embodiment of the present application;

fig. 18 is a schematic structural diagram of a service testing device according to an embodiment of the present application;

fig. 19 is a schematic structural diagram of a computer device according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.

Referring to fig. 1, fig. 1 is a schematic structural diagram of a service testing system according to an embodiment of the present application. As shown in fig. 1, the service testing system may comprise a server 10 and a cluster of user terminals. The cluster of user terminals may comprise one or more user terminals, the number of which will not be limited here. As shown in fig. 1, the user terminals 100a, 100b, 100c, …, and 100n may be specifically included. As shown in fig. 1, the user terminals 100a, 100b, 100c, …, 100n may respectively perform network connection with the server 10, so that each user terminal may perform data interaction with the server 10 through the network connection.

Wherein each user terminal in the user terminal cluster may include: smart terminals with business tests such as smart phones, tablet computers, notebook computers, desktop computers, wearable devices, smart home, head-mounted devices and the like. It should be appreciated that each user terminal in the cluster of user terminals shown in fig. 1 may be provided with a target application (i.e. application client) that, when running in each user terminal, may interact with the server 10 shown in fig. 1, respectively, as described above.

As shown in fig. 1, the server 10 may combine virtual characters and character skills included in the game service according to test configuration data associated with the game service sent by the user terminal, so as to generate M game pair test cases. The server 10 may further distribute the M game-pair test cases to N subprocesses through a main process corresponding to the game service, and test the game-pair test cases in the N subprocesses through a simulated game component corresponding to the game service, so as to generate game-pair test results respectively corresponding to the M game-pair test cases. The server 10 may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDNs, basic cloud computing services such as big data and artificial intelligence platforms.

For easy understanding, in the embodiment of the present application, one user terminal may be selected from the plurality of user terminals shown in fig. 1 as a target user terminal, where the target user terminal may include: and intelligent terminals with service testing functions such as intelligent mobile phones, tablet personal computers, notebook computers, desktop computers and intelligent televisions. For example, the embodiment of the present application may use the user terminal 100a shown in fig. 1 as a target user terminal, and an application client having the service test function may be integrated in the target user terminal (the application client in this case may be understood as a test tool). Wherein the target user terminal (e.g., user terminal 100 a) may be a user terminal used by a tester. For example, the user terminal 100a may determine the material uploaded by the tester as test configuration data associated with the game service in response to the uploading operation of the tester in the application client, i.e., acquire the test configuration data determined by the uploading operation. After the user terminal 100a obtains the test configuration data, the test configuration data may be sent to the server 10, and the server 10 at this time may be understood as a background server corresponding to the application client, that is, a background server corresponding to the test tool. After receiving the test configuration data sent by the user terminal 100a, the server 10 may combine the virtual characters and character skills included in the game service according to the test configuration data, to generate M game pair test cases. The server 10 may further distribute the M game-pair test cases to N subprocesses through a main process corresponding to the game service, and test the game-pair test cases in the N subprocesses through a simulated game component associated with the game service, so as to generate game-pair test results corresponding to the M game-pair test cases respectively.

Referring to fig. 2, fig. 2 is a flow chart of a service testing method according to an embodiment of the present application. The service testing method may be performed by a computer device, which may be a server (e.g. the server 10 in fig. 1 described above), or a user terminal (e.g. any user terminal in the user terminal cluster in fig. 1 described above), or a system comprising a server and a user terminal, which is not limited in this application. As shown in fig. 2, the service testing method may include steps S101 to S103.

S101, acquiring test configuration data associated with the game service, and combining virtual characters and character skills contained in the game service according to the test configuration data to generate M game pair test cases.

In particular, during the development of a game application, whether it is a brand new game application or an updated game version, it is necessary to test it to reduce defects in the game application. During the testing process of the game application, a tester may perform a start operation on a test tool (such as the application client) integrated in the computer device, the computer device may start the test tool in the computer device and enter a test page of the test tool in response to the start operation on the test tool, and the tester may upload test configuration data associated with the game service to the test page. After the test configuration data is uploaded successfully, the computer device may acquire test configuration data associated with the game service uploaded by the tester, where the test configuration data may include test environment configuration data (i.e., running environment configuration data required for running the game service), virtual characters and character skills associated with the game service, and may further include test parameter information such as a test task type, a test task name, a test number of times, and a number of combinations between the virtual characters and the character skills.

The computer device may combine virtual characters and character skills included in the game service according to the test configuration data to generate M game pair test cases. The virtual character may be a virtual character controlled in a game scene by a game player when the game player plays a game, for example, the game player may control a character "da ji" in a game scene to move forward, the "da ji" is a virtual character, and the character skill may be a skill that the virtual character may carry, for example, the "da ji" carries a "point control" skill, and in the game scene, the da ji may use the skill to control an opponent, so that the opponent is frozen and cannot give any skill. Wherein, a game pair test case can comprise at least two teams, each team can comprise one or more virtual characters and character skills, and each team is in competition or a pair relationship. For example, the test configuration data specifies a number of virtual characters in each combination of 6, one combination comprising two teams, each team comprising 3 virtual characters, each virtual character comprising a character skills, where a can be a positive integer, e.g., a can take on values of 1,2,3, …; thus, all virtual characters and all character skills provided by the test configuration data can be combined according to the regulations to generate a plurality of game pair test cases.

Optionally, the specific manner of generating the M game pair test cases may include: and responding to the uploading operation in the test page, acquiring the test configuration data determined by the uploading operation, and acquiring the virtual character and character skill associated with the game service in the test configuration data. And according to the test parameter information in the test configuration data, randomly combining the virtual character and the character skills to generate M game pair test cases.

Specifically, a tester may upload test configuration data associated with a game service in a test page provided by the embodiment of the present application, and the computer device may respond to an upload operation of the tester in the test page, obtain test configuration data determined by the upload operation, and obtain a virtual character and character skills associated with the game service in the test configuration data. And according to the test parameter information in the test configuration data, randomly combining the virtual character and the character skills to generate M game pair test cases. The test parameter information may include information such as a test task type, a test task name, the number of tests, the number of combinations between the virtual character and the character skill, and the like. For example, the number of virtual characters contained in each team in the game trial case is 6, and the character skills that each virtual character can carry can be 3 isoparametric information.

As shown in fig. 3, fig. 3 is a schematic diagram of a method for acquiring test configuration data provided in an embodiment of the present application, as shown in fig. 3, relevant information of a test task added by a tester is shown in a test page, in the test page shown in fig. 3, the tester may implement an upload operation for uploading test configuration data associated with a game service, for example, click on a "add version (test configuration data)" button, and a computer device in an embodiment of the present application may respond to an upload operation of the tester in the test page, and acquire test configuration data determined by the upload operation, that is, generate a new test task. As shown in fig. 3, the test page further provides a test task created by the tester, for example, a version number corresponding to "548" is named as a small range, a version corresponding to "numerical balance analysis", and a creation time corresponding to "2020.12.10" and "548" is a version number corresponding to one test task created by the tester. As shown in FIG. 3, a tester may implement a trigger operation for starting a "548" test task in a test page, i.e. click on "task start", and the computer device in the embodiment of the present application may respond to the trigger operation of the tester to test the "548" test task, so as to obtain a test result. Of course, when the test task is not required, the tester may click the "delete" touch key to delete the test task "548".

Fig. 4 is a schematic diagram of acquiring test configuration data according to the embodiment of the present application, and as shown in fig. 4, after a tester performs an upload operation of uploading test configuration data in fig. 3, that is, clicks "add a version of a conversion", a computer device may perform a page jump, jump to a test page shown in fig. 4, and the tester may input specific information of test configuration data associated with a game service in the test page shown in fig. 4. As shown in fig. 4, a tester may select a task type corresponding to a current test task, for example, make a matrix PK (contrast), start analysis or perform a test, and may set test parameter information such as a name remark corresponding to the current task, where the test parameter information may be set according to specific requirements. The tester can trigger a "+upload configuration file" touch key to upload test configuration data associated with the game service, wherein the test configuration data comprises the running environment of the game service, virtual characters and character skills contained in the game service and other relevant information. After the tester finishes adding all the test configuration data, the touch key of 'determining and generating tasks' can be triggered, and the computer equipment can generate a test task by the test configuration data input by the tester. And according to the test task, acquiring the virtual character and character skills associated with the game service from the test configuration data, and according to the test parameter information in the test configuration data, randomly combining the virtual character and the character skills to generate M game pair test cases.

Optionally, the specific manner of generating the M game pair test cases by the computer device by randomly combining the virtual characters and the character skills according to the test parameter information in the test configuration data may include: and according to the test parameter information in the test configuration data, carrying out random combination on the virtual characters and character skills to obtain Q candidate game pair combinations, wherein Q is a positive integer greater than or equal to M. Obtaining game opposite conditions corresponding to game services, determining candidate game opposite combinations meeting the game opposite conditions in the Q candidate game opposite combinations as M game opposite combinations, performing code conversion on the M game opposite combinations, and generating game opposite test cases corresponding to the M game opposite combinations respectively.

Specifically, the computer device may perform random combination on virtual characters and character skills in the game service according to the test parameter information in the test configuration data, to obtain Q candidate game play pair combinations, obtain game play pair conditions corresponding to the game service, and determine candidate game play pair combinations meeting the game play pair conditions in the Q candidate game play pair combinations as M game play pair combinations. The game play condition can be a game play combination condition only concerned in the test task, if the test task only concerned a game play combination in a certain mode, the game play combination outside the game play combination in a certain mode can be removed, the test efficiency can be effectively improved, and the game play condition at the moment can be a screening condition which is set in a self-defining mode based on a specific game scene or a specific test purpose. The computer equipment obtains M game play combinations, carries out code conversion on the M game play combinations, and generates game play test cases corresponding to the M game play combinations respectively. The computer equipment can generate M game pair test cases through an automatic test case generation tool.

For example, the computer device may use Blob encoding to transcode the M game-pair combinations to generate game-pair test cases corresponding to the M game-pair combinations, so as to compress the size of the game-pair test cases, thereby facilitating transmission and saving storage space. Blob refers to a class file object of immutable, raw data, whose data can be read in text or binary format, or converted into a data interface for data manipulation. For example, the computer device can realize an automatic test case generating tool through a computer programming language, and in the automatic test case generating tool, virtual characters and character skills in the game service generate M game test cases according to game conditions. The computer programming languages may include Python (a computer programming language that may be used to write running scripts for test tasks), C language (a procedural, abstract, general purpose programming language), java (a static object oriented programming language), and the like, among others.

For example, the test configuration data includes two roles, namely a virtual role J and a virtual role P, and further includes a role skill 1 and a role skill 2, and if the test configuration data specifies that each game pair combination includes two teams, each team includes one virtual role, and each virtual role includes 1 role skill, then according to the specification in the test configuration data, all the virtual roles and the role skills in the test configuration data are randomly combined to obtain a plurality of game pair test cases. Wherein, all virtual characters and character skills in the test configuration data are randomly combined, namely, virtual character J, virtual character P, character skill 1 and character skill 2 are randomly combined to obtain 16 candidate game pair combinations of (J-1 ), (J-1, J-2), (J-2, J-1), (J-2 ), (P-1, P-1), (P-1, P-2), (P-2, P-1), (J-1, P-2) and (J-2, P-2). If the candidate game pair combinations (J-1 ), (J-2, J-2), (P-1 ) and (P-2, P-2) are determined to be unsatisfactory according to the game pair conditions corresponding to the game service, the candidate game pair combinations (J-1, J-2), (J-2, J-1), (P-1, P-2), (P-2, P-1), (J-1, P-1), (J-2, P-1), (J-1, P-2), (J-2, P-2) and (J-2, P-2) meeting the game pair conditions in the 16 candidate game pair combinations are determined to be game pair combinations, and code conversion is carried out on the 12 game pair combinations to generate game pair test cases corresponding to the 12 game pair combinations respectively. Wherein the game play combination (J-1, J-2) comprises a warfare team J-1 and a warfare team J-2, the warfare team J-1 comprising a virtual character J carrying character skills 1, the warfare team J-2 comprising a virtual character J carrying character skills 2.

Fig. 5 is a schematic diagram of generating a game-to-game test case according to an embodiment of the present application, and fig. 5 shows a combination of virtual characters and character skills of a team in a game-to-game test case, and information related to ID (identification number) and the like. One game pair test case may include two teams, where the two teams are in a competitive or antipodal relationship, and as shown in fig. 5, each team includes three virtual characters, and each virtual character may include 2 skills. As shown in fig. 5, the corresponding code value may be set to "level", the corresponding "value check" may be set to "no check", so that the level of each virtual character may be not considered during the test, and the skill of each virtual character and each virtual character may be set to check, so that during the test, each virtual character and the skill of the character may be checked to determine whether the game-play condition is met, so as to combine the virtual characters and the skill of the character in the game service and set related information, and generate the game-play test case.

Optionally, the specific manner of generating the M game pair test cases may further include: and acquiring character characteristics corresponding to the virtual characters in the test configuration data, and acquiring skill characteristics corresponding to the character skills in the test configuration data. The method comprises the steps of converting test parameter information in test configuration data into test parameter characteristics, splicing character characteristics, skill characteristics and test parameter characteristics into input characteristic matrixes, inputting the input characteristic matrixes into a game generation model, and outputting a combined evaluation value between a virtual character and character skills through the game generation model. And obtaining M game pair combinations between the virtual character and the character skill according to the combination evaluation value, performing code conversion on the M game pair combinations, and generating game pair test cases respectively corresponding to the M game pair combinations. Wherein the game generation model adopts a large amount of sample game combination data, and the training of the label data corresponding to the plurality of sample game play combinations is completed, the tag data corresponding to the sample game play combination may include 0 and 1, and when the tag data is 0, the corresponding sample game play combination may be an invalid game play combination; when the label data is 1, the corresponding sample game play combination can be an effective game play combination, and the trained game play generation model can be used for predicting a combination evaluation value between the virtual character and the character skill; of course, the label data corresponding to the game play combination of the sample game may also be represented by using the remaining numbers or symbols, and the type of the label data is not specifically limited in the present application.

The computer equipment can acquire the virtual characters and all character skills contained in the test configuration data, and the virtual characters and the character skills in the test configuration data are represented in a numbered form, so that the virtual characters and the character skills are required to be converted into vector forms, and the vector forms at the moment can be called character features after the virtual characters are converted into the vector forms; after converting character skills into a vector form, the vector form at this time may be referred to as a skill feature. The manner of vector conversion of the virtual character and character skills may include, but is not limited to: and performing vector conversion on the virtual character and the character skill by adopting a single hot code (one-hot code) to obtain character characteristics corresponding to the virtual character and skill characteristics corresponding to the character skill, wherein the single hot code refers to a code system with only one bit being 1 and the other bits being 0, namely N states are encoded by using an N-bit state register, each state is an independent register bit, and only one bit is valid at any time. In addition, the computer equipment can also perform vector conversion on the virtual character and the character skills by LabelEncoder coding to obtain character features corresponding to the virtual character and skill features corresponding to the character skills. LabelEncoder codes can code the virtual character and character skills to obtain a code value between 0 and n-1, where n is the number of different values of a list and can be considered as the number of all different values of a certain feature (such as the virtual character or character skills). Similarly, the test parameter information in the test configuration data may be converted into test parameter characteristics in the same manner as described above. And then, character features, skill features and test parameter features can be spliced into an input feature matrix, the input feature matrix is input into a game generation model, a combination evaluation value between the virtual character and the character skill is output through the game generation model, the combination determined by the virtual character and the character skill is screened according to the combination evaluation value, namely, the combination with the combination evaluation value smaller than a first threshold value is deleted, and only the combination with the combination evaluation value larger than or equal to the first threshold value is reserved, so that M game combinations are obtained.

The combination evaluation value can be used as a reference basis for combining the virtual character and the character skills and used for primarily screening the combination between the virtual character and the character skills; the larger the combination evaluation value is, the more the player experience feeling in the actual game of the combination corresponding to the combination evaluation value is likely to be stronger, for example, the ability of two teams in the combination corresponding to the combination evaluation value is likely to be average; the smaller the combination evaluation value is, the worse the experience of the player in the actual game of the combination corresponding to the combination evaluation value is, for example, one team in the combination corresponding to the combination evaluation value may win in a plurality of tests (such as 100 times) and the other team may lose.

As an example, the test configuration data includes two roles of the virtual role J and the virtual role P, and two skills of the role skill 1 and the role skill 2, the computer device may input the role feature vectors corresponding to the virtual role J and the virtual role P, the skill feature vectors corresponding to the role skill 1 and the role skill 2, and the test parameter feature vectors corresponding to the test parameter information in the test configuration data, into the game generation model, may combine the virtual role and the role skill in the game generation model, and output each combination corresponding to the combination evaluation value, where, if two teams are specified in the test parameter information, one team includes one virtual role, one virtual role may carry one role skill, and may output the combination evaluation values corresponding to the 16 candidate game combinations, respectively, through the game generation model, and may determine the game combination according to the combination evaluation value. Assuming that the combination evaluation value of the candidate game pair combination (J-1 ) is 0.1, the combination evaluation value of the candidate game pair combination (J-1, p-1) is 0.7, when the first threshold value is set to 0.5 (which can be set manually according to specific requirements), since the combination evaluation value of the candidate game pair combination (J-1 ) is 0.1 smaller than the first threshold value of 0.5, it can be determined that the candidate game pair combination (J-1 ) is an invalid game pair combination, i.e., the candidate game pair combination (J-1 ) can be deleted; since the combination evaluation value 0.7 of the candidate game play combination (J-1, p-1) is greater than the first threshold value 0.5, the candidate game play combination (J-1, p-1) can be determined as a valid game play combination (i.e., one of the above-described M game play combinations).

Optionally, the computer device may randomly combine all the virtual characters and character skills included in the test configuration data to obtain Q candidate game opposite-office combinations, and further may splice character feature vectors corresponding to the virtual characters and skill feature vectors corresponding to the character skills in each candidate game opposite-office combination to obtain input vectors corresponding to each candidate game opposite-office combination, input the input vectors to the opposite-office generation model, output combination evaluation values corresponding to each candidate game opposite-office combination through the opposite-office generation model, and screen the Q candidate game opposite-office combinations according to the combination evaluation values (delete candidate game opposite-office combinations with the combination evaluation values smaller than the first threshold value), so as to obtain M game opposite-office combinations.

Optionally, the computer device may further combine the virtual character and the character skills by a genetic algorithm to obtain M game-pair combinations between the virtual character and the character skills. The specific process of generating M game play combinations by using a genetic algorithm is as follows: the computer device may encode (e.g., binary encode) the virtual character and character skills in the game service to obtain encoded virtual character and character skills, i.e., gene codes that emulate a biological genetic algorithm. And combining the coded virtual characters and character skills according to the test parameter information and the intersection and variation in the simulated biology genetics to obtain Q candidate game pair combinations, and performing adaptability evaluation on the Q candidate game pair combinations through an adaptability function to obtain the combination adaptability corresponding to each game pair combination. And if the history log exists in the game log combination between the virtual character and the character skills, determining an adaptive function between the virtual character and the character skills according to the history log. And rejecting the game combinations of the Q candidate games between the virtual characters and the character skills through the combination selection function according to the combination fitness between the virtual characters and the character skills, for example, calculating the combination fitness between the virtual characters and the character skills as a variable value in the combination selection function to obtain a reference value between the virtual characters and the character skills.

Specifically, after the computer device determines the reference value between the virtual character and the character skill, the computer device screens the Q candidate game pair combinations according to the reference value between the virtual character and the character skill to obtain M game pair test cases. If the reference value between the virtual character and the character skill is smaller than a second threshold value (which can be set according to specific requirements), eliminating the virtual character, if the reference value between the virtual character B and the character skill c is smaller than 0.05, eliminating the game pair corresponding to the virtual character B and the character skill c; if the reference value between the virtual character and the character skill is greater than or equal to a second threshold value (which can be set according to specific requirements), combining the game between the virtual character and the character skill to determine a game test case; if the reference value between the virtual character and the character skill is smaller than a second threshold value (which can be set according to specific requirements), eliminating the game play combination between the virtual character and the character skill, if the reference value between the virtual character B and the character skill c is larger than the second threshold value 0.4, determining the game play combination corresponding to the virtual character B and the character skill c as a game play test case; if the reference value between the virtual character B and the character skill c is 0.05 and is smaller than the second threshold value of 0.4, the game pair corresponding to the virtual character B and the character skill c is combined and removed.

S102, distributing M game pair test cases to N subprocesses through a main process corresponding to the game service.

Specifically, after the computer device determines M game play test cases, the M game play test cases may be distributed to N subprocesses in the main process through the main process corresponding to the game service, so that the N subprocesses test the M game play test cases, and a test result is obtained. The main process and the N sub-processes are provided with inter-process communication channels, for example, the main process and the sub-processes share the same memory space and communicate through the shared memory space.

Optionally, the specific manner of distributing the M game pair test cases to the N subprocesses by the computer device through the main process corresponding to the game service may include: and starting a main process corresponding to the game service, and creating and starting N subprocesses determined by the number M of the test cases through the main process. And respectively carrying out data conversion on the M game pair test cases according to the data format in the main process to obtain M game pair test cases after format conversion. And distributing the M game pair test cases with the converted formats to the sub-threads in the N sub-processes through an inter-process communication channel between the main process and the N sub-processes, wherein one sub-thread corresponds to one game pair test case.

Specifically, after M game-pair test cases are generated by the computer device, a main process corresponding to the game service may be started, after the main process corresponding to the game service is started, the number N of sub-processes to be started may be determined according to the number M of test cases corresponding to the M game-pair test cases, and N sub-processes for executing the M game-pair test cases may be created according to the number N of sub-processes to be started. Meanwhile, according to the data format in the main process, the M game pair test cases can be analyzed, and the analyzed M game pair test cases are respectively subjected to data conversion to obtain M game pair test cases after format conversion. In an automatic test case generating tool, a Blob binary code is adopted to encode M game check-out test cases, the M game check-out test cases are compressed, and M game check-out test cases are generated.

The main process corresponding to the game service can distribute the M game pair test cases after format conversion to N subprocesses through an inter-process communication channel between the main process and the N subprocesses. Each of the N sub-processes may create a sub-thread in each of the sub-processes according to the number of game-to-game test cases it contains, and distribute the game-to-game test cases to each of the sub-threads, where one of the sub-threads corresponds to one of the game-to-game test cases. If the main process distributes 6 game-pair test cases to the subprocesses P according to the running load related information of the subprocesses, the subprocesses P creates 6 subprocesses according to the number '6' of the game-pair test cases, and distributes 6 game-pair test cases to 6 subprocesses, namely one subprocess corresponding to one game-pair test case. The main process can acquire the execution state of the N subprocesses on the game to the local test case (such as acquired through the shared memory) at fixed time, and display the execution state to a tester through the test page.

The subsequent main process may also send the execution status of the current executing game to the corresponding control end of the computer device (for detecting the execution progress of each process executing game to the office test case) in real time through Websocket (a protocol for communicating over a single TCP (Transmission Control Protocol, a connection-oriented, reliable, byte stream-based transport layer communication protocol), which may make the Data exchange between the client and the server simpler, allowing the server to actively push Data to the client), or through DB (Data Base, an organic collection of a large amount of sharable Data organized in a certain structure and stored in the computer for a long time).

S103, testing the game pair test cases in the N subprocesses through the simulated game components associated with the game service, and generating game pair test results corresponding to the M game pair test cases respectively.

Specifically, the computer device may test the game-play test cases in the N subprocesses through the simulated game component associated with the game service, and generate game-play test results corresponding to the M game-play test cases respectively. The simulated game component related to the game service comprises an operation environment corresponding to the simulated game service, so that the operation of an actual game player can be simulated, and the game test cases are tested in the game operation environment provided by the simulated game component to obtain a test result. The simulated game component is obtained according to test configuration data input by a tester, and is updated in a background corresponding to the computer equipment according to the requirements of each test task. It should be noted that, the simulated game component in the embodiment of the present application is a simulated running environment generated by a simulated actual game running server, that is, a simulated client, in the computer device, where a test of a game versus game test case is executed, that is, a test of a game versus game test case is executed at a client where the computer device is located, and is not an external client, but is an internal virtual client in the computer device.

Optionally, the specific manner of testing the game pair test cases in the N subprocesses by the computer device through the simulated game component associated with the game service to generate the game pair test results corresponding to the M game pair test cases respectively may include: and based on the test environment configuration data in the test configuration data, carrying out environment update on the initial simulation component to obtain the simulation game component matched with the game service. And testing the game pair test cases in the N subprocesses through the simulation game component, and acquiring game pair test results corresponding to the M game pair test cases from the N subprocesses through inter-process communication channels between the main process and the N subprocesses when the main process detects that the game pair test cases in the N subprocesses are in an end state.

Specifically, the computer device may perform an environmental update on the initial simulation component based on the test environment configuration data in the test configuration data, that is, the test operation environment data corresponding to the game service (for example, an installation data packet corresponding to the game service), to obtain a simulation game component matched with the game service, that is, replace the initial simulation component with a simulation game component required by the test task. And testing the game pair test cases in the N subprocesses through the simulation game component, and acquiring game pair test results corresponding to the M game pair test cases from the N subprocesses through inter-process communication channels (such as through a shared memory) between the main process and the N subprocesses when the main process detects that the execution conditions of the game pair test cases in the N subprocesses are in an end state.

Specifically, when the computer device tests the game play test cases in the N subprocesses through the simulated game component, the computer device can test the game play test cases in the N subprocesses according to the running load conditions corresponding to the simulated game component. And the N subprocesses sequentially send packages to the simulation game components, and if the load of the simulation game component which is currently sent is full or is about to be full, the N subprocesses send packages to the next simulation game component until the N game pair test cases are sent. If there are 100 sub-processes currently, and the corresponding running load of each simulated game component is 10 sub-processes, 10 simulated game components are required to test game pair test cases in 100 sub-processes. Of course, the correspondence between the sub-processes and the simulated game components may also be determined according to the specific circumstances. When the game checking test case test of the simulation game component is finished, the corresponding subprocess can acquire game checking test results corresponding to the game checking test case from the simulation game component, and send the game checking test results to the main process through the communication channel, so that game checking test results corresponding to M game checking test cases are acquired. The computer equipment can analyze the game test results and provide reference basis for matching between virtual roles and role skills in the game service.

Fig. 6 is a schematic diagram of a game pair test result provided in the embodiment of the present application, where the game pair test result is respectively corresponding to M game pair test cases, and as shown in fig. 6, when a computer device generates M game pair test cases, and starts a main process corresponding to a game service, the main process creates and starts N sub-processes according to the number M of game pair test cases, and distributes the M game pair test cases to the N sub-processes. As shown in FIG. 6, each of the N sub-processes creates a corresponding connection (i.e., sub-thread) according to the number of game-to-office test cases that each owns, one game-to-office test case corresponding to one connection (i.e., sub-thread). The sub-process may package the simulated game components (i.e., the simulated game clients within the computer device) according to the connections (i.e., the sub-processes) it creates and accept the test results of the simulated game components on the game-play test cases. The main process can detect the situation that each subprocess executes the game check test cases in real time through the communication channel, and when the game check test cases corresponding to each subprocess are tested, the main process can summarize game check test results corresponding to the game check test cases in N subprocesses through the communication channel.

Fig. 7 is a schematic diagram of a service testing method provided in the embodiment of the present application, where, as shown in fig. 7, after the computer device obtains test configuration data corresponding to a game service, an automation use case generator may generate Q candidate game play combinations by combining virtual characters and character skills in the test configuration data according to test environment configuration data and test parameter information in the test configuration data, and screening the Q candidate game play combinations to generate M game play combinations. And encoding M game pair combinations through an automatic case generator to generate M game pair test cases. After the M game test cases are generated, the M game test cases can be analyzed through a case analyzer in a case high concurrency executor, the M game test cases are converted into a data format which can be identified by the high concurrency executor, the M game test cases are packaged through a high concurrency package sender, the M game test cases are sent to a simulated game component (the simulated game component is a simulated game running end in computer equipment), the simulated game component is used for normally simulating the corresponding game of the game business, redundant combat logic (namely, combat logic which is not related to the task) is stripped, and pre-operation (namely, the operation is performed under judging conditions which are not related to the context and actual combat of some game combat, such as judging whether a virtual character needs to have sufficient physical strength or not, and limiting combat entering conditions such as specific combat properties or not need to exist, but the judging conditions are irrelevant to actual combat numerical values) is reduced.

When the game checking test cases are tested, the game checking test results corresponding to the game checking test cases are returned to the corresponding subprocesses, and when the main process detects that the execution of the game checking test cases by each subprocess is finished through the communication channel, the game checking test results corresponding to the game checking test cases in each subprocess are summarized to obtain game checking test results corresponding to M game checking test cases. The computer equipment can analyze the M game test results through the data analysis platform according to analysis indexes set in the data analysis platform to obtain analysis results, and visualizes the analysis results, namely, the analysis results are displayed to testers, so that the testers or related equipment provide reference for matching between the virtual roles and the role skills according to the analysis results.

The method and the device have the advantages that the expandability is high, the deployment can be flexibly realized, and all components (such as an automatic use case generator, a high concurrency executor, a simulation game component and a data analysis platform) are mutually independent and can communicate through a network protocol. Meanwhile, the embodiment of the application can realize message queues, execute a large number of games on the office test cases, and visualize the execution state of each game on the office test cases, such as creating a daemon detection process, realizing two-way communication between a package sending tool (such as a main process and a subprocess) and the detection daemon through TCP (Transmission Control Protocol, which is a connection-oriented and reliable transport layer communication protocol based on byte streams), and realizing two-way communication between the daemon detection process and a test page through Websocket (a protocol for communication on single TCP (Transmission Control Protocol, which is a connection-oriented and reliable transport layer communication protocol based on byte streams), so that data exchange between a client and a server becomes simpler, and the server is allowed to actively push data to the client), thereby displaying the test state of the game on the office test cases to a tester.

Because of more game play combinations in the game service, the embodiment of the application can be high-performance, high-concurrency and extensible by using the high-concurrency executor, and the test efficiency of the game service can be improved. Meanwhile, when more test packets corresponding to game pair test cases exist, the process of issuing the test packets is likely to be longer, under special conditions, the package issuing can be stopped, the package issuing can also be stopped, and the test packets continue at proper time, so that the situation that the executed game pair test cases need to be re-executed due to special reasons (such as server downtime and network interruption) is avoided. In addition, the embodiment of the scheme can also regulate and control the rate of the packet sending, such as safety limitation possibly occurring in an external network or flow limitation, and can regulate and control the rate of the packet sending. In addition, the embodiment of the application can support the protocol of any game protocol (namely, the test environment configuration data related to the game service), and the initial simulation assembly can be updated according to any game protocol to obtain the simulation game assembly matched with the game service, namely, after each game protocol update, the original game protocol is replaced in the background without coding and compiling engineering. The scheme can support communication protocols such as TCP, UDP (User Datagram Protocol, a communication protocol capable of transmitting packets without establishing a connection) and the like, and can be freely configured. The Protobuf protocol can support at least Protobuf2 protocol and Protobuf3 protocol, and the Protobuf protocol refers to a method of language-independent, platform-independent and extensible serial structure data, and is used for (data) communication protocol, data storage and the like. The Protobuf protocol can be used for converting data such as game test cases generated by the scheme into a format capable of being stored and transmitted (such as network transmission), for example, the data structure of M game test cases can be converted, the M game test cases are converted into a format capable of being stored and transmitted (such as network transmission), the M game test cases after the format conversion are distributed to N subprocesses, and in the virtual game component, the M game test cases after the format conversion are tested, so that test results corresponding to the M game test cases are obtained.

Fig. 8 is a schematic flow chart of a service test provided in the embodiment of the present application, as shown in fig. 8, a tester uploads test configuration data corresponding to a game service to a test server (i.e. a computer device) in a corresponding test page, and after a test task is started, the test server may generate a test task according to the test configuration data input by the tester, and in object 1, a game pair test case is generated according to a related algorithm (e.g. a genetic algorithm, see the specific content described in step S101). And starting a main process, testing the game against test cases through the subprocesses in the main process, and checking whether the game against test cases are executed or not through a shared memory (namely a database). Object 1 transmits game pair test cases and game test protocols (i.e., game environment configuration data) to object 2, object 2 may update the initial simulation components based on the game test protocols, obtaining a simulated game component matched with the game service, and generating a game test result corresponding to the game test case in the simulated game component. The main process can acquire the execution progress of the game on the game test case in each sub-process in real time, and report the execution progress to the test server, so as to detect the execution condition of the game on the game test case in real time. After the object 2 obtains the game checking test result corresponding to the game checking test case, the game checking test result is sent to the object 1, the object 1 analyzes the game checking test result, the game checking test result is stored and displayed through the test server, and a tester can check the game checking test result in a test page provided by the server.

Fig. 9 is a schematic diagram of obtaining a game play test result according to the embodiment of the present application, and as shown in fig. 9, a computer device may obtain test configuration data 901 input by a tester, generate a game play test combination by combining virtual characters and character skills in the test configuration data, and filter 902 the game play test to generate a game play test case. After the game pair test case is generated, filling 903 the game protocol (i.e. game environment configuration data) in the test configuration data, namely filling in default values in the game protocol, such as virtual character identification, character skill identification, virtual character grade and the like, and supplementing the values required to be perfected in the game protocol to generate a test packet. The computer device may send the test packet 904, test the game-in-game test case in the simulated game component, generate a game-in-game test result corresponding to the game-in-game test case, and receive the packet 905. The computer device may store and analyze 906 game play test results to provide a reference basis for matching between the virtual character and character skills.

As shown in fig. 10, fig. 10 is a schematic diagram of an analysis result corresponding to a game pair test result provided in the embodiment of the present application, fig. 10 shows test results corresponding to 3 game teams, and as shown in fig. 10, the number of combat performed by T0 (game team T0) is 36, the ratio (i.e. the ratio of the total number) is 47%, the lowest win ratio is 60%, and the highest win ratio is 73%; the number of combat performed by T1 (game team T1) is 6, the proportion of the combat is 8%, the lowest winning rate is 51%, and the highest winning rate is 58%; the number of combat performed by T2 (game team T2) was 34, the duty ratio (i.e., the proportion of the total number) was 45%, the minimum odds were 0.3%, and the maximum odds were 49%. As shown in fig. 10, a line graph and a rectangle graph of the combat loss ratio (KD, a ratio between the residual forces of the arms and the enemy, and the higher the ratio, the smaller combat loss, the stronger the team ability) and the win rate (i.e. winning number of plays+number of plays of tie)/total number of plays of the tie) of each game team are also shown, so that the game test results corresponding to each team can be more intuitively shown. In this way, the tester or related device can match the virtual character with the character skills based on the analysis results.

The method and the device can be applied to strategy game scenes and card game scenes, in the related technology, the test cases are executed manually, but virtual roles and role skills in the strategy game scenes and the card game scenes are more, the influence of combined variables is large, and single low-frequency manual test is adopted, so that the efficiency is low, a large number of effective and accurate test results cannot be provided, and the evaluation value obtained in the test data analysis stage is often inaccurate. According to the scheme, through an automatic case generation tool, virtual characters and character skills contained in game service are combined according to test configuration data, and M game pair test cases are generated. Distributing M game test cases to N subprocesses through a main process corresponding to the game service, testing the game test cases in the N subprocesses in a simulated game component associated with the game service to generate game test results respectively corresponding to the M game test cases, the method can reduce the labor cost of game service test, improve the test efficiency, and simultaneously can efficiently generate a large number of comprehensive test results so as to provide more accurate reference for matching between virtual roles and role skills.

In the embodiment of the application, the virtual characters and character skills contained in the game service are combined according to the test configuration data by acquiring the test configuration data associated with the game service, so that M game pair test cases are generated; m game check test cases are distributed to N subprocesses through the main processes corresponding to the game services, and M game check test cases are distributed through the main processes corresponding to the game services, so that a large number of game check test cases can be conducted simultaneously, test efficiency is improved, and labor cost can be reduced. The game counter test cases in N subprocesses are tested through the simulation game components related to the game service, game counter test results corresponding to the M game counter test cases are generated, the simulation game components are generated through simulating the actual game running environment, the game counter test cases can be tested through the simulation game components, and the game counter test cases are not required to be sent to the actual game client side, so that the test efficiency can be improved, and the test cost can be reduced. According to the method and the device, the labor cost can be reduced, the testing efficiency is improved, a large number of comprehensive testing results can be generated efficiently, and more accurate reference basis is provided for matching between the virtual roles and the role skills.

As shown in fig. 11, fig. 11 is a schematic diagram of a service testing method provided in an embodiment of the present application, where the method may be performed by a computer device, and the method may be performed by a computer device, where the computer device may be a server (such as the server 10 in fig. 1 described above), or a target user terminal (such as any target user terminal in the target user terminal cluster in fig. 1 described above), or a system formed by the server and the target user terminal, which is not limited in this application. As shown in fig. 11, the steps of the service testing method include S201-206.

S201, test configuration data associated with the game service is obtained, virtual characters and character skills contained in the game service are combined according to the test configuration data, and M game pair test cases are generated.

S202, M game pair test cases are distributed to N subprocesses through a main process corresponding to the game service.

S203, testing the game pair test cases in the N subprocesses through the game service-related simulated game components, and generating game pair test results respectively corresponding to the M game pair test cases.

The specific contents of steps S201-S206 may be described with reference to fig. 1, and embodiments of the present application will not be described here.

S204, obtaining analysis index corresponding to game service, analyzing game test result according to the analysis index, and obtaining a game counter value corresponding to the game counter test result.

Specifically, the computer equipment generates game opposite test results corresponding to M game opposite test cases respectively, can acquire analysis indexes corresponding to game services, analyzing the game test result according to the analysis index, and obtaining a game counter value corresponding to the game counter test result. The analysis indexes at least comprise win probability, excellent balance rate, war loss ratio, virtual character appearance times, restraint opponent number, skill appearance times, grade or star grade and the like. A reference basis may be provided for matching between the virtual characters and the character skills based on the statistics of the office, i.e., determining which virtual characters may be combined together, which virtual characters may not be combined together, which virtual characters may be combined with the character skills, which character skills may not be combined together, and so on.

S205, if the statistics value meets the statistics threshold, determining the virtual characters and character skills in the game statistics test cases corresponding to the statistics value meeting the statistics threshold as effective game opposite combinations.

S206, if the statistics value does not meet the statistics threshold value, the virtual characters and character skills in the game statistics test cases corresponding to the statistics value which does not meet the statistics threshold value, and determining an invalid game play combination, and setting an alarm identifier for the invalid game play combination in the game service.

Specifically, after obtaining the game statistics corresponding to the game statistics results, if the statistics values are determined to meet the statistics threshold, the computer equipment determines effective game play combinations by the virtual characters and the character skills in the game play test cases corresponding to the statistics values meeting the statistics threshold. If the statistics value does not meet the statistics threshold value, the virtual characters and character skills in the game statistics test cases corresponding to the statistics value which does not meet the statistics threshold value, and determining an invalid game play combination, and setting an alarm identifier for the invalid game play combination in the game service. The effective game pair combination may be a game experience that may be performed in a battle team form (i.e., a form of combination between a virtual character and a character skill) corresponding to the effective game pair combination when an actual game player performs the game experience. The invalid game match-making combination can be that when an actual game player plays the game experience, the game experience cannot be played in a form of a corresponding team of the invalid game match-making combination (namely, a combination form between the virtual character and the character skill), and an alarm mark is set for the invalid game match-making combination in the game service, namely, when the team of the game player after combination is the invalid game match-making combination, the combination form is sent to a user, namely, the game player is not allowed to play the game experience in the form of the invalid game match-making combination.

If the game match test results corresponding to the M game match test cases respectively can be used for counting the winning probability corresponding to each team, each game match test case can comprise two teams and has a contradictory relation. In this way, the winning probability corresponding to each battle team in each game pair test case is obtained, if the winning probability of the battle team corresponding to the game pair test case meets the statistical threshold, the battle team with the winning probability meeting the statistical threshold is taken as an effective game pair combination, namely, when an actual game player plays a game, the game experience can be played in a battle team form (namely, a combination form between a virtual character and character skills) corresponding to the effective game pair combination; if the win probability of the battle team corresponding to the game match test case does not meet the statistical threshold, the battle team with the win probability which does not meet the statistical threshold is taken as an invalid game match combination, namely, when an actual game player plays a game experience, the game experience cannot be played in a form of the battle team corresponding to the invalid game match combination (namely, in a combined form between the virtual character and the character skill).

For example, when the analysis index of the computer device is the optimal balance rate (i.e., winning number of occasions + number of occasions of tie) and the total number of occasions, the game checking test results corresponding to the game checking test cases are analyzed, so as to obtain the optimal balance rate (i.e., checking statistics) corresponding to each battle team in each game checking test case. In this way, when the battle team's excellent balance rate corresponding to the game match test case meets the statistical threshold, the battle team whose excellent balance rate meets the statistical threshold is taken as an effective game match combination; and when the superior level rate of the battle team corresponding to the game match test case does not meet the statistical threshold, the battle team with the superior level rate meeting the statistical threshold is taken as an invalid game match combination. Similarly, when the analysis index of the computer equipment is a combat loss ratio (i.e., a ratio value between the residual force of the weapon and the residual force of the enemy, the higher the ratio value is, the smaller combat loss is indicated, and the stronger the team capability is), the game match test results corresponding to the game match test cases are analyzed, and the combat loss ratio (i.e., the match statistics) corresponding to each combat team in each game match test case is obtained. In this way, when the combat loss ratio of the combat team corresponding to the game match test case meets the statistical threshold, the combat team with the combat loss ratio meeting the statistical threshold is used as an effective game match combination; and when the combat loss ratio of the combat team corresponding to the game match test case does not meet the statistical threshold, the combat team with the excellent balance rate meeting the statistical threshold is taken as an invalid game match combination.

Similarly, when the analysis index of the computer equipment is the number of virtual character appearance times, the number of opponents in restraint, the number of skill appearance times, the grade or star grade and the like, the game test result is analyzed according to the analysis index, obtaining the game statistics corresponding to the game statistics, judging whether the game statistics meets the statistics threshold, and determining virtual characters and character skills in the game match test cases, and combining for effective games or combining for ineffective games.

Fig. 12 is a schematic diagram of analyzing a Game play test result provided in the embodiment of the present application, and as shown in fig. 12, in a strategy Game (SLG, simulation Game), a computer device may determine that a battle team lineup in each Game play test case is 3 virtual roles and 6 role skills, and each virtual role corresponds to 2 skills, so that after a plurality of Game play test cases are obtained, the plurality of Game play test cases are tested, and a Game play test result is obtained. The computer equipment can analyze the game checking test result, namely, array capacity analysis is carried out, and the optimal balance rate (instant win field times + tie field times)/total field times) corresponding to each team in each game checking test case, the combat loss value (namely, a proportional value between the residual force of the weapon and the residual force of the enemy) and the combat statistics corresponding to analysis indexes such as the higher the proportional value is, the smaller combat loss is indicated, the higher the team capacity is, the number of the check team is calculated. The virtual characters and the character skills in the game match test cases can be analyzed, and the effective game match combination or the ineffective game match combination can be obtained by analyzing the virtual characters and the character skills in each team, the occurrence frequency, star match, type match, attribute match and the like, and finally calculating the contribution degree of each team (namely, the numerical value obtained according to a plurality of match statistics data) to obtain the injury proportion of the character skills and the overall injury proportion of the virtual characters. If the team capacity of the battle team 1 is too strong according to the statistics of the game, the team is hardly restricted, and the fairness of the game operation can be affected when the actual game is operated, so that the experience of a game player is affected. Thus, team 1 is an invalid game play combination, i.e., the form of match between the virtual character and character skills in team 1 is not allowed.

As shown in fig. 13, fig. 13 is a schematic diagram of an analysis index provided in an embodiment of the present application, and as shown in fig. 13, an analysis layer for analyzing a game pair test result by using a computer device may include: array capacity analysis, virtual character analysis and character skill analysis. As shown in fig. 13, when the game play test result is analyzed by using the array capacity analysis as an analysis level, if the team in the game play test case has 3 alarm types, i.e., the team capacity is too strong, the national team T degree, and the team capacity is too weak, the team having the 3 alarm types can be determined as an invalid game play combination. As shown in fig. 13, when the alert type of the team is "team capacity is too strong", the detailed criteria for determining whether the current team is "team capacity is too strong" alert type, in which the corresponding reference index (i.e., analysis index) is the number of check teams (i.e., the number of check teams corresponding to the current alert team is determined), the optimal balance rate, and the KD ratio, are described as follows: 1. no restraint team, 2, etc. When the alarm type of the warfare is 'national team T degree', the corresponding reference index (namely the analysis index) is the optimal level rate, and the detailed standard for judging whether the current warfare is the alarm type of 'national team T degree' is described as follows: 1. the winning rate has a significant jump, such as a jump rate greater than 10%, etc. When the alarm type of the warfare is 'team capacity is too weak', the corresponding reference index (namely the analysis index) is the optimal balance rate and KD (KD) war loss ratio, and the detailed standard for judging whether the current warfare is 'team capacity is too weak' alarm type is described as follows: 1. the matrix excellent flat rate is relatively low, 2, the matrix excellent flat rate is obviously reduced relative to the team in between, and the like.

As shown in fig. 13, when the game pair test result is analyzed by using the virtual character analysis as the analysis layer, if the wars in the game pair test case have 2 alarm types, i.e., the virtual character is too strong and the star level is virtually perceived to be not matched, the wars having the 2 alarm types can be determined as invalid game pair combinations. When the alarm type of the warfare is 'virtual character is too strong', the corresponding reference index (namely the analysis index) is the number of occurrences of the virtual character, the high-level rate, and the detailed standard for judging whether the current warfare is 'team is too strong' alarm type is described as follows: 1. the number of occurrences in the top 30 of the virtual character rank is too many, 2, high rate of excellent balance, etc. When the alarm type of the team is 'star level mismatch of the virtual character', the corresponding reference index (i.e. analysis index) is the number of occurrences of the virtual character and star level, and the detailed standard for judging whether the current team is 'team capacity too strong' alarm type is described as follows: 1. the star level in the combination is too far apart, etc. When the game checking test result is analyzed by taking the character skill analysis as an analysis layer, if the battle team in the game checking test case has an alarm type with strong character skill ability, the battle team corresponding to the character skill ability can be determined to be an invalid game checking combination. When the alarm type of the warfare team is 'character skill ability is too strong', the corresponding reference index (namely analysis index) is the skill occurrence number and the excellent balance rate, and the detailed standard for judging whether the current warfare team is 'character skill too strong' alarm type is described as follows: 1. too many occurrences in the role skill ranking front 30, and so on. Therefore, according to the detailed description of the analysis layers, the reference indexes and the judgment standards, whether the warfare in the game play test case belongs to the alarm type is determined, if the warfare is the alarm type, the combination between the virtual character and the character skill in the warfare corresponding to the alarm type is determined to be an invalid game play combination, namely, game players are forbidden when the actual game is run, and game experience is carried out by the invalid game play combination.

For example, as shown in fig. 14, fig. 14 is a schematic diagram of a method for analyzing a game play test result provided in the embodiment of the present application, as shown in fig. 14, the present application may be applied to a policy game scene, where a computer device analyzes a test result of a team D in a game play test case, to obtain an analysis path that the team D is "team capacity is too weak" as follows: firstly, analyzing test results of the warfare agent D according to a plurality of analysis layers and reference bases to obtain an analysis summary page corresponding to the warfare agent D. The computer equipment can analyze the array capacity of the warfare agent D to determine which problems exist in the warfare agent D currently, acquire a warfare record list with the excellent level rate smaller than 25% corresponding to the warfare agent D, then compare KD (warfare loss ratio) to obtain a warfare loss ratio reference picture, and finally determine and position the array capacity of the warfare agent D in advance, for example, determine that the warfare agent D is of a warning type with weak team capacity according to the analysis.

As shown in fig. 15, fig. 15 is a schematic diagram of a level-of-balance analysis provided in the embodiment of the present application, and as shown in fig. 15, a level-of-balance comparison corresponding to a team in a game pair test case is shown, it can be seen from fig. 15 that a level-of-balance corresponding to a team D is 14.45, the level-of-balance is lower, and the jump is larger (lower than 10% of the previous team) compared with the level-of-balance of the previous team.

Fig. 16 is a schematic diagram of a battle damage value analysis provided in the embodiment of the present application, as shown in fig. 16, showing that the battle damage value corresponding to the battle team in the game match test case is compared, as shown in fig. 15, the battle damage value corresponding to the battle team D is 0.073, which is far lower than the battle damage values of other battle teams, so that, as shown in fig. 15 and fig. 16, the battle team D can be determined to be of a "team capacity is too weak" alarm type, when the game actually runs, when the battle team combination form corresponding to the game player is of a combination form corresponding to the battle team D, alarm information can be input, the battle team combination form is provided to be too weak, and prompt information such as recombination is requested.

As shown in fig. 17, fig. 17 is a schematic diagram of a game pair game test result analysis method provided in the embodiment of the present application, as shown in fig. 17, the present application may be applied to a chess game service, as shown in fig. 17, a computer device may obtain test configuration data corresponding to the chess game service input by a tester in a test page, where the test configuration data corresponding to the chess game service may include running environment configuration data (i.e., a game running installation package) corresponding to the chess game service, and virtual characters (i.e., game player representatives) and character skills (e.g., character rights) included in the chess game service, and combine the virtual characters and the character skills according to test parameter information corresponding to the chess game service, so as to generate a test case. The test parameter information in the test configuration data may include the number of teams in each game pair test case, the number of virtual roles in each team, and which role skills (such as role rights) each virtual role has, for example, four teams may be included in the game pair test case K, where each team includes one virtual role, and each virtual role has 2 role skills.

And the computer equipment performs random combination on all virtual characters and all character skills contained in the game service according to the test parameter information in the test configuration data to obtain Q candidate game pair combinations. And screening the Q candidate game match combinations according to default combination screening conditions to obtain M game match combinations, and then encoding the M game match combinations to obtain M game match test cases corresponding to the M game match combinations. The computer equipment can update the initial simulation assembly according to the running environment configuration data in the test configuration data to obtain a simulation game assembly matched with the chess game service, and execute the generated M game test cases in the simulation game assembly to obtain test results of the M game test cases corresponding to the chess game service. Analyzing the test result according to related analysis indexes (such as combat loss value, number of winning rates and the like), determining the combat statistics of each combat team, and determining whether the combat team in the game combat test case is an invalid game combat combination according to the combat statistics of each combat team.

Optionally, the method includes storing M game pair test cases generated by the guide in the embodiment, M game pair test results corresponding to the M game pair test cases, and analysis results corresponding to the M game pair test results. The display is an open-source, distributed and column storage system, is particularly suitable for real-time analysis and statistics on big data, has better stability (high Available), is relatively lighter, and has very perfect documents. Meanwhile, the data generated in the scheme can be compressed and added into the index structure by the guide, so that the data storage capacity is increased by compression, the transmission is more convenient, and related equipment can be accessed quickly.

In the embodiment of the application, the virtual characters and character skills contained in the game service are combined according to the test configuration data by acquiring the test configuration data associated with the game service, so that M game pair test cases are generated; m game check test cases are distributed to N subprocesses through the main processes corresponding to the game services, and M game check test cases are distributed through the main processes corresponding to the game services, so that a large number of game check test cases can be conducted simultaneously, test efficiency is improved, and labor cost can be reduced. The game counter test cases in N subprocesses are tested through the simulation game components related to the game service, game counter test results corresponding to the M game counter test cases are generated, the simulation game components are generated through simulating the actual game running environment, the game counter test cases can be tested through the simulation game components, and the game counter test cases are not required to be sent to the actual game client side, so that the test efficiency can be improved, and the test cost can be reduced. Obtaining analysis indexes corresponding to the game service, analyzing game test results according to the analysis indexes, and obtaining a game counter value corresponding to the game counter test result. If the statistics value of the game statistics meets the statistics threshold, determining virtual characters and character skills in game test cases corresponding to the statistics value of the game statistics meeting the statistics threshold as effective game combination; if the statistics value does not meet the statistics threshold value, the virtual characters and character skills in the game statistics test cases corresponding to the statistics value which does not meet the statistics threshold value, and determining an invalid game play combination, and setting an alarm identifier for the invalid game play combination in the game service. Therefore, the game checking result is analyzed through a plurality of analysis indexes, so that big data checking result reference can be obtained, the game checking result is effectively evaluated, the matching between the virtual angle and the character skill in the game service is better determined, the service of the game service is perfected, and updated game experience is provided for game players. According to the method and the device, the labor cost can be reduced, the testing efficiency is improved, a large number of comprehensive testing results can be generated efficiently, and more accurate reference basis is provided for matching between the virtual roles and the role skills.

Referring to fig. 18, fig. 18 is a schematic structural diagram of a service testing device according to an embodiment of the present application. The service test device may be a computer program (including program code) running in a computer apparatus, for example, the service test device is an application software; the device can be used for executing corresponding steps in the service testing method provided by the embodiment of the application. As shown in fig. 18, the service testing apparatus may include: the system comprises a first generation module 11, a distribution module 12, a second generation module 13, an analysis module 14, a first determination module 15 and a second determination module 16.

The first generating module 11 is configured to obtain test configuration data associated with a game service, and combine a virtual character and character skills included in the game service according to the test configuration data to generate M game pair test cases;

the distribution module 12 is configured to distribute M game pair test cases to N subprocesses through a main process corresponding to the game service; inter-process communication channels are arranged between the main process and N sub-processes, and M, N is a positive integer;

the second generating module 13 is configured to test game pair test cases in N subprocesses through a simulated game component associated with a game service, and generate game pair test results corresponding to the M game pair test cases respectively; the game play test results provide a reference basis for matching between the virtual character and the character skills.

Wherein the first generating module 11 comprises:

a first obtaining unit 1101, configured to obtain, in response to an upload operation in the test page, test configuration data determined by the upload operation, and obtain, in the test configuration data, a virtual character and a character skill associated with the game service;

the first generating unit 1102 is configured to randomly combine the virtual character and the character skill according to the test parameter information in the test configuration data, and generate M game pair test cases.

The first generating unit 1102 includes:

Wherein the first generating module 11 comprises:

a second obtaining unit 1103, configured to obtain character features corresponding to the virtual characters in the test configuration data, and obtain skill features corresponding to the character skills in the test configuration data;

An input unit 1104 for converting the test parameter information in the test configuration data into test parameter characteristics, and splicing the character characteristics, the skill characteristics and the test parameter characteristics into an input characteristic matrix;

an output unit 1105 for inputting the input feature matrix to the game generation model, outputting a combination evaluation value between the virtual character and the character skill through the game generation model;

the second generating unit 1106 is configured to obtain M game pair combinations between the virtual character and the character skill according to the combination evaluation values, and transcode the M game pair combinations to generate game pair test cases corresponding to the M game pair combinations respectively.

Wherein the distribution module 12 comprises:

a starting unit 1201, configured to start a main process corresponding to the game service, and create and start N sub-processes determined by the number M of test cases through the main process;

the data conversion unit 1202 is configured to perform data conversion on the M game-play test cases according to a data format in the main process, so as to obtain M game-play test cases after format conversion;

a distributing unit 1203, configured to distribute the M game pair test cases after format conversion to sub-threads in the N sub-processes through an inter-process communication channel between the main process and the N sub-processes; one sub-thread corresponds to one game pair test case.

Wherein the second generating module 13 comprises:

an updating unit 1301, configured to perform an environmental update on the initial simulation component based on the test environment configuration data in the test configuration data, to obtain a simulation game component that matches the game service;

a test unit 1302, configured to test game play test cases in N subprocesses through the simulated game component;

the third obtaining unit 1303 is configured to obtain, when the main process detects that the game pair test cases in the N sub-processes are in an end state, game pair test results corresponding to the M game pair test cases respectively from the N sub-processes through an inter-process communication channel between the main process and the N sub-processes.

Wherein the apparatus further comprises:

an analysis module 14 for obtaining analysis indexes corresponding to the game service, analyzing the game test result according to the analysis index, obtaining a game statistics corresponding to game test results; the analysis indexes at least comprise win probability, excellent balance rate, war loss ratio, virtual character occurrence frequency and opponent number;

a first determining module 15, configured to, if the statistics threshold is met for the statistics values, the virtual character and character skill in the game test case corresponding to the game statistics value meeting the statistics threshold value, determining as valid game play combinations;

And the second determining module 16 is configured to determine the virtual character and the character skill in the game checking test case corresponding to the checking statistics value that does not meet the statistics threshold value as an invalid game checking combination if the checking statistics value does not meet the statistics threshold value, and set an alarm identifier for the invalid game checking combination in the game service.

According to one embodiment of the present application, the steps involved in the traffic testing method shown in fig. 2 may be performed by the respective modules in the traffic testing apparatus shown in fig. 18. For example, step S101 shown in fig. 2 may be performed by the first generation module 11 in fig. 18, step S102 shown in fig. 2 may be performed by the distribution module 12 in fig. 18, step S102 shown in fig. 2 may be performed by the second generation module 13 in fig. 18, and so on.

According to an embodiment of the present application, each module in the service testing apparatus shown in fig. 18 may be separately or completely combined into one or several units to form a structure, or some (some) of the units may be further split into a plurality of sub-units with smaller functions, so that the same operation may be implemented without affecting the implementation of the technical effects of the embodiments of the present application. The above modules are divided based on logic functions, and in practical applications, the functions of one module may be implemented by a plurality of units, or the functions of a plurality of modules may be implemented by one unit. In other embodiments of the present application, the test device may also include other units, and in practical applications, these functions may also be implemented with assistance from other units, and may be implemented by cooperation of multiple units.

Referring to fig. 19, fig. 19 is a schematic structural diagram of a computer device according to an embodiment of the present application. As shown in fig. 19, the above-mentioned computer device 1000 may include: processor 1001, network interface 1004, and memory 1005, and in addition, the above-described computer device 1000 may further include: a target user interface 1003, and at least one communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The target user interface 1003 may include a Display (Display) and a Keyboard (Keyboard), and the optional target user interface 1003 may further include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a nonvolatile memory (non-volatile memory), such as at least one magnetic disk memory. The memory 1005 may also optionally be at least one storage device located remotely from the processor 1001. As shown in fig. 19, an operating system, a network communication module, a target user interface module, and a device control application may be included in a memory 1005, which is one type of computer-readable storage medium.

In the computer device 1000 shown in fig. 19, the network interface 1004 may provide network communication functions; while target user interface 1003 is primarily an interface for providing input to a target user; and the processor 1001 may be used to invoke a device control application stored in the memory 1005 to implement:

alternatively, the processor 1001 may be configured to invoke a device control application program stored in the memory 1005 to implement:

It should be understood that the computer device 1000 described in the embodiments of the present application may perform the description of the service testing method described above in the embodiments corresponding to fig. 2 or fig. 11, and may also perform the description of the service testing apparatus corresponding to fig. 18, which is not repeated herein.

According to one aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the computer device may execute the service testing method in the embodiment corresponding to fig. 2 or fig. 11, which is not described herein. In addition, the description of the beneficial effects of the same method is omitted.

As an example, the above-described program instructions may be executed on one computer device or on a plurality of computer devices disposed at one site, or alternatively, on a plurality of computer devices distributed at a plurality of sites and interconnected by a communication network, which may constitute a blockchain network.

Those skilled in the art will appreciate that implementing all or part of the above-described methods may be accomplished by way of computer programs, which may be stored on a computer-readable storage medium, and which, when executed, may comprise the steps of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), or the like.

The foregoing disclosure is only illustrative of the preferred embodiments of the present application and is not intended to limit the scope of the claims herein, as the equivalent of the claims herein shall be construed to fall within the scope of the claims herein.

Claims

1. A method for testing services, comprising:

acquiring test configuration data associated with a game service, and combining virtual characters and character skills contained in the game service according to the test configuration data to generate M game pair test cases; the M game test cases are obtained by randomly combining the virtual roles and the role skills according to the test parameter information in the test configuration data, or are generated by a game generation model according to a combination evaluation value between the virtual roles and the role skills output by the test configuration data, and the combination evaluation value is used for representing the combination probability between the virtual roles and the role skills;

distributing the M game pair test cases to N subprocesses through the main processes corresponding to the game service; an inter-process communication channel is arranged between the main process and the N subprocesses, and M, N is a positive integer;

2. The method of claim 1, wherein the obtaining test configuration data associated with a game service, combining virtual characters and character skills included in the game service according to the test configuration data, and generating M game pair test cases, comprises:

responding to uploading operation in a test page, acquiring test configuration data determined by the uploading operation, and acquiring a virtual character and character skills associated with the game service in the test configuration data;

3. The method of claim 2, wherein the randomly combining the virtual character and the character skills according to the test parameter information in the test configuration data to generate M game pair test cases comprises:

According to the test parameter information in the test configuration data, carrying out random combination on the virtual character and the character skills to obtain Q candidate game pair combinations; q is a positive integer greater than or equal to M;

obtaining game play conditions corresponding to the game service, and determining candidate game play combinations meeting the game play conditions in the Q candidate game play combinations as M game play combinations;

and performing code conversion on the M game pair combinations to generate game pair test cases respectively corresponding to the M game pair combinations.

4. The method of claim 1, wherein the combining virtual characters and character skills included in the game service according to the test configuration data generates M game pair test cases, including:

acquiring character characteristics corresponding to the virtual characters in the test configuration data, and acquiring skill characteristics corresponding to character skills in the test configuration data;

converting the test parameter information in the test configuration data into test parameter characteristics, and splicing the character characteristics, the skill characteristics and the test parameter characteristics into an input characteristic matrix;

and acquiring M game pair combinations between the virtual character and the character skills according to the combination evaluation value, performing code conversion on the M game pair combinations, and generating game pair test cases respectively corresponding to the M game pair combinations.

5. The method according to claim 1, wherein the distributing the M game-pair test cases to N sub-processes through the main process corresponding to the game service includes:

according to the data format in the main process, respectively carrying out data conversion on the M game pair test cases to obtain M game pair test cases after format conversion;

distributing the M game pair test cases after the format conversion to the sub-threads in the N sub-processes through an inter-process communication channel between the main process and the N sub-processes; one sub-thread corresponds to one game pair test case.

6. The method according to claim 1, wherein the testing the game-play test cases in the N subprocesses through the game service-related simulated game component to generate game-play test results respectively corresponding to the M game-play test cases includes:

testing the game pair test cases in the N subprocesses through the simulated game component;

when the main process detects that the game-play test cases in the N subprocesses are in an end state, game-play test results respectively corresponding to the M game-play test cases are obtained from the N subprocesses through inter-process communication channels between the main process and the N subprocesses.

7. The method according to claim 1, characterized in that the method comprises:

obtaining analysis indexes corresponding to the game service, analyzing the game test results according to the analysis indexes, obtaining a game statistics corresponding to the game test result; the analysis indexes at least comprise win probability, excellent balance rate, war loss ratio, virtual character occurrence times and opponent number restriction;

If the pair statistics meet a statistics threshold, the virtual characters and character skills in the game test cases corresponding to the game statistics values meeting the statistics threshold value, determining as valid game play combinations;

8. A traffic testing device, comprising:

the first acquisition module is used for acquiring test configuration data associated with the game service, combining virtual roles and role skills contained in the game service according to the test configuration data, and generating M game pair test cases; the M game test cases are obtained by randomly combining the virtual roles and the role skills according to the test parameter information in the test configuration data, or are generated by a game generation model according to a combination evaluation value between the virtual roles and the role skills output by the test configuration data, and the combination evaluation value is used for representing the combination probability between the virtual roles and the role skills;

The distribution module is used for distributing the M game pair test cases to N subprocesses through the main processes corresponding to the game service; an inter-process communication channel is arranged between the main process and the N subprocesses, and M, N is a positive integer;

the generation module is used for testing the game pair test cases in the N subprocesses through the game service-related simulation game components, and generating game pair test results respectively corresponding to the M game pair test cases; the game play test results provide a reference basis for matching between the virtual character and the character skills.

9. A computer device, comprising: a processor and a memory;

the memory stores a computer program which, when executed by the processor, performs the method of any of claims 1 to 7.

10. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program adapted to be loaded by a processor and to perform the method of any of claims 1 to 7.