CN112860579A

CN112860579A - Service testing method, device, storage medium and equipment

Info

Publication number: CN112860579A
Application number: CN202110286976.XA
Authority: CN
Inventors: 黄斌; 罗章龙; 袁明凯; 王谊; 严明
Original assignee: Shenzhen Tencent Information Technology Co Ltd
Current assignee: Shenzhen Tencent Information Technology Co Ltd
Priority date: 2021-03-17
Filing date: 2021-03-17
Publication date: 2021-05-28
Anticipated expiration: 2041-03-17
Also published as: CN112860579B

Abstract

The embodiment of the application discloses a service testing method, a storage medium and equipment. The method comprises the following steps: acquiring test configuration data associated with game services, and combining virtual roles and role skills contained in the game services according to the test configuration data to generate M game-to-game test cases; distributing the M game match test cases to N sub-processes through a main process corresponding to the game service, testing the game match test cases in the N sub-processes through a simulation game component associated with the game service, and generating game match test results corresponding to the M game match test cases respectively. Through the application, the labor cost of the test can be reduced, and the test efficiency is improved.

Description

Service testing method, device, storage medium and equipment

Technical Field

The present application relates to the field of testing technologies, and in particular, to a method, an apparatus, a storage medium, and a device for testing a service.

Background

With the rapid development of entertainment applications, game entertainment applications become a mainstream application of current entertainment, and a game entertainment application is essential for testing game service provided by the game entertainment applications in the processes of research, development, operation and the like, determining the defects and improving the defects, so that a higher game experience is better improved for game players.

However, in the current game service testing process, a manual testing method is usually adopted to manually combine virtual roles in a game, and compile a corresponding test case for each combination, and each test case needs to be manually tested. However, since the number of virtual characters in the game is large, it takes a lot of time to combine them manually, which results in high testing cost and low testing efficiency.

Disclosure of Invention

The technical problem to be solved by the embodiments of the present application is to provide a service testing method, device, storage medium, and apparatus, which can reduce labor cost and improve testing efficiency.

An aspect of the present application provides a service testing method, including:

acquiring test configuration data associated with game services, and combining virtual roles and role skills contained in the game services according to the test configuration data to generate M game-to-game test cases;

distributing the M game-to-game test cases to N sub-processes through a main process corresponding to the game service; an interprocess communication channel is arranged between the main process and the N subprocesses, and M, N are positive integers;

testing the game match-up test cases in the N sub-processes through a simulation game component associated with the game service to generate game match-up test results corresponding to the M game match-up test cases respectively; the game test result provides reference basis for matching between the virtual character and the character skill.

The method comprises the following steps of obtaining test configuration data associated with game services, combining virtual roles and role skills contained in the game services according to the test configuration data, and generating M game-to-game test cases, wherein the test configuration data comprises the following steps:

responding to the uploading operation in the test page, acquiring test configuration data determined by the uploading operation, and acquiring virtual roles and role skills associated with game services in the test configuration data;

and randomly combining the virtual roles and the role skills according to the test parameter information in the test configuration data to generate M game test cases.

The method comprises the following steps of randomly combining virtual roles and role skills according to test parameter information in test configuration data to generate M game match test cases, wherein the steps comprise:

randomly combining the virtual roles and the role skills according to the test parameter information in the test configuration data to obtain Q candidate game combination; q is a positive integer greater than or equal to M;

obtaining game play conditions corresponding to game services, and determining candidate game play combinations meeting the game play conditions in the Q candidate game play combinations as M game play combinations;

and carrying out code conversion on the M game-play combinations to generate game-play test cases respectively corresponding to the M game-play combinations.

The method for generating M game match test cases by combining virtual roles and role skills contained in game services according to test configuration data comprises the following steps:

acquiring character characteristics corresponding to virtual characters in the test configuration data, and acquiring skill characteristics corresponding to character skills in the test configuration data;

converting test parameter information in the test configuration data into test parameter characteristics, and splicing the role characteristics, the skill characteristics and the test parameter characteristics into an input characteristic matrix;

inputting the input characteristic matrix into a game generation model, and outputting a combined evaluation value between the virtual character and the character skill through the game generation model;

and acquiring M game play combinations between the virtual character and the character skill according to the combination evaluation value, and performing code conversion on the M game play combinations to generate game play test cases respectively corresponding to the M game play combinations.

Wherein, through the main process that the game business corresponds, distribute M game to game test cases to N subprocesses, include:

starting a main process corresponding to the game service, and creating and starting N sub-processes determined by the number M of the test cases through the main process;

respectively carrying out data conversion on the M game-to-game test cases according to the data format in the main process to obtain M game-to-game test cases after format conversion;

distributing the M game match test cases after format conversion to sub-threads in the N sub-processes through an inter-process communication channel between the main process and the N sub-processes; one child thread corresponds to one game-to-game test case.

The method for testing game match-up test cases in N sub-processes through a game service-associated simulation game component to generate game match-up test results corresponding to M game match-up test cases respectively includes:

updating the environment of the initial simulation component based on the test environment configuration data in the test configuration data to obtain a simulation game component matched with the game service;

testing the game match test cases in the N sub-processes through the simulation game component;

and when the main process monitors that the game-to-game test cases in the N subprocesses are in an end state, acquiring game-to-game test results respectively corresponding to the M game-to-game test cases from the N subprocesses through an interprocess communication channel between the main process and the N subprocesses.

The method comprises the following steps:

obtaining an analysis index corresponding to the game service, and analyzing the game match test result according to the analysis index to obtain a match statistic corresponding to the game match test result; the analysis indexes at least comprise victory probability, excellent rate, war-loss ratio, occurrence times of virtual characters and number of restraining opponents;

if the game-play statistic satisfies the statistic threshold, determining the virtual character and character skills in the game-play test case corresponding to the game-play statistic satisfying the statistic threshold as an effective game-play combination;

if the game-play statistic does not meet the statistic threshold, determining the virtual character and character skills in the game-play test case corresponding to the game-play statistic which does not meet the statistic threshold as an invalid game-play combination, and setting an alarm identifier for the invalid game-play combination in the game service.

An aspect of the present application provides a service testing apparatus, including:

the first generation module is used for acquiring test configuration data associated with the game service, combining virtual roles and role skills contained in the game service according to the test configuration data and generating M game-to-game test cases;

the distribution module is used for distributing the M game-to-game test cases to the N sub-processes through the main process corresponding to the game service; an interprocess communication channel is arranged between the main process and the N subprocesses, and M, N are positive integers;

the second generation module is used for testing the game match test cases in the N sub-processes through the simulation game components related to the game business and generating game match test results corresponding to the M game match test cases respectively; the game test result provides reference basis for matching between the virtual character and the character skill.

Wherein, the first generating module comprises:

the first acquisition unit is used for responding to the uploading operation in the test page, acquiring the test configuration data determined by the uploading operation, and acquiring the virtual character and the character skill associated with the game service in the test configuration data;

and the first generation unit is used for randomly combining the virtual roles and the role skills according to the test parameter information in the test configuration data to generate M game-to-game test cases.

Wherein the first generation unit includes:

Wherein, the first generating module comprises:

the second acquisition unit is used for acquiring the role characteristics corresponding to the virtual roles in the test configuration data and acquiring the skill characteristics corresponding to the role skills in the test configuration data;

the input unit is used for converting the test parameter information in the test configuration data into test parameter characteristics and splicing the role characteristics, the skill characteristics and the test parameter characteristics into an input characteristic matrix;

an output unit for inputting the input feature matrix to the game generation model, and outputting a combined evaluation value between the virtual character and the character skill through the game generation model;

and the second generation unit is used for acquiring M game play combinations between the virtual character and the character skill according to the combination evaluation value, carrying out code conversion on the M game play combinations and generating game play test cases corresponding to the M game play combinations respectively.

Wherein, the distribution module includes:

the starting unit is used for starting a main process corresponding to the game service, and creating and starting N sub-processes determined by the number M of the test cases through the main process;

the data conversion unit is used for respectively carrying out data conversion on the M game-to-game test cases according to the data format in the main process to obtain the M game-to-game test cases after format conversion;

the distributing unit is used for distributing the M game match test cases after format conversion to the sub-threads in the N sub-processes through an inter-process communication channel between the main process and the N sub-processes; one child thread corresponds to one game-to-game test case.

Wherein the second generating module comprises:

the updating unit is used for updating the environment of the initial simulation component based on the test environment configuration data in the test configuration data to obtain a simulation game component matched with the game service;

the testing unit is used for testing the game match-up test cases in the N subprocesses through the simulation game component;

and the third obtaining unit is used for obtaining game-to-game test results corresponding to the M game-to-game test cases from the N subprocesses through an interprocess communication channel between the main process and the N subprocesses when the main process monitors that the game-to-game test cases in the N subprocesses are in an ending state.

Wherein, the device still includes:

the analysis module is used for acquiring analysis indexes corresponding to game services, analyzing game match test results according to the analysis indexes and obtaining match statistics corresponding to the game match test results; the analysis indexes at least comprise victory probability, excellent rate, war-loss ratio, occurrence times of virtual characters and number of restraining opponents;

the first determining module is used for determining virtual roles and role skills in game play test cases corresponding to play statistics meeting the statistical threshold as effective game play combinations if the play statistics meet the statistical threshold;

and the second determining module is used for determining the virtual character and the character skill in the game play test case corresponding to the play statistic which does not meet the statistical threshold as an invalid game play combination if the play statistic does not meet the statistical threshold, and setting an alarm identifier for the invalid game play combination in the game service.

One aspect of the present application provides a computer device, comprising: a processor and a memory;

wherein, the memorizer is used for storing the computer program, the processor is used for calling the above-mentioned computer program, in order to carry out the following step:

An aspect of the embodiments of the present application provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the computer program performs the following steps:

An aspect of the application provides a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method of the above-described aspect.

In the embodiment of the application, M game match test cases are generated by acquiring the test configuration data associated with the game service and combining the virtual roles and the role skills contained in the game service according to the test configuration data. The M game match-up test cases are distributed to the N sub-processes through the main process corresponding to the game service, so that a large number of game match-up test cases can be tested simultaneously, the test efficiency is improved, and the labor cost can be reduced. The game-to-game test cases in the N sub-processes are tested through the game service-associated simulation game component, the game-to-game test results corresponding to the M game-to-game test cases respectively are generated, the simulation game component is generated through simulating the actual game running environment, the test of the game-to-game test cases can be realized at the simulation game component without being sent to the actual game client, the test efficiency can be improved, and the test cost can be reduced. Through the application, the labor cost can be reduced, and the testing efficiency is improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a service testing system according to an embodiment of the present application;

fig. 2 is a schematic flowchart of a service testing method according to an embodiment of the present application;

FIG. 3 is a schematic diagram illustrating a method for obtaining test configuration data according to an embodiment of the present disclosure;

FIG. 4 is a schematic diagram of obtaining test configuration data according to an embodiment of the present application;

FIG. 5 is a schematic diagram of generating a game-to-game test case according to an embodiment of the present disclosure;

fig. 6 is a schematic diagram of game-to-game test results respectively corresponding to M game-to-game test cases generated according to an embodiment of the present application;

fig. 7 is a schematic diagram of a service testing method provided in an embodiment of the present application;

fig. 8 is a schematic flowchart of a service test provided in an embodiment of the present application;

FIG. 9 is a schematic diagram of a game-to-game test result obtained according to an embodiment of the present application;

FIG. 10 is a diagram illustrating an analysis result corresponding to a game-to-game test result according to an embodiment of the present disclosure;

fig. 11 is a schematic diagram of a service testing method provided in an embodiment of the present application;

FIG. 12 is a schematic diagram illustrating an analysis of game match test results provided by an embodiment of the present application;

FIG. 13 is a schematic diagram of an analysis index provided by an embodiment of the present application;

FIG. 14 is a schematic diagram of a method for analyzing game-to-game test results according to an embodiment of the present disclosure;

FIG. 15 is a schematic diagram of a goodness-of-average analysis provided by an embodiment of the present application;

FIG. 16 is a schematic diagram of a damage value analysis provided in an embodiment of the present application;

FIG. 17 is a schematic diagram of a method for analyzing game-to-game test results according to an embodiment of the present disclosure;

fig. 18 is a schematic structural diagram of a service testing apparatus according to an embodiment of the present application;

fig. 19 is a schematic structural diagram of a computer device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Referring to fig. 1, fig. 1 is a schematic structural diagram of a service testing system according to an embodiment of the present application. As shown in fig. 1, the service test system may include a server 10 and a user terminal cluster. The user terminal cluster may comprise one or more user terminals, where the number of user terminals will not be limited. As shown in fig. 1, the system may specifically include a user terminal 100a, a user terminal 100b, user terminals 100c and …, and a user terminal 100 n. As shown in fig. 1, the user terminal 100a, the user terminal 100b, the user terminals 100c, …, and the user terminal 100n may be respectively connected to the server 10 via a network, so that each user terminal may interact with the server 10 via the network.

Wherein, each ue in the ue cluster may include: the intelligent terminal comprises an intelligent terminal with a service test function, such as a smart phone, a tablet computer, a notebook computer, a desktop computer, wearable equipment, an intelligent home, and head-mounted equipment. It should be understood that each user terminal in the user terminal cluster shown in fig. 1 may be installed with a target application (i.e., an application client), and when the application client runs in each user terminal, data interaction may be performed with the server 10 shown in fig. 1.

As shown in fig. 1, the server 10 may combine virtual characters and character skills included in the game service according to test configuration data associated with the game service and sent by the user terminal, and generate M game-to-game test cases. The server 10 may also distribute the M game-to-game test cases to the N sub-processes through the main process corresponding to the game service, and test the game-to-game test cases in the N sub-processes through the simulation game component corresponding to the game service to generate game-to-game test results corresponding to the M game-to-game test cases, respectively. The server 10 may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a network service, cloud communication, a middleware service, a domain name service, a security service, a CDN, a big data and artificial intelligence platform, and the like.

For convenience of understanding, in the embodiment of the present application, one user terminal may be selected as a target user terminal from the plurality of user terminals shown in fig. 1, where the target user terminal may include: the intelligent terminal comprises an intelligent terminal carrying a service test function, such as a smart phone, a tablet computer, a notebook computer, a desktop computer and an intelligent television. For example, the user terminal 100a shown in fig. 1 may be a target user terminal, and an application client having the service test function may be integrated in the target user terminal (in this case, the application client may be understood as a test tool). The target user terminal (e.g., user terminal 100a) may be a user terminal used by a tester. For example, the user terminal 100a may determine, in response to an upload operation of a tester in the application client, the material uploaded by the tester as the test configuration data associated with the game service, that is, obtain the test configuration data determined by the upload operation. After obtaining the test configuration data, the user terminal 100a may send the test configuration data to the server 10, where the server 10 at this time may be understood as a background server corresponding to the application client, that is, a background server corresponding to the test tool. After receiving the test configuration data sent by the user terminal 100a, the server 10 may combine the virtual character and the character skill included in the game service according to the test configuration data to generate M game-to-game test cases. The server 10 may also distribute each of the M game-to-game test cases to the N sub-processes through the main process corresponding to the game service, and test the game-to-game test cases in the N sub-processes through the simulated game component associated with the game service to generate game-to-game test results corresponding to the M game-to-game test cases, respectively.

Referring to fig. 2, fig. 2 is a schematic flow chart of a service testing method according to an embodiment of the present application. The service testing method may be executed by a computer device, and the computer device may be a server (such as the server 10 in fig. 1), or a user terminal (such as any user terminal in the user terminal cluster in fig. 1), or a system composed of a server and a user terminal, which is not limited in this application. As shown in fig. 2, the service test method may include steps S101-S103.

S101, obtaining test configuration data associated with the game service, combining virtual roles and role skills contained in the game service according to the test configuration data, and generating M game-to-game test cases.

Specifically, in the development process of the game application, whether the game application is brand new or the game version is updated, the game application needs to be tested, so that defects in the game application are reduced. In the testing process of the game application, a tester can perform a starting operation on a testing tool (such as the application client) integrated in a computer device, the computer device responds to the starting operation aiming at the testing tool, starts the testing tool in the computer device and enters a testing page of the testing tool, and the tester can upload testing configuration data associated with game services to the testing page. After the test configuration data is successfully uploaded, the computer device may acquire the test configuration data associated with the game service and uploaded by the tester, where the test configuration data may include test environment configuration data (i.e., operation environment configuration data required by operation of the game service), virtual characters and character skills related to the game service, and may also include test parameter information such as a test task type, a test task name, a test frequency, and a number of combinations between the virtual characters and the character skills.

The computer equipment can combine virtual roles and role skills contained in game services according to the test configuration data to generate M game test cases. The virtual character can be a virtual character controlled in a game scene when a game player plays a game, for example, the game player can control a Chinese character in a certain game scene to move forwards, the Chinese character is a virtual character, the character skill refers to a skill which can be carried by the virtual character, and for example, when the Chinese character carries a point control skill, the Chinese character can use the skill to control an opponent in the game scene, so that the opponent is frozen and cannot send any skill. The game play test case can comprise at least two teams, each team can comprise one or more virtual characters and character skills, and competition or competition relations exist among the teams. For example, the test configuration data specifies that the number of virtual characters in each combination is 6, one combination includes two teams, both teams include 3 virtual characters, and each virtual character includes a character skills, where a may be a positive integer, e.g., a may take the value of 1, 2, 3, …; in this way, all virtual characters and all character skills provided by the test configuration data can be combined according to the above specification to generate a plurality of game match test cases.

Optionally, the specific manner of generating M game-to-game test cases may include: and responding to the uploading operation in the test page, acquiring the test configuration data determined by the uploading operation, and acquiring the virtual character and the character skill associated with the game service in the test configuration data. And randomly combining the virtual roles and the role skills according to the test parameter information in the test configuration data to generate M game test cases.

Specifically, a tester can upload test configuration data associated with a game service in a test page provided in the embodiment of the present application, and a computer device can respond to an upload operation of the tester in the test page, acquire the test configuration data determined by the upload operation, and acquire a virtual character and a character skill associated with the game service in the test configuration data. And randomly combining the virtual roles and the role skills according to the test parameter information in the test configuration data to generate M game test cases. The test parameter information may include information on a test task type, a test task name, a number of tests, and a number of combinations between the virtual character and the character skill. For example, the number of virtual characters contained in each team in the game match test case is 6, and the character skills that each virtual character can carry can be 3.

As shown in fig. 3, fig. 3 is a schematic diagram of a method for acquiring test configuration data according to an embodiment of the present disclosure, and as shown in fig. 3, a test page shows information about a test task added by a tester, and in the test page shown in fig. 3, the tester may perform an upload operation of uploading test configuration data associated with a game service, for example, click a "add transfer version (test configuration data)" button. As shown in fig. 3, the test page also provides a test task created and completed by the tester, for example, the version name corresponding to the version number "548" is a small range- ×, the corresponding version is described as "numerical balance analysis", and the creation time is "2020.12.10", "548" is a version number corresponding to a test task, and is a test task created for the tester. As shown in fig. 3, a tester may implement a trigger operation for starting a "548" test task in a test page, that is, click "task start", and the computer device in the embodiment of the present application may respond to the trigger operation of the tester to test the "548" test task to obtain a test result. Of course, when the test task is not needed, the tester can click the "delete" touch key to delete the test task "548".

As shown in fig. 4, fig. 4 is a schematic diagram of obtaining test configuration data according to an embodiment of the present application, and as shown in fig. 4, after a tester performs an upload operation of uploading test configuration data in fig. 3, that is, clicks "add transfer test version", a computer device may perform page jump to a test page as shown in fig. 4, and the tester may input specific information of the test configuration data associated with a game service in the test page as shown in fig. 4. As shown in fig. 4, a tester may select a task type corresponding to a current test task, such as making a formation PK (solution), starting analysis, or testing, and may also set test parameter information, such as a name remark, corresponding to the current task, where the test parameter information may be set according to specific requirements. The tester can also trigger a "+ upload configuration file" touch key to upload the test configuration data associated with the game service, wherein the test configuration data comprises the running environment of the game service and the information related to virtual characters, character skills and the like contained in the game service. After the tester adds all the test configuration data, the touch key for determining and generating the task can be triggered, and the computer equipment can generate a test task by the test configuration data input by the tester. And according to the test task, virtual roles and role skills associated with game services are obtained in the test configuration data, and according to test parameter information in the test configuration data, the virtual roles and the role skills are randomly combined to generate M game match test cases.

Optionally, the specific manner in which the computer device randomly combines the virtual character and the character skill according to the test parameter information in the test configuration data to generate the M game-to-game test cases may include: and randomly combining the virtual roles and the role skills according to the test parameter information in the test configuration data to obtain Q candidate game. Obtaining game play conditions corresponding to game services, determining candidate game play combinations meeting the game play conditions in the Q candidate game play combinations as M game play combinations, performing code conversion on the M game play combinations, and generating game play test cases corresponding to the M game play combinations respectively.

Specifically, the computer device may randomly combine the virtual character and the character skill in the game service according to the test parameter information in the test configuration data to obtain Q candidate game play combinations, obtain game play conditions corresponding to the game service, and determine a candidate game play combination satisfying the game play conditions among the Q candidate game play combinations as M game play combinations. The game match condition may refer to a game match combination condition that only focuses on in the test task, and if the test task only focuses on a game match combination of a certain mode, game match combinations other than the game match combination of the certain mode can be eliminated, so that the test efficiency can be effectively improved, and the game match condition at this time may refer to a screening condition that is set by self-definition based on a specific game scene or a specific test purpose. The computer equipment obtains M game match-up combinations, carries out code conversion on the M game match-up combinations and generates game match-up test cases respectively corresponding to the M game match-up combinations. The computer equipment can generate M game-to-game test cases through an automatic test case generation tool.

For example, the computer device may perform transcoding on M game-play combinations by using Blob coding, and generate game-play test cases corresponding to the M game-play combinations, so as to compress the size of the game-play test cases, thereby facilitating transmission and saving storage space. Blob is a class file object of immutable, original data, whose data can be read in text or binary format, or converted into data interface for data manipulation. For example, the computer device can realize an automatic test case generation tool through a computer programming language, and in the automatic test case generation tool, the virtual roles and the role skills in the game business are used for generating M game test cases according to game conditions. The computer programming language may include Python (a computer programming language that may be used to write run scripts for test tasks), C (a procedural-oriented, abstract, general-purpose programming language), Java (a static object-oriented programming language), and so on.

For example, the test configuration data includes two roles, namely a virtual role J and a virtual role P, and also includes a role skill 1 and a role skill 2, if it is specified in the test configuration data that each game play combination includes two teams, each team includes one virtual role, and each virtual role includes 1 role skill, all the virtual roles and the role skills in the test configuration data are randomly combined according to the specification in the test configuration data, so as to obtain a plurality of game play test cases. Wherein, all the virtual characters and character skills in the test configuration data are randomly combined, namely, the virtual character J, the virtual character P, the character skill 1 and the character skill 2 are randomly combined to obtain 16 candidate game combinations (J-1 ), (J-1, J-2), (J-2, J-1), (P-1, P-2), (P-2, P-1), (P-2 ), (J-1, P-1), (J-2, P-1), (J-1, P-2) and (J-2, P-2). If the candidate game play combination (J-1 ), (J-2, J-2), (P-1 ), (P-2, P-2) is determined to be not in accordance with the game play conditions corresponding to the game services, the candidate game play combination (J-1, J-2), (J-2, J-1), (P-1, P-2), (P-2, P-1), (J-1, P-1), (J-2, P-1), (J-1, P-2), (J-2, P-2), (J-2, P-2) which satisfies the game play conditions in the 16 candidate game play combinations are determined to be the game play combinations, and the 12 game play combinations are subjected to code conversion, and generating game play test cases corresponding to the 12 game play combinations respectively. The game-play combination (J-1, J-2) comprises a team J-1 and a team J-2, the team J-1 comprises a virtual character J carrying a character skill 1, and the team J-2 comprises a virtual character J carrying a character skill 2.

Fig. 5 is a schematic diagram of generating a game match-up test case according to an embodiment of the present application, and fig. 5 shows a combination between virtual characters and character skills of a team in a game match-up test case, and information related to an ID (identification number) and the like. As shown in fig. 5, each team includes three virtual characters, and each virtual character may include 2 skills. As shown in fig. 5, the corresponding code value may be set to "level", and the corresponding "value check" is set to "no check", so that the level of each virtual character may not be considered during the test, and the skill of each virtual character and each virtual character may be set to check, so that during the test, each virtual character and character skill may be checked to determine whether the game match condition is met, so as to combine the virtual characters and character skills in the game service and set the related information, thereby generating the game match test case.

Optionally, the specific manner of generating M game-to-game test cases may further include: and acquiring character characteristics corresponding to virtual characters in the test configuration data, and acquiring skill characteristics corresponding to character skills in the test configuration data. Converting test parameter information in the test configuration data into test parameter characteristics, splicing the character characteristics, the skill characteristics and the test parameter characteristics into an input characteristic matrix, inputting the input characteristic matrix into a game generation model, and outputting a combined evaluation value between the virtual character and the character skill through the game generation model. And acquiring M game play combinations between the virtual character and the character skill according to the combination evaluation value, and performing code conversion on the M game play combinations to generate game play test cases respectively corresponding to the M game play combinations. The game-play generating model is trained by adopting a large amount of sample game-play combination data and label data corresponding to the large amount of sample game-play combinations respectively, the label data corresponding to the sample game-play combinations can comprise 0 and 1, and when the label data is 0, the corresponding sample game-play combinations can be invalid game-play combinations; when the label data is 1, the corresponding sample game play combination can be an effective game play combination, and the trained play generation model can be used for predicting a combination evaluation value between the virtual character and the character skill; of course, the label data corresponding to the sample game-to-game combination can also be represented by other numbers or symbols, and the type of the label data is not particularly limited in the present application.

The computer equipment can acquire virtual roles and all role skills contained in the test configuration data, and because the virtual roles and the role skills in the test configuration data are expressed in a form of numbers, the virtual roles and the role skills are required to be converted into a vector form, and after the virtual roles are converted into the vector form, the vector form at the moment can be called as role features; after the character skill is converted into a vector form, the vector form at this time can be called a skill feature. The method for vector transformation of virtual roles and role skills may include, but is not limited to: the method comprises the steps of adopting an one-hot code to carry out vector conversion on virtual roles and role skills to obtain role characteristics corresponding to the virtual roles and skill characteristics corresponding to the role skills, wherein the one-hot code is a code system with only one bit being 1 and other bits being 0, namely, N state registers are used for coding N states, each state is an independent register bit, and only one bit is effective at any time. In addition, the computer equipment can also carry out LabelEncoder coding to carry out vector conversion on the virtual roles and the role skills so as to obtain role characteristics corresponding to the virtual roles and skill characteristics corresponding to the role skills. The LabelEncoder code can encode virtual characters and character skills to obtain a code value between 0 and n-1, where n is the number of different values of a list, and can be considered as the number of all different values of a certain feature (such as a virtual character or character skill). Similarly, the test parameter information in the test configuration data may be converted into the test parameter characteristics in the same manner as described above. And then, the character characteristics, the skill characteristics and the test parameter characteristics can be spliced into an input characteristic matrix, the input characteristic matrix is input into a game generation model, a combination evaluation value between the virtual character and the character skill is output through the game generation model, combinations determined by the virtual character and the character skill are screened according to the combination evaluation value, namely, the combinations with the combination evaluation value smaller than a first threshold value are deleted, and only the combinations with the combination evaluation value larger than or equal to the first threshold value are reserved to obtain M game combination.

The combined evaluation value can be a combined probability aiming at virtual roles and role skills output by the office generating model, and the combined evaluation value can be used as a reference basis for combining the virtual roles and the role skills and is used for preliminarily screening the combination of the virtual roles and the role skills; the larger the combination evaluation value is, the stronger the player experience in the actual game may be expressed as a combination corresponding to the combination evaluation value, e.g., the capabilities of two teams in the combination corresponding to the combination evaluation value may be averaged; the smaller the combination evaluation value is, it can be indicated that the player experience of the combination corresponding to the combination evaluation value in the actual game is poor, for example, one team in the combination corresponding to the combination evaluation value may always win in a plurality of tests (for example, 100 times), and the other team may always lose.

As described above, the test configuration data includes two characters, i.e., a virtual character J and a virtual character P, and two skills, i.e., a character skill 1 and a character skill 2, the computer device may input a character feature vector corresponding to each of the virtual character J and the virtual character P, a skill feature vector corresponding to each of the character skill 1 and the character skill 2, and a test parameter feature vector corresponding to test parameter information in the test configuration data into the game generation model, may combine the virtual character and the character skill in the game generation model, and output a combined evaluation value corresponding to each combination, i.e., each combination includes two teams, one team includes one virtual character, one virtual character may carry one character skill, and the combined evaluation values corresponding to the 16 game-pair combinations may be output through the game generation model, and a game combination can be determined based on the combination evaluation value. Assuming that the combination evaluation value of the candidate game pair hand combination (J-1 ) is 0.1 and the combination evaluation value of the candidate game pair hand combination (J-1, P-1) is 0.7, when the first threshold value is set to 0.5 (which may be set artificially according to specific requirements), since the combination evaluation value 0.1 of the candidate game pair hand combination (J-1 ) is less than the first threshold value of 0.5, the candidate game pair hand combination (J-1 ) may be determined as an invalid game pair hand combination, that is, the candidate game pair hand combination (J-1 ) may be deleted; since the combination evaluation value 0.7 of the candidate game pair combination (J-1, P-1) is larger than the first threshold value 0.5, it can be determined that the candidate game pair combination (J-1, P-1) is the valid game pair combination (i.e., one of the M game pair combinations described above).

Optionally, the computer device may randomly combine all virtual characters and character skills included in the test configuration data to obtain Q candidate game play combinations, further may splice a character feature vector corresponding to a virtual character in each candidate game play combination and a skill feature vector corresponding to a character skill to obtain input vectors corresponding to each candidate game play combination, input the input vectors to the play generation model, output a combination evaluation value corresponding to each candidate game play combination through the play generation model, and screen the Q candidate game play combinations according to the combination evaluation value (delete the candidate game play combinations whose combination evaluation values are smaller than the first threshold), to obtain M game play combinations.

Optionally, the computer device may further combine the virtual character and the character skills through a genetic algorithm, so as to obtain M game-play combinations between the virtual character and the character skills. The specific process of generating M game-to-game combinations by using the genetic algorithm is as follows: the computer device may encode (e.g., binary code) virtual characters and character skills in the game service to obtain encoded virtual characters and character skills, i.e., genetic code that mimics a biological genetic algorithm. And combining the coded virtual characters and character skills according to the test parameter information and the intersection and variation in the simulated biological genetics to obtain Q candidate game-to-game combinations, and performing adaptive evaluation on the Q candidate game-to-game combinations through an adaptive function to obtain the corresponding combination fitness of each game-to-game combination. If the game play combination between the virtual character and the character skill has a historical play record, the adaptive function between the virtual character and the character skill can be determined according to the historical play record. And according to the combined fitness between the virtual character and the character skill, eliminating Q candidate game pair combinations between the virtual character and the character skill through a combined selection function, for example, calculating the combined fitness between the virtual character and the character skill as a variable value in the combined selection function to obtain a reference value between the virtual character and the character skill.

Specifically, after the computer device determines a reference value between the virtual character and the character skill, the Q candidate game-to-game combinations are screened according to the reference value between the virtual character and the character skill, and M game-to-game test cases are obtained. If the reference value between the virtual character and the character skill is smaller than a second threshold value (which can be set according to specific requirements), rejecting the reference value, and if the reference value between the virtual character B and the character skill c is smaller than 0.05, rejecting the game-play combination corresponding to the virtual character B and the character skill c; if the reference value between the virtual character and the character skill is larger than or equal to a second threshold value (which can be set according to specific requirements), determining a game test case by combining the game games between the virtual character and the character skill; if the reference value between the virtual character and the character skill is smaller than a second threshold value (which can be set according to specific requirements), eliminating the game-play combination between the virtual character and the character skill, and if the reference value between the virtual character B and the character skill c is 0.7 and is larger than the second threshold value 0.4, determining the game-play combination corresponding to the virtual character B and the character skill c as a game-play test case; and if the reference value between the virtual character B and the character skill c is 0.05 and is smaller than the second threshold value 0.4, rejecting the game match combination corresponding to the virtual character B and the character skill c.

S102, distributing the M game-to-game test cases to N sub-processes through the main process corresponding to the game service.

Specifically, after the computer device determines the M game-play test cases, the M game-play test cases may be distributed to N subprocesses in the main process through the main process corresponding to the game service, so that the N subprocesses test the M game-play test cases to obtain a test result. Inter-process communication channels are arranged between the main process and the N sub-processes, for example, the main process and the sub-processes share the same memory space and communicate through the shared memory space.

Optionally, the specific manner in which the computer device distributes the M game-to-game test cases to the N subprocesses through the main process corresponding to the game service may include: and starting a main process corresponding to the game service, and creating and starting N sub-processes determined by the number M of the test cases through the main process. And respectively carrying out data conversion on the M game-to-game test cases according to the data format in the main process to obtain the M game-to-game test cases after format conversion. And distributing the M game-to-game test cases after format conversion to sub-threads in the N sub-processes through an interprocess communication channel between the main process and the N sub-processes, wherein one sub-thread corresponds to one game-to-game test case.

Specifically, after the computer device generates M game-to-game test cases, a main process corresponding to the game service may be started, after the main process corresponding to the game service is started, the number N of subprocesses to be started may be determined according to the number M of test cases corresponding to the M game-to-game test cases, and N subprocesses for executing the M game-to-game test cases may be created according to the number N of subprocesses to be started. Meanwhile, the M game match-up test cases can be analyzed according to the data format in the main process, and the analyzed M game match-up test cases are subjected to data conversion respectively to obtain the M game match-up test cases after format conversion. For example, in an automated test case generation tool, a Blob binary code is used to encode M game-to-game test combinations, the M game-to-game combinations are compressed, and M game-to-game test cases are generated.

The main process corresponding to the game service can distribute the M game-to-game test cases after format conversion to the N sub-processes through an inter-process communication channel between the main process and the N sub-processes. Each subprocess in the N subprocesses can create a subprocess in each subprocess according to the number of game-play test cases contained in the subprocess, and distribute the game-play test cases to each subprocess, wherein one subprocess corresponds to one game-play test case. For example, the main process distributes 6 game-to-game test cases to the subprocess P according to the running load related information of the subprocess, the subprocess P creates 6 sub-threads according to the number "6" of the game-to-game test cases, and distributes the 6 game-to-game test cases to the 6 sub-threads, namely, one sub-thread corresponding to one game-to-game test case. The main process and the N subprocesses can communicate through a shared memory, and the main process can regularly acquire the execution state of the game-to-game test case by the N subprocesses (for example, the execution state is acquired through the shared memory), and the execution state is displayed to a tester through a test page.

The subsequent host process may also use a Websocket (a Protocol for communicating over a single TCP (Transmission Control Protocol), which is a connection-oriented, reliable, byte stream-based transport layer communication Protocol), to make Data exchange between the client and the server simpler, and allow the server to actively push Data to the client, or use a DB (Data Base), which is an organic collection of a large amount of sharable Data organized according to a certain structure and stored in the computer for a long time, to send the execution status of the currently executed game-to-game test case to the Control end (used for monitoring the execution progress of the game-to-game test case executed by each process) corresponding to the computer device in real time.

S103, testing the game match test cases in the N sub-processes through the simulation game components related to the game business, and generating game match test results corresponding to the M game match test cases respectively.

Specifically, the computer device may test the game-to-game test cases in the N sub-processes through the simulation game component associated with the game service, and generate game-to-game test results corresponding to the M game-to-game test cases, respectively. The simulation game component related to the game service comprises a running environment corresponding to the simulation game service, can simulate the operation of an actual game player, and tests the game test case in the game running environment provided by the simulation game component to obtain a test result. The simulation game component is obtained from test configuration data input by a tester, and is updated in a corresponding background of the computer equipment according to the requirement of each test task. It should be noted that the simulation game component in the embodiment of the present application is a simulation running environment generated by a simulation actual game running server in the computer device in the embodiment of the present application, that is, a simulated client, and executes a test on a game-to-game test case in the computer device, that is, executes a test on a game-to-game test case at a client where the computer device is located, and is not an external client but an internal virtual client in the computer device.

Optionally, the specific manner in which the computer device tests the game match-up test cases in the N sub-processes through the game service-related simulation game component to generate the game match-up test results corresponding to the M game match-up test cases respectively may include: and updating the environment of the initial simulation assembly based on the test environment configuration data in the test configuration data to obtain a simulation game assembly matched with the game service. And testing the game-to-game test cases in the N subprocesses through the simulation game component, and acquiring game-to-game test results corresponding to the M game-to-game test cases from the N subprocesses through an interprocess communication channel between the main process and the N subprocesses when the main process monitors that the game-to-game test cases in the N subprocesses are in an end state.

Specifically, the computer device may update the environment of the initial simulation component based on the test environment configuration data in the test configuration data, that is, the test operation environment data corresponding to the game service (for example, an installation data packet corresponding to the game service), to obtain a simulation game component matched with the game service, that is, to replace the initial simulation component with a simulation game component required by the current test task. The game-to-game test cases in the N sub-processes are tested through the simulation game component, and when the main process monitors that the execution condition of the game-to-game test cases in the N sub-processes is in an ending state, the game-to-game test results corresponding to the M game-to-game test cases are obtained from the N sub-processes through inter-process communication channels (such as shared memory) between the main process and the N sub-processes.

Specifically, when the computer device tests the game-to-game test cases in the N sub-processes through the simulation game component, the game-to-game test cases in the N sub-processes can be tested according to the running load condition corresponding to the simulation game component. The N subprocesses send packages to the simulation game components in sequence, and if the load of the simulation game component which is currently sent packages is full or is about to be used fully, the next simulation game component is sent packages until the N game match test case sending packages are completed. If there are 100 subprocesses currently, and the operation load corresponding to each simulated game component is 10 subprocesses, 10 simulated game components are required to test the game-to-game test case in 100 subprocesses. Of course, the corresponding relationship between the sub-process and the simulation game component can also be determined according to specific situations. When the simulation game component finishes the test of the game play test cases, the corresponding sub-process can acquire the game play test results corresponding to the game play test cases from the simulation game component and send the game play test results to the main process through the communication channel, so that the game play test results corresponding to the M game play test cases are obtained. The computer equipment can analyze game-to-game test results and provide reference basis for matching virtual characters and character skills in game services.

As shown in fig. 6, fig. 6 is a schematic diagram of game-play test results corresponding to M game-play test cases respectively generated according to an embodiment of the present application, and as shown in fig. 6, when a computer device generates M game-play test cases, a main process corresponding to a game service is started, the main process creates and starts N subprocesses according to the number M of the game-play test cases, and distributes the M game-play test cases to the N subprocesses. As shown in fig. 6, each of the N sub-processes creates a corresponding connection (i.e., a sub-thread) according to the number of game-to-game test cases owned by each sub-process, and one game-to-game test case corresponds to one connection (i.e., a sub-thread). The sub-process may package the simulated game component (i.e., the simulated game client within the computer device) according to the connection (i.e., the sub-process) it creates and accept the test results of the simulated game component to the game-to-game test case. The main process can monitor the condition of executing the game-to-game test cases by each sub-process in real time through the communication channel, and when the test of the corresponding game-to-game test case in each sub-process is completed, the main process can gather the game-to-game test results corresponding to the game-to-game test cases in the N sub-processes through the communication channel.

As shown in fig. 7, fig. 7 is a schematic diagram of a service testing method provided in an embodiment of the present application, and as shown in fig. 7, after obtaining test configuration data corresponding to a game service, a computer device may combine virtual roles and role skills in the test configuration data by using an automated case generator according to test environment configuration data and test parameter information in the test configuration data, generate Q candidate game-play combinations, and filter the Q candidate game-play combinations, so as to generate M game-play combinations. And coding the M game-play combinations through an automatic case generator to generate M game-play test cases. After M game match test cases are generated, the M game match test cases can be analyzed through a case analyzer in a case high concurrency executor, the M game match test cases are converted into a data format which can be identified by the high concurrency executor, the M game match test cases are transmitted through a high concurrency wrapper transmitter, the M game match test cases are transmitted to a simulation game component (the simulation game component is a simulation game running end in computer equipment), match combat corresponding to game business is normally simulated through the simulation game component, redundant combat logic is stripped (namely the combat logic irrelevant to a task at this time is not executed), front operation is reduced (namely, judgment conditions irrelevant to game combat context and combat reality are executed, such as judging whether virtual characters need to have physical strength or not, whether a specific combat prop is required or not, etc., but the judgment condition is irrelevant to the actual combat value).

And when the main process monitors that the game-to-game test cases are completely executed by each sub-process through the communication channel, summarizing the game-to-game test results corresponding to the game-to-game test cases in each sub-process to obtain the game-to-game test results corresponding to the M game-to-game test cases. The computer equipment can analyze the M game match test results through the data analysis platform according to the analysis indexes set in the data analysis platform to obtain the analysis results, and visualize the analysis results, namely, show the analysis results to the tester, so that the tester or related equipment provides reference basis for matching between the virtual character and the character skill according to the analysis results.

The system and the method have the advantages that the expandability is strong, the deployment can be flexible, the components (such as an automatic case generator, a high concurrency actuator, a simulation game component and a data analysis platform) are mutually independent, and the communication can be carried out through a network protocol. Meanwhile, the embodiment of the application can also realize message queue and execute a large number of game-to-game test cases simultaneously, and visualizing the execution state of each game-to-game test case, such as creating a daemon monitor process, wherein two-way communication is realized between a package sending tool (such as a main process and a sub-process) and the monitor daemon process through a Transmission Control Protocol (TCP), which is a connection-oriented, reliable and byte-stream-based transport layer communication Protocol), and the daemon monitor process realizes two-way communication with a test page through a Websocket (a Protocol for communicating on a single TCP (Transmission Control Protocol), so that data exchange between a client and a server is simpler, and a server is allowed to actively push data to the client), and the test state of the game-to-game test case is displayed to a tester.

Because the game-to-game combination in the game service is more, the embodiment of the application can be high-performance, high-concurrency and expandable by using the high-concurrency actuator, and the test efficiency of the game service can be improved. Meanwhile, when the number of test packets corresponding to the game-to-game test case is large, the packet sending process is possibly long, and under special conditions, the packet sending can be suspended or interrupted, and the packet sending can be continued when appropriate, so that the executed game-to-game test case is prevented from being required to be executed again due to special reasons (such as server downtime and network interruption). In addition, the embodiment of the scheme can also regulate and control the packet sending rate, for example, the packet sending rate can be regulated and controlled by safety limit or flow limit which may occur in an external network. In addition, the embodiment of the application can support the protocol of any game protocol (namely the test environment configuration data associated with the game service), and the initial simulation component can be updated according to any game protocol to obtain the simulation game component matched with the game service, namely, after the game protocol is updated each time, the original game protocol is only required to be replaced in the background, and code compiling and compiling projects are not required. The scheme can support communication protocols such as TCP, UDP (User data program), and the like, and can also be freely configured. The embodiments of the present application may support at least a Protobuf2 protocol and a Protobuf3 protocol, where the Protobuf protocol is a method of language-independent, platform-independent, and extensible serialized structured data, and is used for (data) communication protocols, data storage, and the like. The Protobuf protocol may be used to convert data such as game-to-game test cases generated by the scheme into a format capable of being stored and transmitted (for example, network transmission), for example, data structure conversion may be performed on M game-to-game test cases, and the M game-to-game test cases may be converted into a format capable of being stored and transmitted (for example, network transmission), so that the format-converted M game-to-game test cases are distributed to N subprocesses, and the format-converted M game-to-game test cases are tested in the virtual game component, so as to obtain test results corresponding to the M game-to-game test cases.

As shown in fig. 8, fig. 8 is a schematic flow chart of a service test provided in an embodiment of the present application, and as shown in fig. 8, after a tester uploads test configuration data corresponding to a game service to a test server (i.e., a computer device) in a corresponding test page and starts a test task, the test server may generate the test task according to the test configuration data input by the tester, and in an object 1, a game-to-game test case is generated according to a related algorithm (e.g., a genetic algorithm, which may refer to specific content described in step S101). And starting the main process, testing the game-to-game test case through the sub-process in the main process, and checking whether the game-to-game test case is executed or not through a shared memory (namely a database). The object 1 sends the game match test case and the game test protocol (namely game environment configuration data) to the object 2, the object 2 can update the initial simulation component based on the game test protocol to obtain a simulation game component matched with the game service, and a game match test result corresponding to the game match test case is generated in the simulation game component. The main process can acquire the execution progress of the game-to-game test case in each sub-process in real time, report the execution progress to the test server, and monitor the execution condition of the game-to-game test case in real time. After the object 2 obtains the game match test result corresponding to the game match test case, the game match test result is sent to the object 1, the object 1 analyzes the game match test result, the game match test result is stored and displayed through the test server, and a tester can check the game match test result in a test page provided by the server.

As shown in fig. 9, fig. 9 is a schematic diagram of obtaining a game match-up test result according to an embodiment of the present application, and as shown in fig. 9, a computer device may obtain test configuration data 901 input by a tester, generate a game match-up test combination by combining virtual characters and character skills in the test configuration data, and filter 902 the game match-up test to generate a game match-up test case. After the game match test case is generated, a game protocol (namely game environment configuration data) in the test configuration data is filled 903, namely default values in the game protocol, such as virtual character identification, character skill identification, virtual character grade and the like, are filled, values required to be perfect in the game protocol are supplemented, and a test packet is generated. The computer device may send 904 the test package, test the game match test case in the simulated game component, generate a game match test result corresponding to the game match test case, and receive 905 the package. The computer device may store and analyze 906 the game play test results to provide a reference for matching between virtual characters and character skills.

As shown in fig. 10, fig. 10 is a schematic diagram of an analysis result corresponding to a game match-up test result provided in the embodiment of the present application, and fig. 10 shows a test result corresponding to 3 game teams, where as shown in fig. 10, the number of battles performed by T0 (game team T0) is 36, the percentage (i.e., the proportion of the total number) is 47%, the minimum winning rate is 60%, and the maximum winning rate is 73%; the T1 (game team T1) battles 6 times, the proportion (namely the proportion of the total amount) is 8%, the lowest rate of winning is 51%, and the highest rate of winning is 58%; the number of battles performed by T2 (game team T2) was 34, the percentage (i.e., the proportion of the total number) was 45%, the minimum win rate was 0.3%, and the maximum win rate was 49%. As shown in fig. 10, a line graph and a rectangle graph of the loss ratio (KD, which is a ratio between the remaining force/the remaining force of the enemy, the higher the ratio, the smaller the loss, the stronger the ability of the team) and the win ratio (i.e., the winning field + the tie field)/the total field) of each of the three game teams in each game play are also shown, so that the game play test results corresponding to each team can be more intuitively shown. In this way, the testing personnel or the related equipment can match the virtual character and the character skill according to the analysis result.

The embodiment of the application can be applied to strategy game scenes and card game scenes, in the related technology, the test cases are executed manually, but virtual roles and role skills in the strategy game scenes and the card game scenes are more, the influence of combination variables is large, single low-frequency manual test is adopted, the efficiency is low, a large number of effective and accurate test results cannot be provided, and the evaluation value obtained in the test data analysis stage is often inaccurate. In the scheme, the virtual roles and the role skills contained in the game business are combined according to the test configuration data through an automatic case generating tool to generate M game match test cases. The method comprises the steps of distributing M game match test cases to N subprocesses through a main process corresponding to game services, testing the game match test cases in the N subprocesses in a game service-associated simulation game component, and generating game match test results corresponding to the M game match test cases respectively.

In the embodiment of the application, by acquiring test configuration data associated with game services and combining virtual roles and role skills contained in the game services according to the test configuration data, M game-to-game test cases are generated; the M game match-up test cases are distributed to the N sub-processes through the main process corresponding to the game service, and the M game match-up test cases are distributed through the main process corresponding to the game service, so that a large number of game match-up test cases can be simultaneously carried out, the test efficiency is improved, and the labor cost can be reduced. The game-to-game test cases in the N sub-processes are tested through the game service-associated simulation game component, the game-to-game test results corresponding to the M game-to-game test cases respectively are generated, the simulation game component is generated through simulating the actual game running environment, the test of the game-to-game test cases can be realized through the simulation game component without being sent to the actual game client, the test efficiency can be improved, and the test cost can be reduced. Through the method and the device, labor cost can be reduced, testing efficiency is improved, meanwhile, a large number of comprehensive testing results can be generated efficiently, and more accurate reference basis is provided for matching between the virtual roles and the role skills.

As shown in fig. 11, fig. 11 is a schematic diagram of a service testing method provided in this embodiment, where the method may be executed by a computer device, and the method may be executed by a computer device, where the computer device may be a server (such as the server 10 in fig. 1), or a target user terminal (such as any one of the target user terminals in the target user terminal cluster in fig. 1), or a system composed of the server and the target user terminal, which is not limited in this application. As shown in fig. 11, the steps of the service test method include S201-206.

S201, obtaining test configuration data associated with the game service, combining virtual roles and role skills contained in the game service according to the test configuration data, and generating M game-to-game test cases.

S202, distributing the M game-to-game test cases to N sub-processes through the main process corresponding to the game service.

S203, testing the game match test cases in the N sub-processes through the simulation game components associated with the game services, and generating game match test results corresponding to the M game match test cases respectively.

The specific contents of steps S201-S206 can refer to the contents described in fig. 1, and the embodiments of the present application will not be described herein again.

S204, obtaining an analysis index corresponding to the game service, and analyzing the game match test result according to the analysis index to obtain a match statistic corresponding to the game match test result.

Specifically, the computer device generates game match test results corresponding to the M game match test cases, and can obtain an analysis index corresponding to the game service, and analyze the game match test results according to the analysis index to obtain match statistics corresponding to the game match test results. The analysis indexes at least comprise victory probability, average rate, war-loss ratio, number of virtual character occurrences, number of restraining opponents, skill occurrence number, grade or star level and the like. According to the game statistics, reference basis can be provided for matching between the virtual roles and the role skills, namely determining which virtual roles can be combined together, which virtual roles cannot be combined together, which virtual roles and the role skills can be combined together, which role skills cannot be combined together and the like.

S205, if the game-play statistic satisfies the statistic threshold, determining the virtual character and the character skill in the game-play test case corresponding to the game-play statistic satisfying the statistic threshold as an effective game-play combination.

S206, if the game-play statistic does not meet the statistic threshold, determining the virtual character and the character skill in the game-play test case corresponding to the game-play statistic which does not meet the statistic threshold as an invalid game-play combination, and setting an alarm identifier for the invalid game-play combination in the game service.

Specifically, after the computer device obtains the game match statistic corresponding to the game match test result, if the match statistic is determined to meet the statistic threshold, the virtual character and the character skill in the game match test case corresponding to the match statistic meeting the statistic threshold are determined to determine the effective game match combination. If the game-play statistic does not meet the statistic threshold, determining the virtual character and character skills in the game-play test case corresponding to the game-play statistic which does not meet the statistic threshold as an invalid game-play combination, and setting an alarm identifier for the invalid game-play combination in the game service. The effective game-play combination may refer to that, when an actual game player performs game experience, the game experience may be performed in a team form (i.e., a combination form between virtual characters and character skills) corresponding to the effective game-play combination. The invalid game play combination may refer to that, when an actual game player performs game experience, the game experience may not be performed in a form of a team corresponding to the invalid game play combination (i.e., a combination form between virtual characters and character skills), and an alarm identifier is set for the invalid game play combination in a game service, that is, when a team after the game player combines is an invalid game play combination, a "combination form is an invalid combination" may be sent to the user, that is, the game player is not allowed to perform game experience in a form of the invalid game play combination.

For example, the winning probability corresponding to each team can be counted according to the game play test results corresponding to the M game play test cases respectively, and each game play test case can comprise two teams and have an opponent relationship. Thus, the victory probability corresponding to each team in each game match test case is obtained, if the victory probability of the team corresponding to the game match test case meets the statistical threshold, the team with the victory probability meeting the statistical threshold is an effective game match combination, namely when an actual game player performs game experience, the game experience can be performed in a team form (namely a combination form between virtual characters and character skills) corresponding to the effective game match combination; if the victory probability of the team corresponding to the game match test case does not meet the statistical threshold, the team of which the victory probability does not meet the statistical threshold is an invalid game match combination, namely when the actual game player performs game experience, the game experience cannot be performed in the form of the team corresponding to the invalid game match combination (namely the combination form between the virtual character and the character skill).

For example, when the computer device analysis index is the excellent average rate (i.e. winning field + tie field)/total field), the game match test result corresponding to the game match test case is analyzed to obtain the excellent average rate (i.e. match statistic value) corresponding to each team in each game match test case. Thus, when the optimal average rate of the teams corresponding to the game match test cases meets the statistical threshold, the teams with the optimal average rate meeting the statistical threshold are taken as effective game match combinations; and when the excellent rate of the team corresponding to the game match test case does not meet the statistical threshold, the team with the excellent rate meeting the statistical threshold is an invalid game match combination. Similarly, when the analysis index of the computer equipment is the combat damage ratio (namely, a proportion value between the remaining force/the remaining force of the enemy is higher, the higher the proportion value is, the smaller the combat damage is, and the stronger the team capacity is), the game match test result corresponding to the game match test case is analyzed to obtain the combat damage ratio (namely, the match statistic value) corresponding to each team in each game match test case. Thus, when the fighting loss ratio of the team corresponding to the game match test case meets the statistical threshold, the team with the fighting loss ratio meeting the statistical threshold is taken as an effective game match combination; and when the fighting loss ratio of the fighting team corresponding to the game match test case does not meet the statistical threshold, the fighting team with the excellent-average rate meeting the statistical threshold is taken as an invalid game match combination.

Similarly, when the analysis index of the computer equipment is the number of times of occurrence of the virtual character, the number of restraining opponents, the number of times of occurrence of skills, the level or the star level and the like, the game match test result is analyzed according to the analysis index to obtain a match statistic corresponding to the game match test result, and then whether the match statistic meets the statistic threshold value is judged to determine the virtual character and the character skill in the game match test case, so that the game match test case is an effective game match combination or an ineffective game match combination.

As shown in fig. 12, fig. 12 is a schematic diagram of analyzing a Game match test result according to an embodiment of the present application, and as shown in fig. 12, in a Game of strategic type (SLG, Simulation Game), a computer device may determine a battle formation in each Game match test case as 3 virtual characters and 6 character skills, each virtual character corresponds to 2 skills, so as to obtain a plurality of Game match test cases, and then test the plurality of Game match test cases to obtain a Game match test result. The computer equipment can analyze the game match test result, namely, carry out array capacity analysis, and calculate and obtain the game statistic values corresponding to analysis indexes such as the average rate (namely the winning field plus the tie field)/the total field) and the combat damage value (namely a proportion value between the remaining force/the remaining force of the enemy, wherein the higher the proportion value is, the smaller the combat damage is, the stronger the team capability is), the number of the teams in control and the like, which correspond to each battle group in each game match test case. The virtual characters and the character skills included in each team can be analyzed, the occurrence frequency, the star level matching, the type matching, the attribute matching and the like are analyzed, finally, the contribution degree of each team is calculated (namely, a numerical value obtained according to the statistical data of a plurality of games) to obtain the injury proportion of the character skills and the overall injury proportion of the virtual characters, so that the virtual characters and the character skills in the game test case are analyzed, and the game combination is effective or ineffective. If the team ability of the team 1 is too strong according to the game statistics, the team can hardly control the team, and the fairness of game operation and the experience of game players are influenced when the actual game is operated. The team 1 is therefore an invalid game-play combination, i.e. the form of match between virtual characters and character skills in the team 1 is not allowed.

As shown in fig. 13, fig. 13 is a schematic diagram of an analysis index provided in an embodiment of the present application, and as shown in fig. 13, an analysis level of the computer device for analyzing the game-to-game test result may include: lineup analysis, virtual character analysis, and character skill analysis. As shown in fig. 13, when analyzing the game play test result in the analysis hierarchy of formation analysis, if there are 3 types of alarms "team capacity is too strong", "national team T degree", and "team capacity is too weak" for the team in the game play test case, the team with the 3 types of alarms may be determined as an invalid game play combination. As shown in fig. 13, when the type of the warning of the team is "too strong in team capacity", the corresponding reference index (i.e., analysis index) is the number of the control teams (i.e., the number of the control teams corresponding to the currently-warned team is determined), the ratio of the priority and the KD war loss ratio, and the detailed standard for determining whether the current team is the "too strong in team capacity" warning type is described as follows: 1. no tokens, 2, etc. When the alarm type of the team is 'national team T degree', the corresponding reference index (namely the analysis index) is the optimal average rate, and the detailed standard for judging whether the current team is 'national team T degree' alarm type is described as follows: 1. the rate of the success has obvious jump, such as jump rate larger than 10%, etc. When the alarm type of the team is 'too weak team capacity', the corresponding reference index (namely analysis index) is the optimal average rate and the KD war loss ratio, and the detailed standard for judging whether the current team is 'too weak team capacity' is described as follows: 1. the lineup is low, 2, there is a significant drop relative to the team in between, etc.

As shown in fig. 13, when analyzing the game play test result using the virtual character analysis as the analysis level, if there are 2 types of alarms, "the virtual character capability is too strong," and "the star rating is virtually found not to match" in the team in the game play test case, the team with the 2 types of alarms may be determined as an invalid game play combination. When the alarm type of the team is 'too strong virtual character capability', the corresponding reference index (i.e. analysis index) is the occurrence frequency and the optimal average rate of the virtual character, and the detailed standard description for judging whether the current team is 'too strong team capability' alarm type is as follows: 1. too many occurrences in avatar rank top 30, 2, high goodness, and so on. When the alarm type of the team is 'star level mismatching of virtual characters', the corresponding reference index (i.e. analysis index) is the occurrence frequency and star level of the virtual characters, and the detailed standard description for judging whether the current team is 'too strong' alarm type is as follows: 1. the star levels in the combination differ too much, etc. When the game match test result is analyzed by taking the character skill analysis as an analysis level, if the team in the game match test case has the warning type of 'too strong character skill ability', the team corresponding to the 'too strong character skill' can be determined as an invalid game match combination. When the alarm type of the team is 'the character skill ability is too strong', the corresponding reference index (i.e. the analysis index) is the skill occurrence frequency and the excellence rate, and the detailed standard for judging whether the current team is 'the character skill ability is too strong' alarm type is described as follows: 1. too many occurrences in role skill top 30, and so on. Therefore, whether the team in the game match test case belongs to the alarm type or not is determined according to the detailed description of the multiple analysis levels, the reference indexes and the judgment standard, and if the team is the alarm type, the combination between the virtual character and the character skill in the team corresponding to the alarm type is determined to be an invalid game match combination, namely, a game player is prohibited during the actual game operation, and the game experience is performed by the invalid game match combination.

For example, as shown in fig. 14, fig. 14 is a schematic diagram of a method for analyzing game match test results according to an embodiment of the present application, and as shown in fig. 14, the method may be applied to a strategy game scenario, and a computer device analyzes the test results of a team D in a game match test case, and obtains an analysis path that the team D is "too weak in team ability" as: firstly, according to a plurality of analysis levels and reference bases, analyzing the test results of the team D to obtain an analysis summary page corresponding to the team D. The computer device can analyze the formation of the team D, determine which problems exist in the team D currently, acquire a fighting record list with the optimal rate of less than 25% corresponding to the team D, perform KD (war loss ratio) comparison, obtain a war loss ratio reference map, and finally determine positioning for the team D according to the formation, such as determining that the team D is of a warning type of 'too weak team' according to the analysis.

Fig. 15 is a schematic diagram of a high yield analysis provided in the embodiment of the present application, as shown in fig. 15, which shows a high yield comparison between teams in a game play test case, and as can be seen from fig. 15, the high yield corresponding to team D is 14.45, the high yield is lower, and the jump is larger (less than 10% of the high yield of the previous team) compared to the high yield of the previous team.

As shown in fig. 16, fig. 16 is a schematic diagram of a damage value analysis provided in an embodiment of the present application, as shown in fig. 16, a comparison between damage values corresponding to teams in a game match test case is shown, as shown in fig. 15, a damage value corresponding to a team D is 0.073, which is much lower than the damage values of other teams, so as shown in fig. 15 and fig. 16, a team D can be determined as a "team capacity is too weak" alarm type, and when a team combination form corresponding to a game player is a combination form corresponding to a team D during actual operation of a game, alarm information can be input, and prompt information such as that the team combination form is too weak and a player should be recombined is provided.

As shown in fig. 17, fig. 17 is a schematic diagram of a game match test result analysis method provided in an embodiment of the present application, as shown in fig. 17, the present solution may be applied to a chess and card game service, as shown in fig. 17, a computer device may obtain test configuration data corresponding to the chess and card game service input by a tester in a test page, where the test configuration data corresponding to the chess and card game service may include running environment configuration data (i.e., a game running installation package) corresponding to the chess and card game service, and a virtual character (i.e., a game player representative) and a character skill (e.g., a character authority) included in the chess and card game service, and the virtual character and the character skill are combined according to test parameter information corresponding to the chess and card game service to generate a test case. The test parameter information in the test configuration data may include the number of teams in each game match test case, the number of virtual characters in each team, and which character skills (e.g., character permissions) each virtual character possesses, for example, four teams may be included in the game match test case K, each team includes one virtual character, and each virtual character possesses 2 character skills.

The computer equipment randomly combines all virtual roles and all role skills contained in the game service according to the test parameter information in the test configuration data to obtain Q candidate game-to-game combinations. And screening the Q candidate game play combinations according to the default combination screening conditions to obtain M game play combinations, and coding the M game play combinations to obtain M game play test cases corresponding to the M game play combinations. The computer equipment can update the initial simulation assembly according to the running environment configuration data in the test configuration data to obtain a simulation game assembly matched with the chess and card game business, and execute the generated M game play test cases in the simulation game assembly to obtain the test results of the M game play test cases corresponding to the chess and card game business. And analyzing the test result according to related analysis indexes (such as a battle loss value, a winning rate number and the like), determining a game-play statistic value of each team, and determining whether the team in the game-play test case is an invalid game-play combination according to the game-play statistic value of each team.

Optionally, the draid in the embodiment of the present application stores M game match test cases generated by the present solution, M game match test results corresponding to the M game match test cases, and analysis results corresponding to the M game match test results. The Druid is an open-source, distributed and column storage system, is particularly suitable for real-time analysis statistics on big data, has good stability (high Available), is relatively light in weight, and is very complete in document. Meanwhile, the Druid can compress the data generated in the scheme and then add the data into the index structure, so that the compression increases the data storage capacity, the transmission is more convenient, and the related equipment can be rapidly accessed.

In the embodiment of the application, by acquiring test configuration data associated with game services and combining virtual roles and role skills contained in the game services according to the test configuration data, M game-to-game test cases are generated; the M game match-up test cases are distributed to the N sub-processes through the main process corresponding to the game service, and the M game match-up test cases are distributed through the main process corresponding to the game service, so that a large number of game match-up test cases can be simultaneously carried out, the test efficiency is improved, and the labor cost can be reduced. The game-to-game test cases in the N sub-processes are tested through the game service-associated simulation game component, the game-to-game test results corresponding to the M game-to-game test cases respectively are generated, the simulation game component is generated through simulating the actual game running environment, the test of the game-to-game test cases can be realized through the simulation game component without being sent to the actual game client, the test efficiency can be improved, and the test cost can be reduced. And acquiring an analysis index corresponding to the game service, and analyzing the game match test result according to the analysis index to obtain a match statistic corresponding to the game match test result. If the game-play statistic satisfies the statistic threshold, determining the virtual character and character skills in the game-play test case corresponding to the game-play statistic satisfying the statistic threshold as an effective game-play combination; if the game-play statistic does not meet the statistic threshold, determining the virtual character and character skills in the game-play test case corresponding to the game-play statistic which does not meet the statistic threshold as an invalid game-play combination, and setting an alarm identifier for the invalid game-play combination in the game service. Therefore, the game match test result is analyzed through a plurality of analysis indexes, the big data match test result reference can be obtained, the game match test result is effectively evaluated, the matching between the virtual angle and the character skill in the game business is better determined, the service of the game business is perfected, and the updated game experience is provided for game players. Through the method and the device, labor cost can be reduced, testing efficiency is improved, meanwhile, a large number of comprehensive testing results can be generated efficiently, and more accurate reference basis is provided for matching between the virtual roles and the role skills.

Referring to fig. 18, fig. 18 is a schematic structural diagram of a service testing apparatus according to an embodiment of the present application. The service testing device may be a computer program (including program code) running in a computer device, for example, the service testing device is an application software; the device can be used for executing corresponding steps in the service testing method provided by the embodiment of the application. As shown in fig. 18, the service test apparatus may include: the system comprises a first generation module 11, a distribution module 12, a second generation module 13, an analysis module 14, a first determination module 15 and a second determination module 16.

The first generation module 11 is configured to acquire test configuration data associated with the game service, combine virtual characters and character skills included in the game service according to the test configuration data, and generate M game-to-game test cases;

the distribution module 12 is configured to distribute the M game-to-game test cases to N sub-processes through a main process corresponding to the game service; an interprocess communication channel is arranged between the main process and the N subprocesses, and M, N are positive integers;

the second generation module 13 is configured to test the game match-up test cases in the N sub-processes through the game service-related simulation game component, and generate game match-up test results corresponding to the M game match-up test cases, respectively; the game test result provides reference basis for matching between the virtual character and the character skill.

Wherein, the first generating module 11 includes:

a first obtaining unit 1101, configured to respond to an uploading operation in a test page, obtain test configuration data determined by the uploading operation, and obtain virtual roles and role skills associated with game services in the test configuration data;

the first generating unit 1102 is configured to randomly combine the virtual character and the character skill according to the test parameter information in the test configuration data, and generate M game-to-game test cases.

The first generation unit 1102 includes:

Wherein, the first generating module 11 includes:

a second obtaining unit 1103, configured to obtain a character feature corresponding to a virtual character in the test configuration data, and obtain a skill feature corresponding to a character skill in the test configuration data;

the input unit 1104 is used for converting the test parameter information in the test configuration data into test parameter characteristics and splicing the role characteristics, the skill characteristics and the test parameter characteristics into an input characteristic matrix;

an output unit 1105 for inputting the input feature matrix to the game generation model, and outputting a combined evaluation value between the virtual character and the character skill through the game generation model;

a second generating unit 1106, configured to obtain M game play combinations between the virtual character and the character skills according to the combination evaluation value, perform code conversion on the M game play combinations, and generate game play test cases corresponding to the M game play combinations respectively.

Wherein, the distributing module 12 includes:

the starting unit 1201 is configured to start a main process corresponding to the game service, and create and start N subprocesses determined by the number M of the test cases through the main process;

a data conversion unit 1202, configured to perform data conversion on the M game-to-game test cases respectively according to a data format in the main process, so as to obtain M game-to-game test cases after format conversion;

a distributing unit 1203, configured to distribute the M game-to-game test cases subjected to format conversion to sub-threads in the N sub-processes through an inter-process communication channel between the main process and the N sub-processes; one child thread corresponds to one game-to-game test case.

Wherein, the second generating module 13 includes:

an updating unit 1301, configured to perform environment updating on the initial simulation component based on the test environment configuration data in the test configuration data, to obtain a simulation game component matched with the game service;

the testing unit 1302 is configured to test the game-to-game test case in the N sub-processes through the simulation game component;

a third obtaining unit 1303, configured to obtain, when the main process monitors that the game-play test case in the N sub-processes is in an end state, game-play test results corresponding to the M game-play test cases from the N sub-processes through an inter-process communication channel between the main process and the N sub-processes.

Wherein, the device still includes:

the analysis module 14 is configured to obtain an analysis index corresponding to the game service, and analyze the game match test result according to the analysis index to obtain a match statistic corresponding to the game match test result; the analysis indexes at least comprise victory probability, excellent rate, war-loss ratio, occurrence times of virtual characters and number of restraining opponents;

the first determining module 15 is configured to determine, if the game-play statistic satisfies the statistical threshold, the virtual character and the character skill in the game-play test case corresponding to the game-play statistic satisfying the statistical threshold as an effective game-play combination;

the second determining module 16 is configured to determine, if the game-play statistic does not meet the statistical threshold, the virtual character and the character skill in the game-play test case corresponding to the game-play statistic that does not meet the statistical threshold as an invalid game-play combination, and set an alarm identifier for the invalid game-play combination in the game service.

According to an embodiment of the present application, the steps involved in the service testing method shown in fig. 2 may be performed by various modules in the service testing apparatus shown in fig. 18. For example, step S101 shown in fig. 2 may be performed by the first generation module 11 in fig. 18, step S102 shown in fig. 2 may be performed by the distribution module 12 in fig. 18, step S102 shown in fig. 2 may be performed by the second generation module 13 in fig. 18, and so on.

According to an embodiment of the present application, each module in the service testing apparatus shown in fig. 18 may be respectively or entirely combined into one or several units to form the apparatus, or some unit(s) may be further split into multiple sub-units with smaller functions, which may implement the same operation without affecting implementation of technical effects of the embodiment of the present application. The modules are divided based on logic functions, and in practical application, the functions of one module can be realized by a plurality of units, or the functions of a plurality of modules can be realized by one unit. In other embodiments of the present application, the testing device may also include other units, and in practical applications, these functions may also be implemented by the assistance of other units, and may be implemented by cooperation of a plurality of units.

Referring to fig. 19, fig. 19 is a schematic structural diagram of a computer device according to an embodiment of the present application. As shown in fig. 19, the computer apparatus 1000 may include: the processor 1001, the network interface 1004, and the memory 1005, and the computer apparatus 1000 may further include: a target user interface 1003, and at least one communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The target user interface 1003 may include a Display screen (Display) and a Keyboard (Keyboard), and the selectable target user interface 1003 may also include a standard wired interface and a standard wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., at least one disk memory). The memory 1005 may optionally be at least one memory device located remotely from the processor 1001. As shown in fig. 19, a memory 1005, which is a kind of computer-readable storage medium, may include therein an operating system, a network communication module, a target user interface module, and a device control application program.

In the computer device 1000 shown in fig. 19, the network interface 1004 may provide a network communication function; the target user interface 1003 is an interface for providing input to a target user; and the processor 1001 may be used to invoke a device control application stored in the memory 1005 to implement:

optionally, the processor 1001 may be configured to invoke a device control application stored in the memory 1005 to implement:

It should be understood that the computer device 1000 described in this embodiment of the present application may perform the description of the service testing method in the embodiment corresponding to fig. 2 or fig. 11, and may also perform the description of the service testing apparatus corresponding to fig. 18, which is not described herein again.

According to an aspect of the application, a computer program product or computer program is provided, comprising computer instructions, the computer instructions being stored in a computer readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device can perform the description of the service testing method in the embodiment corresponding to fig. 2 or fig. 11, which is not described herein again. In addition, the beneficial effects of the same method are not described in detail.

By way of example, the program instructions described above may be executed on one computer device, or on multiple computer devices located at one site, or distributed across multiple sites and interconnected by a communication network, which may comprise a blockchain network.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.

The above disclosure is only for the purpose of illustrating the preferred embodiments of the present application and is not to be construed as limiting the scope of the present application, so that the present application is not limited thereto, and all equivalent variations and modifications can be made to the present application.

Claims

1. A method for testing a service, comprising:

testing the game match-up test cases in the N subprocesses through the simulation game component associated with the game service, and generating game match-up test results corresponding to the M game match-up test cases respectively; the game-to-game test result provides reference basis for matching between the virtual character and the character skill.

2. The method of claim 1, wherein the obtaining test configuration data associated with a game service, and combining virtual characters and character skills included in the game service according to the test configuration data to generate M game match test cases comprises:

responding to uploading operation in a test page, acquiring test configuration data determined by the uploading operation, and acquiring virtual roles and role skills associated with the game service in the test configuration data;

and randomly combining the virtual roles and the role skills according to the test parameter information in the test configuration data to generate M game match test cases.

3. The method of claim 2, wherein the randomly combining the virtual character and the character skill according to the test parameter information in the test configuration data to generate M game-to-game test cases comprises:

according to test parameter information in the test configuration data, randomly combining the virtual roles and the role skills to obtain Q candidate game combination; q is a positive integer greater than or equal to M;

obtaining game play conditions corresponding to the game services, and determining candidate game play combinations meeting the game play conditions in the Q candidate game play combinations as M game play combinations;

4. The method of claim 1, wherein the generating M game match-making test cases by combining the virtual characters and character skills included in the game service according to the test configuration data comprises:

converting the test parameter information in the test configuration data into test parameter characteristics, and splicing the role characteristics, the skill characteristics and the test parameter characteristics into an input characteristic matrix;

inputting the input feature matrix to a game generation model, and outputting a combined evaluation value between the virtual character and the character skill through the game generation model;

5. The method according to claim 1, wherein the distributing the M game-to-game test cases to N subprocesses through a main process corresponding to the game service comprises:

according to the data format in the main process, respectively carrying out data conversion on the M game-to-game test cases to obtain M game-to-game test cases with converted formats;

distributing the M game-to-game test cases after format conversion to sub-threads in the N sub-processes through an inter-process communication channel between the main process and the N sub-processes; one child thread corresponds to one game-to-game test case.

6. The method according to claim 1, wherein the testing game-to-game test cases in the N subprocesses through the game service-related simulation game component to generate game-to-game test results corresponding to the M game-to-game test cases, respectively, includes:

based on the test environment configuration data in the test configuration data, carrying out environment updating on the initial simulation assembly to obtain a simulation game assembly matched with the game service;

testing the game match test cases in the N subprocesses through the simulation game component;

7. The method according to claim 1, characterized in that it comprises:

obtaining an analysis index corresponding to the game service, and analyzing the game match test result according to the analysis index to obtain a match statistic corresponding to the game match test result; the analysis indexes at least comprise victory probability, excellent average rate, war-loss ratio, occurrence times of virtual characters and number of restraining opponents;

if the game-play statistic satisfies a statistic threshold, determining virtual characters and character skills in the game-play test case corresponding to the game-play statistic satisfying the statistic threshold as an effective game-play combination;

if the game-play statistic does not meet the statistic threshold, determining the virtual character and the character skill in the game-play test case corresponding to the game-play statistic which does not meet the statistic threshold as an invalid game-play combination, and setting an alarm identifier for the invalid game-play combination in the game service.

8. A service testing apparatus, comprising:

the game system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring test configuration data associated with game services, combining virtual roles and role skills contained in the game services according to the test configuration data and generating M game-to-game test cases;

the distribution module is used for distributing the M game-to-game test cases to N sub-processes through a main process corresponding to the game service; an interprocess communication channel is arranged between the main process and the N subprocesses, and M, N are positive integers;

the generating module is used for testing the game match-up test cases in the N subprocesses through the simulation game component related to the game service, and generating game match-up test results corresponding to the M game match-up test cases respectively; the game-to-game test result provides reference basis for matching between the virtual character and the character skill.

9. A computer device, comprising: a processor and a memory;

the memory stores a computer program which, when executed by the processor, performs the method of any of claims 1 to 7.

10. A computer-readable storage medium, in which a computer program is stored which is adapted to be loaded by a processor and to carry out the method of any one of claims 1 to 7.