CN116955148A - Service system testing method, device, equipment, storage medium and product - Google Patents

Service system testing method, device, equipment, storage medium and product Download PDF

Info

Publication number
CN116955148A
CN116955148A CN202310374276.5A CN202310374276A CN116955148A CN 116955148 A CN116955148 A CN 116955148A CN 202310374276 A CN202310374276 A CN 202310374276A CN 116955148 A CN116955148 A CN 116955148A
Authority
CN
China
Prior art keywords
service
test
parameter
parameters
mapping
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310374276.5A
Other languages
Chinese (zh)
Inventor
秦晓晨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202310374276.5A priority Critical patent/CN116955148A/en
Publication of CN116955148A publication Critical patent/CN116955148A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3684Test management for test design, e.g. generating new test cases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3688Test management for test execution, e.g. scheduling of test suites

Abstract

The application discloses a service system testing method, a device, equipment, a storage medium and a product, and relates to the technical field of computers. The method comprises the following steps: acquiring a plurality of service test parameters corresponding to test services; matching the plurality of service test parameters with the service mapping table to obtain mapping identifiers corresponding to the plurality of service test parameters respectively; and carrying out combination collocation test matching on mapping identifications corresponding to the service test parameters respectively through an identification test rule function configured by the service system to obtain service test cases corresponding to the parameter combinations. That is, after one service scene is set, service test cases under a plurality of service scenes with different conditions are automatically output, so that the automation of test case output is realized, the output test cases can cover all service scenes, and the accuracy and the working efficiency of system test are improved.

Description

Service system testing method, device, equipment, storage medium and product
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to a service system testing method, a device, equipment, a storage medium and a product.
Background
In the process of developing a service system or testing the service system, a test scene is usually required to be generated in advance, and an output result corresponding to the test scene is output through the service system, so that the service operation capability of the service system is tested according to the output result.
In the related art, a test scene is usually manually created by a service person on a scene configuration page, so as to trigger an output result of a service system in the test scene, and the service person determines the corresponding operation capability of the service system according to the output result.
However, in the related art, because the number of scene types corresponding to the service system is huge, the situation that the scene is missed only depends on manual creation of service personnel, so that the testing or developing accuracy and efficiency of the service system are reduced.
Disclosure of Invention
The embodiment of the application provides a service system testing method, a device, equipment, a storage medium and a product, which can improve the efficiency of service system testing. The technical scheme is as follows.
In one aspect, a service system testing method is provided, and the method includes:
acquiring a plurality of service test parameters corresponding to a test service, wherein at least one target service parameter in the plurality of service test parameters comprises a plurality of service sub-parameters, and the plurality of service test parameters are used for indicating conditions which a service system needs to conform to when executing the test service;
Matching the plurality of service test parameters with a service mapping table to obtain mapping identifiers corresponding to the plurality of service test parameters respectively, wherein the mapping identifiers corresponding to the target service parameters comprise sub-identifiers corresponding to the plurality of service sub-parameters respectively, and the service mapping table comprises a preset matching relationship between the parameters and the mapping identifiers;
the mapping identifications corresponding to the service test parameters are combined, matched and tested through the identification test rule function configured by the service system to obtain service test cases corresponding to the parameter combinations, wherein the service test cases are used for representing service operation capacity of the service system, and the service system is in a service execution effective state under the condition that the service operation capacity indicates that the service system meets service operation requirements, and the identification test rule function is a logic function which is pre-configured in the service system and is used for combining and matching the service test parameters according to the test service.
In another aspect, a service system testing apparatus is provided, the apparatus including:
the system comprises an acquisition module, a test module and a control module, wherein the acquisition module is used for acquiring a plurality of service test parameters corresponding to a test service, at least one target service parameter in the plurality of service test parameters comprises a plurality of service subparameters, and the plurality of service test parameters are used for indicating conditions which a service system needs to conform to when executing the test service;
The matching module is used for matching the plurality of service test parameters with a service mapping table to obtain mapping identifiers corresponding to the plurality of service test parameters respectively, wherein the mapping identifiers corresponding to the target service parameters comprise sub identifiers corresponding to a plurality of service sub parameters respectively, and the service mapping table comprises a preset matching relationship between the parameters and the mapping identifiers;
the matching module is further configured to perform combination matching test matching on mapping identifiers corresponding to the service test parameters respectively through an identifier test rule function configured by the service system, so as to obtain service test cases corresponding to a plurality of parameter combinations, where the service test cases are used for representing service operation capability of the service system, and the service system is in a service execution valid state under the condition that the service operation capability indicates that the service system meets service operation requirements, where the identifier test rule function is a logic function that is pre-configured in the service system and performs combination matching on the service test parameters according to the test service.
In another aspect, a computer device is provided, where the computer device includes a processor and a memory, where the memory stores at least one instruction, at least one program, a set of codes, or a set of instructions, where the at least one instruction, the at least one program, the set of codes, or the set of instructions are loaded and executed by the processor to implement a service system testing method according to any one of the embodiments of the present application.
In another aspect, a computer readable storage medium is provided, where at least one instruction, at least one program, a set of codes, or a set of instructions is stored, where the at least one instruction, the at least one program, the set of codes, or the set of instructions are loaded and executed by a processor to implement a business system testing method according to any one of the embodiments of the present application.
In another aspect, a computer program product or computer program is provided, the computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the business system testing method of any of the above embodiments.
The technical scheme provided by the embodiment of the application has the beneficial effects that at least:
in the process of testing the service system, after a plurality of service test parameters corresponding to test services are obtained, the service test parameters are matched with a preset service mapping table to obtain mapping identifications corresponding to the service test parameters, so that the mapping representations corresponding to the service test parameters are combined, matched and tested according to an identification test rule function configured by the service system, and service test cases corresponding to the parameter combinations are automatically generated. That is, after setting a service scenario, the service test parameters in the service scenario are converted into corresponding mapping identifications through the service mapping table corresponding to the service scenario, and the combination matching test matching is performed on a plurality of mapping identifications according to the identification test rule function generated by the combination matching logic between the service scenario determination mapping identifications, so that the service test cases corresponding to the parameter combinations generated by different combination matching are automatically output, and after setting a service scenario, the service test cases in a plurality of service scenarios under different conditions are automatically output, thereby not only realizing the automation of test case output, but also enabling the output test cases to cover all service scenarios, and improving the accuracy and the working efficiency of system test.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic illustration of an implementation environment provided by an exemplary embodiment of the present application;
FIG. 2 is a flow chart of a business system testing method provided by an exemplary embodiment of the present application;
FIG. 3 is a flow chart of a business system testing method provided by another exemplary embodiment of the present application;
fig. 4 is a schematic diagram of a service configuration method according to an exemplary embodiment of the present application;
FIG. 5 is a parametric function analysis diagram provided by an exemplary embodiment of the present application;
FIG. 6 is a schematic diagram of a parameter loop sub-function provided by an exemplary embodiment of the present application;
FIG. 7 is a schematic diagram of a regular round-robin sub-function provided by an exemplary embodiment of the present application;
FIG. 8 is a schematic diagram of a full use case set acquisition method provided by an exemplary embodiment of the present application;
FIG. 9 is a schematic diagram of a business system testing method according to an exemplary embodiment of the present application;
FIG. 10 is a flow chart of a business system testing method provided by an exemplary embodiment of the present application;
FIG. 11 is a schematic diagram of a system architecture provided by an exemplary embodiment of the present application;
FIG. 12 is a block diagram of a business system testing apparatus provided in an exemplary embodiment of the present application;
FIG. 13 is a block diagram illustrating a business system testing apparatus according to another exemplary embodiment of the present application;
fig. 14 is a schematic diagram of a server according to an exemplary embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the embodiments of the present application will be described in further detail with reference to the accompanying drawings.
First, an implementation environment corresponding to the present application will be described. Referring to fig. 1, a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application is shown, and as shown in fig. 1, the implementation environment includes a terminal 110 and a server 120, where the terminal 110 and the server 120 are connected through a communication network 130.
In the embodiment of the present application, an order exposure risk system installed in the server 120 is taken as an example to describe a service system, which is used for purchasing or selling different types of resources, that is, a test process of the service system is implemented in the server. In another possible case, the test procedure of the service system may be implemented in the terminal, which is not limited thereto.
Taking the order exposure risk system as an example, a plurality of resource exchange parameters corresponding to a resource exchange service are stored in the terminal 110, the resource exchange service refers to exchanging a first type of resource (for example, selling the first type of resource to a resource acquisition platform), the plurality of resource exchange parameters refer to conditions met by a specified type of resource in the process of exchanging, and at least one target exchange resource parameter in the plurality of exchange resource parameters includes a plurality of sub-parameters, for example: the target exchange resource parameter is an exchange trigger parameter, and the exchange trigger parameter comprises a subparameter 1 (the holding quantity of each type of resource in the resource exchange platform), a subparameter 2 (the triggering time) and a subparameter 3 (the holding quantity of each type of resource in the specified geographic area in the resource exchange platform), wherein the exchange trigger parameter refers to that when the configuration condition corresponding to the first type of resource meets the parameter condition, the order exposure risk system can trigger the first type of resource to exchange the resource.
The terminal 110 sends the plurality of resource redemption parameters to the server 120 for system testing of the order exposure system. After receiving the plurality of resource exchange parameters, the server 120 obtains a preset resource exchange mapping table according to the resource exchange service, wherein the resource exchange mapping table comprises a matching relation between parameters and identifiers, and matches the plurality of resource exchange parameters with the resource exchange mapping table to obtain mapping identifiers corresponding to the plurality of resource exchange parameters respectively, and the mapping identifiers corresponding to the target exchange resource parameters comprise a sub-identifier 1 corresponding to the sub-parameter 1, a sub-identifier 2 corresponding to the sub-parameter 2 and a sub-identifier 3 corresponding to the sub-parameter 3.
After parameter escaping is performed on the plurality of resource exchange parameters according to the resource exchange mapping table by the server 120, combination matching is performed on the plurality of service parameters according to the resource exchange service to generate an identification test rule function corresponding to a plurality of mapping identifications, combination matching test matching is performed on the mapping identifications corresponding to the plurality of resource exchange parameters respectively according to the identification test rule function, and a plurality of exchange test cases corresponding to parameter combinations are obtained, wherein the exchange test cases are used for representing service operation capacity of the service system. The server 120 feeds back a plurality of redemption test cases to the terminal 110 for display.
It should be noted that, the above embodiment is only described in the context of an open-order risk system, and the solution provided by the present application may also be applied to the context of a wind control system (for identifying an abnormal account), a shopping system (for selling goods), an automatic question-answering system (for automatically performing a dialogue with a user), etc., which is not limited thereto.
The terminal 110 is at least one of a smart phone, a tablet personal computer, a portable laptop, a desktop computer, an intelligent sound box, an intelligent wearable device, an intelligent voice interaction device, an intelligent household appliance, a vehicle-mounted terminal and other terminals, and the server is used for realizing a scene of instruction operation in the fields of intelligent transportation, the vehicle-mounted terminal, the internet of things and the like.
It should be noted that the server 120 may be implemented as a Cloud server, where Cloud technology (Cloud technology) refers to a hosting technology that unifies serial resources such as hardware, software, and networks in a wide area network or a local area network to implement calculation, storage, processing, and sharing of data.
In some embodiments, the server 120 described above may also be implemented as a node in a blockchain system.
It should be noted that, the service system testing method provided in the embodiment of the present application may be implemented by the terminal 110 alone, or may be implemented by the server 120 alone, or may be implemented by the terminal 110 and the server 120 cooperatively.
When the terminal 110 and the server 120 cooperatively implement the scheme provided by the embodiment of the present application, the terminal 110 and the server 120 may be directly or indirectly connected through a wired or wireless communication manner, which is not limited in the embodiment of the present application.
It should be noted that, before and during the process of collecting the relevant data of the user, the present application may display a prompt interface, a popup window or output voice prompt information, where the prompt interface, popup window or voice prompt information is used to prompt the user to collect the relevant data currently, so that the present application only starts to execute the relevant step of obtaining the relevant data of the user after obtaining the confirmation operation of the user to the prompt interface or popup window, otherwise (i.e. when the confirmation operation of the user to the prompt interface or popup window is not obtained), the relevant step of obtaining the relevant data of the user is finished, i.e. the relevant data of the user is not obtained. In other words, all user data collected by the present application is collected with the consent and authorization of the user, and the collection, use and processing of relevant user data requires compliance with relevant laws and regulations and standards of the relevant region.
In connection with the above description of the noun introduction and the implementation environment, the method for testing a business system according to the embodiment of the present application will be described by taking a server to execute the method as an example, and referring to fig. 2, a flowchart of a method for testing a business system according to an exemplary embodiment of the present application is shown, where the method includes the following steps.
Step 210, obtaining a plurality of service test parameters corresponding to the test service.
The at least one target service parameter in the plurality of service test parameters comprises a plurality of service sub-parameters, and the plurality of service test parameters are used for indicating conditions which the service system needs to meet when executing the test service.
The test service is schematically one of the service scenarios used in testing the service system.
Optionally, the test service is specified scene content set by service personnel in advance, for example: for an order exposure risk system, the test service is implemented to sell the first type of resource when the amount of the first type of resource is greater than 100. Also for example: for the wind control system, the test service is implemented to identify the account as an abnormal account and blacklist the account when the unrevealed number of times of the account is greater than 5 times. Also for example: for shopping systems, the test service is implemented to automatically load up to 50 items in quantity when the vendible amount of the items on the virtual shelf is less than 10 items. That is, the test traffic in this case is a manually structured traffic scenario.
Optionally, the test service is historical service content that has been executed by the service system during a historical period of time, for example: for the order exposure system, when the order exposure system performs a conversion transaction of converting the first type of resources with the resource quantity of 100 into the second type of resources with the resource quantity of 50 according to the conversion rate in a historical time period, the first type of resources with the resource quantity of 100 are converted into the second type of resources with the resource quantity of 50 according to the conversion rate as a test service. That is, the test service in this case is a real service scenario that the service system executes in the application process.
The service test parameters refer to the execution conditions required by the service system in the process of executing the test service, that is, the test service can be successfully executed after the current state of the service system accords with the test conditions corresponding to the service test parameters, and if the current state of the service system does not accord with the test conditions corresponding to at least one service test parameter, the test service cannot be executed/fails to be executed.
Optionally, the service test parameter obtaining manner includes at least one of the following manners:
1. different service test parameter types are configured in advance according to different service scenes, and after relevant parameter information is input into filling boxes respectively corresponding to the different service test parameter types in a service configuration interface corresponding to the test service, the parameter information corresponding to the service test parameter types is directly used as corresponding service test parameters;
2. After the service content corresponding to the test service is input, content analysis is carried out on the service content, so that a plurality of service test parameters contained in the service content are obtained according to the analysis result. It should be noted that the above-mentioned manner of acquiring the service test parameters is merely an illustrative example, and the embodiments of the present application are not limited thereto.
In some embodiments, the service test parameters refer to parameters included in the scenario corresponding to the test service, that is, the service test parameters are parameters associated with the test service. For example: when the test service is implemented such that the amount of the first type of resource is greater than 100, and the first type of resource is sold, the service test parameters include a resource type parameter (first type of resource), a trigger condition parameter (greater than), a performance target parameter (100), and a target value parameter (the sale becomes the amount of the resource 0). Also for example: when the test service is implemented such that the number of unrevealed accounts is greater than 5, the account is identified as an abnormal account, and the abnormal account is blacklisted, and the service test parameters comprise an account name parameter, an account gender parameter, an account opening time parameter, an account historical transaction parameter (unrevealed), an account historical transaction parameter (5 times) and a target account type parameter (blacklisted). Also for example: when the test service is implemented such that the vendable amount of the goods on the virtual shelf is less than 10 pieces, the service test parameters include a goods type parameter, a goods deal amount parameter, a goods vendable type parameter (less than), a goods quantity parameter (10 pieces).
Optionally, the plurality of service test parameters are parameters included in the test service, i.e. each service test parameter is explicitly present in the test service, for example: when the test service is implemented such that the amount of the first type of resources is greater than 100, the service test parameters are implemented as 4 when the first type of resources are sold, and each service test parameter is explicitly present in the test service. Also for example: when the test service is realized that the number of unrevealed accounts is more than 5, the account is identified as an abnormal account, and the abnormal account is blacklisted, the service test parameters are realized as 6, and each service test parameter belongs to the test service and clearly exists.
Optionally, some of the plurality of service test parameters are parameters included in the test service, and some of the plurality of service test parameters are parameters not included in the test service, but included in a service scenario corresponding to the test service, for example: when the test service is implemented in a resource exchange service scenario and the amount of the first type of resource is greater than 100, the first type of resource is sold, wherein service test parameters corresponding to the test service are implemented as 4 parameters, and in addition, in the resource exchange service scenario, there may be at least one of a plurality of parameter types including a position set parameter (an identification parameter for indicating a resource exchange transaction), an exchange initiation time parameter (an identification parameter for indicating triggering a resource exchange at a certain moment), a trigger variable parameter (a variable parameter for indicating triggering a resource exchange), an execution time parameter (a moment of executing the resource exchange), and the like, in addition to the three service test parameters.
In some embodiments, at least one service subparameter in the target service parameters is a parameter indicating the same service parameter type as a result of classification of different types in one target service parameter. For example: in a resource exchange scene, the triggering condition parameters comprise more than, less than, equal to, more than or equal to, less than or equal to and the like, so that the more than, less than, equal to, more than or equal to and less than are respectively used as sub-parameters corresponding to the triggering condition parameters; also for example: in the wind control system scene, the account historical transaction parameters comprise repayment, unrendered and overdue unrendered, so that the repayment, unrendered and overdue unrendered are respectively used as sub-parameters corresponding to the account historical transaction parameters. Also for example: in the shopping system scene, the goods selling type parameter comprises lower, higher and equal parameters, so that the lower, higher and equal parameters are respectively used as sub-parameters corresponding to the goods selling type parameter.
And 220, matching the plurality of service test parameters with the service mapping table to obtain mapping identifiers corresponding to the plurality of service test parameters respectively.
The mapping identifiers corresponding to the target service parameters comprise sub-identifiers respectively corresponding to a plurality of service sub-parameters, and the service mapping table comprises a preset matching relationship between the parameters and the mapping identifiers.
Illustratively, the service mapping table is a mapping table set by the service system according to different service scenarios in advance, for example: under the resource exchange scene, the service system sets a matching relation between the plurality of exchange test parameters and the corresponding mapping identifiers in the steps.
Illustratively, the mapping identifier refers to an identifier of a specified type having a matching relationship with the parameter, where the identifier may be implemented as a parameter identifier, a number identifier, a character string identifier, and the like, for example: currently there are parameter 1, parameter 2 and parameter 3, the parameter 1 configuration map is identified as a, the parameter 2 configuration map is identified as b, and the parameter 3 configuration map is identified as c. Also for example: currently, a parameter a, a parameter b and a parameter c exist, the configuration mapping of the parameter a is identified as 1, the configuration mapping of the parameter b is identified as 2, and the configuration mapping of the parameter c is identified as 3; also for example: currently there are parameters a, B and C, the parameter a configuration map is identified as 11101, the parameter B configuration map is identified as 11102, and the parameter C configuration map is identified as 11103.
Optionally, different mapping identifiers under the same type are corresponding to different parameters in a service mapping table under the same service scene (for example, the mapping identifiers are all letter identifiers); or, different mapping identifiers of different types are corresponding to different parameters in a service mapping table under the same service scene (for example, the mapping identifier type comprises two identifiers of character identifiers and letter identifiers).
Illustratively, a single parameter corresponds to at least one mapping identifier, which is not limited.
In an alternative case, a plurality of service test parameters of the same type correspond to the same mapping identity, for example: the first type of resource, the second type of resource and the third type of resource all correspond to the mapping identifier f and are used for representing the resource type.
In some embodiments, the target traffic parameter refers to one of a plurality of traffic test parameters, the target traffic parameter comprising a plurality of traffic subparameters, for example: when the target service parameter is a trigger condition parameter, the trigger condition parameter includes a subparameter 1 (greater than one value), a subparameter 2 (less than one value), a subparameter 3 (equal to one value), and a subparameter 4 (invalid value). Thus, the plurality of sub-parameters correspond to different sub-identifications, respectively, such as: when the mapping identifier corresponding to the triggering condition parameter is E, the mapping identifier corresponding to the subparameter 1 is E1, the mapping identifier corresponding to the subparameter 2 is E2, the mapping identifier corresponding to the subparameter 3 is E3, and the mapping identifier corresponding to the subparameter 4 is E4. Also for example: when the mapping identifier corresponding to the triggering condition parameter is 1, the mapping identifier corresponding to the subparameter 1 is 1-1, the mapping identifier corresponding to the subparameter 2 is 1-2, the mapping identifier corresponding to the subparameter 3 is 1-3, and the mapping identifier corresponding to the subparameter 4 is 1-4.
In another possible case, after a plurality of service test parameters corresponding to the test service are acquired for the first time, respectively assigning different mapping identifiers to the plurality of service test parameters, and when service test parameters corresponding to other test services in the same scene are acquired subsequently, directly referencing the service test parameters corresponding to the test service to the set mapping identifiers (wherein if the service test parameters which do not exist, a new mapping identifier is assigned to the service test parameters, and the mapping identifier is different from the set mapping identifier).
And 230, carrying out combination collocation test matching on mapping identifications corresponding to the service test parameters respectively through an identification test rule function configured by the service system to obtain service test cases corresponding to the parameter combinations.
The service test case is used for representing service operation capability of the service system, the service system is in a service execution effective state under the condition that the service operation capability indicates that the service system meets service operation requirements, and the service test case is used for testing the service operation capability of the service system, wherein the identification test rule function is a logic function which is pre-configured in the service system and carries out combination collocation on a plurality of service test parameters according to test services.
In some embodiments, in a service scenario corresponding to a test service, there is a logical relationship of combination and collocation between at least two service test parameters, for example: for the resource exchange service scenario, only one of the subparameter 1 (greater than one value) and the subparameter 3 (equal to one value) in the trigger condition parameter can occur, when the service system executes the service content corresponding to the subparameter 1 and the subparameter 3 simultaneously, the execution failure/incapability occurs, so that the identifier test rule function generated for the case is "E1 and E3 cannot occur simultaneously", that is, the identifier test rule function refers to that when the combination collocation exists in the service scenario meeting the test service correspondence between at least two service test parameters, the logic corresponding to the combination collocation corresponding to the at least two service test parameters is converted into the mathematical logic relationship between the mapping identifiers, for example: must occur simultaneously, have mutually exclusive relationships, etc.
Optionally, the identification test rule function represents only a single logical function that is combined and collocated between at least two business test parameters, for example: e1 and E3 cannot occur simultaneously; alternatively, the identification test rule function includes a function set of a plurality of logic sub-functions that are combined and collocated among a plurality of business test parameters, for example: including sub-functions 1"E1 and E3 cannot occur simultaneously, and including sub-functions 2"D and H must occur simultaneously. When the identification test rule function comprises a function set of a plurality of logic subfunctions which are combined and collocated among a plurality of service test parameters, a plurality of different subfunctions are connected in series according to a designated serial order, so that the identification test rule function is obtained.
Wherein the specified series order includes at least one of the following series orders:
1. sequentially connecting the sub-functions corresponding to the service test parameters in series according to the arrangement sequence of the service test parameters;
2. according to the length of the subfunction, the subfunctions are connected in series from long to short or from short to long;
3. and carrying out serial connection in sequence according to the number of the service test parameters contained in the subfunction.
It should be noted that the above types of serial sequences are merely illustrative examples, and embodiments of the present application are not limited in this regard.
In some embodiments, after the mapping identifiers corresponding to the service test parameters are combined, matched and tested by the identifier test rule function, the matching result obtained by the combination and matching is output to obtain a plurality of service test cases, that is, different service test cases include the combination and matching corresponding to different service test parameters.
Optionally, the service operation capability corresponding to the service system includes an operation speed, an accuracy of an operation result, and the like.
Illustratively, the business operational requirements are specified requirements configured in advance by business personnel, such as: the running speed reaches to 10 business test cases generated per second.
Illustratively, the service execution valid state refers to a state in which the current service system can effectively execute different service tasks.
In this embodiment, the service test case is used for covering different service scenarios corresponding to the specified service, that is, by inputting a single test service, and by combining and collocating different service test parameters, the full coverage of the service scenarios is realized.
In summary, in the service system testing method provided by the embodiment of the present application, after a plurality of service testing parameters corresponding to a test service are obtained in the process of testing a service system, the plurality of service testing parameters are matched with a preset service mapping table to obtain mapping identifiers corresponding to the plurality of service testing parameters, so that a combination matching test is performed on mapping representations corresponding to the plurality of service testing parameters respectively through an identifier test rule function configured by the service system, and a service test case corresponding to a plurality of parameter combinations is automatically generated. That is, after setting a service scenario, the service test parameters in the service scenario are converted into corresponding mapping identifications through the service mapping table corresponding to the service scenario, and the combination matching test matching is performed on a plurality of mapping identifications according to the identification test rule function generated by the combination matching logic between the service scenario determination mapping identifications, so that the service test cases corresponding to the parameter combinations generated by different combination matching are automatically output, and after setting a service scenario, the service test cases in a plurality of service scenarios under different conditions are automatically output, thereby not only realizing the automation of test case output, but also enabling the output test cases to cover all service scenarios, and improving the accuracy and the working efficiency of system test.
In an alternative embodiment, the identifying test rule function includes a plurality of test rule subfunctions, and referring to fig. 3, a flowchart of a service system testing method according to an exemplary embodiment of the present application is shown schematically, that is, step 230 includes step 231 and step 232, step 210 is further followed by step 210a, step 220 includes step 221 and step 222, and the method includes the following steps.
Step 210, obtaining a plurality of service test parameters corresponding to the test service.
The at least one target service parameter in the plurality of service test parameters comprises a plurality of service sub-parameters, and the plurality of service test parameters are used for indicating conditions which the service system needs to meet when executing the test service.
Illustratively, the test service is a service scenario for use in testing a service system.
In this embodiment, the test service is a designated scenario set by a service person in advance, and referring to fig. 4, a schematic diagram of a service configuration method provided by an exemplary embodiment of the present application is shown, as shown in fig. 4, in which a service configuration interface 400 is currently displayed, the service configuration interface 400 includes a plurality of configurable service test parameters, including: position set parameters, to-be-converted resource type parameters, service initiation time parameters, target conversion resource type parameters, trigger variable parameters, trigger condition parameters, execution mark parameters, target variable parameters, target value parameters, conversion effective time parameters and the like.
Taking the implementation of the service test parameter as the trigger variable parameter 401 as an example, the "respective openings" are filled in the parameter filling frame 402 corresponding to the trigger variable parameter 401, so as to indicate that the current trigger variable parameter 401 is the "respective opening".
The exposure refers to the holding amounts corresponding to the first type of resources and the second type of resources in the resource exchange resource pair required to be performed in the order exposure risk system. Thus, the respective exposure refers to the holding capacity of each type of resource in the plurality of resource pairs.
After all the service test parameters/part of the service test parameters in the service configuration interface 400 are filled, the service personnel trigger the storage control 403 to generate a corresponding test service, wherein the test service comprises a plurality of service test parameters selected by the service personnel.
In this embodiment, a set of positions 300000001 of a test service configured by a service person is used, the type of exchange resource is a first type resource, a T0 transaction is initiated, the trigger variables are respectively opened, the trigger conditions are >100, the execution targets are respectively opened, and the effective time is 2:00-3:00 "is illustrated as an example.
The position set is a service effective identifier of the test service.
T0 transactions represent the initiation of resource redemption transactions today.
The respective exposure refers to the holding capacity of the first type of resource in the respective resource pairs (e.g., resource pair 1 refers to first type of resource and second type of resource exchange, where the holding capacity of the first type of resource is 100 in resource pair 1, and resource pair 2 refers to first type of resource and third type of resource exchange, where the holding capacity of the first type of resource is 200 in resource pair 2).
The trigger condition refers to executing the service when the holding amount of the first type resource is greater than 100.
Execution targets refer to the scope of executing test traffic as first type resources in the respective openings.
The effective time means that the test service can be successfully executed between 2 points and 3 points today, and the rest time is not executed/failed to be executed.
In this embodiment, only one test service is currently acquired, which may be referred to as an "input rule".
In another achievable case, for the wind control system scenario, the exposure may be implemented as the number of transactions and the transaction type of the same account, for example: an account was constructed as open for five times of unrevealed money.
In yet another achievable case, for a shopping system scenario, the exposure may be implemented as a marketable quantity of the good, such as: a cargo having a cargo amount of 10 pieces was constructed as an opening.
And 210a, performing parameter type analysis on the plurality of service test parameters to obtain parameter classification results corresponding to the plurality of service test parameters.
The parameter classification result comprises a first type of service test parameter and a second type of service test parameter, wherein the first type and the second type respectively indicate different service test influence conditions, and the service test influence conditions refer to output influence of the service test parameter on the service system when the service system executes test service.
Illustratively, after a plurality of service test parameters are obtained according to an input rule, the plurality of service test parameters are subjected to parameter type analysis according to the input rule, so that different types of service test parameters are obtained and serve as parameter classification results corresponding to the plurality of service test parameters respectively.
In one possible case, the parameter types include two parameter types of a necessary parameter and a non-necessary parameter, where the necessary parameter refers to a service test parameter that must be uploaded when the service system is capable of executing a test service, for example: if the resource type parameter belongs to the necessary transmission parameter, the service system cannot know what kind of resource is exchanged when executing the test service, and therefore cannot execute the test service.
The unnecessary parameters refer to that the service system can execute the test service when the service test parameters are not uploaded, and the service system can execute the test service when the service test parameters are uploaded, so that the execution result of the service system on the test service can be changed only after the unnecessary parameters are uploaded, for example: the execution time parameter belongs to unnecessary parameters, when the execution time parameter is not uploaded, the service system can continuously execute the test service at the current moment/any moment/from the current moment, and after the execution time parameter is uploaded, the service system can only successfully execute the test service within the execution time range, and other time service systems do not execute/fail to execute.
The uploading parameter refers to a process of using the service test parameter as a subsequent process for carrying out combination collocation to output the service test case, and the not uploading parameter refers to a process of not using the service test parameter as a subsequent process for carrying out combination collocation to output the service test case.
In this embodiment, when the parameter types include two parameter types, that is, a necessary parameter and a non-necessary parameter, the first type is implemented as a non-necessary parameter, and the second type is implemented as a necessary parameter, or the first type is implemented as a necessary parameter, and the second type is implemented as a non-necessary parameter.
In another possible case, the parameter types include a critical parameter and a non-critical parameter, where the critical parameter refers to a parameter that affects an execution result corresponding to the service system executing the test service, for example: the trigger condition parameter affects the execution result of the test service executed by the service system, when the trigger condition parameter is greater than a certain value, the service system can execute the test service only when the opening meets the condition that the trigger condition parameter is greater than a certain value, and when the trigger condition parameter is less than a certain value, the service system can execute the test service only when the opening meets the condition that the trigger condition parameter is less than a certain value, so that the trigger condition parameter belongs to a key parameter.
The non-critical parameters refer to parameters that do not affect the execution result corresponding to the execution of the test service by the service system, for example: the position set parameter is only used for representing the exchange identifier of the current resource exchange, so that whether the position set parameter exists or not does not affect the execution result corresponding to the execution test service of the service system (when the position set parameter belongs to an invalid parameter, the position set parameter is used for outputting an abnormal case parameter, and the following embodiment is described in detail), and therefore, the position set parameter belongs to a non-key parameter.
In this embodiment, when the parameter types include two parameter types, i.e., a critical parameter and a non-critical parameter, the first type is implemented as the non-critical parameter, and the second type is implemented as the critical parameter, or the first type is implemented as the critical parameter, and the second type is implemented as the non-critical parameter.
In yet another possible case, the parameter types include an associated parameter and an independent parameter, where the associated parameter refers to a parameter association between at least two service test parameters, for example: for an order exposure risk system, the triggering condition parameter and the triggering variable parameter are a group of related parameters, namely when the triggering condition parameter is more than 100 and the triggering variable parameter is an exposure, at least one exposure with the holding resource quantity of 200 can be constructed through the triggering condition parameter and the triggering variable parameter.
Wherein, the independent parameter refers to that no parameter association exists between any service test parameter, for example: the validation time parameter is an independent parameter.
Illustratively, the essential and non-essential parameters, the critical and non-critical parameters, and the associated and independent parameters belong to three different parameter types, at least one of which is selected for implementation.
In this embodiment, first, parameter type analysis of necessary transmission parameters and unnecessary transmission parameters is performed on a plurality of service test parameters, so as to determine necessary transmission parameters and unnecessary transmission parameters contained in the plurality of service test parameters.
And secondly, carrying out parameter type analysis on the key parameters and the non-key parameters of the service test parameters, and determining the key parameters and the non-key parameters contained in the service test parameters. The key parameters are used for carrying out combination collocation test matching on mapping identifications corresponding to at least two key parameters respectively through the identification test rule function.
Optionally, the above-mentioned parameter classification result corresponding to the service test parameter is used before the service mapping table is determined, and may also be performed after the mapping identifier is obtained by matching. Under the condition that the matching is performed after the mapping identification is obtained, the output parameter classification result is realized as a classification result corresponding to the mapping identification corresponding to each service test parameter.
Step 221, matching the plurality of service testing parameters with the service mapping table to obtain service mapping types corresponding to the plurality of service testing parameters respectively.
Wherein the service mapping type corresponds to at least one mapping identity.
Illustratively, the service mapping type refers to a parameter type corresponding to the service test parameter in the service mapping table.
Optionally, the method for obtaining the service mapping table includes at least one of the following modes:
(1) After the service personnel finishes configuring the test service, generating a service mapping table according to the matching relation between the service test parameters corresponding to the test service configuration test service and the mapping identifiers;
(2) And the service personnel determines the corresponding service test parameters under different service scenes in advance according to different service scenes, so as to generate different service mapping tables under different service scenes, and after the test service is configured, the corresponding service test parameters are acquired according to the service scene corresponding to the test service, and the service mapping table corresponding to the service scene is acquired.
It should be noted that the above-mentioned manner of obtaining the service mapping table is merely an illustrative example, and the embodiment of the present application is not limited thereto.
In this embodiment, a set of positions 300000001 for a test service configured by a service staff, a type of exchange resource is a first type resource, a T0 transaction is initiated, trigger variables are respectively opened, trigger conditions are >100, execution targets are respectively opened, and effective time is 2:00-3:00", the business test parameters include" 300000001 position set "," first type resource "," T0 transaction "," trigger variable is open respectively "," 100"," execution target is open respectively "," 2:00-3:00".
Illustratively, the service mapping table for the resource redemption scenario is shown below.
(1) A-position set
Valid (300000001), invalid (300000004)
(2) B-resource pair
Valid (first type of resource, second type of resource, third type of resource, fourth type of resource), invalid (fifth type of resource)
(3) C-transaction time
Effective (T0, T1, T2), ineffective (T5)
Wherein, T0 represents the transaction time as today, T1 represents the transaction time as tomorrow, and T3 represents the transaction time as postamble.
(4) D-trigger variable
Effective (D1-open each, D2-time, D3-open each on shore, D4-not realizing profit and loss by itself), ineffective (not uploaded)
(5) E-trigger condition
Valid (E1-greater than one value, E2-less than one value, E3-equal to one value), invalid (not uploaded)
(6) F-Enforcement flag is valid (uploaded), invalid (not uploaded)
(7) G-target variable
Effective (G1-open each, G2-open each, open on shore), ineffective (no upload)
(8) H-target value
Valid (one value), invalid (not uploaded)
(9) I-execution time
Valid (greater than the present time), invalid (less than the present time)
(10) J-forced offshore
Valid (Yes, no), invalid (not uploaded)
The letter identifier corresponds to a mapping representation corresponding to the service test parameter, and the letter identifier with numbers (for example, G1) corresponds to a sub-identifier corresponding to a sub-parameter contained in the target service test parameter.
Wherein, invalidation refers to when the service test parameter is in an invalid state, and is used for generating an abnormal test case subsequently.
Wherein, not uploading means that the service test parameter belongs to an unnecessary parameter, and when the service test parameter is not uploaded, the service test parameter belongs to an invalid state.
In this case, the shore refers to a type of resource corresponding to the present area held in the current geographical area when each geographical area corresponds to one type of resource, and thus the shore opening refers to the holding amount of a type of resource corresponding to the present area held in the current geographical area. Offshore refers to the holding capacity of type resources corresponding to the area in other geographic areas.
Optionally, the single service mapping type corresponds to a single mapping identifier (for example, the position set corresponds to the mapping identifier as A); alternatively, a single traffic map type corresponds to multiple map identifications (e.g., the target variable corresponds to multiple map identifications G1, G2).
In this embodiment, taking the service test parameter "2:00-3:00" as an example, after matching with the service mapping table, it is determined that the service mapping type corresponding to the service test parameter is "execution time".
Step 222, obtaining mapping identifiers corresponding to the plurality of service test parameters according to the service mapping types.
Schematically, after the service mapping types corresponding to the service testing parameters are obtained, the mapping identifiers corresponding to the service testing parameters are determined according to the mapping identifiers corresponding to the service mapping types.
In some embodiments, the service invalid identifier is included in the service mapping type. And under the condition that at least one service test parameter corresponds to the service invalid identifier, obtaining an abnormal test case corresponding to the service test parameter.
In this embodiment, the service invalid identifier refers to the "invalid" mentioned above, and if the mapping identifier corresponding to the service test parameter is the service invalid identifier, the abnormal test case corresponding to the service test parameter is output. That is, all the service test cases including the combinations corresponding to the service test parameters belong to the abnormal test cases.
And 231, carrying out combinational logic analysis on a plurality of service test parameters according to the test service to obtain an identification test rule function.
Wherein the identification test rule function comprises a test rule sub-function between at least two business test parameters.
Illustratively, the combinational logic analysis refers to analyzing collocations logic among a plurality of service test parameters according to rule types corresponding to test services, and generating a data function mainly based on mapping identifiers by performing data modeling.
In this embodiment, the identification test rule function consists of n inputs, 1 output, and function calculation logic, for example: y=f (x 1, x2, …, xn), where y represents the output (i.e., the generated business test case), xn represents the input (i.e., the input business test parameters), and f is the identity test rule function.
Schematically, the combinational logic analysis refers to making the combinational collocation between at least two service test parameters conform to the service requirements corresponding to the service scenario.
In this embodiment, after mapping identifiers corresponding to a plurality of service test parameters are obtained, a combination logic analysis is performed on a combination relationship between a plurality of service test parameters according to a test service to analyze the test service, where an analysis process is to convert a combination collocation logic between a plurality of service test parameters into a data relationship between mapping identifiers, for example: mutual exclusion relation, must appear at the same time, represent the value range with judgement mode, for example: greater than, etc.
In this embodiment, a plurality of key parameters are subjected to combinational logic analysis according to the test service, so as to obtain that the data relationship 1 is "D and E cannot occur simultaneously", the data relationship 2 is "D includes 4 types, respectively, D1, D2, D3 and D4", and the data relationship 3 is "E includes 3 types, respectively, E1, E2 and E3". Wherein data relationship 1 is implemented as a rule subfunction and data relationship 2 and data relationship 3 are implemented as a parameter subfunction.
In this embodiment, when there are a plurality of rule sub-functions, the plurality of rule sub-functions are sequentially connected in series according to a specified arrangement order to obtain a rule circulation sub-function, and when there are a plurality of parameter sub-functions, the plurality of parameter sub-functions are sequentially connected in series according to the specified arrangement order to obtain a parameter circulation sub-function. Wherein the regular cyclic subfunction and the parametric cyclic subfunction belong to the test regular subfunction.
The parameter aiming sub-function can be obtained according to a plurality of sub-parameters corresponding to the target service parameters in the process of configuring the test service by service personnel. Referring to fig. 5, a schematic diagram of parameter function analysis provided by an exemplary embodiment of the present application is shown, as shown in fig. 5, currently, service configuration pages 510, 520 and 530 are displayed respectively, wherein a service configuration page 510 includes a target service test parameter 511, the target service test parameter 511 includes four types of sub-parameters, which are respectively opened, time, respectively opened on shore and not realizing profit and loss, a service configuration page 520 includes a target service test parameter 521, the target service test parameter 521 includes three types of sub-parameters, which are respectively >, < and=, a service configuration page 530 includes a target service test parameter 531, and the target service test parameter 531 includes two types of sub-parameters, which are respectively opened and opened on shore. Thus, the parameter subfunctions respectively corresponding to the three target service test parameters are obtained.
And 232, carrying out combination collocation test matching on mapping identifiers corresponding to the service test parameters one by one according to the test rule subfunctions to obtain service test cases corresponding to the parameter combinations.
In this embodiment, after the regular circulation sub-function and the parameter circulation sub-function are obtained, the mapping identifiers corresponding to the plurality of key parameters are combined, matched and tested one by one in a bidirectional nested circulation mode of the regular circulation sub-function and the parameter circulation sub-function, so as to obtain service test cases corresponding to the plurality of parameter combinations.
The parameter combination comprises a combination result between at least two mapping identifications.
Referring to fig. 6 and 7, fig. 6 shows a schematic diagram of a parameter cyclic sub-function according to an exemplary embodiment of the present application, and fig. 7 shows a schematic diagram of a regular cyclic sub-function according to an exemplary embodiment of the present application.
As shown in fig. 6, the current acquisitions C, D, E and F belong to mapping identifiers corresponding to four key parameters respectively, so as to acquire four parameter sub-functions, which are a C parameter combination function, a D parameter combination function, an E parameter combination function, and an F parameter combination function, respectively. Wherein the combining function is to value the parameter corresponding to a plurality of different sub-parameters. The resulting parametric loop sub-functions thus comprise four series of parametric loops including parametric loop 601 (corresponding to the C-parametric combination function), parametric loop 602 (corresponding to the D-parametric combination function), parametric loop 603 (corresponding to the E-parametric combination function) and parametric loop 604 (corresponding to the F-parametric combination function).
As shown in FIG. 7, four rule subfunctions are currently obtained, namely, rule 1"C1 and D2 cannot appear, C1 and D appear at the same time, rule 2" C2 and D4 appear at the same time ", rule 3"E and H appear at the same time "and rule 4" appear at C3, G is yes ". The resulting rule round sub-function thus includes four rule rounds in series, including rule round 701 (corresponding to rule 1), rule round 702 (corresponding to rule 2), rule round 703 (corresponding to rule 3), and rule round 704 (corresponding to rule 4).
In the process of performing combination collocation test matching on mapping identifiers corresponding to a plurality of key parameters one by one through the parameter circulation sub-function 600, a parameter circulation 601, a parameter circulation 602, a parameter circulation 603 and a parameter circulation 604 are sequentially executed, and a first set of examples corresponding to a plurality of parameter combinations is output.
In the process of performing the combination collocation test matching on the mapping identifications corresponding to the key parameters one by one through the regular circulation sub-function 700, the regular circulation 701, the regular circulation 702, the regular circulation 703 and the regular circulation 704 are sequentially executed, and when the circulation rule is satisfied, the regular use case set 705 is output and obtained, and when the circulation rule is not satisfied, the abnormal use case set 706 is output and obtained as the second use case set.
In some embodiments, an ith test rule subfunction is corresponding between an nth service test parameter and an mth service test parameter in the plurality of service test parameters, where i, n and m are positive integers, and the service test cases include abnormal test cases; in the process of carrying out combination collocation test matching on mapping identifiers respectively corresponding to the nth service test parameter and the mth service test parameter according to the ith test rule subfunction, responding to the fact that the ith parameter combination corresponding to the nth service test parameter and the mth service test parameter does not accord with a conventional function result corresponding to the ith test rule subfunction, and obtaining an abnormal test case corresponding to the ith parameter combination. That is, the exception test is for one of the case types belonging to the business test case.
In this embodiment, when the mapping identifier corresponding to the nth service test parameter is C2, the mapping identifier corresponding to the mth service test parameter is D4, the ith test rule sub-function is that rules 2"C2 and D4 appear simultaneously" (appear simultaneously as a conventional function result), and when C2 and D4 do not appear simultaneously, it is indicated that the ith parameter combination corresponding to the nth service test parameter and the mth service test parameter does not conform to the conventional function result corresponding to the ith test rule sub-function, and then an abnormal test case corresponding to the ith parameter combination is generated.
After the first case set and the second case set are obtained, the same service test case in the first case set and the second case set is subjected to deduplication to obtain a deduplicated service test case, and in the embodiment, the deduplicated service test case is taken as a basic case set (service test case). In addition, when the service test parameter belongs to the invalid state, the output abnormal test case is used as an abnormal case set. That is, the base case set and the full-volume case set do not include abnormal test cases.
Illustratively, the business test cases appear as follows:
first use case: groupID, A, B, C1, C1, D1, E, F, G, time, yes;
second use case: groupID, A, B, C1, C1, D1, E, F, G, time, no;
third use case: groupID, A, B, C1, C1, D2, E, F, G, time, no.
Where GroupID represents a queue identification code and Time represents the current use case generation Time.
In some embodiments, matching a plurality of mapping identifiers in the service test case with the service mapping table to obtain at least one service restoration parameter corresponding to the plurality of mapping identifiers respectively; and acquiring the total test cases among the plurality of restoring combinations based on at least one service restoring parameter, wherein the plurality of restoring combinations and the plurality of test combinations have combination corresponding relations.
In this embodiment, after a plurality of service test cases are obtained, for each service test case, a plurality of mapping identifiers and service mapping tables included in each service test case are re-matched, so as to obtain at least one service restoration parameter corresponding to the mapping identifier, where the service restoration parameter and the service test are the same or may be different. For example: and when the mapping identifiers in the service test case a are B and G1, re-matching the B and G1 with the service mapping table to obtain four service restoration parameters corresponding to the mapping identifier B, and obtaining one service restoration parameter corresponding to the G1, so that four full test cases are generated according to the restoration combination relation between the four service restoration parameters corresponding to the mapping identifier B and the one service restoration parameter corresponding to the G1. And acquiring a plurality of full test cases corresponding to all the service test cases according to the method.
Referring to fig. 7, after the basic use case set is obtained, the corresponding full use case set is obtained through the mapping table, and the basic use case set, the full use case set and the abnormal use case set are finally output.
Referring to fig. 8, a schematic diagram of a method for obtaining a full-volume case set according to an exemplary embodiment of the present application is shown, as shown in fig. 8, after a basic case set 810 (service test case) is obtained according to the rule sub-functions and the parameter sub-functions, a full-volume case set 830 is obtained by re-matching according to a mapping table 820, and finally, the basic case set 810 and the full-volume case set 830 are output.
That is, the present application refines the test traffic into a pattern of input (traffic test parameters) +rule (identification test rule function) =output (traffic test case). By refining the input service test parameters into the corresponding mapping identifications, the combination logic analysis is carried out on the plurality of service test parameters, so that the service test cases are automatically output, and the test accuracy and the test working efficiency are improved.
Next, a process of generating the service test case will be described.
(1) Demand escape
Schematically, after the test service is obtained, a plurality of service test parameters corresponding to the test service are obtained, and the service test parameters are matched with the service mapping table to obtain mapping identifiers corresponding to the service test parameters respectively.
After the mapping identifiers corresponding to the service test parameters are analyzed according to the test service, the 8 necessary transmission parameters (A, B, C, D, E, F, G, H) and the 2 unnecessary transmission parameters (I, J) are determined.
(2) Parameter analysis
By performing parameter type analysis on a plurality of service test parameters, A, B, C, F is a non-critical parameter, and D, E, G, J is a critical parameter.
(3) Rule parsing
Quan Canshu
D and E cannot occur simultaneously
D has four seed identifiers, D1, D2, D3 and D4 respectively
E has three seed identifiers, E1, E2 and E3 respectively
(4) Generating use cases
And generating a service test case through the rule subfunction and the parameter subfunction according to the key parameters.
In summary, in the service system testing method provided by the embodiment of the present application, after a plurality of service testing parameters corresponding to a test service are obtained in the process of testing a service system, the plurality of service testing parameters are matched with a preset service mapping table to obtain mapping identifiers corresponding to the plurality of service testing parameters, so that a combination matching test is performed on mapping representations corresponding to the plurality of service testing parameters respectively through an identifier test rule function configured by the service system, and a service test case corresponding to a plurality of parameter combinations is automatically generated. That is, after setting a service scenario, the service test parameters in the service scenario are converted into corresponding mapping identifications through the service mapping table corresponding to the service scenario, and the combination matching test matching is performed on a plurality of mapping identifications according to the identification test rule function generated by the combination matching logic between the service scenario determination mapping identifications, so that the service test cases corresponding to the parameter combinations generated by different combination matching are automatically output, and after setting a service scenario, the service test cases in a plurality of service scenarios under different conditions are automatically output, thereby not only realizing the automation of test case output, but also enabling the output test cases to cover all service scenarios, and improving the accuracy and the working efficiency of system test.
In this embodiment, the test service performs a combinational logic analysis on the service test parameters to obtain the identification test rule function, so that a combination matching test matching is performed on a plurality of service test parameters through the identification test rule function, and full scene coverage can be realized through combinational logic, thereby improving the comprehensiveness and rationality of the test scene.
In the embodiment, the abnormal test cases are output under the condition that the two business test parameters do not accord with the test rule subfunction, so that the automatic output of the abnormal test cases can be realized, and the output efficiency and the comprehensiveness of the cases are improved.
In this embodiment, the parameter type analysis is performed on the multiple service test parameters, so that the combination, collocation, test and matching can be performed according to the service test parameters of different types, and the use case output efficiency is improved.
In this embodiment, by matching a plurality of service test parameters with the service mapping table, the service mapping type is obtained first, so that the mapping identifier is obtained according to the service mapping type, and the accuracy of obtaining the mapping identifier can be improved.
In this embodiment, when the service test parameter corresponds to the service invalid identifier, the process of directly outputting the abnormal test case can improve the output efficiency of the case.
In the embodiment, the service mapping table is used for restoring the service test cases into the full test cases, so that all the cases can be ensured to be covered, and the accuracy and the comprehensiveness of the system test are improved.
Referring to fig. 9, a schematic diagram of a service system testing method according to an exemplary embodiment of the present application is shown, and as shown in fig. 9, a currently executing process includes four process implementations of scene setting 910, data construction 920, request calling 930, and result checking 940. The method is used for the resource exchange scene for illustration.
In the scenario setup 910, the scenario where testing is needed is first clarified, i.e. a service person may manually configure a test service for testing the service system. In this embodiment, for the order exposure risk system, a resource exchange service is first configured, where the service system automatically sells all the first type resources when the resource holding capacity of the first type resources is greater than 100, so that the scope of execution targets is determined after the resource exchange service. The resource exchange service refers to a service automatically executed by a service system.
In the data construction 920, since the resource exchange service is currently under a test scenario, an opening for automatically executing the service system is constructed according to the execution label range in the resource exchange service after the resource exchange service is acquired, and in this embodiment, an opening (which may be 150 or 200) with a resource holding amount of at least one first type of resource greater than 100 is constructed, so as to ensure that the service system can automatically execute the resource exchange service.
In the request call 930, the service system sequentially completes a new identifier test rule function (also referred to as a new rule set), a new rule sub-function and a parameter sub-function (also referred to as a new rule), a startup rule sub-function and a parameter sub-function (also referred to as a startup rule), a startup identifier test rule function (also referred to as a startup rule set), acquires a current rule circulation sub-function/parameter circulation sub-function (also referred to as acquiring a current rule set), and a trigger message (used for triggering the service system to automatically generate a service test case in the circulation process), thereby outputting a basic case set corresponding to a plurality of parameter combinations.
In the result checking 940, after the service system executes the resource exchange service to output the execution result, a checking program compiled in advance is used to detect a state machine corresponding to the service system, so as to identify whether the current execution result belongs to at least one of executed/execution failure/execution success, and as a check on the execution state, a check is performed on a bill corresponding to the resource exchange service, and the execution result is checked.
In this embodiment, the above process is applicable to both the development environment of the service system and the testing environment of the service system. Referring to fig. 10, a flowchart of a service system testing method according to an exemplary embodiment of the present application is shown, as shown in fig. 10, a plurality of service test parameter sets 1010 corresponding to a test service are currently obtained as input, mapping identifiers corresponding to the plurality of service test parameters are obtained after parameter escaping 1020 is performed on the plurality of service test parameters according to a service mapping table, and combinational logic between the plurality of mapping identifiers is obtained through the test service, so that a rule loop 1030 is performed on the mapping identifiers corresponding to the plurality of service test functions by using an identifier test rule function is generated, so as to generate a de-duplicated basic use case set 1050, rule mapping 1040 is performed on the basic use case set through the service mapping table, a full use case set 1060 is generated, and furthermore, an abnormal use case set 1070 is output according to the condition that the service test parameters are in an invalid state.
Next, an architecture of the corresponding service system implemented as an order exposure risk system in this embodiment will be described. Referring to fig. 11, a schematic system architecture diagram provided by an exemplary embodiment of the present application is shown in fig. 11, where an order exposure risk system architecture diagram 1100 is currently shown, and includes five layers of architecture, namely an interaction layer 1110, a business logic layer 1120, a data logic layer 1130, a general layer 1140 and a storage layer 1150.
The interaction layer 1110 includes a use case execution module and a use case result module; the business logic layer 1120 includes an open construction module, a rule set construction module, a rule and rule set starting module, a protocol request module and a result judging module; the data logic layer 1130 includes a position header management module, a rule management module, a mapping relation management module, a data processing management module and an exception processing management module; the general layer 1140 includes an encryption/decryption module, a date module, a login module, a log module, and a protocol communication module, and the storage layer 1150 includes a database 1 (Mysql database) and a database 2 (Redis, integrated service group).
In addition, the order exposure risk system has external dependencies including test frameworks, memory, exchange rate data and rights systems. The order exposure risk system supports a development environment and a testing environment.
In the application process, an automation program carried in a business system accesses an integrated service group through a domain name, the integrated service group inquires current balance information, after an opening to be reconciled is calculated, the integrated service group issues a redis message, and after the automatic execution resource exchange service in the business system receives the message, the construction of the opening is completed.
In summary, in the service system testing method provided by the embodiment of the present application, after a plurality of service testing parameters corresponding to a test service are obtained in the process of testing a service system, the plurality of service testing parameters are matched with a preset service mapping table to obtain mapping identifiers corresponding to the plurality of service testing parameters, so that a combination matching test is performed on mapping representations corresponding to the plurality of service testing parameters respectively through an identifier test rule function configured by the service system, and a service test case corresponding to a plurality of parameter combinations is automatically generated. That is, after setting a service scenario, the service test parameters in the service scenario are converted into corresponding mapping identifications through the service mapping table corresponding to the service scenario, and the combination matching test matching is performed on a plurality of mapping identifications according to the identification test rule function generated by the combination matching logic between the service scenario determination mapping identifications, so that the service test cases corresponding to the parameter combinations generated by different combination matching are automatically output, and after setting a service scenario, the service test cases in a plurality of service scenarios under different conditions are automatically output, thereby not only realizing the automation of test case output, but also enabling the output test cases to cover all service scenarios, and improving the accuracy and the working efficiency of system test.
The application has the following beneficial effects:
1) The modeling thought can cover all business scenes, and the business scenes cannot be omitted after duplicate removal;
2) The use case is automatically generated, so that the accuracy and convenience of the use case are improved to a great extent, and the working efficiency is improved;
3) After the requirement is cleared, testers reduce the understanding capability of the service and quickly get up;
4) And outputting abnormal cases, and flexibly meeting the dimension of each test content.
Fig. 12 is a block diagram of a service system testing apparatus according to an exemplary embodiment of the present application, and as shown in fig. 12, the apparatus includes:
an obtaining module 1210, configured to obtain a plurality of service test parameters corresponding to a test service, where at least one target service parameter existing in the plurality of service test parameters includes a plurality of service sub-parameters, where the plurality of service test parameters are used to indicate conditions that a service system needs to conform to when executing the test service;
the matching module 1220 is configured to match the plurality of service test parameters with a service mapping table to obtain mapping identifiers corresponding to the plurality of service test parameters, where the mapping identifiers corresponding to the target service parameters include sub-identifiers corresponding to a plurality of service sub-parameters, and the service mapping table includes a preset matching relationship between the parameters and the mapping identifiers;
The matching module 1220 is further configured to perform a combination matching test on the mapping identifiers corresponding to the plurality of service test parameters respectively through an identifier test rule function configured by the service system, so as to obtain service test cases corresponding to a plurality of parameter combinations, where the service test cases are used to characterize service operation capability of the service system, and the service system is in a service execution valid state when the service operation capability indicates that the service system meets a service operation requirement, where the identifier test rule function is a logic function that is preconfigured in the service system and performs combination matching on the plurality of service test parameters according to the test service.
In some embodiments, as shown in fig. 13, the matching module 1220 includes:
an analysis unit 1221, configured to perform a combinational logic analysis on the plurality of service test parameters according to the test service, to obtain the identifier test rule function, where the identifier test rule function includes a test rule subfunction between at least two service test parameters;
and the matching unit 1222 is used for carrying out combination collocation test matching on the mapping identifiers corresponding to the service test parameters respectively one by one according to the plurality of test rule subfunctions to obtain the service test cases corresponding to the plurality of parameter combinations.
In some embodiments, an ith test rule subfunction is corresponding between an nth service test parameter and an mth service test parameter in the plurality of service test parameters, where i, n and m are positive integers, and the service test cases include abnormal test cases;
the matching unit 1222 is further configured to, in a process of performing a combination matching test matching on mapping identifiers corresponding to the nth service test parameter and the mth service test parameter according to the ith test rule subfunction, obtain an abnormal test case corresponding to the ith parameter combination in response to that the ith parameter combination corresponding to the nth service test parameter and the mth service test parameter does not conform to a conventional function result corresponding to the ith test rule subfunction.
In some embodiments, the apparatus further comprises:
the analysis module 1230 is configured to perform parameter type analysis on the multiple service test parameters to obtain a parameter classification result corresponding to the multiple service test parameters, where the parameter classification result includes a first type of service test parameter and a second type of service test parameter, where the first type and the second type indicate different service test influence conditions, and the service test influence conditions refer to output influences of the service test parameters on the service system when executing the test service.
In some embodiments, the matching module 1220 is further configured to match the plurality of service test parameters with a service mapping table, and obtain service mapping types corresponding to the plurality of service test parameters, where the service mapping types correspond to at least one mapping identifier; and obtaining mapping identifiers corresponding to the service test parameters respectively according to the service mapping types.
In some embodiments, the matching module 1220 is further configured to match the plurality of service test parameters with a service mapping table, and obtain service mapping types corresponding to the plurality of service test parameters, where the service mapping types correspond to at least one mapping identifier; and obtaining mapping identifiers corresponding to the service test parameters respectively according to the service mapping types.
In some embodiments, the service mapping type includes a service invalidation identifier;
the obtaining module 1210 is further configured to obtain an abnormal test case corresponding to the service test parameter under the condition that at least one service test parameter corresponds to a service invalid identifier.
In some embodiments, the matching module 1220 is further configured to match a plurality of mapping identifiers in the service test case with the service mapping table, and obtain at least one service restoration parameter corresponding to each of the plurality of mapping identifiers;
The obtaining module 1210 is further configured to obtain a total number of test cases between a plurality of restoration combinations based on the at least one service restoration parameter, where the plurality of restoration combinations and the plurality of test combinations have a combination correspondence.
In summary, in the service system testing device provided by the embodiment of the present application, after a plurality of service testing parameters corresponding to a test service are obtained in a process of testing a service system, the plurality of service testing parameters are matched with a preset service mapping table to obtain mapping identifiers corresponding to the plurality of service testing parameters, so that a combination matching test is performed on mapping representations corresponding to the plurality of service testing parameters respectively through an identifier test rule function configured by the service system, and a service test case corresponding to a plurality of parameter combinations is automatically generated. That is, after setting a service scenario, the service test parameters in the service scenario are converted into corresponding mapping identifications through the service mapping table corresponding to the service scenario, and the combination matching test matching is performed on a plurality of mapping identifications according to the identification test rule function generated by the combination matching logic between the service scenario determination mapping identifications, so that the service test cases corresponding to the parameter combinations generated by different combination matching are automatically output, and after setting a service scenario, the service test cases in a plurality of service scenarios under different conditions are automatically output, thereby not only realizing the automation of test case output, but also enabling the output test cases to cover all service scenarios, and improving the accuracy and the working efficiency of system test.
It should be noted that: in the service system testing device provided in the above embodiment, only the division of the above functional modules is used for illustration, and in practical application, the above functional allocation may be performed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the service system testing device and the service system testing method provided in the foregoing embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments, which are not repeated herein.
Fig. 14 is a schematic diagram showing a structure of a server according to an exemplary embodiment of the present application. Specifically, the following is said:
the server 1400 includes a central processing unit (Central Processing Unit, CPU) 1401, a system Memory 1404 including a random access Memory (Random Access Memory, RAM) 1402 and a Read Only Memory (ROM) 1403, and a system bus 1405 connecting the system Memory 1404 and the central processing unit 1401. The server 1400 also includes a mass storage device 1406 for storing an operating system 1413, application programs 1414, and other program modules 1415.
The mass storage device 1406 is connected to the central processing unit 1401 through a mass storage controller (not shown) connected to the system bus 1405. The mass storage device 1406 and its associated computer-readable media provide non-volatile storage for the server 1400. That is, the mass storage device 1406 may include a computer readable medium (not shown) such as a hard disk or compact disc read only memory (Compact Disc Read Only Memory, CD-ROM) drive.
Computer readable media may include computer storage media and communication media without loss of generality. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes RAM, ROM, erasable programmable read-only memory (Erasable Programmable Read Only Memory, EPROM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read Only Memory, EEPROM), flash memory or other solid state memory technology, CD-ROM, digital versatile disks (Digital Versatile Disc, DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices. Of course, those skilled in the art will recognize that computer storage media are not limited to the ones described above. The system memory 1404 and mass storage device 1406 described above may be collectively referred to as memory.
According to various embodiments of the application, the server 1400 may also operate by a remote computer connected to the network through a network, such as the Internet. That is, the server 1400 may be connected to the network 1412 through a network interface unit 1411 connected to the system bus 1145, or the network interface unit 1411 may be used to connect to other types of networks or remote computer systems (not shown).
The memory also includes one or more programs, one or more programs stored in the memory and configured to be executed by the CPU.
The embodiment of the application also provides a computer device, which comprises a processor and a memory, wherein at least one instruction, at least one section of program, code set or instruction set is stored in the memory, and the at least one instruction, the at least one section of program, the code set or instruction set is loaded and executed by the processor to realize the service system testing method provided by the above method embodiments.
Embodiments of the present application further provide a computer readable storage medium having at least one instruction, at least one program, a code set, or an instruction set stored thereon, where the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by a processor to implement the service system testing method provided by the foregoing method embodiments.
Embodiments of the present application also provide a computer program product, or computer program, comprising computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the business system testing method of any of the above embodiments.
Alternatively, the computer-readable storage medium may include: read Only Memory (ROM), random access Memory (RAM, random Access Memory), solid state disk (SSD, solid State Drives), or optical disk, etc. The random access memory may include resistive random access memory (ReRAM, resistance Random Access Memory) and dynamic random access memory (DRAM, dynamic Random Access Memory), among others. The foregoing embodiment numbers of the present application are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program for instructing relevant hardware, where the program may be stored in a computer readable storage medium, and the storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The foregoing description of the preferred embodiments of the present application is not intended to limit the application, but rather, the application is to be construed as limited to the appended claims.

Claims (11)

1. A business system testing method, the method comprising:
acquiring a plurality of service test parameters corresponding to a test service, wherein at least one target service parameter in the plurality of service test parameters comprises a plurality of service sub-parameters, and the plurality of service test parameters are used for indicating conditions which a service system needs to conform to when executing the test service;
matching the plurality of service test parameters with a service mapping table to obtain mapping identifiers corresponding to the plurality of service test parameters respectively, wherein the mapping identifiers corresponding to the target service parameters comprise sub-identifiers corresponding to the plurality of service sub-parameters respectively, and the service mapping table comprises a preset matching relationship between the parameters and the mapping identifiers;
the mapping identifications corresponding to the service test parameters are combined, matched and tested through the identification test rule function configured by the service system to obtain service test cases corresponding to the parameter combinations, wherein the service test cases are used for representing service operation capacity of the service system, and the service system is in a service execution effective state under the condition that the service operation capacity indicates that the service system meets service operation requirements, and the identification test rule function is a logic function which is pre-configured in the service system and is used for combining and matching the service test parameters according to the test service.
2. The method of claim 1, wherein the performing, by the identifier test rule function configured by the service system, a combination collocation test matching on the mapping identifiers corresponding to the plurality of service test parameters respectively to obtain service test cases corresponding to a plurality of parameter combinations includes:
performing combinational logic analysis on the plurality of service test parameters according to the test service to obtain the identification test rule function, wherein the identification test rule function comprises a test rule sub-function between at least two service test parameters;
and carrying out combination collocation test matching on the mapping identifiers respectively corresponding to the plurality of service test parameters according to a plurality of test rule subfunctions to obtain the service test cases corresponding to the plurality of parameter combinations.
3. The method of claim 2, wherein an ith test rule subfunction corresponds between an nth service test parameter and an mth service test parameter in the plurality of service test parameters, wherein i, n and m are positive integers, and the service test cases include abnormal test cases;
the step of carrying out combination collocation test matching on the mapping identifiers respectively corresponding to the plurality of service test parameters according to a plurality of test rule subfunctions to obtain the service test cases corresponding to the plurality of parameter combinations, comprising the following steps:
In the process of carrying out combination collocation test matching on mapping identifications respectively corresponding to an nth service test parameter and an mth service test parameter according to an ith test rule subfunction, responding to the fact that an ith parameter combination corresponding to the nth service test parameter and the mth service test parameter does not accord with a conventional function result corresponding to the ith test rule subfunction, and obtaining an abnormal test case corresponding to the ith parameter combination.
4. A method according to any one of claims 1 to 3, wherein after the obtaining the service test parameters corresponding to the test service, the method further comprises:
and carrying out parameter type analysis on the service test parameters to obtain parameter classification results corresponding to the service test parameters, wherein the parameter classification results comprise a first type of service test parameters and a second type of service test parameters, the first type and the second type respectively indicate different service test influence conditions, and the service test influence conditions refer to output influence of the service test parameters on the service system when executing the test service.
5. A method according to any one of claims 1 to 3, wherein the matching the plurality of service test parameters with a service mapping table to obtain mapping identifiers corresponding to the plurality of service test parameters respectively includes:
Matching the service test parameters with a service mapping table to obtain service mapping types corresponding to the service test parameters respectively, wherein the service mapping types correspond to at least one mapping identifier;
and obtaining mapping identifiers corresponding to the service test parameters respectively according to the service mapping types.
6. The method of claim 5, wherein the service mapping type includes a service invalidation identifier;
the method further comprises the steps of:
and under the condition that at least one service test parameter corresponds to a service invalid identifier, obtaining an abnormal test case corresponding to the service test parameter.
7. A method according to any one of claims 1 to 3, wherein the method further comprises:
matching a plurality of mapping identifiers in the service test case with the service mapping table to obtain at least one service restoration parameter respectively corresponding to the plurality of mapping identifiers;
and acquiring the total test cases among a plurality of restoring combinations based on the at least one service restoring parameter, wherein the plurality of restoring combinations and the plurality of test combinations have combination corresponding relations.
8. A business system testing apparatus, said apparatus comprising:
The system comprises an acquisition module, a test module and a control module, wherein the acquisition module is used for acquiring a plurality of service test parameters corresponding to a test service, at least one target service parameter in the plurality of service test parameters comprises a plurality of service subparameters, and the plurality of service test parameters are used for indicating conditions which a service system needs to conform to when executing the test service;
the matching module is used for matching the plurality of service test parameters with a service mapping table to obtain mapping identifiers corresponding to the plurality of service test parameters respectively, wherein the mapping identifiers corresponding to the target service parameters comprise sub identifiers corresponding to a plurality of service sub parameters respectively, and the service mapping table comprises a preset matching relationship between the parameters and the mapping identifiers;
the matching module is further configured to perform combination matching test matching on mapping identifiers corresponding to the service test parameters respectively through an identifier test rule function configured by the service system, so as to obtain service test cases corresponding to a plurality of parameter combinations, where the service test cases are used for representing service operation capability of the service system, and the service system is in a service execution valid state under the condition that the service operation capability indicates that the service system meets service operation requirements, where the identifier test rule function is a logic function that is pre-configured in the service system and performs combination matching on the service test parameters according to the test service.
9. A computer device comprising a processor and a memory, wherein the memory has stored therein at least one program that is loaded and executed by the processor to implement the business system testing method of any of claims 1 to 7.
10. A computer readable storage medium, wherein at least one program is stored in the storage medium, and the at least one program is loaded and executed by a processor to implement the service system testing method according to any one of claims 1 to 7.
11. A computer program product comprising a computer program which, when executed by a processor, implements the business system testing method of any of claims 1 to 7.
CN202310374276.5A 2023-04-04 2023-04-04 Service system testing method, device, equipment, storage medium and product Pending CN116955148A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310374276.5A CN116955148A (en) 2023-04-04 2023-04-04 Service system testing method, device, equipment, storage medium and product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310374276.5A CN116955148A (en) 2023-04-04 2023-04-04 Service system testing method, device, equipment, storage medium and product

Publications (1)

Publication Number Publication Date
CN116955148A true CN116955148A (en) 2023-10-27

Family

ID=88450103

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310374276.5A Pending CN116955148A (en) 2023-04-04 2023-04-04 Service system testing method, device, equipment, storage medium and product

Country Status (1)

Country Link
CN (1) CN116955148A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117573566A (en) * 2024-01-16 2024-02-20 麒麟软件有限公司 Multi-system test case generation method, device and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117573566A (en) * 2024-01-16 2024-02-20 麒麟软件有限公司 Multi-system test case generation method, device and storage medium
CN117573566B (en) * 2024-01-16 2024-04-12 麒麟软件有限公司 Multi-system test case generation method, device and storage medium

Similar Documents

Publication Publication Date Title
US20170003948A1 (en) Continuous deployment success prediction
US11295247B2 (en) Discovery and generation of organizational key performance indicators utilizing glossary repositories
CN106487603B (en) Response testing method and device
CN109409836A (en) Data application processing method and device, electronic equipment, storage medium
CN110060139B (en) Accounting processing method and device
US11972382B2 (en) Root cause identification and analysis
CN112559635B (en) Service processing method, device, equipment and medium for Ethernet alliance chain node
CN109284321A (en) Data load method, calculates equipment and computer readable storage medium at device
CN116955148A (en) Service system testing method, device, equipment, storage medium and product
CN114564374A (en) Operator performance evaluation method and device, electronic equipment and storage medium
US9740601B2 (en) Globalization testing management service configuration
CN111582649B (en) Risk assessment method and device based on user APP single-heat coding and electronic equipment
CN112561690A (en) Method, system, equipment and storage medium for testing credit card staging service interface
CN112433936A (en) Test method, test device and storage medium
CN116974874A (en) Database testing method and device, electronic equipment and readable storage medium
CN109669829A (en) A kind of diagnosis adjustment method, device and server based on BMC
CN110971478A (en) Pressure measurement method and device for cloud platform service performance and computing equipment
CN110363394B (en) Wind control service method and device based on cloud platform and electronic equipment
CN110348984B (en) Automatic credit card data input method and related equipment under different transaction channels
CN109992614B (en) Data acquisition method, device and server
US20080195453A1 (en) Organisational Representational System
CN111258879A (en) Service test scheduling method and device based on page acquisition and intelligent terminal
CN112799956B (en) Asset identification capability test method, device and system device
CN111813694B (en) Test method, test device, electronic equipment and readable storage medium
US20230325871A1 (en) Subgroup analysis in a/b testing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication