CN114048136A

CN114048136A - Test type determination method, device, server, medium and product

Info

Publication number: CN114048136A
Application number: CN202111355397.2A
Authority: CN
Inventors: 李婷姝
Original assignee: Bank of China Ltd
Current assignee: Bank of China Ltd
Priority date: 2021-11-16
Filing date: 2021-11-16
Publication date: 2022-02-15

Abstract

The application discloses a test type determination method, a test type determination device, a test type determination server, a test type determination medium and a test type determination product, which can be applied to the financial field or other fields. Obtaining a second number of tuples in advance, each tuple including sample information corresponding to a plurality of sample products, respectively, the sample information of the sample products including: the development period, the transaction type contained in the sample product, the number of servers with data interaction with the sample product, the test type suitable for the sample product and the error problem generated in the test process by the test type; and for the product to be tested, obtaining a first number of nearest neighbor tuples from the second number of tuples, wherein the first number of nearest neighbor tuples are tuples closest to the product information of the product to be tested in the second number of tuples, and determining the test type corresponding to the first number of nearest neighbor tuples as the target test type suitable for the product to be tested. Therefore, the purpose of determining the target test type suitable for the product to be tested is achieved.

Description

Test type determination method, device, server, medium and product

Technical Field

The present application relates to the field of testing technologies, and in particular, to a method, an apparatus, a server, a medium, and a product for determining a test type.

Background

Developed products, such as applications, need to be tested before being released to the public, for example to test whether the performance or functionality of the product is satisfactory. The test types include: unit test type, assembly test type, function test type and automation test type.

At present, because it cannot be determined which test type a product is suitable for, each test type is generally applied to the product, and which test type has the most error problems, the test type is suitable for the product. The test time is long because each test type needs to be applied to a product to obtain a test type suitable for the product.

In conclusion, how to determine which test type the product is suitable for is an urgent problem to be solved by those skilled in the art.

Disclosure of Invention

In view of the above, the present application provides a method, an apparatus, a server, a medium, and a product for determining a test type.

In order to achieve the above purpose, the present application provides the following technical solutions:

according to a first aspect of the embodiments of the present disclosure, there is provided a test type determining method, including:

acquiring product information of a product to be detected, wherein the product information comprises: the development period, the transaction type contained in the product to be tested, the number of servers with data interaction with the product to be tested and the servers with data interaction with the product to be tested;

obtaining a first priority queue, where the first priority queue includes a first number of nearest neighbor tuples, the first number of nearest neighbor tuples is the first number of tuples arbitrarily selected from a second number of tuples obtained through pre-training, each tuple includes sample information corresponding to a plurality of sample products, and the sample information of the sample products includes: development period, transaction type contained in the sample product, number of servers having data interaction with the sample product, test type suitable for the sample product, error problem generated in the test process by the test type;

calculating first distances between the product information and the nearest neighbor tuples respectively;

screening unselected target tuples from the second number of tuples;

calculating a second distance between the product information and the target tuple;

comparing the second distance with a first distance corresponding to the sample information of each sample product stored in the first priority queue;

if a first distance greater than the second distance exists, deleting a target nearest neighbor tuple in the first priority queue, wherein the target nearest neighbor tuple is a nearest neighbor tuple corresponding to the largest first distance in the first distances greater than the second distance;

storing the target tuples into the first priority queue as nearest neighbor tuples, and returning to the step of screening unselected target tuples from the second number of tuples until the second number of tuples are all selected;

if the first distance larger than the second distance does not exist, returning to the step of screening the unselected target tuples from the second number of tuples until the second number of tuples are all selected;

dividing nearest neighbor tuples corresponding to the same test type in the first number of nearest neighbor tuples stored in the first priority queue into the same tuple set;

obtaining a target tuple set containing the most nearest neighbor tuples from the tuple set;

and determining the test type corresponding to the target element set as a target test type suitable for the product to be tested.

With reference to the first aspect, in a first possible implementation manner, the method for obtaining the second number of tuples includes:

determining a plurality of setting parameters, and executing the following operations for each setting parameter:

determining each sample product in the plurality of sample products as a sample product to be tested, and performing the following operations:

obtaining a second priority queue, wherein the second priority queue comprises sample information of a set parameter number of sample products, and the set parameter number of sample products are the set parameter number of sample products arbitrarily selected from a plurality of sample products;

calculating a third distance between the sample information of the sample product to be detected and the sample information of the set parameter sample products contained in the second priority queue;

screening sample information of unselected target sample products from the plurality of sample products;

calculating a fourth distance between the sample information of the sample product to be detected and the sample information of the target sample product;

comparing the fourth distance with a third distance corresponding to the sample information of each sample product stored in a second priority queue;

if a third distance greater than the fourth distance exists, replacing the sample information of the sample product corresponding to the largest third distance in the third distances greater than the fourth distance with the sample information of the target sample product, and returning to the step of screening the sample information of the target sample product which is not selected from the plurality of sample products until the plurality of sample products are all selected;

if the third distance which is larger than the fourth distance does not exist, returning to the step of screening the sample information of the unselected target sample products from the plurality of sample products until the plurality of sample products are all selected;

determining that the sample information of the sample product to be tested and the sample information of the sample products with set parameters stored in the second priority queue belong to the same tuple to obtain a plurality of tuples;

dividing the sample information of the sample products stored in the second priority queue, which contains the sample information of the same test type, into the same sample set;

obtaining a target sample set containing the most sample information from the sample set;

determining the test type corresponding to the target sample set as the test type of the tuple to obtain the test types corresponding to the multiple tuples respectively;

obtaining error rates corresponding to the set parameters based on the test types corresponding to the tuples and the test types corresponding to the sample products contained in the tuples so as to obtain the error rates corresponding to the set parameters;

determining a set parameter corresponding to the minimum error rate as a target set parameter from the error rates corresponding to the plurality of set parameters respectively;

and under the target setting parameters, determining the obtained multiple tuples as the second number of tuples.

With reference to the first aspect, in a second possible implementation manner, the method further includes:

obtaining a test case belonging to the target test type;

and testing the product to be tested through the test case belonging to the target test type.

According to a second aspect of the embodiments of the present disclosure, there is provided a test type determination apparatus including:

the first acquisition module is used for acquiring product information of a product to be detected, wherein the product information comprises: the development period, the transaction type contained in the product to be tested, the number of servers with data interaction with the product to be tested and the servers with data interaction with the product to be tested;

a second obtaining module, configured to obtain a first priority queue, where the first priority queue includes a first number of nearest neighbor tuples, the first number of nearest neighbor tuples is the first number of tuples arbitrarily selected from a second number of tuples obtained through pre-training, each tuple includes sample information corresponding to a plurality of sample products, and the sample information of the sample products includes: development period, transaction type contained in the sample product, number of servers having data interaction with the sample product, test type suitable for the sample product, error problem generated in the test process by the test type;

the first calculation module is used for calculating first distances between the product information and the nearest neighbor tuples respectively;

the first screening module is used for screening the unselected target tuples from the second number of tuples;

a second calculation module for calculating a second distance between the product information and the target tuple;

the first comparison module is used for comparing the second distance with a first distance corresponding to the sample information of each sample product stored in the first priority queue;

a first deleting module, configured to delete a target nearest neighbor tuple in the first priority queue if a first distance greater than the second distance exists, where the target nearest neighbor tuple is a nearest neighbor tuple corresponding to a largest first distance in the first distances greater than the second distance;

the first returning module is used for storing the target tuples into the first priority queue as nearest neighbor tuples, and returning to the step of screening unselected target tuples from the second number of tuples until the second number of tuples are all selected;

a second returning module, configured to, if there is no first distance greater than the second distance, return to the step of screening unselected target tuples from the second number of tuples until the second number of tuples are all selected;

the first dividing module is used for dividing nearest neighbor tuples, corresponding to the same test type, in the first number of nearest neighbor tuples stored in the first priority queue into the same tuple set;

the third acquisition module is used for acquiring a target tuple set containing the most nearest neighbor tuples from the tuple set;

and the first determining module is used for determining that the test type corresponding to the target element set is the test type suitable for the product to be tested.

With reference to the second aspect, in a first possible implementation manner, the method further includes:

a second determining module, configured to determine a plurality of setting parameters, for each of which the following operations are performed:

a fourth obtaining module, configured to obtain a second priority queue, where the second priority queue includes sample information of a set parameter number of sample products, and the set parameter number of sample products is the set parameter number of sample products arbitrarily selected from a plurality of sample products;

the third calculation module is used for calculating a third distance between the sample information of the sample product to be measured and the sample information of the set parameter sample products contained in the second priority queue;

the second screening module is used for screening out sample information of unselected target sample products from the plurality of sample products;

the fourth calculation module is used for calculating a fourth distance between the sample information of the sample product to be measured and the sample information of the target sample product;

the second comparison module is used for comparing the fourth distance with a third distance corresponding to the sample information of each sample product stored in the second priority queue;

a third returning module, configured to, if a third distance greater than the fourth distance exists, replace sample information of a sample product corresponding to a largest third distance among the third distances greater than the fourth distance with sample information of the target sample product, and return to the step of screening sample information of the target sample product that is not selected from the plurality of sample products until all the plurality of sample products are selected;

a fourth returning module, configured to, if a third distance greater than the fourth distance does not exist, return to the step of screening sample information of the unselected target sample products from the plurality of sample products until all the plurality of sample products are selected;

the third determining module is used for determining that the sample information of the sample product to be tested and the sample information of the sample products with the set parameters stored in the second priority queue belong to the same tuple so as to obtain a plurality of tuples;

the second dividing module is used for dividing the sample information of the sample products stored in the second priority queue, which contains the sample information of the same test type, into the same sample set;

a fifth obtaining module, configured to obtain, from the sample set, a target sample set that contains the most sample information;

a fourth determining module, configured to determine that the test type corresponding to the target sample set is the test type of the tuple, so as to obtain test types corresponding to multiple tuples respectively;

a sixth obtaining module, configured to obtain error rates corresponding to the setting parameters based on the test types corresponding to the multiple tuples and the test types corresponding to the sample products included in the multiple tuples, so as to obtain error rates corresponding to the multiple setting parameters;

a fifth determining module, configured to determine, as a target setting parameter, a setting parameter corresponding to a minimum error rate among the error rates corresponding to the multiple setting parameters, respectively;

and a sixth determining module, configured to determine, under the target setting parameter, that the obtained multiple tuples are the second number of tuples.

With reference to the second aspect, in a second possible implementation manner, the method further includes:

a seventh obtaining module, configured to obtain a test case belonging to the target test type;

and the test module is used for testing the product to be tested through the test case belonging to the target test type.

According to a third aspect of the embodiments of the present disclosure, there is provided a server, including: a processor; a memory for storing the processor-executable instructions; wherein the processor is configured to execute the instructions to implement the test type determination method of the first aspect.

According to a fourth aspect of embodiments of the present disclosure, there is provided a storage medium having instructions that, when executed by a processor of a server, enable the server to perform the test type determination method according to the first aspect.

According to a fifth aspect of the embodiments of the present disclosure, there is provided a computer program product directly loadable into an internal memory of a computer and containing software code, the computer program being loadable and executable by the computer to enable the method for determining a test type as shown in the first aspect to be implemented.

According to the technical scheme, in the test type determining method provided by the application, the product information of the product to be tested is acquired; acquiring a first priority queue, wherein the first priority queue comprises a first number of nearest neighbor tuples, the first number of nearest neighbor tuples are the first number of tuples randomly selected from a second number of tuples obtained by pre-training, and each tuple comprises sample information corresponding to a plurality of sample products; calculating first distances between the product information and the nearest neighbor tuples respectively; screening unselected target tuples from the second number of tuples; calculating a second distance between the product information and the target tuple; comparing the second distance with a first distance corresponding to the sample information of each sample product stored in the first priority queue; if a first distance greater than the second distance exists, deleting a target nearest neighbor tuple in the first priority queue, wherein the target nearest neighbor tuple is a nearest neighbor tuple corresponding to the largest first distance in the first distances greater than the second distance; storing the target tuples into the first priority queue as nearest neighbor tuples, and returning to the step of screening unselected target tuples from the second number of tuples until the second number of tuples are all selected; if the first distance larger than the second distance does not exist, returning to the step of screening the unselected target tuples from the second number of tuples until the second number of tuples are all selected; dividing nearest neighbor tuples corresponding to the same test type in the first number of nearest neighbor tuples stored in the first priority queue into the same tuple set; obtaining a target tuple set containing the most nearest neighbor tuples from the tuple set; and determining the test type corresponding to the target element set as a target test type suitable for the product to be tested. Therefore, the purpose of determining the target test type suitable for the product to be tested is achieved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.

Fig. 1 is a block diagram of a hardware architecture according to an embodiment of the present application;

fig. 2 is a flowchart of a method for determining a test type according to an embodiment of the present disclosure;

fig. 3 is a block diagram of a test type determination apparatus according to an embodiment of the present application;

FIG. 4 is a block diagram illustrating a server in accordance with an example embodiment.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The embodiment of the application provides a method, a device, a server, a medium and a product for determining a test type, and before introducing the technical scheme provided by the embodiment of the application, a hardware architecture related to the application is explained.

As shown in fig. 1, a block diagram of a hardware architecture according to an embodiment of the present application is shown, where the hardware architecture includes: an electronic device 11 and a server 12.

The electronic device 11 may be any electronic product capable of interacting with a user through one or more ways, such as a keyboard, a touch PAD, a touch screen, a remote controller, a voice interaction device, or a handwriting device, for example, a mobile phone, a notebook computer, a tablet computer, a palm computer, a personal computer, a wearable device, a smart television, a PAD, and the like.

It should be noted that fig. 1 is only an example, and the type of the electronic device may be various and is not limited to the notebook computer in fig. 1.

The server 12 may be, for example, one server, a server cluster composed of a plurality of servers, or a cloud computing server center. The server 12 may include a processor, memory, and a network interface, among others.

Illustratively, the user may upload product information of the product under test to the server 12 based on the electronic device 11.

For example, the user may upload product information of the product to be tested through a user interface on a client or a website operated by the electronic device 11.

For example, after the server 12 receives the product information of the product to be tested, the method for determining the test type provided by the embodiment of the present application may be executed.

It will be understood by those skilled in the art that the foregoing electronic devices and servers are merely exemplary and that other existing or future electronic devices or servers may be suitable for use with the present disclosure and are intended to be included within the scope of the present disclosure and are hereby incorporated by reference.

The following describes a test type determination method provided in the embodiment of the present application with reference to the above hardware architecture. As shown in fig. 2, a flowchart of a method for determining a test type provided in an embodiment of the present application, which may be applied to the server 12, includes the following steps S201 to S212.

Step S201: acquiring product information of a product to be detected, wherein the product information comprises: the development period, the transaction type contained in the product to be tested, the number of servers with data interaction with the product to be tested and the servers with data interaction with the product to be tested.

By way of example, the product may be: any of an application, a device.

The development cycle of different products is different, and the following description will take the development cycle of an application program as an example.

The development cycle of an application includes six phases: the first stage is as follows: the definition and the scheme of the problem, the turn is the discussion between an application developer and a demander, so as to confirm the software development target and the feasibility. And a second stage: and (4) analyzing the requirement, and in the case of determining that the application program development is feasible, analyzing each function required to be realized by the application program in detail. And a third stage: and (4) designing the application program, wherein the whole application program system is designed according to the result of the requirement analysis at this stage, such as system framework design, database design and the like. Application design is generally divided into general design and detailed design. A fourth stage: program code, this stage is the conversion of the results of the application programming into computer executable program code. In the program code, it is necessary to make a uniform, standard-compliant writing specification. The fifth stage: and (3) an application program testing stage: problems in the application design process are identified and corrected. The sixth stage: operation and maintenance, application maintenance being the longest time in an application lifecycle. After the application is developed and put into use, the application cannot continuously adapt to the requirements of the user for various reasons. To extend the life of an application, the application must be maintained. Application maintenance includes error correction maintenance and improved maintenance.

The duration of the development cycle of an application is determined by the complexity of the application development required, for example, the development cycle of an application may be one and a half months to one and a half years.

For example, the development cycle included in the product information may include at least one of each phase included in the development cycle and a duration of the development cycle.

The transaction type is related to the product, and the product is taken as a mobile banking application of the bank as an example.

Exemplary transaction types include, but are not limited to: at least one of transfer type, deposit type, withdrawal type, query balance type, investment type.

It is understood that the product may involve a process of interacting with other systems in executing a transaction corresponding to a transaction type, and the following description will take an investment type transaction as an example.

In the process that a user invests through a mobile banking application program, if the user needs to purchase funds, the corresponding amount of money in the corresponding bank card needs to be deducted by a bank card system, and the investment system needs to allocate the funds corresponding to the corresponding amount of money to the user. An investment type transaction may involve two systems.

It will be appreciated that problems may arise in interacting a product with other systems, and therefore the parameter "other systems interacting with the product" is required in determining the type of test appropriate for the product.

For example, in the embodiment of the present application, "the server having data interaction with the product to be tested" refers to a server included in another system having data interaction with the product to be tested.

For example, the "server having data interaction with the product under test" may be an Application Programming Interface (API) of the server having data interaction with the product under test.

It will be appreciated that the type of test that will accommodate both products should be the same for any two products if the development cycle, type of transaction, number of servers with data interaction with the product, and number of servers with data interaction with the product are similar. For example, if the distance between the product information of the product to be tested and the product information of the sample information a is small, the test type suitable for the sample product should also be suitable for the product to be tested.

Step S202: a first priority queue is obtained, the first priority queue comprising a first number of nearest neighbor tuples.

The first number of nearest neighbor tuples are the first number of tuples arbitrarily selected from a second number of tuples obtained by pre-training, each tuple includes sample information corresponding to a plurality of sample products, and the sample information of the sample products includes: development period, transaction type contained in the sample product, number of servers having data interaction with the sample product, test type suitable for the sample product, error problem generated in the test process by the test type.

Illustratively, the second number is greater than the first number.

Illustratively, the distance between the sample information of the plurality of sample products belonging to the same tuple is less than or equal to a preset threshold.

For the description of the sample information of the sample product, reference may be made to the description of the product information of the product to be tested, which is not repeated herein.

It is to be understood that, since it is a sample product, the test type suitable for the sample product has been determined, and for example, the number of test types suitable for the sample product may be one or more.

"an error problem generated during the test by the test type" refers to a BUG generated during the test for a sample product by using a test case belonging to the test type, for example, a transaction failure.

Illustratively, the first priority queue stores a first number of elements, one of said elements comprising a nearest neighbor tuple, and a first distance of said each element from product information of the product under test.

The first priority queue belongs to a priority queue, which is explained below.

A priority queue (priority queue) is a collection of 0 or more elements, each element having a distance, and operations performed on the priority queue include find element operations, insert element operations, and delete element operations. In the embodiment of the present disclosure, the search element operation for the priority queue is used to search the element with the largest distance in the priority queue. The delete element operation for the priority queue is used to delete the element that is searched for with the greatest distance.

Step S203: and calculating first distances between the product information and the nearest neighbor tuples respectively.

In an optional implementation manner, for each nearest neighbor tuple, a first distance between the product information and the nearest neighbor tuple represents a non-similarity index between the product to be measured and the nearest neighbor tuple. For example, the first distance between the product information and the nearest neighbor tuple may be a euclidean distance or a manhattan distance.

It can be understood that, since the nearest neighbor tuple includes sample information of a plurality of sample products, the first distance between the product information and the nearest neighbor tuple is determined according to a test class included in the sample information of the plurality of sample products included in the nearest neighbor tuple, rather than a test class included in the sample information of a single sample product. This is an advantage of the present application. I.e. the product information thus obtained is more accurate in terms of the first distance to the nearest neighbor tuple.

For example, the first distance between the product information and the nearest neighbor tuple is an average value of distances between the product information and sample information of a plurality of sample products included in the nearest neighbor tuple.

Step S204: and screening out unselected target tuples from the second number of tuples.

In the present application, the tuple that has been calculated to have a distance from the product information of the product to be measured is the selected tuple.

Step S205: calculating a second distance of the product information from the target tuple.

For example, the second distance between the product information and the target tuple may be a euclidean distance or a manhattan distance.

It can be understood that, since the target tuple includes sample information of a plurality of sample products, the second distance between the product information and the target tuple is determined according to the test class included in the sample information of the plurality of sample products included in the target tuple, rather than the test class included in the sample information of a single sample product. This is an advantage of the present application. I.e. the product information thus obtained is more accurate in the second distance to the target tuple.

For example, the second distance between the product information and the target tuple is an average value of distances between the product information and sample information of a plurality of sample products included in the target tuple.

Step S206: and comparing the second distance with the first distance corresponding to the sample information of each sample product stored in the first priority queue.

Step S207: and if the first distance greater than the second distance exists, deleting a target nearest neighbor tuple in the first priority queue, wherein the target nearest neighbor tuple is a nearest neighbor tuple corresponding to the largest first distance in the first distances greater than the second distance.

For example, if a first distance greater than a second distance exists in the first priority queue, it is indicated that the distance between the target tuple and the product to be tested is close, that is, the probability that the test type corresponding to the target tuple may be the same as the test type suitable for the product to be tested is higher than the probability that the test type corresponding to the target nearest tuple may be the same as the test type suitable for the product to be tested, and therefore, the target nearest tuple in the first priority queue is deleted.

And if a plurality of first distances greater than the second distance exist in the first priority queue, deleting the nearest neighbor tuple corresponding to the maximum first distance.

In summary, the first number of nearest neighbor tuples stored in the first priority queue are the first number of tuples closest to the product information of the product to be tested.

Step S208: and storing the target tuple as a nearest neighbor tuple to the first priority queue, and returning to the step S204 until the second number of tuples are all selected.

Step S209: if there is no first distance greater than the second distance, the process returns to step S204 until the second number of tuples are all selected.

Step S210: dividing nearest neighbor tuples corresponding to the same test type in the first number of nearest neighbor tuples stored by the first priority queue into the same tuple set.

For example, the test type may be: unit test, assembly test and system test.

Step S211: and obtaining a target tuple set containing the most nearest neighbor tuples from the tuple set.

Assume that the number of tuple sets is 3 and respectively: tuple set 1, tuple set 2, tuple set 3. Tuple set 1 (corresponding unit test) includes: nearest neighbor tuple 11, nearest neighbor tuple 12, and nearest neighbor tuple 13; tuple set 2 (assembly test) includes: a nearest neighbor tuple 21; tuple set 3 (corresponding system test) includes: the nearest neighbor tuple 31. The target tuple set containing the highest number of nearest neighbor tuples is tuple set 2.

Step S212: and determining the test type corresponding to the target element set as a target test type suitable for the product to be tested.

In the method for determining the test type provided by the embodiment of the application, product information of a product to be tested is obtained; acquiring a first priority queue, wherein the first priority queue comprises a first number of nearest neighbor tuples, the first number of nearest neighbor tuples are the first number of tuples randomly selected from a second number of tuples obtained by pre-training, and each tuple comprises sample information corresponding to a plurality of sample products; calculating first distances between the product information and the nearest neighbor tuples respectively; screening unselected target tuples from the second number of tuples; calculating a second distance between the product information and the target tuple; comparing the second distance with a first distance corresponding to the sample information of each sample product stored in the first priority queue; if a first distance greater than the second distance exists, deleting a target nearest neighbor tuple in the first priority queue, wherein the target nearest neighbor tuple is a nearest neighbor tuple corresponding to the largest first distance in the first distances greater than the second distance; storing the target tuples into the first priority queue as nearest neighbor tuples, and returning to the step of screening unselected target tuples from the second number of tuples until the second number of tuples are all selected; if the first distance larger than the second distance does not exist, returning to the step of screening the unselected target tuples from the second number of tuples until the second number of tuples are all selected; dividing nearest neighbor tuples corresponding to the same test type in the first number of nearest neighbor tuples stored in the first priority queue into the same tuple set; obtaining a target tuple set containing the most nearest neighbor tuples from the tuple set; and determining the test type corresponding to the target element set as a target test type suitable for the product to be tested. Therefore, the purpose of determining the target test type suitable for the product to be tested is achieved.

In an alternative implementation, the process of training to obtain the second number of tuples includes the following steps a101 to a 103.

Step A101: a plurality of setting parameters are determined, the plurality of setting parameters being different. The following steps B101 to B113 are performed for each setting parameter.

Step B101, determining each sample product in the plurality of sample products as a sample product to be tested, and executing the following operations:

step B102, obtaining a second priority queue, wherein the second priority queue comprises sample information of a plurality of set parameter sample products, and the plurality of set parameter sample products are the plurality of set parameter sample products randomly selected from a plurality of sample products.

And step B103, calculating a third distance between the sample information of the sample product to be detected and the sample information of the set parameter sample products contained in the second priority queue.

For example, the third distance between the sample information of the sample product to be measured and the sample information of the set parameter sample product included in the second priority queue may be a euclidean distance or a manhattan distance.

And B104, screening out sample information of the unselected target sample products from the plurality of sample products.

In the present application, the sample information that has been calculated to be distant from the product information of the sample product to be measured is the sample information that has been selected.

And B105, calculating a fourth distance between the sample information of the sample product to be detected and the sample information of the target sample product.

Illustratively, the fourth distance may be a euclidean distance or a manhattan distance.

And B106, comparing the fourth distance with a third distance corresponding to the sample information of each sample product stored in the second priority queue.

And step B107, if a third distance larger than the fourth distance exists, replacing the sample information of the sample product corresponding to the largest third distance in the third distances larger than the fourth distance with the sample information of the target sample product, and returning to the step B104 until the plurality of sample products are all selected.

And B108, if the third distance which is larger than the fourth distance does not exist, returning to the step B104 until the plurality of sample products are all selected.

For example, if a third distance greater than the fourth distance exists in the second priority queue, it is indicated that the distance between the sample information of the target sample product and the sample information of the sample product to be tested is short, that is, the probability that the test type corresponding to the target sample product may be the same as the test type suitable for the sample product to be tested is high, so the sample information of the sample product corresponding to the maximum third distance in the second priority queue is deleted.

In summary, the second priority queue stores the sample information of the sample product with the set parameter closest to the product information of the sample product to be tested.

And step B109, determining that the sample information of the sample product to be tested and the sample information of the sample products with the set parameters stored in the second priority queue belong to the same tuple so as to obtain a plurality of tuples.

And B110, dividing the sample information of the sample products stored in the second priority queue, which contains the sample information of the same test type, into the same sample set.

And step B111, obtaining a target sample set containing the most sample information from the sample sets.

And step B112, determining the test type corresponding to the target sample set as the test type of the tuple to obtain the test types corresponding to the multiple tuples respectively.

Assume that the number of sample sets is 3 and is: sample set 1, sample set 2, sample set 3. The sample set 1 (corresponding unit test) includes: sample information of sample product 11, sample information of sample product 12, sample information of sample product 13; sample set 2 (assembly test) includes: sample information of the sample product 21; the sample set 3 (corresponding system test) includes: sample information of the sample product 31. The target sample set containing the most sample information is sample set 2. The test type corresponding to the tuple is the test type corresponding to the sample set 2, i.e. the assembly test.

And B113, acquiring error rates corresponding to the set parameters based on the test types respectively corresponding to the tuples and the test types corresponding to the sample products respectively contained in the tuples so as to obtain the error rates respectively corresponding to the set parameters.

For example, the error rate calculation method may be the same as the error rate calculation method in the KNN (K-nearest neighbor) algorithm, and details thereof are not repeated here.

It will be appreciated that it is possible that the sample information for multiple sample products belong to the same tuple, so it is not necessary to determine each sample product as the sample product to be measured. For example, after the sample information of the sample product a is determined as the sample product to be measured, the following is obtained that belongs to the same tuple as the sample information of the sample product a: the sample information of the sample product B and the sample information of the sample product C are not needed to be determined as the sample product to be measured.

Step A102: and determining the set parameter corresponding to the minimum error rate as the target set parameter in the error rates corresponding to the plurality of set parameters respectively.

Step A103: and under the target setting parameters, determining the obtained multiple tuples as the second number of tuples.

It is understood that the setting parameters determined in step a101 include the target setting parameters, the number of the tuples obtained from step B101 to step B113 executed under the setting parameters is the second number, and the obtained tuple is the tuple mentioned in step S202.

In an alternative implementation, the following steps C11 to C12 are further included.

Step C11: and acquiring the test case belonging to the target test type.

Step C12: and testing the product to be tested through the test case belonging to the target test type.

The method is described in detail in the embodiments disclosed in the present application, and the method of the present application can be implemented by various types of apparatuses, so that an apparatus is also disclosed in the present application, and the following detailed description is given of specific embodiments.

As shown in fig. 3, a block diagram of a test type determining apparatus provided in an embodiment of the present application includes: a first obtaining module 301, a second obtaining module 302, a first calculating module 303, a first screening module 304, a second calculating module 305, a first comparing module 306, a first deleting module 307, a first returning module 308, a second returning module 309, a first dividing module 310, a third obtaining module 311, and a first determining module 312, wherein:

a first obtaining module 301, configured to obtain product information of a product to be tested, where the product information includes: the development period, the transaction type contained in the product to be tested, the number of servers with data interaction with the product to be tested and the servers with data interaction with the product to be tested;

a second obtaining module 302, configured to obtain a first priority queue, where the first priority queue includes a first number of nearest neighbor tuples, the first number of nearest neighbor tuples is the first number of tuples arbitrarily selected from a second number of tuples obtained through pre-training, each tuple includes sample information corresponding to a plurality of sample products, and the sample information of the sample products includes: development period, transaction type contained in the sample product, number of servers having data interaction with the sample product, test type suitable for the sample product, error problem generated in the test process by the test type;

a first calculating module 303, configured to calculate first distances between the product information and the nearest neighbor tuples respectively;

a first filtering module 304, configured to filter out unselected target tuples from the second number of tuples;

a second calculation module 305, configured to calculate a second distance between the product information and the target tuple;

a first comparing module 306, configured to compare the second distance with a first distance corresponding to sample information of each sample product stored in the first priority queue;

a first deleting module 307, configured to delete a target nearest neighbor tuple in the first priority queue if a first distance greater than the second distance exists, where the target nearest neighbor tuple is a nearest neighbor tuple corresponding to a largest first distance in the first distances greater than the second distance;

a first returning module 308, configured to store the target tuple as a nearest neighbor tuple in the first priority queue, and return to the first screening module 304 until the second number of tuples are all selected;

a second returning module 309, configured to, if there is no first distance greater than the second distance, return to the first filtering module 304 until the second number of tuples are all selected;

a first dividing module 310, configured to divide, into the same tuple set, nearest neighbor tuples corresponding to the same test type in the first number of nearest neighbor tuples stored in the first priority queue;

a third obtaining module 311, configured to obtain, from the tuple set, a target tuple set that includes the most nearest neighbor tuples;

a first determining module 312, configured to determine that the test type corresponding to the target element set is a test type suitable for the product to be tested.

In an optional implementation manner, the method further includes:

further comprising:

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

FIG. 4 is a block diagram illustrating a server according to an exemplary embodiment, and as shown in FIG. 4, server 400 includes, but is not limited to: a processor 401, a memory 402, a network interface 403, an I/O controller 404, and a communication bus 405.

It should be noted that the structure of the server shown in fig. 4 is not limited to the server, and the server may include more or less components than those shown in fig. 4, or some components may be combined, or a different arrangement of components may be used, as will be understood by those skilled in the art.

The following describes the components of the server 400 in detail with reference to fig. 4:

the processor 401 is a control center of the server, connects various parts of the entire server using various interfaces and lines, and performs various functions of the server and processes data by running or executing software programs and/or modules stored in the memory 402 and calling data stored in the memory 402, thereby performing overall monitoring of the server. Processor 401 may include one or more processing units; optionally, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly handles operating systems, user interfaces, application programs, and the like, and the modem processor mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 401.

Processor 401 may be a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement embodiments of the present invention, or the like;

the Memory 402 may include Memory, such as a Random-Access Memory (RAM) 4021 and a Read-Only Memory (ROM) 4022, and may also include a mass storage device 4023, such as at least 1 disk Memory. Of course, the server may also include hardware needed for other services.

The memory 402 is used for storing the executable instructions of the processor 401. The processor 401 is configured to perform any of the steps of the test type determination embodiments described above.

A wired or wireless network interface 403 is configured to connect the server 400 to a network.

The processor 401, the memory 402, the network interface 403, and the I/O controller 404 may be connected to each other by a communication bus 405, which may be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, an EISA (Extended Industry Standard Architecture) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc.

In an exemplary embodiment, the server 400 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described test type determination.

In an exemplary embodiment, a storage medium comprising instructions, such as a memory 402 comprising instructions, executable by a processor 401 of the server 400 to perform the above-described method is also provided. Alternatively, the storage medium may be a non-transitory computer readable storage medium, which may be, for example, a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

In an exemplary embodiment, a computer program product is also provided, which is directly loadable into an internal memory of a computer, such as the memory 402 described above, and contains software code, and which, when loaded and executed by a computer, is able to carry out the method of any of the above-described embodiments for determining the type of test.

It should be noted that the test type determination method, apparatus, server, medium, and product provided by the present invention may be used in the financial field or other fields, for example, may be used in a test application scenario in the financial field. The other fields are arbitrary fields other than the financial field. The above description is only an example, and does not limit the application fields of the test type determination method, apparatus, server, medium, and product provided by the present invention.

Note that the features described in the embodiments in the present specification may be replaced with or combined with each other. For the device or system type embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for determining a test type, comprising:

obtaining a first priority queue, the first priority queue comprising a first number of nearest neighbor tuples, the first number of nearest neighbor tuples being the first number of tuples arbitrarily selected from a second number of tuples obtained by pre-training, each tuple comprising a plurality of samples

The sample information that this product corresponds respectively, the sample information of sample product includes: development period, transaction type contained in the sample product, number of servers having data interaction with the sample product, test type suitable for the sample product, error problem generated in the test process by the test type;

screening unselected target tuples from the second number of tuples;

2. The test type determination method of claim 1, wherein obtaining the second number of tuples comprises:

3. The test type determination method according to any one of claims 1 or 2, characterized by further comprising:

obtaining a test case belonging to the target test type;

4. A test type determination apparatus, comprising:

5. The test type determination apparatus according to claim 4, further comprising:

6. The test type determination apparatus according to any one of claims 4 or 5, characterized by further comprising:

7. A server, comprising:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the test type determination method of any of claims 1 to 3.

8. A computer readable storage medium, instructions in which, when executed by a processor of a server, enable the server to perform the test type determination method of any one of claims 1 to 3.

9. A computer program product directly loadable into the internal memory of a computer, said memory being the memory comprised by the server according to claim 7 and containing software code, said computer program being loadable and executable by the computer to implement the method of determining the type of test according to any of claims 1 to 3.