CN111382056A - Service testing method and device, server and storage medium - Google Patents

Service testing method and device, server and storage medium Download PDF

Info

Publication number
CN111382056A
CN111382056A CN201811643645.1A CN201811643645A CN111382056A CN 111382056 A CN111382056 A CN 111382056A CN 201811643645 A CN201811643645 A CN 201811643645A CN 111382056 A CN111382056 A CN 111382056A
Authority
CN
China
Prior art keywords
test
service
data
request
response data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811643645.1A
Other languages
Chinese (zh)
Other versions
CN111382056B (en
Inventor
俞宏云
郑宇�
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing ByteDance Network Technology Co Ltd
Original Assignee
Beijing ByteDance Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd filed Critical Beijing ByteDance Network Technology Co Ltd
Priority to CN201811643645.1A priority Critical patent/CN111382056B/en
Publication of CN111382056A publication Critical patent/CN111382056A/en
Application granted granted Critical
Publication of CN111382056B publication Critical patent/CN111382056B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3684Test management for test design, e.g. generating new test cases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3688Test management for test execution, e.g. scheduling of test suites

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The embodiment of the disclosure discloses a service testing method, a service testing device, a server and a storage medium. The method comprises the following steps: acquiring a test case from a first database, wherein the test case comprises upstream service request data and service request response data corresponding to the upstream service request data; generating and sending a test request for testing the tested service to the online server according to the upstream service request data so that the online server generates a test data pair based on the test request, wherein the tested service runs on the online server; and receiving a test data pair sent by the online server, and judging whether the test response data in the test data pair is the same as the service request response data. The technical scheme disclosed by the embodiment of the disclosure can test the tested service according to the actual data during service operation, has wider coverage compared with the traditional mode of manually compiling test cases, and simultaneously improves the usability of the system and reduces the maintenance cost.

Description

Service testing method and device, server and storage medium
Technical Field
The embodiment of the disclosure relates to the technical field of testing, and in particular, to a service testing method and device, a server and a storage medium.
Background
Because the existing service system is frequently on-line, has more service requirements and short iteration period, and the on-line accident easily caused by code change appears for many times, the service needs to be tested before the on-line.
The existing service test is to compare the expected output and the actual output according to the manually specified test case and judge whether the online interface has problems. However, the manual specification of the test cases requires a lot of manpower and material resources, and there may be a case that the coverage of the test cases is not complete, which results in too high maintenance cost of the system.
Disclosure of Invention
The embodiment of the disclosure provides a service testing method, a service testing device, a server and a storage medium, which can test a tested service according to actual data during service operation, and compared with a traditional manual test case compiling mode, the service testing method has the advantages of wider coverage, improved usability of a system and reduced maintenance cost.
In a first aspect, an embodiment of the present disclosure provides a service testing method, including:
acquiring a test case from a first database, wherein the test case comprises upstream service request data and service request response data corresponding to the upstream service request data;
generating and sending a test request for testing the tested service to the online server according to the upstream service request data so that the online server generates a test data pair based on the test request, wherein the tested service runs on the online server;
and receiving a test data pair sent by the online server, and judging whether the test response data in the test data pair is the same as the service request response data.
Optionally, the test request carries a test identifier.
Optionally, the service request response data includes at least one of upstream service response data, downstream service request data and downstream service response data, and the test response data includes at least one of upstream test response data, downstream test request data and downstream test response data;
judging whether the test response data in the test data pair is the same as the service request response data comprises at least one of the following steps:
judging whether the upstream test response data is the same as the upstream service response data;
judging whether the downstream test request data is the same as the downstream service request data or not;
it is determined whether the downstream test response data is the same as the downstream service response data.
Optionally, the method further includes:
and if the test response data is different from the service request response data, generating a test response error paradigm according to the different test response data.
Optionally, the test response data includes at least one of upstream test response data, downstream test request data and downstream test response data, and the test response error pattern includes at least one of an upstream test response pattern, a downstream test request pattern and a downstream test response pattern.
Optionally, before obtaining the test case from the first database, the method further includes:
and receiving an online service test instruction sent by the online service management platform.
Optionally, the tested service includes a plurality of tested methods, the test case corresponds to the tested method, and the test case, the test request, and the test data pair all include the same tested service identifier, tested method identifier, and service request identifier.
Optionally, the test case in the first database is updated according to a preset time threshold, or is updated according to a correction instruction. In a second aspect, an embodiment of the present disclosure provides a service testing method, including:
receiving a test request which is sent by a test server and used for testing a tested service, wherein the test request is generated by the test server according to a test case, and the test case comprises upstream service request data and service request response data corresponding to the upstream service request data;
generating a test data pair based on the test request;
and sending the test data pair to the test server so as to judge whether the test response data in the test data pair is the same as the service request response data or not by the test server.
Optionally, the test request carries a test identifier.
Optionally, the test data pair includes upstream test request data and at least one of upstream test response data, downstream test request data and downstream test response data;
generating test data pairs based on the test requests includes:
acquiring upstream test request data and upstream test response data through a first middleware;
downstream test request data and downstream test response data are obtained by the second middleware.
Optionally, before receiving a test request for testing a tested service sent by the test server, the method further includes:
acquiring a plurality of service data pairs when a tested service runs, wherein each service data pair comprises upstream service request data and service request response data corresponding to the upstream service request data;
a plurality of service data pairs are sent to a first database.
Optionally, the service request response data includes at least one of upstream service response data, downstream service request data and downstream service response data obtained by the tested service based on the upstream service request data;
acquiring a plurality of interaction data pairs of a tested service runtime comprises:
acquiring upstream service request data and upstream service response data through a first middleware;
downstream service request data and downstream service response data are obtained through the second middleware.
Optionally, the method further includes:
and after the second middleware acquires the downstream test request data, performing truncation processing, and acquiring downstream service response data from the test service as downstream test response data.
Optionally, the tested service includes a plurality of tested methods, the test case corresponds to the tested method, and the test case, the test request, and the test data pair all include the same tested service identifier, tested method identifier, and service request identifier.
In a third aspect, an embodiment of the present disclosure provides a device for testing a service, including: the device comprises a receiving module, a generating module, a sending module and a judging module;
the test case comprises upstream service request data and service request response data corresponding to the upstream service request data;
the generating module is used for generating a test request for testing the tested service according to the upstream service request data;
the sending module is used for sending a test request to the online server so that the online server generates a test data pair based on the test request, and the tested service runs on the online server;
the receiving module is also used for receiving the test data pair sent by the online server;
and the judging module is used for judging whether the test response data in the test data pair is the same as the service request response data.
Optionally, the test request carries a test identifier.
Optionally, the service request response data includes at least one of upstream service response data, downstream service request data and downstream service response data, and the test response data includes at least one of upstream test response data, downstream test request data and downstream test response data;
the judging module is specifically used for judging whether the upstream test response data is the same as the upstream service response data; and/or, judging whether the downstream test request data is the same as the downstream service request data; and/or determining whether the downstream test response data is the same as the downstream service response data.
Optionally, the generating module is further configured to generate a test response error pattern according to different test response data if the test response data is different from the service request response data.
Optionally, the test response data includes at least one of upstream test response data, downstream test request data and downstream test response data, and the test response error pattern includes at least one of an upstream test response pattern, a downstream test request pattern and a downstream test response pattern.
Optionally, the receiving module is further configured to receive an online service test instruction sent by the online service management platform before the test case is obtained from the first database.
Optionally, the tested service includes a plurality of tested methods, the test case corresponds to the tested method, and the test case, the test request, and the test data pair all include the same tested service identifier, tested method identifier, and service request identifier.
In a fourth aspect, an embodiment of the present disclosure provides a device for testing a service, including: the device comprises a receiving module, a generating module and a sending module;
the system comprises a receiving module, a test module and a test module, wherein the receiving module is used for receiving a test request which is sent by a test server and used for testing a tested service, the test request is generated by the test server according to a test case, and the test case comprises upstream service request data and service request response data corresponding to the upstream service request data;
the generating module is used for generating a test data pair based on the test request;
and the sending module is used for sending the test data pair to the test server so as to judge whether the test response data in the test data pair is the same as the service request response data or not by the test server.
Optionally, the test request carries a test identifier.
Optionally, the test data pair includes upstream test request data and at least one of upstream test response data, downstream test request data and downstream test response data;
the generating module is specifically used for acquiring upstream test request data and upstream test response data through the first middleware; downstream test request data and downstream test response data are obtained by the second middleware.
Optionally, the generating module is further configured to, before the receiving module receives a test request for testing the service to be tested, send by the test server, a plurality of service data pairs during running of the service to be tested, where each service data pair includes upstream service request data and service request response data corresponding to the upstream service request data;
and the sending module is also used for sending the plurality of service data pairs to the first database.
Optionally, the service request response data includes at least one of upstream service response data, downstream service request data and downstream service response data obtained by the tested service based on the upstream service request data;
the generation module is specifically used for acquiring upstream service request data and upstream service response data through the first middleware; downstream service request data and downstream service response data are obtained through the second middleware.
Optionally, the method further includes: a processing module;
and the processing module is used for performing truncation processing after the second middleware acquires the downstream test request data, and acquiring downstream service response data from the test service as downstream test response data.
Optionally, the tested service includes a plurality of tested methods, the test case corresponds to the tested method, and the test case, the test request, and the test data pair all include the same tested service identifier, tested method identifier, and service request identifier.
In a fifth aspect, an embodiment of the present disclosure further provides a server, including:
one or more processors;
a memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement a method of testing a service as in any one of the first aspects.
In a sixth aspect, an embodiment of the present disclosure further provides a server, including:
one or more processors;
a memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement a method of testing a service as in any one of the second aspects.
In a seventh aspect, the disclosed embodiments also provide a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements a method for testing a service according to any one of the first aspect or the second aspect.
According to the embodiment of the disclosure, the real-time data during running according to the service is stored in the first database, so that the test server can receive the test data pair sent by the online server after initiating the test request, and judge whether the test response data in the test data pair is the same as the service request response data, compared with the traditional mode of manually writing the test case, the coverage is wider, meanwhile, the usability of the system is improved, and the maintenance cost is reduced. The second middleware is used for intercepting the downstream test request data after receiving the downstream test request data, so that the non-reentrant interface can be tested, and the problem that the traditional test method cannot test the interface is solved
Drawings
FIG. 1 is a schematic structural diagram of a service testing system provided by an embodiment of the present disclosure;
FIG. 2 is a flow chart of a method for testing a service provided by an embodiment of the present disclosure;
FIG. 3 is a flow chart illustrating another method for testing services provided by embodiments of the present disclosure;
FIG. 4 is a flow chart illustrating a method for testing a service provided by an embodiment of the present disclosure;
FIG. 5 is a flow chart illustrating a method for testing a further service provided by an embodiment of the present disclosure;
FIG. 6 is a schematic structural diagram of a service testing apparatus provided in an embodiment of the present disclosure;
FIG. 7 is a schematic structural diagram of a testing apparatus for another service provided by the embodiment of the present disclosure;
FIG. 8 is a schematic structural diagram of a testing apparatus for testing a further service provided by an embodiment of the present disclosure;
fig. 9 is a schematic structural diagram of a server according to an embodiment of the present disclosure.
Detailed Description
The present disclosure is described in further detail below with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the disclosure and are not limiting of the disclosure. It should be further noted that, for the convenience of description, only some of the structures relevant to the present disclosure are shown in the drawings, not all of them.
It should be noted that the terms "system" and "network" are often used interchangeably in this disclosure. Reference to "and/or" in embodiments of the present disclosure is intended to "include any and all combinations of one or more of the associated listed items. The terms "first", "second", and the like in the description and claims of the present disclosure and in the drawings are used for distinguishing between different objects and not for limiting a particular order.
It should also be noted that the following embodiments of the present disclosure may be implemented individually, or may be implemented in combination with each other, and the embodiments of the present disclosure are not limited specifically.
The embodiment of the disclosure provides a service testing method and device, a server and a storage medium, which can test a tested service according to actual data during service operation, improve the usability of a system and reduce the maintenance cost.
Fig. 1 is a schematic structural diagram of a service test system according to an embodiment of the present disclosure. As can be seen from FIG. 1, the test system is divided into an online test part and an offline test part; the online testing part at least comprises an online server, and the offline testing part at least comprises a testing server, an online service management platform and a first database.
The online server can receive normal user traffic and test traffic sent by the test server. The online server is loaded with a first middleware and a second middleware, the first middleware and the second middleware are plug-ins, wherein the first middleware is responsible for collecting input and output of a tested service, the second middleware is responsible for collecting input and output when online is called rpc to be dependent and not rpc to be dependent, and the input and output collected by the first middleware and the second middleware can be sent to an offline testing part of the testing system through a Databaus. The first middleware and the second middleware are automatically opened when detecting that the tested service is in a low-flow environment, or a starting switch can be further added to the first middleware and the second middleware, and the opening and closing are controlled by an external management platform. Specifically, rpc relies on an upstream service developed using the kite framework, and Databus is a low latency, reliable, transaction-supported, consistent data change capture system.
The first database stores test cases and test response error paradigms generated by the test server, and the test cases are actual data of the service operation. The online service management platform is used for sending an online service test instruction to the test server so that the test server sends a test request for testing the tested service to the online server. The first database can comprise Kafka for processing data and Redis for storing data, and specifically, Kafka is an open source stream processing platform, is written by Scala and Java, is a high-throughput distributed publish-subscribe message system, and can process all action stream data in a consumer-scale website; redis is an open source log-type and Key-Value database which is written by using ANSIC language, supports network, can be based on memory and can also be persisted, and provides Application Programming Interface (API) of multiple languages.
Hereinafter, a method and an apparatus for testing a service, and technical effects thereof will be described in detail.
Fig. 2 is a schematic flow chart of a service testing method provided in the embodiment of the present disclosure, where the method disclosed in the embodiment of the present disclosure is mainly applied to the testing server shown in fig. 1, and as shown in fig. 2, the method specifically includes the following steps:
s100, the test server receives an online service test instruction sent by the online service management platform.
Optionally, the online service test instruction may be automatically generated by the online service management platform when the tested service is online, and sent to the test server.
S101, the test server obtains a test case from the first database, wherein the test case comprises upstream service request data and service request response data corresponding to the upstream service request data.
The test cases are the actual data at the runtime of the service. The service request response data may include at least one of upstream service response data, downstream service request data, and downstream service response data.
After receiving an online service test instruction sent by an online service management platform, the test server can directly acquire a test case from the first database to obtain upstream service request data and service request response data corresponding to the upstream service request data.
S102, the test server generates a test request for testing the tested service according to the upstream service request data.
The test request carries a test identifier, so that the online server can identify whether the currently received traffic is normal user traffic or test traffic sent by the test server.
The test flag may occupy one flag bit. Optionally, the flag may be "0" or "1", and when the flag is "0", it indicates that the request is another request, such as normal user traffic; when the flag is "1", it indicates that the request is a test request. Or, the identification bit may also determine whether the request is a test request by whether the identification bit carries a test identification, which is not specifically limited in the embodiment of the present disclosure. The test identification may be passed through to downstream by the tested service to be embodied in downstream test request data and downstream test response data.
S103, the test server sends a test request to the online server so that the online server generates a test data pair based on the test request.
The tested service runs on an online server.
S104, the test server receives the test data pair sent by the online server.
Because the test request carries the test identifier, the online server generates the test data pair based on the test request correspondingly, and the test data pair also carries the test identifier.
S105, the test server judges whether the test response data in the test data pair is the same as the service request response data.
Specifically, the test data pair includes upstream test request data and test response data, and the test response data includes at least one of the upstream test response data, the downstream test request data and the downstream test response data.
In addition, the service request response data includes at least one of upstream service response data, downstream service request data, and downstream service response data. The method for the test server to determine whether the test response data in the test data pair is the same as the service request response data may include any one or a combination of three methods:
the test server judges whether the upstream test response data is the same as the upstream service response data;
the test server judges whether the downstream test request data is the same as the downstream service request data;
the test server determines whether the downstream test response data is the same as the downstream service response data.
When the upstream test response data is the same as the upstream service response data, and/or the downstream test request data is the same as the downstream service request data, and/or the downstream test response data is the same as the downstream service response data, the test is passed; and when the upstream test response data is different from the upstream service response data, the downstream test request data is different from the downstream service request data, and the downstream test response data is different from the downstream service response data, the test is not passed.
On the basis of the foregoing embodiment of the present disclosure, fig. 3 is a schematic flowchart of a method for testing another service provided in the embodiment of the present disclosure, and as shown in fig. 3, in addition to steps S100 to S105 in the foregoing embodiment, the method further includes:
and S106, if the test response data is different from the service request response data, the test server generates a test response error paradigm according to the different test response data.
Specifically, the test response data includes at least one of upstream test response data, downstream test request data, and downstream test response data, and therefore, the test response data being different from the service request response data may include: at least one of the upstream test response data being different from the upstream service response data, the downstream test request data being different from the downstream service request data, the downstream test response data being different from the downstream service response data.
When the upstream test response data is different from the upstream service response data, the test response error pattern comprises an upstream test response pattern; when the downstream test request data is different from the downstream service request data, the test response error paradigm comprises a downstream test request paradigm; the test response error pattern includes a downstream test response pattern when the downstream test response data is not the same as the downstream service response data.
Optionally, after the test server generates the test response error pattern, the test response error pattern may be sent to the first database for storage, so as to provide the test response error pattern for the tester to view when necessary.
The test response error pattern can be implemented, for example, as follows, the upstream service response data of a certain tested server is { "a": 1, "b": 2}, if the tested service is tested, the upstream test response data with three errors are distributed as { "a": 2, "b": 4}, { "a": 2, "b": 3} and { "a": 1, "b": 3}, it can be found that the a and b fields are changed in the first two tests, and only the b field is changed in the 3 rd test, so that there are two error response patterns, i.e., "the a field and the b field are both erroneous" and "the b field is erroneous", respectively.
It should be further noted that the tested service includes a plurality of tested methods, the test case corresponds to the tested method, and the test case, the test request, and the test data pair all include the same tested service identifier, tested method identifier, and service request identifier.
In addition, the data in the first database may be stored in a predetermined format, such as a predetermined field or a predetermined name. The format of the test request is also uniform, such as the Json string format. The tested service can be divided into two types of http service and rpc service, and the interface of each rpc service has strict requirements on the data format, so that the format of the test request is inconsistent with the interface format of the tested service, and therefore, an http interface can be configured for the rpc service to meet the compatibility of the data format.
Meanwhile, the function of the downstream interface or the internal logic of the tested service and the like are changed, so that the service request response data corresponding to the upstream service request data changes when the tested service runs, for example, the function of a certain downstream interface is to obtain an address list in a first time period, the downstream service response data when the tested service runs necessarily includes a series of addresses, but the function of the downstream interface changes in a second time period and is not to obtain the address list any more, and the downstream service response data pair when the tested service runs also necessarily changes. Or, the upstream service request is a request for acquiring microblog data, and 10 pieces of microblog data are fed back each time according to the internal logic of the tested service in the first time period, so that the upstream service response data includes the 10 pieces of microblog data, whereas the content logic of the tested service in the second time period changes, and the upstream service response data in the running of the tested service also changes inevitably when 50 pieces of microblog data are fed back each time. Therefore, the test cases in the first database can be updated according to the preset conditions.
Optionally, the test case may be updated according to a preset time threshold, for example, the test case may be updated every day, and if the function of the interface is not changed, the updated test case may be added to the first database; and if the function of the interface is changed, deleting the original test case in the first database, and only keeping the updated test case.
Optionally, the test case may be updated according to the update instruction, for example, the external management platform may periodically check whether the function of the downstream interface changes, and if the function of the downstream interface changes, the external management platform generates the update instruction to the test server, so that the test server updates the test case, deletes the original test case in the first database, and only retains the updated test case.
The embodiment of the disclosure provides a service testing method. The real-time data during running according to the service is stored in the first database, so that the test server can receive the test data pair sent by the online server after initiating the test request and judge whether the test response data in the test data pair is the same as the service request response data or not, the test case is automatically used for testing, manual intervention is not needed, the coverage of the test case is wider, the usability of the system is improved, and the maintenance cost is reduced.
Fig. 4 is a schematic flow chart of a method for testing another service provided in the embodiment of the present disclosure, where the method disclosed in the embodiment of the present disclosure is mainly applied to the online server shown in fig. 1, and as shown in fig. 4, the method specifically includes the following steps:
s201, the online server receives a test request which is sent by the test server and used for testing the tested service, wherein the test request is generated by the test server according to a test case, and the test case comprises upstream service request data and service request response data corresponding to the upstream service request data.
The test cases are actual data of the service runtime. The service request response data may include at least one of upstream service response data, downstream service request data, and downstream service response data.
The test request carries a test identifier, so that the online server can identify whether the currently received traffic is normal user traffic or test traffic sent by the test server.
The test flag may occupy one flag bit. Optionally, the flag may be "0" or "1", and when the flag is "0", it indicates that the request is another request, such as normal user traffic; when the flag is "1", it indicates that the request is a test request. Or, the identification bit may also determine whether the request is a test request by whether the identification bit carries a test identification, which is not specifically limited in the embodiment of the present disclosure. The test identification may be passed through to downstream by the tested service to be embodied in downstream test request data and downstream test response data.
S202, the online server generates a test data pair based on the test request.
Because the test request carries the test identifier, the online server generates the test data pair based on the test request correspondingly, and the test data pair also carries the test identifier.
The test data pairs include upstream test request data and at least one of upstream test response data, downstream test request data, and downstream test response data.
The method for generating the test data pair based on the test request by the online server can comprise the following steps: the online server acquires upstream test request data and upstream test response data through a first middleware; and the online server acquires the downstream test request data and the downstream test response data through the second middleware.
Optionally, after the second middleware acquires the downstream test request data, the online server performs truncation processing, and acquires downstream service response data from the test service as downstream test response data. Therefore, the service testing method provided by the embodiment of the disclosure is suitable for testing some interfaces which are not re-input, and the problem that the traditional testing method cannot test the interfaces is solved.
S203, the online server sends the test data pair to the test server, so that the test server judges whether the test response data in the test data pair is the same as the service request response data.
Specifically, the method for the test server to determine whether the test response data in the test data pair is the same as the service request response data may include any one or a combination of more than three methods:
the test server judges whether the upstream test response data is the same as the upstream service response data;
the test server judges whether the downstream test request data is the same as the downstream service request data;
the test server determines whether the downstream test response data is the same as the downstream service response data.
When the upstream test response data is the same as the upstream service response data, and/or the downstream test request data is the same as the downstream service request data, and/or the downstream test response data is the same as the downstream service response data, the test is passed; and when the upstream test response data is different from the upstream service response data, the downstream test request data is different from the downstream service request data, and the downstream test response data is different from the downstream service response data, the test is not passed.
On the basis of the foregoing embodiment of the present disclosure, fig. 5 is a schematic flowchart of a method for testing another service provided in the embodiment of the present disclosure, and as shown in fig. 5, in addition to steps S201 to S203 in the foregoing embodiment, before executing step S201, the method further includes:
s200, the online server acquires a plurality of service data pairs when the tested service runs, wherein each service data pair comprises upstream service request data and service request response data corresponding to the upstream service request data.
The service request response data includes at least one of upstream service response data, downstream service request data, and downstream service response data obtained by the tested service based on the upstream service request data;
specifically, the method for the online server to obtain a plurality of interaction data pairs during the running of the tested service may include: the online server acquires upstream service request data and upstream service response data through a first middleware; and the online server acquires the downstream service request data and the downstream service response data through the second middleware.
S200, the online server sends the service data pairs to a first database.
It should be further noted that the tested service includes a plurality of tested methods, the test case corresponds to the tested method, and the test case, the test request, and the test data pair all include the same tested service identifier, tested method identifier, and service request identifier.
In addition, the data in the first database may be stored in a predetermined format, such as a predetermined field or a predetermined name. The format of the test request is also uniform, such as the Json string format. The tested service can be divided into two types of http service and rpc service, and the interface of each rpc service has strict requirements on the data format, so that the format of the test request is inconsistent with the interface format of the tested service, and therefore, an http interface can be configured for the rpc service to meet the compatibility of the data format.
The embodiment of the disclosure provides a service testing method. By storing the real-time data in the first database during running according to the service, the test server can receive the test data pair sent by the online server after initiating the test request and judge whether the test response data in the test data pair is the same as the service request response data, so that the usability of the system is improved and the maintenance cost is reduced.
Fig. 6 is a schematic structural diagram of a service testing apparatus according to an embodiment of the present disclosure, specifically, the apparatus may be configured in a testing server, and includes: the device comprises a receiving module 10, a generating module 11, a sending module 12 and a judging module 13.
A receiving module 10, configured to obtain a test case from a first database, where the test case includes upstream service request data and service request response data corresponding to the upstream service request data;
a generating module 11, configured to generate a test request for testing a tested service according to the upstream service request data;
a sending module 12, configured to send a test request to an online server, so that the online server generates a test data pair based on the test request, and a service to be tested runs on the online server;
the receiving module 10 is further configured to receive a test data pair sent by the online server;
and the judging module 13 is configured to judge whether the test response data in the test data pair is the same as the service request response data.
Optionally, the test request carries a test identifier.
Optionally, the service request response data includes at least one of upstream service response data, downstream service request data and downstream service response data, and the test response data includes at least one of upstream test response data, downstream test request data and downstream test response data;
a judging module 13, configured to specifically judge whether the upstream test response data is the same as the upstream service response data; and/or, judging whether the downstream test request data is the same as the downstream service request data; and/or determining whether the downstream test response data is the same as the downstream service response data.
Optionally, the generating module 11 is further configured to generate a test response error pattern according to different test response data if the test response data is different from the service request response data.
Optionally, the test response data includes at least one of upstream test response data, downstream test request data and downstream test response data, and the test response error pattern includes at least one of an upstream test response pattern, a downstream test request pattern and a downstream test response pattern.
Optionally, the receiving module 10 is further configured to receive an online service test instruction sent by the online service management platform before the test case is obtained from the first database.
Optionally, the tested service includes a plurality of tested methods, the test case corresponds to the tested method, and the test case, the test request, and the test data pair all include the same tested service identifier, tested method identifier, and service request identifier.
The testing device for the services provided by the embodiment of the disclosure can execute the steps executed by the testing server in the testing method for the services provided by the embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of the execution method.
Fig. 7 is a schematic structural diagram of another service testing apparatus provided in the embodiment of the present disclosure, specifically, the apparatus may be configured in an online server, and includes: a receiving module 20, a generating module 21 and a transmitting module 22.
A receiving module 20, configured to receive a test request sent by a test server and used for testing a tested service, where the test request is generated by the test server according to a test case, and the test case includes upstream service request data and service request response data corresponding to the upstream service request data;
a generating module 21, configured to generate a test data pair based on the test request;
and a sending module 22, configured to send the test data pair to the test server, so that the test server determines whether the test response data in the test data pair is the same as the service request response data.
Optionally, the test request carries a test identifier.
Optionally, the test data pair includes upstream test request data and at least one of upstream test response data, downstream test request data and downstream test response data;
the generating module 21 is specifically configured to obtain upstream test request data and upstream test response data through a first middleware; downstream test request data and downstream test response data are obtained by the second middleware.
Optionally, the generating module 21 is further configured to, before the receiving module receives a test request for testing the service to be tested, sent by the test server, obtain a plurality of service data pairs during running of the service to be tested, where each service data pair includes upstream service request data and service request response data corresponding to the upstream service request data;
the sending module 22 is further configured to send the plurality of service data pairs to the first database.
Optionally, the service request response data includes at least one of upstream service response data, downstream service request data and downstream service response data obtained by the tested service based on the upstream service request data;
a generating module 21, specifically configured to obtain upstream service request data and upstream service response data through a first middleware; downstream service request data and downstream service response data are obtained through the second middleware.
Optionally, with reference to fig. 7, fig. 8 is a schematic structural diagram of a testing apparatus for another service provided in the embodiment of the present disclosure, further including: a processing module 23.
The processing module 23 is configured to perform truncation processing after the second middleware acquires the downstream test request data, and acquire downstream service response data from the test service as downstream test response data.
Optionally, the tested service includes a plurality of tested methods, the test case corresponds to the tested method, and the test case, the test request, and the test data pair all include the same tested service identifier, tested method identifier, and service request identifier.
The testing device for the services provided by the embodiment of the disclosure can execute the steps executed by the online server in the testing method for the services provided by the embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of the execution method.
Fig. 9 is a schematic structural diagram of a server according to an embodiment of the present disclosure, and as shown in fig. 9, a schematic structural diagram of a server suitable for implementing an embodiment of the present disclosure is shown. The server shown in fig. 9 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 9, the server 800 may include a processor (e.g., central processing unit, graphics processor, etc.) 801 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)802 or a program loaded from a storage device 808 into a Random Access Memory (RAM) 803. In the RAM 803, various programs and data necessary for the operation of the server 800 are also stored. The processor 801, the ROM 802, and the RAM 803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.
Generally, the following devices may be connected to the I/O interface 805: input devices 806 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 807 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, and the like; storage 808 including, for example, magnetic tape, hard disk, etc.; and a communication device 809. The communication means 809 may allow the server 800 to perform wireless or wired communication with other devices to exchange data. While fig. 9 illustrates a server 800 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means, or may be installed from a memory. The computer program, when executed by the processor 30, performs the above-described functions defined in the methods of the embodiments of the present disclosure.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring a test case from a first database, wherein the test case comprises upstream service request data and service request response data corresponding to the upstream service request data; generating and sending a test request for testing the tested service to the online server according to the upstream service request data so that the online server generates a test data pair based on the test request, wherein the tested service runs on the online server; and receiving a test data pair sent by the online server, and judging whether the test response data in the test data pair is the same as the service request response data.
Alternatively, the computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: receiving a test request which is sent by a test server and used for testing a tested service, wherein the test request is generated by the test server according to a test case, and the test case comprises upstream service request data and service request response data corresponding to the upstream service request data; generating a test data pair based on the test request; and sending the test data pair to the test server so as to judge whether the test response data in the test data pair is the same as the service request response data or not by the test server.
Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules described in the embodiments of the present disclosure may be implemented by software or hardware. The name of the module does not in some cases form a limitation on the module itself, for example, the receiving module 10 may also be described as a "module for obtaining test cases from the first database".
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.

Claims (19)

1. A method for testing a service, comprising:
acquiring a test case from a first database, wherein the test case comprises upstream service request data and service request response data corresponding to the upstream service request data;
generating and sending a test request for testing a tested service to an online server according to the upstream service request data so as to generate a test data pair by the online server based on the test request, wherein the tested service runs on the online server;
and receiving the test data pair sent by the online server, and judging whether the test response data in the test data pair is the same as the service request response data.
2. The method of claim 1, wherein the test request carries a test identification.
3. The method of claim 1, wherein the service request response data comprises at least one of upstream service response data, downstream service request data, and downstream service response data, and wherein the test response data comprises at least one of upstream test response data, downstream test request data, and downstream test response data;
the judging whether the test response data in the test data pair is the same as the service request response data includes at least one of:
judging whether the upstream test response data is the same as the upstream service response data;
judging whether the downstream test request data is the same as the downstream service request data;
and judging whether the downstream test response data is the same as the downstream service response data or not.
4. The method of claim 1, further comprising:
and if the test response data is different from the service request response data, generating a test response error paradigm according to the different test response data.
5. The method of claim 4, wherein the test response data comprises at least one of upstream test response data, downstream test request data, and downstream test response data, and wherein the test response error pattern comprises at least one of an upstream test response pattern, a downstream test request pattern, and a downstream test response pattern.
6. The method of claim 1, prior to obtaining the test case from the first database, further comprising:
and receiving an online service test instruction sent by the online service management platform.
7. The method of claim 1, wherein the service under test comprises a plurality of methods under test, wherein the test case corresponds to the method under test, and wherein the test case, the test request, and the test data pair each comprise a same service under test identifier, method under test identifier, and service request identifier.
8. The method according to claim 1, wherein the test cases in the first database are updated according to a preset time threshold or according to a correction instruction.
9. A method for testing a service, comprising:
receiving a test request which is sent by a test server and used for testing a tested service, wherein the test request is generated by the test server according to a test case, and the test case comprises upstream service request data and service request response data corresponding to the upstream service request data;
generating a test data pair based on the test request;
and sending the test data pair to the test server so that the test server judges whether the test response data in the test data pair is the same as the service request response data.
10. The method of claim 9, wherein the test request carries a test identification.
11. The method of claim 9, wherein the test data pairs include upstream test request data and at least one of upstream test response data, downstream test request data, and downstream test response data;
the generating test data pairs based on the test requests comprises:
acquiring upstream test request data and upstream test response data through a first middleware;
downstream test request data and downstream test response data are obtained by the second middleware.
12. The method of claim 9, before receiving a test request sent by a test server for testing a service under test, further comprising:
acquiring a plurality of service data pairs during the running of the tested service, wherein each service data pair comprises upstream service request data and service request response data corresponding to the upstream service request data;
sending the plurality of service data pairs into the first database.
13. The method of claim 12, wherein the service request response data comprises at least one of upstream service response data, downstream service request data, and downstream service response data obtained by the tested service based on the upstream service request data;
the obtaining a plurality of interaction data pairs of the service under test runtime comprises:
acquiring the upstream service request data and the upstream service response data through the first middleware;
and acquiring the downstream service request data and the downstream service response data through the second middleware.
14. The method of claim 11, further comprising:
and performing interception processing after the second middleware acquires the downstream test request data, and acquiring downstream service response data from the test service as downstream test response data.
15. The method of claim 14, wherein the service under test comprises a plurality of methods under test, wherein the test case corresponds to the method under test, and wherein the test case, the test request, and the test data pair each comprise a same service under test identifier, method under test identifier, and service request identifier.
16. A device for testing services, comprising: the device comprises a receiving module, a generating module, a sending module and a judging module;
the receiving module is used for acquiring a test case from a first database, wherein the test case comprises upstream service request data and service request response data corresponding to the upstream service request data;
the generating module is used for generating a test request for testing the tested service according to the upstream service request data;
the sending module is used for sending the test request to an online server so that the online server generates a test data pair based on the test request, and the tested service runs on the online server;
the receiving module is further configured to receive the test data pair sent by the online server;
the judging module is used for judging whether the test response data in the test data pair is the same as the service request response data.
17. A device for testing services, comprising: the device comprises a receiving module, a generating module and a sending module;
the receiving module is used for receiving a test request which is sent by a test server and used for testing a tested service, wherein the test request is generated by the test server according to a test case, and the test case comprises upstream service request data and service request response data corresponding to the upstream service request data;
the generating module is used for generating a test data pair based on the test request;
the sending module is configured to send the test data pair to the test server, so that the test server determines whether the test response data in the test data pair is the same as the service request response data.
18. A server, comprising:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement a method of testing a service as claimed in any one of claims 1-8, or a method of testing a service as claimed in any one of claims 9-15.
19. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out a method for testing a service according to any one of claims 1-15.
CN201811643645.1A 2018-12-29 2018-12-29 Service testing method and device, server and storage medium Active CN111382056B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811643645.1A CN111382056B (en) 2018-12-29 2018-12-29 Service testing method and device, server and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811643645.1A CN111382056B (en) 2018-12-29 2018-12-29 Service testing method and device, server and storage medium

Publications (2)

Publication Number Publication Date
CN111382056A true CN111382056A (en) 2020-07-07
CN111382056B CN111382056B (en) 2024-02-02

Family

ID=71221066

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811643645.1A Active CN111382056B (en) 2018-12-29 2018-12-29 Service testing method and device, server and storage medium

Country Status (1)

Country Link
CN (1) CN111382056B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113821430A (en) * 2020-09-24 2021-12-21 北京沃东天骏信息技术有限公司 Multi-service testing method and device

Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011144165A1 (en) * 2010-11-18 2011-11-24 华为技术有限公司 Service deliver platform based application test method and service deliver platform
US20120204091A1 (en) * 2011-02-04 2012-08-09 Oracle International Corporation Automated test tool interface
WO2014085760A1 (en) * 2012-11-29 2014-06-05 Genesys Telecommunications Laboratories, Inc. Workload distribution with resource awareness
CN103888506A (en) * 2012-12-20 2014-06-25 国际商业机器公司 Computer-implemented method and system for extracting rule of monitoring command-response pairs
US20140289699A1 (en) * 2009-08-18 2014-09-25 Adobe Systems Incorporated Methods and Systems for Data Service Development
US9201767B1 (en) * 2013-12-23 2015-12-01 Nationwide Mutual Insurance Company System and method for implementing a testing framework
US9459980B1 (en) * 2013-04-17 2016-10-04 Amazon Technologies, Inc. Varying cluster sizes in a predictive test load while testing a productive system
CN105988932A (en) * 2015-05-13 2016-10-05 中国银联股份有限公司 Test method and system of ESB
CN106776307A (en) * 2016-12-05 2017-05-31 广州唯品会信息科技有限公司 Method for testing software and system
US20170220448A1 (en) * 2016-02-01 2017-08-03 Linkedin Corporation Regression testing of software services
CN107395420A (en) * 2017-07-26 2017-11-24 携程计算机技术(上海)有限公司 Service end performance test methods, system, electronic installation and storage medium
FR3051944A1 (en) * 2016-05-30 2017-12-01 Orange METHOD FOR INQUIRY OF PERSONAL INFORMATION FROM A USER ASKED BY A GIVEN ONLINE SERVICE
CN107729246A (en) * 2017-10-13 2018-02-23 广州阿里巴巴文学信息技术有限公司 For the auxiliary test methods of intended application, device, equipment and storage medium
CN108197021A (en) * 2017-12-28 2018-06-22 深圳市彬讯科技有限公司 A kind of web system automated testing method, device, equipment and storage medium
CN108255727A (en) * 2018-01-18 2018-07-06 网易(杭州)网络有限公司 Data receiver, sending method and device test system, storage medium
CN108319547A (en) * 2017-01-17 2018-07-24 阿里巴巴集团控股有限公司 Method for generating test case, device and system
CN108563562A (en) * 2018-03-22 2018-09-21 平安科技(深圳)有限公司 Test method, device, computer equipment and the storage medium of distributed system
CN108733698A (en) * 2017-04-19 2018-11-02 腾讯科技(深圳)有限公司 A kind of processing method and background service system of log information
CN108897691A (en) * 2018-06-29 2018-11-27 百度在线网络技术(北京)有限公司 Data processing method, device, server and medium based on interface analog service

Patent Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140289699A1 (en) * 2009-08-18 2014-09-25 Adobe Systems Incorporated Methods and Systems for Data Service Development
WO2011144165A1 (en) * 2010-11-18 2011-11-24 华为技术有限公司 Service deliver platform based application test method and service deliver platform
US20120204091A1 (en) * 2011-02-04 2012-08-09 Oracle International Corporation Automated test tool interface
WO2014085760A1 (en) * 2012-11-29 2014-06-05 Genesys Telecommunications Laboratories, Inc. Workload distribution with resource awareness
CN103888506A (en) * 2012-12-20 2014-06-25 国际商业机器公司 Computer-implemented method and system for extracting rule of monitoring command-response pairs
US9459980B1 (en) * 2013-04-17 2016-10-04 Amazon Technologies, Inc. Varying cluster sizes in a predictive test load while testing a productive system
US9201767B1 (en) * 2013-12-23 2015-12-01 Nationwide Mutual Insurance Company System and method for implementing a testing framework
CN105988932A (en) * 2015-05-13 2016-10-05 中国银联股份有限公司 Test method and system of ESB
US20170220448A1 (en) * 2016-02-01 2017-08-03 Linkedin Corporation Regression testing of software services
FR3051944A1 (en) * 2016-05-30 2017-12-01 Orange METHOD FOR INQUIRY OF PERSONAL INFORMATION FROM A USER ASKED BY A GIVEN ONLINE SERVICE
CN106776307A (en) * 2016-12-05 2017-05-31 广州唯品会信息科技有限公司 Method for testing software and system
CN108319547A (en) * 2017-01-17 2018-07-24 阿里巴巴集团控股有限公司 Method for generating test case, device and system
CN108733698A (en) * 2017-04-19 2018-11-02 腾讯科技(深圳)有限公司 A kind of processing method and background service system of log information
CN107395420A (en) * 2017-07-26 2017-11-24 携程计算机技术(上海)有限公司 Service end performance test methods, system, electronic installation and storage medium
CN107729246A (en) * 2017-10-13 2018-02-23 广州阿里巴巴文学信息技术有限公司 For the auxiliary test methods of intended application, device, equipment and storage medium
CN108197021A (en) * 2017-12-28 2018-06-22 深圳市彬讯科技有限公司 A kind of web system automated testing method, device, equipment and storage medium
CN108255727A (en) * 2018-01-18 2018-07-06 网易(杭州)网络有限公司 Data receiver, sending method and device test system, storage medium
CN108563562A (en) * 2018-03-22 2018-09-21 平安科技(深圳)有限公司 Test method, device, computer equipment and the storage medium of distributed system
CN108897691A (en) * 2018-06-29 2018-11-27 百度在线网络技术(北京)有限公司 Data processing method, device, server and medium based on interface analog service

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
王倩倩;成卫青;张登银;: "基于HTTP的Web服务响应时间测试", 南京邮电大学学报(自然科学版), no. 06 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113821430A (en) * 2020-09-24 2021-12-21 北京沃东天骏信息技术有限公司 Multi-service testing method and device

Also Published As

Publication number Publication date
CN111382056B (en) 2024-02-02

Similar Documents

Publication Publication Date Title
US9910941B2 (en) Test case generation
US20140068334A1 (en) Reliable unit testing through cached mocking
US20150026664A1 (en) Method and system for automated test case selection
US9483384B2 (en) Generation of software test code
CN110674047B (en) Software testing method and device and electronic equipment
CN112799940B (en) Regression testing method, regression testing device, computer system and computer readable storage medium
CN112597047A (en) Test method, test device, electronic equipment and computer readable medium
CN109471647B (en) Data updating method and device, electronic equipment and readable medium
CN112954056B (en) Method and device for processing monitoring data, electronic equipment and storage medium
CN109299124B (en) Method and apparatus for updating a model
CN111382058A (en) Service testing method and device, server and storage medium
US11604724B2 (en) Software application component testing
CN115996179A (en) Service node testing method and device, readable medium and electronic equipment
CN111625291B (en) Automatic iteration method and device for data processing model and electronic equipment
CN111382056A (en) Service testing method and device, server and storage medium
CN107562629B (en) Method and device for testing
CN116450511A (en) Information updating method, device, electronic equipment and computer readable medium
CN111382057B (en) Test case generation method, test method and device, server and storage medium
US11709936B2 (en) Automatic integrity vulnerability detection in an integrated development environment
CN109960659B (en) Method and device for detecting application program
CN111367791A (en) Method, device, medium and electronic equipment for generating test case
CN113360365A (en) Flow testing method and flow testing system
CN111382038A (en) Method, device, electronic equipment and storage medium for reporting service data
CN116225946A (en) Interface testing method, device, equipment and storage medium
CN116501634A (en) Test case management method, device, medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant