CN111026639B - Method and system for testing service quality of multi-service system - Google Patents
Method and system for testing service quality of multi-service system Download PDFInfo
- Publication number
- CN111026639B CN111026639B CN201911039182.2A CN201911039182A CN111026639B CN 111026639 B CN111026639 B CN 111026639B CN 201911039182 A CN201911039182 A CN 201911039182A CN 111026639 B CN111026639 B CN 111026639B
- Authority
- CN
- China
- Prior art keywords
- service
- atomic operation
- service system
- test platform
- test
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Test And Diagnosis Of Digital Computers (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a method and a system for testing the service quality of a multi-service system, a computer storage medium and a computing device, which can realize the automatic test of a serial complete service link. The method comprises the following steps: establishing respective test platforms of each service system in the multi-service system, wherein the respective test platforms of each service system externally provide the atomic operation capability of the service system; when a set service scene is tested, determining a plurality of atomic operations corresponding to the set service scene; for each atomic operation in a plurality of atomic operations, calling the atomic operation through a test platform providing the atomic operation capability, calling a service system of the called atomic operation to execute service operation, calling the test platform of the atomic operation to execute test point verification on the atomic operation, and generating a node verification result; and collecting and analyzing the node check results generated by the respective test platform of each service system to generate a service quality report of the multi-service system.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method and a system for testing service quality of a multi-service system, a computer storage medium, and a computing device.
Background
The method relates to the business of external ISV (Independent Software developers), and has quality risks to the stability of the whole business system and the online business due to the problems of environment isolation, inconsistent release rhythm and the like.
In the food ordering service A, a C-end user orders from an application program A, the order is pushed to an ISV service provider by the A, and then the order is pushed to a POS machine of a merchant by the ISV service provider, and the merchant selects the operations of order receiving, order rejection, synchronous order states (such as the states of food preparation, kitchen taking, food taking and the like) and the like through the POS machine, so that the fact that the whole food ordering service strongly depends on the service systems of the A and the ISV can be seen, and the whole food ordering service can be influenced if any party has a problem. Until now, it has been found that a problem with multiple ISV services causes the merchant to receive orders with success rate falling to zero, directly affecting the merchant's business. The related art means finds and processes the online problem through monitoring, but the online service is damaged at the moment.
The quality assurance means in the related technology mainly monitors all service systems and service indexes, finds and responds to online problems, and mainly focuses on the following treatment means. Due to the domain isolation, the A and ISV service systems are independent in respective domains, cannot be communicated and cannot be connected in series to order a complete link by an automatic means.
Specifically, at side a, the order service is placed from the user at end C to the order receiving connection of the merchant through the interface simulation ISV system, and the quality acceptance is completed. And at the ISV side, relevant ordering release is performed, the ordering service is manually returned in the gray scale period before the system function is on-line and the service is released. The above approaches have disadvantages: 1) the A side only can ensure the functions of the service system in the A domain by using a simulation mode; 2) the ISV is lack of single ordering ability under A, only manual business regression can be carried out, the workload is large, and meanwhile problems caused by other non-ordering businesses are easy to evaluate and omit.
Therefore, in the face of service systems in different domains, how to implement automatic concatenation of complete service links, find problems in advance, reduce damage to services, and become a technical problem which needs to be solved urgently.
Disclosure of Invention
In view of the above problems, the present invention is proposed to provide a method and a system for testing service quality of a multi-service system, a computer storage medium and a computing device, which overcome the above problems or at least partially solve the above problems, and can open the multi-service system, implement an automatic test of a serial complete service link, find problems in advance, and guarantee online services.
According to an aspect of the embodiments of the present invention, a method for testing service quality of a multi-service system is provided, including:
establishing respective test platforms of each service system in the multi-service system, wherein the respective test platforms of each service system externally provide the atomic operation capability of the service system;
when a set service scene is tested, determining a plurality of atomic operations corresponding to the set service scene;
for each atomic operation in the plurality of atomic operations, calling the atomic operation through a test platform providing the atomic operation capability, calling a service system of the called atomic operation to execute service operation, calling the test platform of the atomic operation to execute test point verification on the atomic operation, and generating a node verification result;
and collecting and analyzing the node check results generated by the respective test platform of each service system to generate a service quality report of the multi-service system.
Optionally, the respective test platform of each service system provides the atomic operation capability of the service system to the outside through an atomic operation interface;
invoking the atomic operation through a test platform that provides the atomic operation capability, comprising:
and calling the atomic operation interface to a test platform providing the atomic operation capability to call the atomic operation.
Optionally, the method further comprises: constructing a service object for testing in each service system;
the called atomic operation calls a service system of the atomic operation to execute the service operation, and the method comprises the following steps:
the called atomic operation calls a service system of the atomic operation, and the service operation is executed on the service object for testing.
Optionally, invoking the atomic operation through a test platform providing the atomic operation capability includes:
and submitting authentication information to the test platform providing the atomic operation capability, and calling the atomic operation through the test platform providing the atomic operation capability after the authentication information passes the authentication.
Optionally, the method further comprises: and selecting any one test platform from the test platforms of the multi-service system as a designated test platform, and organizing and calling each atomic operation in the plurality of atomic operations by the designated test platform.
Optionally, the invoking, by the specified test platform organization, each of the plurality of atomic operations comprises:
and organizing and calling the calling sequence of each atomic operation in the plurality of atomic operations by the specified test platform, and transmitting the service operation result of the current atomic operation to the next atomic operation, so that the next atomic operation executes the service operation based on the service operation result of the current atomic operation.
Optionally, other test platforms except the specified test platform in the test platforms of the multi-service system synchronize the node verification result generated by the test platforms to the specified test platform;
collecting node verification results generated by the respective test platforms of the service systems, including:
and the appointed test platform receives the synchronous node verification results of other test platforms except the appointed test platform in the test platforms of the multi-service system so as to collect the node verification results generated by the respective test platforms of the service systems.
Optionally, after generating the service quality report of the multi-service system, the method further includes:
and outputting the service quality report of the multi-service system in a preset output mode.
According to another aspect of the embodiments of the present invention, there is also provided a service quality testing system of a multi-service system, including:
the system comprises an establishing unit, a processing unit and a processing unit, wherein the establishing unit is suitable for establishing respective testing platforms of each service system in a multi-service system, and the respective testing platforms of each service system externally provide the atomic operation capability of the service system;
the device comprises a determining unit, a judging unit and a judging unit, wherein the determining unit is suitable for determining a plurality of atomic operations corresponding to a set service scene when the set service scene is tested;
the test unit is suitable for calling the atomic operation through a test platform providing the atomic operation capability for each atomic operation in the plurality of atomic operations, then the called atomic operation calls a service system of the test unit to execute the service operation, and the test platform calling the atomic operation executes test point verification on the atomic operation to generate a node verification result;
and the generating unit is suitable for collecting and analyzing the node checking result generated by the respective testing platform of each service system and generating a service quality report of the multi-service system.
Optionally, the respective test platform of each service system provides the atomic operation capability of the service system to the outside through an atomic operation interface; the test unit is further adapted to:
and calling the atomic operation interface to a test platform providing the atomic operation capability to call the atomic operation.
Optionally, the system further comprises:
the construction unit is suitable for constructing the business object for testing in each business system;
the test unit is also suitable for the called atomic operation to call the service system of the test unit and execute the service operation on the service object for testing.
Optionally, the test unit is further adapted to:
and submitting authentication information to the test platform providing the atomic operation capability, and calling the atomic operation through the test platform providing the atomic operation capability after the authentication information passes the authentication.
Optionally, the test unit is further adapted to:
and selecting any one test platform from the test platforms of the multi-service system as a designated test platform, and organizing and calling each atomic operation in the plurality of atomic operations by the designated test platform.
Optionally, the test unit is further adapted to:
and organizing and calling the calling sequence of each atomic operation in the plurality of atomic operations by the specified test platform, and transmitting the service operation result of the current atomic operation to the next atomic operation, so that the next atomic operation executes the service operation based on the service operation result of the current atomic operation.
Optionally, the system further comprises:
the synchronization unit is suitable for other test platforms except the specified test platform in the test platforms of the multi-service system to synchronize the node verification result generated by the test platform to the specified test platform;
the generating unit is further adapted to receive, by the designated test platform, node verification results synchronized with other test platforms except the designated test platform in the test platform of the multi-service system, so as to collect node verification results generated by the respective test platforms of the respective service systems.
Optionally, the system further comprises:
and the output unit is suitable for outputting the service quality report of the multi-service system in a preset output mode after the generation unit generates the service quality report of the multi-service system.
According to yet another aspect of the embodiments of the present invention, there is also provided a computer storage medium storing computer program code, which, when run on a computing device, causes the computing device to execute the above-mentioned method for testing the quality of service of a multi-service system.
According to still another aspect of the embodiments of the present invention, there is also provided a computing device including: a processor; a memory storing computer program code; the computer program code, when executed by the processor, causes the computing device to perform the above-described method of quality of service testing of a multi-service system.
By the technical scheme, the service quality testing method of the multi-service system provided by the embodiment of the invention establishes the respective testing platform of each service system in the multi-service system, provides the atomic operation capability of the service system to the outside through the respective testing platform of each service system, thereby completing each service system, calls the atomic operation of the set service scene through the testing platform providing the atomic operation capability, realizes the automatic test of the serial complete service link, can find the problem in advance and guarantees the on-line service.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
The above and other objects, advantages and features of the present invention will become more apparent to those skilled in the art from the following detailed description of specific embodiments thereof, taken in conjunction with the accompanying drawings.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:
fig. 1 shows a flow chart of a method of quality of service testing of a multi-service system according to an embodiment of the invention;
fig. 2 is a flowchart illustrating a method for testing service quality of an a service system and an ISV service system according to an embodiment of the present invention;
FIG. 3 shows an interaction diagram of the A service system, the A test platform, the ISV test platform, and the ISV service system;
FIG. 4 illustrates a schematic diagram of a quality of service report in accordance with an embodiment of the present invention;
fig. 5 shows a schematic diagram of a quality of service report according to another embodiment of the invention;
FIG. 6 shows a block diagram of a quality of service test system of a multi-service system according to an embodiment of the invention;
fig. 7 is a block diagram illustrating a service quality testing system of a multi-service system according to another embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
In order to solve the above technical problems, embodiments of the present invention provide a method and a system for testing service quality of a multi-service system, a computer storage medium, and a computing device, which can open the multi-service system, implement an automated test of a serial complete service link, find a problem in advance, and guarantee an online service.
Fig. 1 shows a flowchart of a method for testing the service quality of a multi-service system according to an embodiment of the present invention. As shown in fig. 1, the method may include the following steps S101 to S104:
step S101, establishing respective test platforms of each service system in the multi-service system, wherein the respective test platforms of each service system externally provide atomic operation capability of the service system;
step S102, when testing the set service scene, determining a plurality of atomic operations corresponding to the set service scene;
step S103, for each atomic operation in a plurality of atomic operations, calling the atomic operation through a test platform providing the atomic operation capability, calling a service system of the atomic operation to execute the service operation, calling the test platform of the atomic operation to execute test point verification on the atomic operation, and generating a node verification result;
and step S104, collecting and analyzing the node check results generated by the respective test platform of each service system, and generating a service quality report of the multi-service system.
The method for testing the service quality of the multi-service system provided by the embodiment of the invention establishes the respective test platform of each service system in the multi-service system, provides the atomic operation capability of the service system to the outside through the respective test platform of each service system, thereby opening each service system, calls the atomic operation of the set service scene through the test platform providing the atomic operation capability, realizes the automatic test of the serial complete service link, can find the problem in advance and ensure the on-line service.
In step S101, the respective test platform of each service system provides the atomic operation capability of the service system to the outside, specifically, the respective test platform of each service system provides the atomic operation capability of the service system to the outside through the atomic operation interface. Therefore, the external part can send a request for calling the atomic operation interface to the test platform of the service system, the test platform interacts with the service system according to the request, the service system executes the atomic operation and returns the operation result of the atomic operation to the test platform, and then the test platform returns the operation result of the atomic operation to the external part.
The atomic operation may be a minimum operation unit, taking the ordering service as an example, the atomic operation may be operations of purchase adding, purchase deduction, order placing, order receiving, order rejecting, and the like, and these atomic operations may be combined into the ordering operation. In an optional embodiment, the atomic operation may also be a predefined operation for implementing a service function, and in the ordering service, the buy-up and buy-down operations may be taken as the atomic operation.
In an optional embodiment of the present invention, a service object for testing may be constructed in each service system, so as to implement data isolation, and the online service is not affected during testing, that is, the service object for testing is only used for testing, and no service is provided to the outside. Specifically, the called atomic operation calls a service system of the atomic operation itself, and performs a service operation on a service object for testing.
In step S103, the atomic operation is called by the test platform providing the atomic operation capability, and the identity verification information may also be submitted to the test platform providing the atomic operation capability, and after the identity verification information passes, the atomic operation is called by the test platform providing the atomic operation capability. Therefore, the safety of the service system can be improved through the identity verification of the test platform.
In an optional embodiment of the present invention, in order to improve the testing efficiency, any one of the test platforms of the multi-service system may be selected as a designated test platform, and the designated test platform organizes and calls each atomic operation of the plurality of atomic operations.
Further, when the designated test platform organizes and calls each of the plurality of atomic operations, the designated test platform organizes and calls the calling sequence of each of the plurality of atomic operations, and transfers the service operation result of the current atomic operation to the next atomic operation, so that the next atomic operation executes the service operation based on the service operation result of the current atomic operation.
In an optional embodiment of the present invention, the other test platforms except the designated test platform in the test platform of the multi-service system synchronize the node verification result generated by the other test platforms except the designated test platform to the designated test platform, so that the node verification result generated by the respective test platforms of each service system is collected in step S104.
After the service quality report of the multi-service system is generated in step S104, the embodiment of the present invention may further output the service quality report of the multi-service system in a preset output manner. Here, the preset output mode may be a text mode, a picture mode, a mail mode, and the like, which is not limited in this embodiment of the present invention.
In the above, various implementation manners of each link in the embodiment shown in fig. 1 are introduced, and the service quality testing method of the multi-service system provided in the embodiment of the present invention is further described in combination with a specific service system.
The catering ordering service comprises a service system A and an ISV service system, wherein the service system A provides operations such as order adding, order subtracting, order placing and the like executed by a C-end user on an application program A, the ISV service system provides operations such as order receiving, order rejection, synchronous order state and the like executed by a merchant on a POS machine, and the service system A and the ISV service system belong to different domains. It should be noted that the a service system listed here is only illustrative and does not limit the embodiment of the present invention.
Fig. 2 is a flowchart illustrating a method for testing service quality of an a service system and an ISV service system according to an embodiment of the present invention. As shown in fig. 2, the service quality testing method may include the following steps S201 to S206.
Step S201, an a test platform of the a service system and an ISV test platform of the ISV service system are established, where the a test platform provides the atomic operation capability of the a service system externally, and the ISV test platform provides the atomic operation capability of the ISV service system externally.
In the step, the A test platform provides the atomic operation capability of the A service system to the outside through an atomic operation interface; the ISV test platform provides the atomic operation capability of the ISV service system to the outside through the atomic operation interface. The test platform provides the atomic operation capability of the service system to the outside, on one hand, the test platform is harmless to the service system, on the other hand, the external calling interface can be standardized, and the calling party for the change on the service system is not aware, for example, the lower single link of the A service system is changed, at the moment, the ISV test platform is unaware, and the A test platform uniformly adjusts the change point.
Step S202, a test store for testing is constructed in the A service system and the ISV service system.
In this step, a test store may be constructed according to a manner in which the ISV service system accesses the a service system, and specifically, the ISV service system creates the test store and registers identification information of the test store to the a service system, and the a service system stores the identification information of the ISV service system and the test store, thereby facilitating subsequent use.
Step S203, testing the set service scenario, and determining a plurality of atomic operations corresponding to the set service scenario.
In this step, the set service scenario may be a core scenario in the ordering service, which is jointly formulated by the a test platform and the ISV test platform, such as ordering by the a service system, ordering by the ISV service system, and the like.
Step S204, the A test platform organizes and calls each atomic operation in a plurality of atomic operations, the atomic operation is called through the test platform providing the atomic operation capability, then the called atomic operation calls a service system of the A test platform to execute service operation, the test platform calling the atomic operation executes test point verification on the atomic operation, and a node verification result is generated.
In this step, taking ordering of the service system a and ordering of the service system ISV as examples, the test platform a organizes itself to call the next monatomic operation, the called next monatomic operation calls the service system a to execute the service operation, and the test platform a executes test point verification on the next monatomic operation to generate a node verification result. Meanwhile, the A test platform transmits the operation result of the next single-atom operation to the single-atom receiving operation, the A test platform calls the single-atom receiving operation of the ISV test platform, the called single-atom receiving operation calls the ISV service system to execute service operation, and the ISV test platform executes test point verification on the single-atom receiving operation to generate a node verification result.
In an alternative embodiment, each of the plurality of atomic operations may also be invoked by the ISV test platform organization. Still taking ordering of the service system A and ordering of the service system ISV as examples, the ISV test platform calls the next monatomic operation of the test platform A, the called next monatomic operation calls the service system A to execute the service operation, and the test platform A executes test point verification on the next monatomic operation to generate a node verification result. Meanwhile, the A test platform returns the operation result of the next single-atom operation to the ISV test platform, the ISV test platform transmits the operation result of the next single-atom operation to the single-atom receiving operation, the ISV test platform organizes the single-atom receiving operation, the called single-atom receiving operation calls the ISV service system to execute service operation, and the ISV test platform executes test point verification on the single-atom receiving operation to generate a node verification result.
Step S205, the A test platform receives the synchronous node verification result of the ISV test platform.
Step S206, the A test platform collects and analyzes the node check result generated by the A test platform and the synchronous node check result of the ISV test platform, generates and outputs the service quality reports of the A service system and the ISV service system.
In the embodiment of the invention, the A test platform and the ISV test platform jointly make a core scene in the ordering service, automatically regress the core scene in the gray stage after the ordering related system is released and before the service is opened, collect the verification results of each node in the scene, generate the quality inspection report before release, output and submit the quality inspection report, thereby finding problems in time and ensuring the online service.
Fig. 3 shows an interaction diagram of an a-service system, an a-test platform, an ISV test platform, and an ISV service system. Taking ordering by the service system A and order receiving by the ISV service system as examples, in step1, the ISV test platform calls a purchase adding operation interface to the A test platform to obtain an order A. Specifically, the called purchase adding operation calls the A service system to execute the service operation and returns an A order to the A test platform, and the A test platform returns the A order to the ISV test platform, so that the ISV test platform obtains the A order. In the process, the A service system does not sense the testing process, and the A service system pushes the A order to the ISV service system after generating the A order.
In step2, the A test platform calls the order taking operation interface to the ISV test platform to obtain the order state. Specifically, the called order receiving operation calls an ISV service system to execute service operation and returns an order state to the ISV test platform, and the ISV test platform returns the order state to the A test platform, so that the A test platform obtains the order state. In the process, the ISV service system does not sense the testing process, and the ISV service system can push the order state to the A service system after generating the order state.
In step3, the ISV test platform synchronizes the node check results to the A test platform.
And after the A test platform collects the check results of the nodes at the A side and the ISV side, a quality report is generated and related personnel are informed.
As shown in fig. 4, in the service quality report diagram, in scene 1, both the node of "post-payment order placement" and "merchant order receiving" pass the test, and the node of "merchant refund" does not pass the test, so that the problem can be timely found, and the problem can be solved, thereby ensuring the online service. In scenario 2, both the "post-paid drop" and "merchant refusal" nodes pass the test.
In an optional embodiment of the invention, the service patrol can be performed on a daily line. In order to find the problems in time, the on-line function inspection of the ordering service needs to be established, daily scene use cases are triggered to be regressed and executed through timing tasks, relevant quality personnel are informed to execute results, and intervention is carried out in time.
As shown in fig. 5, in the service quality report diagram, in scenario 1, the nodes "post payment order placement", "merchant order receipt", and "merchant refund" all pass the test. In scenario 2, both the "post-paid drop" and "merchant refusal" nodes pass the test.
It should be noted that, in practical applications, all the above optional embodiments may be combined in a combined manner at will to form an optional embodiment of the present invention, and details are not described here any more.
Based on the service quality testing method of the multi-service system provided by the above embodiments, based on the same inventive concept, the embodiments of the present invention further provide a service quality testing system of the multi-service system.
Fig. 6 is a schematic structural diagram of a service quality testing system of a multi-service system according to an embodiment of the present invention. As shown in fig. 6, the system may include a setup unit 610, a determination unit 620, a test unit 630, and a generation unit 640.
The establishing unit 610 is adapted to establish respective testing platforms of each service system in the multi-service system, and the respective testing platforms of each service system provide the atomic operation capability of the service system to the outside;
a determining unit 620, adapted to determine, when a set service scenario is tested, a plurality of atomic operations corresponding to the set service scenario;
the testing unit 630 is adapted to, for each atomic operation in the multiple atomic operations, invoke the atomic operation through a testing platform that provides the atomic operation capability, further invoke the atomic operation to invoke a service system of its own to execute a service operation, invoke the testing platform of the atomic operation to execute test point verification on the atomic operation, and generate a node verification result;
the generating unit 640 is adapted to collect and analyze the node verification results generated by the respective testing platforms of the respective service systems, and generate a service quality report of the multi-service system.
In an optional embodiment of the present invention, the respective test platform of each service system provides the atomic operation capability of the service system to the outside through the atomic operation interface; the test unit 630 is further adapted to:
and calling the atomic operation interface to a test platform providing the atomic operation capability to call the atomic operation.
In an alternative embodiment of the present invention, as shown in fig. 7, the system illustrated in fig. 6 above may further include a construction unit 710 adapted to construct a business object for testing in each business system;
the testing unit 630 is further adapted to invoke its own service system by the invoked atomic operation, and perform a service operation on the service object for testing.
In an alternative embodiment of the invention, the test unit 630 is further adapted to:
and submitting authentication information to the test platform providing the atomic operation capability, and calling the atomic operation through the test platform providing the atomic operation capability after the authentication information passes the authentication.
In an alternative embodiment of the invention, the test unit 630 is further adapted to:
and selecting any one test platform from the test platforms of the multi-service system as an appointed test platform, and organizing and calling each atomic operation in the plurality of atomic operations by the appointed test platform.
In an alternative embodiment of the invention, the test unit 630 is further adapted to:
and organizing and calling the calling sequence of each atomic operation in the plurality of atomic operations by the specified test platform, and transmitting the service operation result of the current atomic operation to the next atomic operation, so that the next atomic operation executes the service operation based on the service operation result of the current atomic operation.
In an optional embodiment of the present invention, as shown in fig. 7, the system shown in fig. 6 above may further include a synchronization unit 720, which is adapted to synchronize the node verification result generated by the test platform except the designated test platform in the test platforms of the multi-service system to the designated test platform;
the generating unit 640 is further adapted to assign the test platform to receive the node verification results synchronized by other test platforms except the assigned test platform in the test platform of the multi-service system, so as to collect the node verification results generated by the respective test platforms of the respective service systems.
In an alternative embodiment of the present invention, as shown in fig. 7, the system shown in fig. 6 above may further include an output unit 730, adapted to output the qos report of the multi-service system in a preset output manner after the generation unit 640 generates the qos report of the multi-service system.
Based on the same inventive concept, an embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores computer program codes, and when the computer program codes run on a computing device, the computer storage medium causes the computing device to execute the service quality testing method of the multi-service system.
Based on the same inventive concept, an embodiment of the present invention further provides a computing device, including: a processor; a memory storing computer program code; the computer program code, when executed by the processor, causes the computing device to perform the above-described method of quality of service testing of a multi-service system.
It is clear to those skilled in the art that the specific working processes of the above-described systems, devices, units and modules may refer to the corresponding processes in the foregoing method embodiments, and for the sake of brevity, no further description is provided herein.
In addition, the functional units in the embodiments of the present invention may be physically independent of each other, two or more functional units may be integrated together, or all the functional units may be integrated in one processing unit. The integrated functional units may be implemented in the form of hardware, or in the form of software or firmware.
Those of ordinary skill in the art will understand that: the integrated functional units, if implemented in software and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computing device (e.g., a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention when the instructions are executed. And the aforementioned storage medium includes: u disk, removable hard disk, Read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disk, and other various media capable of storing program code.
Alternatively, all or part of the steps of implementing the foregoing method embodiments may be implemented by hardware (such as a computing device, e.g., a personal computer, a server, or a network device) associated with program instructions, which may be stored in a computer-readable storage medium, and when the program instructions are executed by a processor of the computing device, the computing device executes all or part of the steps of the method according to the embodiments of the present invention.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments can be modified or some or all of the technical features can be equivalently replaced within the spirit and principle of the present invention; such modifications or substitutions do not depart from the scope of the present invention.
According to an aspect of the embodiments of the present invention, a1. a method for testing service quality of a multi-service system is provided, including:
establishing respective test platforms of each service system in the multi-service system, wherein the respective test platforms of each service system externally provide the atomic operation capability of the service system;
when a set service scene is tested, determining a plurality of atomic operations corresponding to the set service scene;
for each atomic operation in the plurality of atomic operations, calling the atomic operation through a test platform providing the atomic operation capability, calling a service system of the called atomic operation to execute service operation, calling the test platform of the atomic operation to execute test point verification on the atomic operation, and generating a node verification result;
and collecting and analyzing the node check results generated by the respective test platform of each service system to generate a service quality report of the multi-service system.
A2. According to the method described in a1, the respective test platform of each service system provides the atomic operation capability of the service system to the outside through an atomic operation interface;
invoking the atomic operation through a test platform that provides the atomic operation capability, comprising:
and calling the atomic operation interface to a test platform providing the atomic operation capability to call the atomic operation.
A3. The method according to a1, further comprising: constructing a service object for testing in each service system;
the called atomic operation calls a service system of the atomic operation to execute the service operation, and the method comprises the following steps:
the called atomic operation calls a service system of the atomic operation, and the service operation is executed on the service object for testing.
A4. The method according to a1, wherein the atomic operation is invoked by a test platform providing the capability of the atomic operation, the method includes:
and submitting authentication information to the test platform providing the atomic operation capability, and calling the atomic operation through the test platform providing the atomic operation capability after the authentication information passes the authentication.
A5. The method according to a1, further comprising:
and selecting any one test platform from the test platforms of the multi-service system as a designated test platform, and organizing and calling each atomic operation in the plurality of atomic operations by the designated test platform.
A6. The method of a5, the invoking, by the specified test platform organization, each of the plurality of atomic operations, comprising:
and organizing and calling the calling sequence of each atomic operation in the plurality of atomic operations by the specified test platform, and transmitting the service operation result of the current atomic operation to the next atomic operation, so that the next atomic operation executes the service operation based on the service operation result of the current atomic operation.
A7. According to the method of a5, synchronizing the node verification results generated by other test platforms except the specified test platform in the test platforms of the multi-service system to the specified test platform;
collecting node verification results generated by the respective test platforms of the service systems, including:
and the appointed test platform receives the synchronous node verification results of other test platforms except the appointed test platform in the test platforms of the multi-service system so as to collect the node verification results generated by the respective test platforms of the service systems.
A8. The method of any of a1-a7, after generating a quality of service report for the multi-service system, the method further comprising:
and outputting the service quality report of the multi-service system in a preset output mode.
According to another aspect of the embodiments of the present invention, there is provided B9. a service quality testing system of a multi-service system, including:
the system comprises an establishing unit, a processing unit and a processing unit, wherein the establishing unit is suitable for establishing respective testing platforms of each service system in a multi-service system, and the respective testing platforms of each service system externally provide the atomic operation capability of the service system;
the device comprises a determining unit, a judging unit and a judging unit, wherein the determining unit is suitable for determining a plurality of atomic operations corresponding to a set service scene when the set service scene is tested;
the test unit is suitable for calling the atomic operation through a test platform providing the atomic operation capability for each atomic operation in the plurality of atomic operations, then the called atomic operation calls a service system of the test unit to execute the service operation, and the test platform calling the atomic operation executes test point verification on the atomic operation to generate a node verification result;
and the generating unit is suitable for collecting and analyzing the node checking result generated by the respective testing platform of each service system and generating a service quality report of the multi-service system.
B10. According to the system described in B9, the respective test platform of each service system provides the atomic operation capability of the service system to the outside through the atomic operation interface; the test unit is further adapted to:
and calling the atomic operation interface to a test platform providing the atomic operation capability to call the atomic operation.
B11. The system of B9, further comprising:
the construction unit is suitable for constructing the business object for testing in each business system;
the test unit is also suitable for the called atomic operation to call the service system of the test unit and execute the service operation on the service object for testing.
B12. The system of B9, the test unit further adapted to:
and submitting authentication information to the test platform providing the atomic operation capability, and calling the atomic operation through the test platform providing the atomic operation capability after the authentication information passes the authentication.
B13. The system of B9, the test unit further adapted to:
and selecting any one test platform from the test platforms of the multi-service system as a designated test platform, and organizing and calling each atomic operation in the plurality of atomic operations by the designated test platform.
B14. The system of B13, the test unit further adapted to:
and organizing and calling the calling sequence of each atomic operation in the plurality of atomic operations by the specified test platform, and transmitting the service operation result of the current atomic operation to the next atomic operation, so that the next atomic operation executes the service operation based on the service operation result of the current atomic operation.
B15. The system of B13, further comprising:
the synchronization unit is suitable for other test platforms except the specified test platform in the test platforms of the multi-service system to synchronize the node verification result generated by the test platform to the specified test platform;
the generating unit is further adapted to receive, by the designated test platform, node verification results synchronized with other test platforms except the designated test platform in the test platform of the multi-service system, so as to collect node verification results generated by the respective test platforms of the respective service systems.
B16. The system of any one of B9-B15, further comprising:
and the output unit is suitable for outputting the service quality report of the multi-service system in a preset output mode after the generation unit generates the service quality report of the multi-service system.
According to a further aspect of embodiments of the present invention, there is also provided c17 a computer storage medium storing computer program code which, when run on a computing device, causes the computing device to perform a method of quality of service testing of a multi-service system according to any one of a 1-A8.
According to yet another aspect of embodiments of the present invention, there is also provided d18. a computing device, comprising: a processor; a memory storing computer program code; the computer program code, when executed by the processor, causes the computing device to perform a method of quality of service testing of a multi-service system as defined in any of a 1-A8.
Claims (18)
1. A method for testing the service quality of a multi-service system is characterized by comprising the following steps:
establishing a respective test platform of each service system in the multi-service system, wherein the respective test platform of each service system externally provides the atomic operation capability of the service system, and the test platform is used for interacting with other test platforms and the service system of the test platform;
when a set service scene is tested, determining a plurality of atomic operations corresponding to the set service scene;
for each atomic operation in the plurality of atomic operations, calling the atomic operation through a test platform providing the atomic operation capability, calling a service system of the called atomic operation to execute service operation, calling the test platform of the atomic operation to execute test point verification on the atomic operation, and generating a node verification result;
and collecting and analyzing the node check results generated by the respective test platform of each service system to generate a service quality report of the multi-service system.
2. The method according to claim 1, wherein the respective testing platform of each service system provides the atomic operation capability of the service system to the outside through an atomic operation interface;
invoking the atomic operation through a test platform that provides the atomic operation capability, comprising:
and calling the atomic operation interface to a test platform providing the atomic operation capability to call the atomic operation.
3. The method of claim 1, further comprising: constructing a service object for testing in each service system;
the called atomic operation calls a service system of the atomic operation to execute the service operation, and the method comprises the following steps:
the called atomic operation calls a service system of the atomic operation, and the service operation is executed on the service object for testing.
4. The method of claim 1, wherein invoking the atomic operation via a test platform that provides the capability of the atomic operation comprises:
and submitting authentication information to the test platform providing the atomic operation capability, and calling the atomic operation through the test platform providing the atomic operation capability after the authentication information passes the authentication.
5. The method of claim 1, further comprising:
and selecting any one test platform from the test platforms of the multi-service system as a designated test platform, and organizing and calling each atomic operation in the plurality of atomic operations by the designated test platform.
6. The method of claim 5, wherein invoking each of the plurality of atomic operations by the specified test platform organization comprises:
and organizing and calling the calling sequence of each atomic operation in the plurality of atomic operations by the specified test platform, and transmitting the service operation result of the current atomic operation to the next atomic operation, so that the next atomic operation executes the service operation based on the service operation result of the current atomic operation.
7. The method according to claim 5, wherein other test platforms except the specified test platform synchronize the node verification results generated by the test platforms to the specified test platform;
collecting node verification results generated by the respective test platforms of the service systems, including:
and the appointed test platform receives the synchronous node verification results of other test platforms except the appointed test platform in the test platforms of the multi-service system so as to collect the node verification results generated by the respective test platforms of the service systems.
8. The method according to any of claims 1-7, wherein after generating the quality of service report for the multi-service system, the method further comprises:
and outputting the service quality report of the multi-service system in a preset output mode.
9. A service quality testing system for a multi-service system, comprising:
the system comprises an establishing unit, a processing unit and a processing unit, wherein the establishing unit is suitable for establishing a respective testing platform of each service system in the multi-service system, and the respective testing platform of each service system externally provides the atomic operation capability of the service system, and is used for interacting with other testing platforms and the service system per se;
the device comprises a determining unit, a judging unit and a judging unit, wherein the determining unit is suitable for determining a plurality of atomic operations corresponding to a set service scene when the set service scene is tested;
the test unit is suitable for calling the atomic operation through a test platform providing the atomic operation capability for each atomic operation in the plurality of atomic operations, then the called atomic operation calls a service system of the test unit to execute the service operation, and the test platform calling the atomic operation executes test point verification on the atomic operation to generate a node verification result;
and the generating unit is suitable for collecting and analyzing the node checking result generated by the respective testing platform of each service system and generating a service quality report of the multi-service system.
10. The system according to claim 9, wherein the respective testing platform of each service system provides the atomic operation capability of the service system to the outside through an atomic operation interface; the test unit is further adapted to:
and calling the atomic operation interface to a test platform providing the atomic operation capability to call the atomic operation.
11. The system of claim 9, further comprising:
the construction unit is suitable for constructing the business object for testing in each business system;
the test unit is also suitable for the called atomic operation to call the service system of the test unit and execute the service operation on the service object for testing.
12. The system of claim 9, wherein the testing unit is further adapted to:
and submitting authentication information to the test platform providing the atomic operation capability, and calling the atomic operation through the test platform providing the atomic operation capability after the authentication information passes the authentication.
13. The system of claim 9, wherein the testing unit is further adapted to:
and selecting any one test platform from the test platforms of the multi-service system as a designated test platform, and organizing and calling each atomic operation in the plurality of atomic operations by the designated test platform.
14. The system of claim 13, wherein the testing unit is further adapted to:
and organizing and calling the calling sequence of each atomic operation in the plurality of atomic operations by the specified test platform, and transmitting the service operation result of the current atomic operation to the next atomic operation, so that the next atomic operation executes the service operation based on the service operation result of the current atomic operation.
15. The system of claim 13, further comprising:
the synchronization unit is suitable for other test platforms except the specified test platform in the test platforms of the multi-service system to synchronize the node verification result generated by the test platform to the specified test platform;
the generating unit is further adapted to receive, by the designated test platform, node verification results synchronized with other test platforms except the designated test platform in the test platform of the multi-service system, so as to collect node verification results generated by the respective test platforms of the respective service systems.
16. The system according to any one of claims 9-15, further comprising:
and the output unit is suitable for outputting the service quality report of the multi-service system in a preset output mode after the generation unit generates the service quality report of the multi-service system.
17. A computer storage medium having computer program code stored thereon which, when run on a computing device, causes the computing device to perform a method of quality of service testing of a multi-service system as claimed in any one of claims 1 to 8.
18. A computing device, comprising: a processor; a memory storing computer program code; the computer program code, when executed by the processor, causes the computing device to perform a method of quality of service testing of a multi-service system as claimed in any of claims 1 to 8.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911039182.2A CN111026639B (en) | 2019-10-29 | 2019-10-29 | Method and system for testing service quality of multi-service system |
| PCT/CN2020/124034 WO2021083144A1 (en) | 2019-10-29 | 2020-10-27 | Service quality testing for multi-service system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911039182.2A CN111026639B (en) | 2019-10-29 | 2019-10-29 | Method and system for testing service quality of multi-service system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111026639A CN111026639A (en) | 2020-04-17 |
| CN111026639B true CN111026639B (en) | 2021-03-02 |
Family
ID=70204704
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911039182.2A Active CN111026639B (en) | 2019-10-29 | 2019-10-29 | Method and system for testing service quality of multi-service system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111026639B (en) |
| WO (1) | WO2021083144A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111026639B (en) * | 2019-10-29 | 2021-03-02 | 口碑(上海)信息技术有限公司 | Method and system for testing service quality of multi-service system |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201248052Y (en) * | 2008-06-26 | 2009-05-27 | 阿里巴巴集团控股有限公司 | Service integration platform system and system for providing internet service |
| CN101650652B (en) * | 2009-09-17 | 2012-07-18 | 中兴通讯股份有限公司 | Method and device for developing business processes |
| EP2541394A4 (en) * | 2010-02-23 | 2014-09-03 | Inn-Sung Bang | Remote application development intermediation system for intermediating program's development contract and development using client's virtual development configuration and method for intermediating remote program development |
| US9842042B2 (en) * | 2014-09-25 | 2017-12-12 | Bank Of America Corporation | Datacenter management computing system |
| CN106484603B (en) * | 2015-08-26 | 2019-08-09 | 阿里巴巴集团控股有限公司 | A kind of service test method and device |
| CN107015902B (en) * | 2016-01-27 | 2021-02-09 | 创新先进技术有限公司 | Test method and test equipment |
| CN107526676B (en) * | 2016-06-20 | 2021-03-02 | 江苏苏宁物流有限公司 | Cross-system test method and device |
| CN107832231A (en) * | 2017-12-05 | 2018-03-23 | 郑州云海信息技术有限公司 | A kind of system detection method, device and medium |
| CN109189669A (en) * | 2018-08-03 | 2019-01-11 | 平安科技（深圳）有限公司 | Test method, electronic device and the readable storage medium storing program for executing of business scenario |
| CN109739634A (en) * | 2019-01-16 | 2019-05-10 | 中国银联股份有限公司 | A kind of atomic task execution method and device |
| CN109933522B (en) * | 2019-01-25 | 2022-04-22 | 畅捷通信息技术股份有限公司 | Test method, test system and storage medium for automatic case |
| CN111026639B (en) * | 2019-10-29 | 2021-03-02 | 口碑(上海)信息技术有限公司 | Method and system for testing service quality of multi-service system |
-
2019
- 2019-10-29 CN CN201911039182.2A patent/CN111026639B/en active Active
-
2020
- 2020-10-27 WO PCT/CN2020/124034 patent/WO2021083144A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| CN111026639A (en) | 2020-04-17 |
| WO2021083144A1 (en) | 2021-05-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109617759A (en) | Block catenary system stability test method, apparatus, equipment and storage medium | |
| CN110502426A (en) | The test method and device of distributed data processing system | |
| CN110472809A (en) | Calculate the basic reason and forecast analysis of Environmental Technology problem | |
| CN109582301A (en) | Method for processing business, device, equipment and the medium of task based access control scheduling system | |
| CN112488652B (en) | Work order auditing method, system, terminal and storage medium | |
| CN105099801B (en) | The test system of information management system and test environment analogy method | |
| Harrer et al. | Open source versus proprietary software in service-orientation: the case of BPEL engines | |
| CN111245900A (en) | Distributed message sending processing system and processing method thereof | |
| CN107153646A (en) | A kind of data processing method and equipment | |
| TW202232395A (en) | Cloud platform management method, apparatus, electronic device, and storage medium | |
| CN108111368A (en) | The function test method and device of a kind of transaction system | |
| CN110007921A (en) | A kind of code dissemination method and device | |
| CN111444051A (en) | Complete machine production testing method and system for product | |
| CN111026639B (en) | Method and system for testing service quality of multi-service system | |
| CN111311200B (en) | Management method and device for guest consultation work order platform | |
| US7844870B2 (en) | Method for embedded integrated end-to-end testing | |
| CN108038667B (en) | Policy generation method, device and equipment | |
| CN113780969B (en) | Customs declaration method and system | |
| CN118394642A (en) | Verification method and device | |
| CN116107913B (en) | Test control method, device and system of single-node server | |
| CN115576827A (en) | Performance test method, device, equipment and storage medium of business process software | |
| CN113360363B (en) | Method, device, equipment and computer storage medium for testing micro service system | |
| CN112184406A (en) | Data processing method, system, electronic device and computer readable storage medium | |
| CN110942298A (en) | Payment data transmission control method and device, electronic equipment and storage medium | |
| CN115879754A (en) | Performance monitoring method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40026871 Country of ref document: HK |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |