CN116467189B - Method and system for interface call completion performance pressure measurement and full link data monitoring - Google Patents
Method and system for interface call completion performance pressure measurement and full link data monitoring Download PDFInfo
- Publication number
- CN116467189B CN116467189B CN202310342105.4A CN202310342105A CN116467189B CN 116467189 B CN116467189 B CN 116467189B CN 202310342105 A CN202310342105 A CN 202310342105A CN 116467189 B CN116467189 B CN 116467189B
- Authority
- CN
- China
- Prior art keywords
- performance
- test
- data
- monitoring
- link
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 91
- 238000012544 monitoring process Methods 0.000 title claims abstract description 80
- 238000009530 blood pressure measurement Methods 0.000 title claims abstract description 11
- 238000012360 testing method Methods 0.000 claims abstract description 106
- 230000008569 process Effects 0.000 claims abstract description 23
- 238000013515 script Methods 0.000 claims abstract description 16
- 230000000007 visual effect Effects 0.000 claims abstract description 15
- 238000000528 statistical test Methods 0.000 claims abstract description 5
- 238000011056 performance test Methods 0.000 claims description 66
- 238000013523 data management Methods 0.000 claims description 11
- 230000006835 compression Effects 0.000 claims description 8
- 238000007906 compression Methods 0.000 claims description 8
- 238000013507 mapping Methods 0.000 claims description 8
- 238000007726 management method Methods 0.000 claims description 7
- 238000007405 data analysis Methods 0.000 claims description 6
- 238000005259 measurement Methods 0.000 claims description 5
- 230000004044 response Effects 0.000 claims description 4
- 230000010365 information processing Effects 0.000 abstract description 2
- 238000004590 computer program Methods 0.000 description 10
- 238000004458 analytical method Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 230000002776 aggregation Effects 0.000 description 2
- 238000004220 aggregation Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000010998 test method Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000002620 method output Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 230000008092 positive effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3696—Methods or tools to render software testable
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3089—Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/323—Visualisation of programs or trace data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3452—Performance evaluation by statistical analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/40—Transformation of program code
- G06F8/53—Decompilation; Disassembly
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Data Mining & Analysis (AREA)
- Life Sciences & Earth Sciences (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Probability & Statistics with Applications (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application belongs to the technical field of airport information processing, and discloses a method and a system for performing performance pressure measurement and full-link data monitoring by interface calling. The method obtains a parameter entering form through decompilation of a system program source code jar packet, performs interface call based on a Jmeter-plug ins-for-apache-dubbo plug-in of a pressure test tool Jmeter, completes parameter setting of parameter entering, and integrates with monitoring of Prometheus and a Zipkin distributed tracking system, and performs real-time visual monitoring of full-link performance data and statistical test results display in the pressure test process. The application improves the testing efficiency, reduces the testing cost, only focuses on the configuration correctness of the related plug-ins of the performance testing tool, the related plug-ins of the performance monitoring and the link tracking, writes the performance script in the testing tool according to the performance testing scheme, and does not need to consume huge workload.
Description
Technical Field
The application belongs to the technical field of airport information processing, and particularly relates to a method and a system for performing performance pressure measurement and full-link data monitoring by interface call.
Background
The airport large-scale information system adopts a high-performance RPC distributed service framework Dubbo architecture, a service Provider registers in a Registry, and a service Consumer Consumer makes service call in a subscription mode in the Registry. However, the conventional test method for the Dubbo architecture adopts manual code writing and test code running to obtain test results, lacks support of a test tool, consumes time and energy, is low in efficiency, and does not support full-link performance test and visual monitoring. The airport core information system has high requirements on the performance and the pressure processing capability of the online pair system, and the full-link test of performance pressure and the monitoring of the test process and the result are the problems to be solved.
Therefore, a full-link pressure testing method based on a Dubbo architecture is sought, so that coding can be reduced, performance pressure testing can be realized, real-time link monitoring in a testing process can be completed, and the problem of the testing result which needs to be solved in the prior art can be intuitively counted.
Through the above analysis, the problems and defects existing in the prior art are as follows: the traditional test method for the Dubbo architecture adopts manual code writing and test code running to obtain test results, and the manual code is low in time and energy consumption and low in efficiency, and does not support full-link performance test and monitoring.
Disclosure of Invention
In order to overcome the problems in the related art, the disclosed embodiments of the present application provide a method and a system for performing performance compression measurement and full link data monitoring by interface call. In particular to a performance test and full-link monitoring method of an airport information system based on a Dubbo architecture.
The technical scheme is as follows: the method for completing performance press measurement and full-link data monitoring by interface call comprises the steps of obtaining a parameter entering form through decompilation of a system program source code jar packet, carrying out interface call based on a Jmeter-plug-for-apache-dubbo plug-in of a pressure test tool Jmeter, completing parameter setting of parameter entering, integrating with a Prometheus monitoring and Zipkin distributed tracking system, carrying out real-time visual monitoring on full-link performance data in the pressure test process, and displaying statistical test results.
In one embodiment, the obtaining the entry form through decompilation of the source code jar packet of the system program includes:
and importing jar packages of the software system in the decompilation module, acquiring all Class, service, interface methods and parameter entry fields of the software system, and constructing parameters with dto form of parameter entry fields.
In one embodiment, the Class is a Class in java;
the Service is used for repackaging one or more DAOs to form a Service;
the interface method comprises a java method of a service scene which needs performance test in a specific test scheme.
In one embodiment, the constructing the parameter with the parameter entry field in the form of dto includes: and carrying out parameter assignment on the dto type parameters in the interface method.
The Jmeter-plug-in for-apache-dubbo plug-in based on the pressure test tool Jmeter performs interface call, and the parameterization setting of the entering parameters is completed by the following steps:
(a) The test data management module writes an sql file according to an interface method and test case data which needs to be parameterized and is determined by an input parameter, an sql logic query statement which needs to be tested for performance of a tested system is added in the sql file, a query result is stored in a csv file form, and test data parameterization mapping relation is set through a csv data file configuration element of a Jmeter; the test data parameterized mapping relation comprises the following steps: file path, variable name, value mode.
(b) Writing performance test script modules through
Adding a dubbo sampler into a Jmeter-plug-in-for-apache-dubbo plug-in, configuring a registry address and service consumer information of a dubbo interface at a main interface of the sampler, and storing the registry address information into user-defined variables in a Jmeter tool;
(c) The performance test execution module sets different performance test modes for different test scenes according to the performance test scheme; setting different performance test modes for different test scenes according to the performance test scheme comprises the following steps: through the Thread group configuration of the Jmeter, one-touch triggers execution of a stress test in which performance test cases are viewed through the added aggregate report, result tree listener element.
The method is integrated with a Prometheus monitoring and Zipkin distributed tracking system, and comprises the steps of visually monitoring the whole link performance data in real time and displaying statistical test results in the pressure test process:
(I) The full-link real-time tracking module is used for carrying out real-time tracking on system call link information; the links are called through a trace id serial system of Zipkin, each time the links for executing performance test are called through unique trace ids, real-time monitoring data from each distributed service are gathered, inquiry is carried out according to service names, labels and response time, long-time consumption link nodes are filtered, and collection and data analysis of the performance data are completed;
(II) the performance monitoring and reporting module generates a performance monitoring report; adding Prometaus monitoring in the interceptor of the dubbo, and intercepting all service providers by utilizing a filter interface of the dubbo; and (3) tracking the acquired data by matching with the Zipkin link, performing final performance data display, and performing visual display after inquiring the acquired data through the integrated Grafana plugin.
Another object of the present application is to provide a method for implementing the interface call completion performance pressure measurement and full link data monitoring by using the interface call completion performance pressure measurement and full link data monitoring system, the system comprising:
the decompilation module is used for acquiring the code of the Dubbo service in a decompilation mode and inquiring the parameter type of the interface to be called;
the test data management module is used for inquiring parameter values in the database through the sql and realizing the association of test data through the csv data file setting of the Jmeter;
the performance test script management module is used for configuring the calling of an interface, registry setting, service Consumer Consumer configuration and parameterization setting of test data through jmeter-plug-in for-Apache-dubbo plug-in;
the performance test execution module is used for configuring a pressure test mode through a Thread group of the Jmeter;
the full-link real-time tracking module is used for positioning a calling link for executing a test through Zipkin configuration, gathering real-time monitoring data from each distributed service and completing data acquisition and data analysis;
and the performance monitoring and reporting module is used for acquiring data of Prometaheus and integrating the data acquired by Zipkin link tracking, and finishing performance data display through Grafana.
By combining all the technical schemes, the application has the advantages and positive effects that: in order to solve the problems, the application provides a method and a system for performing performance press test and full-link data monitoring by interface call, which can reduce code writing quantity, namely realize real-time link monitoring of the interface call for performing the performance press test and complete the test process, and intuitively count performance test results, namely realize the performance press test and full-link performance data monitoring by the interface call without writing functional codes of a call interface. The method obtains a parameter entering form through decompilation of a system program source code jar package, performs interface calling based on a Jmeter-plug ins-for-apache-dubbo plug-in of a pressure test tool Jmeter, completes parameter setting of parameter entering to realize performance pressure test, integrates with Prometaus monitoring and a Zipkin distributed tracking system, performs real-time monitoring of full-link performance data in the test process, can visually count test results, fully solves the problems that the traditional test code writing is time-consuming, and is difficult to realize full-link performance test and visual monitoring, and remarkably improves the test efficiency and quality.
Advantages of the present application compared to the prior art further include: the application realizes the performance press test of the airport information system based on the Dubbo architecture, improves the prior technology blank that a large number of codes are required to realize interface call and full-link monitoring link tracking cannot be carried out into the integrated mode that the performance press test can be realized through jmeter-plug-in-for-apache-Dubbo plug-in configuration and the integrated mode that the Prometheus monitoring plug-in and the Zipkin distributed tracking system are matched, realizes the real-time link monitoring of the performance test process and can intuitively count the performance test result, fills the technical blank of the Dubbo architecture performance test, the full-link monitoring and the performance bottleneck positioning analysis in the market, and opens up a new idea for the uniform performance test.
The application realizes the performance test of the system aiming at the Dubbo architecture, can carry out full-link monitoring and positioning analysis of performance bottlenecks, greatly improves the test efficiency, reduces the test cost, and only needs to pay attention to the configuration correctness of related plug-ins of a performance test tool, performance monitoring and link tracking, writes performance scripts in the test tool according to a performance test scheme without consuming huge workload on interface calling codes. The application obviously improves the performability of the performance test and the visual effectiveness of the test result, greatly shortens the fault locating and checking time and greatly ensures the on-line stability of the system.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure;
FIG. 1 is a schematic diagram of an interface call completion performance pressure measurement and full link data monitoring system provided by an embodiment of the present application;
FIG. 2 is a flowchart of a method for performing performance compression testing and full link data monitoring by an interface call provided by an embodiment of the present application;
FIG. 3 is a schematic diagram of a method for performing performance pressure measurement and full link data monitoring by interface call provided by an embodiment of the present application;
fig. 4 is a flowchart of trace interception acquisition information of a request initiated by a Dubbo application service according to an embodiment of the present application through a Zipkin;
in the figure: 1. a decompilation module; 2. a test data management module; 3. a performance test script management module; 4. a performance test execution module; 5. a full-link real-time tracking module; 6. and a performance monitoring and reporting module.
Detailed Description
In order that the above objects, features and advantages of the application will be readily understood, a more particular description of the application will be rendered by reference to the appended drawings. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. The application may be embodied in many other forms than described herein and similarly modified by those skilled in the art without departing from the spirit or scope of the application, which is therefore not limited to the specific embodiments disclosed below.
In embodiment 1, as shown in fig. 1, the system for performing performance compression testing by interface call and full-link data monitoring provided in the embodiment of the present application obtains an input form by decompiling a jar packet of a system program source code compression file, performs interface call by a Jmeter-plug-for-apache-Dubbo (performing pressure testing on a Dubbo interface visualized in a testing tool Jmeter), and integrates with a system monitoring and alarm system Prometaus which is open source and a Zipkin distributed real-time data tracking system, and performs real-time monitoring of full-link performance data in the testing process and can intuitively count the testing result. The system comprises: decompilation module 1, test data management module 2, performance test script management module 3, performance test execution module 4, full link real-time tracking module 5, performance monitoring and reporting module 6.
The decompilation module 1 obtains codes of the Dubbo service of the distributed service framework in a decompilation mode and inquires the type of the input parameters of the interface to be called;
the test data management module 2 queries parameter values in a database through structured query sql and realizes association of test data through csv data file setting of a Jmeter;
the performance test script management module 3 configures calling of interfaces, registry setting, service Consumer Consumer configuration and parameterization setting of test data through jmeter-plug-in for-apache-dubbo plug-in;
the performance test execution module 4 configures a pressure test mode including concurrence number, execution time and the like through a Thread group of the Jmeter, and can trigger execution by one key;
the full-link real-time tracking module 5 is configured by Zipkin, positions a calling link for executing a test, gathers real-time monitoring data from each distributed service, and completes data acquisition and data analysis;
the performance monitoring and reporting module 6, prometheus data acquisition and Zipkin link tracking data acquisition, completes final performance data display through the visualization tool Grafana, and comprises CPU trend, memory trend, network occupation of performance executing process and time consumption of each link node.
In embodiment 2, as shown in fig. 2, the method for completing performance compression measurement and full link data monitoring by interface call provided in the embodiment of the present application includes the following steps:
s1, importing jar packages of a software system in a decompilation module 1;
obtaining all classes (Class is one Class in java and other non-inherited classes) of a software system, service (Service layer called Service layer, called Service), roughly understood to be the repackage of one or more DAOs (Data Access Objects is an application program interface provided by VB), packaging into one Service, an interface method (java method of a Service scene needing performance test in a specific test scheme) and a parameter entry field of each method, wherein the parameter entry field is obtained according to the interface method needing performance test in the test scheme, and constructs parameters in dto form of parameter entry field, and the construction is used for assigning parameters in dto form of parameters in the interface method;
s2, the test data management module 2 writes the sql file according to an interface method and test case data which needs to be parameterized according to parameter entering determination;
adding sql logic query sentences of a specified method of a service scene of a tested system needing performance test into the sql file, storing query results in a csv file form, and setting a test data parameterized mapping relation by a csv data file configuration element of a Jmeter, wherein the test data parameterized mapping relation comprises a file path, a variable name and a value mode;
s3, writing a performance test script module 3 through
jmeter-plug-for-apache-dubbo plug-in adds a dubbo sampler;
configuring a registry address (provided by a tested system) of the dubbo interface and service consumer information (provided by the tested system) on a main interface of the sampler, and storing the information such as the registry address and the like into user-defined variables in a Jmeter tool; writing a performance test script in a dubbo sampler according to a transaction scene in a performance test scheme, wherein the performance test script comprises an interface name, a method parameter and the like, the method parameter is subjected to parameterization setting and is associated with a csv file in a test data management module, and the parameter name in the csv file is particularly consistent with the parameter name in the script so as to be automatically associated; the user-defined variable can be repeatedly called and loaded through the sampler, and a corresponding method is called after configuration is obtained;
s4, the performance test execution module 4 sets different performance test modes for different test scenes according to the performance test scheme;
through Thread group configuration of the Jmeter, including sampler execution mode, concurrent user number of calling method, duration of pressure test; one-key triggering execution performance test, wherein in the test execution process, the performance test condition can be checked through added monitor elements such as an aggregation report, a fruit tree and the like;
s5, the full-link real-time tracking module 5 performs real-time tracking of system call link information;
comprising the following steps: in the system method, a system call link is connected in series through trace id (generation rule) of Zipkin, each call can be positioned to a link for executing performance test through a unique trace id, real-time monitoring data from each distributed service are gathered, inquiry is carried out according to service names, labels, response time and the like, link nodes with relatively long time consumption are filtered, and collection and data analysis of the performance data are completed;
s6, the performance monitoring and reporting module 6 generates a performance monitoring and reporting;
comprising the following steps: adding Prometaus monitoring in an interceptor of the dubbo to realize a filter interface of the dubbo, and declaring to intercept all service providers; the method comprises the steps of tracking collected data by matching with a Zipkin link, completing final performance data display, inquiring the collected data through an integrated Grafana plug-in, then completing visual display, displaying a performance monitoring report through a visual report view, analyzing and displaying test results from multiple dimensions, intuitively positioning the performance bottleneck of a system, and rapidly performing fault discovery of a service link; the test results comprise CPU utilization rate, memory utilization trend, hard disk utilization, network occupation and time consumption of each link node in the performance test process.
Embodiment 3 as shown in fig. 3, the method for completing performance compression measurement and full link data monitoring by interface call provided in the embodiment of the present application includes:
step 1, loading jar packages of dubbo services registered on a zookeeper by an airport information system, obtaining all class, service, interface methods and parameters of each method of the system through decompilation, obtaining the interface methods according to performance test scenes formulated in a test scheme, searching code segments containing keywords in functional codes for identification, obtaining parameter entering fields, directly assigning basic long and string parameters, and constructing assigned json types for dto-form parameters.
Step 2, writing an sql file according to the interface method output by the decompilation module 1 and the input parameters of each method, wherein the sql file comprises the interface method and the input sql logic query statement, the query result is exported by the sql query statement in the test data management module and is associated by the csv file, the specific operation is to add a csv data file configuration element in a sampler of the Jmeter, configure the parameterized mapping relation of the test data, and comprise the storage path of the sql query result file
(the auxiliary function can be configured into a relative path), the coding mode of the sql query result file, the parameterized variable name, the value mode of the variable and the circulating mode of the variable. And realizing the driving management of the test data by configuring and loading the mapping relation of the csv data file configuration element.
Step 3, adding a dubbo sampler through a jmeter-plug-in for-apache-dubbo plug-in, loading a registry address, service consumer information, an interface name and other performance parameters of a configuration dubbo interface, storing the registry address, the interface name and the other performance parameters into user-defined variables, and calling a corresponding method after the configuration is obtained by repeatedly calling the loading user-defined variables through the sampler; according to the transaction scenario in the system performance test scheme, a performance test script is written in a dubbo sampler, as in fig. 3, an interface method and an input parameter are obtained through a decompilation module 1, the value of a method parameter is a json type of construction, and test data and interface parameters are associated through a csv file in a test data management module 2 in fig. 3.
Step 4, setting different performance test plans according to different test scenes in the performance test scheme, wherein the performance test plans are configured through a Thread group of the Jmeter, and the Thread group is configured with an execution mode of a sampler, the number of concurrent users of a calling method and the duration of performance pressure test as shown in fig. 3; the performance test execution module 4 is a one-key triggering performance test, and executes the performance script in the performance test script management module according to the parameter setting configured in the Thread group during one-key execution; in the performance test execution process, the initial checking of the performance test condition is realized by adding the aggregation report of the Jmeter, the monitor elements of the result tree and the like.
And 5, as shown in fig. 4, connecting links in series in a system through trace ids of Zipkins, recording time stamps of current calls when the system sends requests, burying points through an interceptor to obtain globally unique call chain trace ids, controlling the call chain trace ids to accompany the whole process of the requested call chain, recording the time spent by the current call after the call is finished, integrating information generated by the flow in fig. 4 into a span, as in fig. 3, uploading the span to a Collector module of the Zipkins to complete data acquisition and analysis, collecting performance monitoring data of each service request on each distributed service call link, providing data support for a performance monitoring and reporting module, inquiring according to service names, labels, response time and the like, and improving fault positioning speed through the performance data of the call link.
Step 6, adding Prometheus monitoring in the interceptor of the dubbo to realize the filter interface of the dubbo, declaring interception of all service providers, and collecting performance data in the testing process by the Prometheus monitoring module in the performance testing process, wherein the performance data comprises CPU usage rate, memory usage trend, hard disk usage condition and network throughput condition in the performance testing process, and collecting the performance monitoring data of each service request on each distributed service calling link through a full-link real-time tracking module Zipkin in FIG. 3; the Prometheus visual data component Grafana queries the performance data collected by a plurality of data sources and then carries out visual display, the visual report view monitors and reports the performance process from a plurality of dimensions by using a flexible panel plug-in, the alarm rule of the most important index is defined in a visual mode, the alarm is continuously calculated and sent out, and when the data reaches a threshold value, the alarm is sent out, the performance bottleneck of the system is intuitively positioned, and the fault discovery of a service link is rapidly carried out.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.
The content of the information interaction and the execution process between the devices/units and the like is based on the same conception as the method embodiment of the present application, and specific functions and technical effects brought by the content can be referred to in the method embodiment section, and will not be described herein.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, the specific names of the functional units and modules are only for distinguishing from each other, and are not used for limiting the protection scope of the present application. For specific working processes of the units and modules in the system, reference may be made to corresponding processes in the foregoing method embodiments.
Based on the technical solutions described in the embodiments of the present application, the following application examples may be further proposed.
According to an embodiment of the present application, there is also provided a computer apparatus including: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, which when executed by the processor performs the steps of any of the various method embodiments described above.
Embodiments of the present application also provide a computer readable storage medium storing a computer program which, when executed by a processor, performs the steps of the respective method embodiments described above.
The embodiment of the application also provides an information data processing terminal, which is used for providing a user input interface to implement the steps in the method embodiments when being implemented on an electronic device, and the information data processing terminal is not limited to a mobile phone, a computer and a switch.
The embodiment of the application also provides a server, which is used for realizing the steps in the method embodiments when being executed on the electronic device and providing a user input interface.
Embodiments of the present application also provide a computer program product which, when run on an electronic device, causes the electronic device to perform the steps of the method embodiments described above.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present application may implement all or part of the flow of the method of the above embodiments, and may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include at least: any entity or device capable of carrying computer program code to a photographing device/terminal apparatus, recording medium, computer Memory, read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), electrical carrier signals, telecommunications signals, and software distribution media. Such as a U-disk, removable hard disk, magnetic or optical disk, etc.
While the application has been described with respect to what is presently considered to be the most practical and preferred embodiments, it is to be understood that the application is not limited to the disclosed embodiments, but on the contrary, is intended to cover various modifications, equivalents, and alternatives falling within the spirit and scope of the application.
Claims (9)
1. A method for completing performance press test and full-link data monitoring by interface call is characterized in that the method obtains a parameter entering form through decompilation of a system program source code jar packet, carries out interface call based on a Jmeter-plug ins-for-apache-dubbo plug-in of a pressure test tool Jmeter, completes parameter setting of parameter entering, integrates with a Prometheus monitoring and Zipkin distributed tracking system, carries out real-time visual monitoring and displaying statistical test results on full-link performance data in the pressure test process;
the Jmeter-plug-in for-apache-dubbo plug-in based on the pressure test tool Jmeter performs interface call, and the parameterization setting of the entering parameters is completed by the following steps:
(a) The test data management module (2) writes an sql file according to an interface method and test case data which needs to be parameterized and is determined by entering parameters, an sql logic query statement which needs to be tested for performance of a tested system is added in the sql file, a query result is stored in a csv file form, and test data parameterized mapping relation is set through a csv data file configuration element of a Jmeter;
(b) A performance test script writing module (3) adds a dubbo sampler through Jmeter-plug-in for-apache-dubbo plug-in, configures a registry address and service consumer information of a dubbo interface at a main interface of the sampler, and stores the registry address information into user-defined variables in a Jmeter tool;
(c) The performance test execution module (4) sets different performance test modes for different test scenes according to the performance test scheme.
2. The method for performing performance instrumentation and full link data monitoring by interface call according to claim 1, wherein said obtaining the entry form by decompiling the source code jar packet of the system program comprises:
and importing jar packets of the software system into the decompilation module (1), acquiring all Class, service, interface methods and parameter entry fields of the software system, and constructing parameters with dto form of parameter entry fields.
3. The method for performing performance compression measurement and full link data monitoring by interface call according to claim 2, wherein the Class is a Class in java;
the Service is used for repackaging one or more DAOs to form a Service;
the interface method comprises a java method of a service scene which needs performance test in a specific test scheme.
4. The method of claim 2, wherein constructing parameters in the form of dto for the parameter entry field comprises: and carrying out parameter assignment on the dto type parameters in the interface method.
5. The method of claim 1, wherein in step (a), the test data parameterized mapping relationship comprises: file path, variable name, value mode.
6. The method for performing performance testing and full link data monitoring by interface call according to claim 1, wherein in step (c), setting different performance test modes according to different test scenarios in the performance test scheme comprises: through the Thread group configuration of the Jmeter, one-touch triggers execution of a stress test in which performance test cases are viewed through the added aggregate report, result tree listener element.
7. The method for performing performance pressure measurement and full link data monitoring by interface call according to claim 1, wherein integrating with a promethaus monitoring and Zipkin distributed tracking system, real-time visual monitoring and statistical test results displaying of full link performance data in a pressure test process comprises:
(I) The full-link real-time tracking module (5) performs real-time tracking of system call link information;
(II) the performance monitoring and reporting module (6) generates a performance monitoring report.
8. The method for performing performance compression and full link data monitoring as set forth in claim 7, wherein,
in step (I), the real-time tracking system call link information performed by the full-link real-time tracking module (5) includes: the links are called through a trace id serial system of Zipkin, each time the links for executing performance test are called through unique trace ids, real-time monitoring data from each distributed service are gathered, inquiry is carried out according to service names, labels and response time, long-time consumption link nodes are filtered, and collection and data analysis of the performance data are completed;
in step (II), the performance monitoring and reporting module (6) generates a performance monitoring report comprising: adding Prometaus monitoring in the interceptor of the dubbo, and intercepting all service providers by utilizing a filter interface of the dubbo; and (3) tracking the acquired data by matching with the Zipkin link, performing final performance data display, and performing visual display after inquiring the acquired data through the integrated Grafana plugin.
9. An interface call completion performance pressure measurement and full link data monitoring system, characterized in that implementing the method for interface call completion performance pressure measurement and full link data monitoring according to any one of claims 1 to 8, the system comprising:
the decompilation module (1) is used for acquiring the code of the Dubbo service in a decompilation mode and inquiring the type of the input parameters of the interface to be called;
the test data management module (2) is used for inquiring parameter values in the database through the sql and realizing the association of test data through the csv data file setting of the Jmeter;
the performance test script management module (3) is used for configuring calling of interfaces, registry setting, service Consumer Consumer configuration and parameterization setting of test data through jmeter-plug-in for-apache-dubbo plug-in;
the performance test execution module (4) is used for configuring a pressure test mode through a Thread group of the Jmeter;
the full-link real-time tracking module (5) is used for positioning a calling link for executing a test through Zipkin configuration, gathering real-time monitoring data from each distributed service and completing data acquisition and data analysis;
and the performance monitoring and reporting module (6) is used for acquiring data of Prometaheus and integrating Zipkin link tracking acquired data, and performance data display is completed through Grafana.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310342105.4A CN116467189B (en) | 2023-03-31 | 2023-03-31 | Method and system for interface call completion performance pressure measurement and full link data monitoring |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310342105.4A CN116467189B (en) | 2023-03-31 | 2023-03-31 | Method and system for interface call completion performance pressure measurement and full link data monitoring |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116467189A CN116467189A (en) | 2023-07-21 |
| CN116467189B true CN116467189B (en) | 2023-12-05 |
Family
ID=87176388
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310342105.4A Active CN116467189B (en) | 2023-03-31 | 2023-03-31 | Method and system for interface call completion performance pressure measurement and full link data monitoring |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116467189B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116756044B (en) * | 2023-08-11 | 2023-11-21 | 杭州罗莱迪思科技股份有限公司 | RPC remote debugging method, device and application based on data link tracking |
| CN116775440B (en) * | 2023-08-21 | 2023-12-01 | 青岛民航凯亚系统集成有限公司 | Log-level link tracking method and system based on airport production operation system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109101415A (en) * | 2018-06-25 | 2018-12-28 | 平安科技（深圳）有限公司 | Interface test method, system, equipment and the storage medium compared based on database |
| CN111443940A (en) * | 2020-05-08 | 2020-07-24 | 南京大学 | Complete software life cycle management method and platform based on DevOps |
| CN112486791A (en) * | 2020-12-14 | 2021-03-12 | 政采云有限公司 | Performance test method, device and equipment of server cluster |
| CN113986733A (en) * | 2021-10-28 | 2022-01-28 | 中国平安人寿保险股份有限公司 | Jar package based performance test method, device, equipment and storage medium |
| CN114138674A (en) * | 2021-12-20 | 2022-03-04 | 南京星云数字技术有限公司 | Automatic testing method and device and computer equipment |
| CN114416561A (en) * | 2022-01-19 | 2022-04-29 | 浙江吉利控股集团有限公司 | Pressure test configuration method and device |
| CN115080389A (en) * | 2022-06-09 | 2022-09-20 | 青岛民航凯亚系统集成有限公司 | Test system, method, equipment and storage medium for improving index statistical efficiency |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10838840B2 (en) * | 2017-09-15 | 2020-11-17 | Hewlett Packard Enterprise Development Lp | Generating different workload types for cloud service testing |
| US10931558B2 (en) * | 2017-11-27 | 2021-02-23 | Jpmorgan Chase Bank, N.A. | Script accelerate |
-
2023
- 2023-03-31 CN CN202310342105.4A patent/CN116467189B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109101415A (en) * | 2018-06-25 | 2018-12-28 | 平安科技（深圳）有限公司 | Interface test method, system, equipment and the storage medium compared based on database |
| CN111443940A (en) * | 2020-05-08 | 2020-07-24 | 南京大学 | Complete software life cycle management method and platform based on DevOps |
| CN112486791A (en) * | 2020-12-14 | 2021-03-12 | 政采云有限公司 | Performance test method, device and equipment of server cluster |
| CN113986733A (en) * | 2021-10-28 | 2022-01-28 | 中国平安人寿保险股份有限公司 | Jar package based performance test method, device, equipment and storage medium |
| CN114138674A (en) * | 2021-12-20 | 2022-03-04 | 南京星云数字技术有限公司 | Automatic testing method and device and computer equipment |
| CN114416561A (en) * | 2022-01-19 | 2022-04-29 | 浙江吉利控股集团有限公司 | Pressure test configuration method and device |
| CN115080389A (en) * | 2022-06-09 | 2022-09-20 | 青岛民航凯亚系统集成有限公司 | Test system, method, equipment and storage medium for improving index statistical efficiency |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116467189A (en) | 2023-07-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116467189B (en) | Method and system for interface call completion performance pressure measurement and full link data monitoring | |
| US11379475B2 (en) | Analyzing tags associated with high-latency and error spans for instrumented software | |
| US11232125B1 (en) | Conversion of cloud computing platform data for ingestion by data intake and query system | |
| US8578017B2 (en) | Automatic correlation of service level agreement and operating level agreement | |
| US8656006B2 (en) | Integrating traffic monitoring data and application runtime data | |
| US11347577B1 (en) | Monitoring features of components of a distributed computing system | |
| US8402131B2 (en) | Hierarchy for characterizing interactions with an application | |
| US8667147B2 (en) | Monitoring related content requests | |
| US8051163B2 (en) | Synthetic transactions based on system history and load | |
| US7568023B2 (en) | Method, system, and data structure for monitoring transaction performance in a managed computer network environment | |
| CN112612675A (en) | Distributed big data log link tracking method and system under micro-service architecture | |
| US20090164270A1 (en) | Calculating in-flight metrics for non-interruptible business transactions | |
| US11921693B1 (en) | HTTP events with custom fields | |
| US11436116B1 (en) | Recovering pre-indexed data from a shared storage system following a failed indexer | |
| CN110912776A (en) | Automatic fuzzy test method and device for entity router management protocol | |
| CN108228322B (en) | Distributed link tracking and analyzing method, server and global scheduler | |
| CN109542786A (en) | Visual testing method and device | |
| CN110633195B (en) | Performance data display method and device, electronic equipment and storage medium | |
| CN111367760A (en) | Log collection method and device, computer equipment and storage medium | |
| CN112416902A (en) | One-key inspection method for host and database | |
| CN106067879B (en) | The detection method and device of information | |
| CN113849363A (en) | Service monitoring method and related device | |
| CN117176802B (en) | Full-link monitoring method and device for service request, electronic equipment and medium | |
| US11734297B1 (en) | Monitoring platform job integration in computer analytics system | |
| US11829415B1 (en) | Mapping buckets and search peers to a bucket map identifier for searching |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |