CN116841863A - Performance data monitoring system, method and device and electronic equipment - Google Patents

Performance data monitoring system, method and device and electronic equipment Download PDF

Info

Publication number
CN116841863A
CN116841863A CN202310545840.5A CN202310545840A CN116841863A CN 116841863 A CN116841863 A CN 116841863A CN 202310545840 A CN202310545840 A CN 202310545840A CN 116841863 A CN116841863 A CN 116841863A
Authority
CN
China
Prior art keywords
performance data
data
application system
performance
monitoring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310545840.5A
Other languages
Chinese (zh)
Inventor
皮勇亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
ICBC Technology Co Ltd
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
ICBC Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC, ICBC Technology Co Ltd filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN202310545840.5A priority Critical patent/CN116841863A/en
Publication of CN116841863A publication Critical patent/CN116841863A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3688—Test management for test execution, e.g. scheduling of test suites
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/445—Program loading or initiating
    • G06F9/44521—Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
    • G06F9/44526—Plug-ins; Add-ons

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention discloses a performance data monitoring system, a performance data monitoring method, a performance data monitoring device and electronic equipment. Relates to the field of financial science and technology, and the method comprises the following steps: in the process of performing pressure test on the application system, sending a plurality of access requests to the application system through a pressure test tool, acquiring response results of the application system to the plurality of access requests, and determining first performance data of the application system according to the response results of the plurality of access requests; in the process of performing pressure test on the application system, acquiring second performance data of the application system through a data acquisition tool; the first performance data and the second performance data are presented by the visualization component. The invention solves the technical problems of low data richness caused by less performance data which can be monitored by a pressure testing tool when the pressure testing is carried out on the application system in the prior art.

Description

Performance data monitoring system, method and device and electronic equipment
Technical Field
The invention relates to the field of financial science and technology, in particular to a performance data monitoring system, a performance data monitoring method, a performance data monitoring device and electronic equipment.
Background
At present, when a traditional pressure testing tool Jmeter is used for pressure testing, two modes are shared in the aspect of performance data real-time monitoring. In the scene that can use GUI (graphical interface), use the self-contained monitoring components of pressure test tool Jmeter to look over the result tree, graphic monitoring, etc. to monitor the performance test data, this kind of self-contained performance monitoring components of tool compares the machine resources of consuming the loading machine itself, cause the waste of the pressure test resource easily. In the No-GUI (command line) scene, the performance test condition cannot be checked in real time, and after performance test execution is completed, format conversion is performed on the performance test result through the plug-in unit, so that relevant monitoring data analysis can be performed.
In the two working modes, the pressure testing tool Jmeter can only monitor the index concerned by the pressure testing tool itself, so that the problem of low data richness of the performance data obtained by monitoring is caused.
In view of the above problems, no effective solution has been proposed at present.
Disclosure of Invention
The embodiment of the invention provides a performance data monitoring system, a performance data monitoring method, a performance data monitoring device and electronic equipment, and aims to at least solve the technical problem that the pressure testing tool can monitor less performance data when an application system is subjected to pressure testing in the prior art, so that the data richness is low.
According to an aspect of an embodiment of the present invention, there is provided a monitoring system for performance data, including: the pressure testing tool is used for performing pressure testing on the application system in a mode of sending a plurality of access requests to the application system, acquiring response results of the application system to the plurality of access requests in the pressure testing process, and determining first performance data of the application system according to the response results of the plurality of access requests; and the data acquisition tool is used for acquiring second performance data of the application system in the pressure test process, wherein the second performance data comprises at least one of the following components: performance data of a server deployed with an application in an application system, performance data of a database in the application system, and performance data of middleware in the application system; and the visualization component is used for acquiring the first performance data determined by the pressure testing tool and the second performance data acquired by the data acquisition tool and displaying the first performance data and the second performance data.
Further, the data acquisition tool includes: the data acquisition plug-in is deployed in the application system and is used for acquiring second performance data and sending the second performance data to the data monitoring plug-in; and the data monitoring plug-in is used for acquiring second performance data, and the visualization component acquires the second performance data from the data monitoring plug-in.
Further, the monitoring system of the performance data further comprises a target database, the pressure testing tool is used for sending the first performance data to the target database after acquiring the first performance data, and the visualization component is used for acquiring the first performance data from the target database.
Further, the performance data monitoring system further comprises a target database, the data monitoring plug-in is used for sending the second performance data to the target database after the second performance data are acquired, and the visualization component is used for acquiring the second performance data from the target database.
Further, the data monitoring plug-in is configured to perform data filtering on the second performance data after the second performance data is acquired, obtain filtered second performance data, and further obtain a data format requirement of the target database, perform format conversion on the filtered second performance data according to the data format requirement, obtain converted second performance data, and send the converted second performance data to the target database.
Further, the visualization component is configured to obtain an importance level of the application system, determine a target early warning judgment rule from a plurality of early warning judgment rules according to the importance level of the application system, judge whether abnormal data exists in the first performance data and the second performance data based on the target early warning judgment rule, display the first performance data and the second performance data when the abnormal data exists, and display the abnormal data in a preset area of the visualization component.
Further, the visualization component is configured to obtain a target system identifier of the application system, determine a target data display template matching the target system identifier from the plurality of data display templates according to a matching relationship between the system identifier and the data display template, and display the first performance data and the second performance data through the target data display template.
According to another aspect of the embodiment of the present invention, there is also provided a performance data monitoring method, which is applied to the performance data monitoring method, and the method includes: in the process of performing pressure test on the application system, sending a plurality of access requests to the application system through a pressure test tool, acquiring response results of the application system to the plurality of access requests, and determining first performance data of the application system according to the response results of the plurality of access requests, wherein the plurality of access requests are used for performing pressure test on the application system; during the pressure test of the application system, second performance data of the application system is collected through a data collection tool, wherein the second performance data comprises at least one of the following components: performance data of a server deployed with an application in an application system, performance data of a database in the application system, and performance data of middleware in the application system; the first performance data and the second performance data are presented by the visualization component.
Further, the monitoring method of the performance data further comprises the following steps: acquiring an importance level of an application system; determining a target early warning judgment rule from a plurality of early warning judgment rules according to the importance level of the application system; judging whether abnormal data exists in the first performance data and the second performance data or not based on a target early warning judging rule; and under the condition that the abnormal data exist, displaying the first performance data and the second performance data, and displaying the abnormal data in a preset area of the visual component.
According to another aspect of the embodiment of the present invention, there is also provided a monitoring apparatus for performance data, including: the first processing module is used for sending a plurality of access requests to the application system through the pressure testing tool in the process of carrying out pressure testing on the application system, obtaining response results of the application system to the plurality of access requests, and determining first performance data of the application system according to the response results of the plurality of access requests, wherein the plurality of access requests are used for carrying out pressure testing on the application system; the second processing module is used for collecting second performance data of the application system through the data collecting tool in the process of performing pressure test on the application system, wherein the second performance data comprises at least one of the following: performance data of a server deployed with an application in an application system, performance data of a database in the application system, and performance data of middleware in the application system; and the display module is used for displaying the first performance data and the second performance data through the visualization component.
According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium having a computer program stored therein, wherein the computer program is configured to execute the above-described performance data monitoring method when run.
According to another aspect of an embodiment of the present invention, there is also provided an electronic device including one or more processors; and a memory for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement a method for running the programs, wherein the programs are configured to perform the method of monitoring performance data as described above when run.
In the process, the second performance data of the application system are acquired by setting the data acquisition tool, so that more performance data in the application system are monitored, the data richness of the monitored performance data is improved, and a more accurate evaluation result can be conveniently obtained by a worker when evaluating the performance of the application system. In addition, the first performance data and the second performance data are displayed by the visual component, so that the first performance data and the second performance data are effectively summarized, a worker can intuitively know the performance of an application system conveniently, and meanwhile, the problem that the working efficiency of a pressure testing tool is affected when the pressure testing tool is used for data display is also avoided.
Therefore, the scheme provided by the application achieves the purpose of multi-dimensional performance data monitoring on the application system, thereby realizing the technical effect of improving the data richness, and further solving the technical problem that the pressure testing tool can monitor less performance data when the application system is subjected to pressure testing in the prior art, so that the data richness is low.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute a limitation on the application. In the drawings:
FIG. 1 is a schematic diagram of an alternative performance data monitoring system in accordance with an embodiment of the present application;
FIG. 2 is a flow chart of an alternative monitoring performance data according to an embodiment of the present application;
FIG. 3 is a schematic diagram of an alternative method of monitoring performance data according to an embodiment of the application;
FIG. 4 is a schematic diagram of an alternative performance data monitoring apparatus according to an embodiment of the present application;
fig. 5 is a schematic diagram of an alternative electronic device according to an embodiment of the application.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
It should be noted that the performance data monitoring system, method, device and electronic equipment of the present disclosure may be used in the field of financial technology, and may also be used in any field other than the field of financial technology, and the application fields of the performance data monitoring system, method, device and electronic equipment of the present disclosure are not limited.
It should be noted that, the user information (including, but not limited to, user equipment information, user personal information, etc.) and the data (including, but not limited to, data for presentation, analyzed data, etc.) related to the present disclosure are information and data authorized by the user or sufficiently authorized by each party.
Example 1
According to an embodiment of the present invention, there is provided an embodiment of a performance data monitoring system, and fig. 1 is a schematic diagram of an alternative performance data monitoring system according to an embodiment of the present invention, as shown in fig. 1, and the system includes:
the pressure testing tool is used for performing pressure testing on the application system in a mode of sending a plurality of access requests to the application system, acquiring response results of the application system to the plurality of access requests in the pressure testing process, and determining first performance data of the application system according to the response results of the plurality of access requests;
And the data acquisition tool is used for acquiring second performance data of the application system in the pressure test process, wherein the second performance data comprises at least one of the following components: performance data of a server deployed with an application in an application system, performance data of a database in the application system, and performance data of middleware in the application system;
and the visualization component is used for acquiring the first performance data determined by the pressure testing tool and the second performance data acquired by the data acquisition tool and displaying the first performance data and the second performance data.
In this embodiment, the pressure testing tool is a Jmeter, and the pressure testing tool is used for performing pressure testing on the application system. Specifically, fig. 2 is a flowchart of an alternative monitoring performance data according to an embodiment of the present invention, as shown in fig. 2, in the pressure test process, the pressure test tool sends multiple access requests to the application system according to a preset pressure test requirement, so as to implement a pressure test of the application system. As shown in fig. 2, after the application system acquires the access request, the application system responds to the access request and feeds back a response result to the pressure test tool, so that the pressure test tool determines first performance data of the application system according to the received response result. The first performance data includes, but is not limited to, throughput, concurrent user quantity, number of errors reported, type of errors, etc. Optionally, a Backend Listener component, backend Listener, may be embedded in the pressure test tool to enable data interaction between the pressure test tool and external components. The aforementioned external components may be databases, visualization components, and the like.
Further, since the pressure test tool itself can detect limited performance data, in this embodiment, a data collection tool is provided to monitor more performance data in the application system, where the data collection tool may be a Telegraf, which is a plug-in driven server agent for collecting and sending metrics and events from a database, system, etc. Specifically, the application system includes an application program, a database, middleware, and the like, where the foregoing middleware refers to software or a service, and can connect different application programs, platforms or systems and make them work cooperatively, and the middleware may be Tomcat or other middleware, where Tomcat is a container, and can run an application program. Middleware is typically located between the operating system and the application programs that supports various functions such as messaging, data storage access, transaction management, etc. Alternatively, the application, database, and middleware may be deployed on the same server or on different servers.
In this embodiment, as shown in fig. 2, the data collection function in the data collection tool may be deployed in an application system, so as to realize monitoring of the following performance data: performance data of a server on which an application program in an application system is deployed, performance data of a database in the application system, and performance data of middleware in the application system. The performance data of the server where the application program in the application system is deployed includes, but is not limited to, CPU (central processing unit ) usage, memory usage, network usage, and the like, the performance data of the database in the application system includes, but is not limited to, the number of concurrent connections, response time, and the like, and the performance data of the middleware includes, but is not limited to, memory usage, and the like.
Further, after the first performance data and the second performance data are acquired, the first performance data and the second performance data may be visualized by a visualization component. Specifically, the visualization component can partition and display the first performance data and the second performance data through a preset template, and can divide a plurality of time periods to display finer granularity.
It is easy to notice that in the above process, by setting the data acquisition tool to acquire the second performance data of the application system, more performance data in the application system is monitored, so that the data richness of the monitored performance data is improved, and a more accurate evaluation result can be conveniently obtained by a worker when evaluating the performance of the application system. In addition, the first performance data and the second performance data are displayed by the visual component, so that the first performance data and the second performance data are effectively summarized, a worker can intuitively know the performance of an application system conveniently, and meanwhile, the problem that the working efficiency of a pressure testing tool is affected when the pressure testing tool is used for data display is also avoided.
Therefore, the scheme provided by the application achieves the purpose of multi-dimensional performance data monitoring on the application system, thereby realizing the technical effect of improving the data richness, and further solving the technical problem that the pressure testing tool can monitor less performance data when the application system is subjected to pressure testing in the prior art, so that the data richness is low.
In an alternative embodiment, the data collection tool includes a data collection plug-in and a data monitoring plug-in. The data acquisition plug-in is deployed in the application system and is used for acquiring second performance data and sending the second performance data to the data monitoring plug-in; the data monitoring plug-in is used for acquiring second performance data, wherein the visualization component acquires the second performance data from the data monitoring plug-in.
Optionally, before the second performance data is collected, the data collection plug-in is deployed in the application system, and data interaction is performed between the data collection plug-in and the data monitoring plug-in, where the data monitoring plug-in is not deployed in the application system. In the acquisition process, the data acquisition tool sends the acquired second performance data to the data monitoring plug-in real time. Alternatively, the data monitoring plug-in may interact with other components, which may be databases, visualization components, etc., to provide second performance data for the other components.
It should be noted that, by deploying the data acquisition plug-in the application system, efficient acquisition of the second performance data may be achieved.
In an alternative embodiment, as shown in fig. 1, the performance data monitoring system further includes a target database, the pressure testing tool is configured to send the first performance data to the target database after the first performance data is acquired, and the visualization component is configured to acquire the first performance data from the target database.
Alternatively, as shown in FIG. 2, the pressure test tool interfaces with the target database through a Backend Listener. Specifically, the background list writes the first performance data in the target database in real time in the manner of HTTP (hypertext transfer protocol ), that is, the performance data persistence in fig. 2 is implemented. In this embodiment, the target database may be influxDB, influxDB, which is a time-series database designed to handle high writing, high query load, and is suitable for storing data such as index, event, analysis, etc. The target database receives the second performance data collected by the pressure testing tool through the HTTP interface and stores the second performance data in the target database according to time sequence. And finally, data storage distinguished by indexes is formed so as to provide data support for subsequent data calculation, monitoring and display.
Further, as shown in fig. 2, the visualization component may be Grafana, which is an open source procedure for visualizing large measurement data. The visualization component can interact with the target database, and the data source accessing the target database is configured through the Grafana configuration panel, so that the first performance data in the target database is read, and the real-time display of the first performance data is realized.
It should be noted that, by sending the first performance data to the target database, persistent storage of the first performance data and archiving and querying of the first performance data can be achieved, so that subsequent review by staff is facilitated, and persistent performance test data support is provided for performance test bottleneck analysis. In addition, the first performance data acquired by the pressure testing tool are sent to the visualization component in real time, so that the problem that performance testing data of the Jmeter cannot be acquired in real time in a No-GUI mode in the related art is avoided, and the working efficiency of performance testing is improved.
In an alternative embodiment, as shown in fig. 1, the performance data monitoring system further includes a target database, the data monitoring plug-in is configured to send the second performance data to the target database after the second performance data is acquired, and the visualization component is configured to acquire the second performance data from the target database.
Alternatively, as shown in fig. 2, the data monitoring plug-in may write the second performance data into the target database in real time, that is, implement the performance data persistence in fig. 2. In this embodiment, the target database may be influxDB, influxDB, which is a time-series database designed to handle high writing, high query load, and is suitable for storing data such as index, event, analysis, etc. The target database receives the second performance data collected by the pressure testing tool and stores the second performance data in the target database in time sequence.
Further, the visualization component may be Grafana, an open source procedure for visualizing large measurement data. As shown in fig. 2, the visualization component may interact with the target database, and configure, through the Grafana configuration panel, a data source accessing the target database, and read the second performance data in the target database, so as to implement real-time display of the second performance data.
It should be noted that, by sending the second performance data to the target database, persistent storage of the second performance data and archiving and querying of the second performance data can be achieved, so that subsequent review by staff is facilitated, and persistent performance test data support is provided for performance test bottleneck analysis. In addition, the second performance data acquired by the pressure testing tool are sent to the visualization component in real time by utilizing the back list, so that the problem that performance testing data of the Jmeter cannot be acquired in real time in a No-GUI mode in the related art is avoided, and the working efficiency of performance testing is improved.
In an alternative embodiment, the data monitoring plug-in is configured to perform data filtering on the second performance data after the second performance data is acquired, obtain filtered second performance data, and further obtain a data format requirement of the target database, perform format conversion on the filtered second performance data according to the data format requirement, obtain converted second performance data, and send the converted second performance data to the target database.
Optionally, the data monitoring plug-in may sequentially perform data filtering and format conversion on the obtained second performance data, so as to process the second performance data into a data format supported by the target database, and obtain the converted second performance data. And finally, outputting the processed data to the influxdb in an HTTP request mode through an output data output plug-in of the telegraf program.
In an alternative embodiment, the visualization component is configured to obtain an importance level of the application system, determine a target early warning determination rule from a plurality of early warning determination rules according to the importance level of the application system, determine whether abnormal data exists in the first performance data and the second performance data based on the target early warning determination rule, display the first performance data and the second performance data when the abnormal data exists, and display the abnormal data in a preset area of the visualization component.
Optionally, a worker may preset in advance in the visualization component the importance level of each application system to be tested that needs to be tested for performance. In this embodiment, after the visualization component obtains the first performance data and the second performance data, the visualization component may determine, according to the target system identifier of the application system, an importance level of the application system from a plurality of application systems to be tested, where the importance level characterizes a degree of influence on a user when the application system fails.
Further, different importance levels are matched with different target early warning judgment rules, so that after the importance levels are determined, the visualization component can determine the target early warning judgment rules matched with the importance levels from the plurality of early warning judgment rules according to the importance levels, and accordingly analyze the first performance data and the second performance data based on the target early warning judgment rules to judge whether abnormal data exists in the first performance data and the second performance data. The target early warning judging rule includes a plurality of sub-rules, and different sub-rules are matched with different indexes in the first performance data (or the second performance data), for example, the sub-rules matched with the index of 'error reporting number' may be: and when the error reporting number is greater than 20, determining that the data corresponding to the error reporting number index is abnormal.
Still further, if there is abnormal data, the visualization component displays the abnormal data in a preset area of the visualization component on the premise of displaying the first performance data and the second performance data.
It should be noted that, by processing the first performance data and the second performance data according to the target early warning judgment rule matched with the importance level of the application system, accurate determination of the abnormal data is realized. Further, abnormal data are displayed in the visual assembly, so that workers can review the abnormal data more timely, and performance detection efficiency is improved conveniently.
In an alternative embodiment, the visualization component is configured to obtain a target system identifier of the application system, determine a target data display template matching the target system identifier from the plurality of data display templates according to a matching relationship between the system identifier and the data display template, and display the first performance data and the second performance data through the target data display template.
Optionally, a worker may preset, in advance, a data display template corresponding to each application system to be tested, where performance testing is required, in the visualization component. In this embodiment, after the visualization component obtains the first performance data and the second performance data, the visualization component may determine, according to the target system identifier of the application system, a target data display template matching the target system identifier from a plurality of data display templates, so as to display the first performance data and the second performance data through the target data display template. In addition, the visual component can also provide Web (World Wide Web) access service, so that staff can monitor and view performance data through a browser.
It should be noted that, by performing different data display on different application systems, a worker can more quickly understand relatively important performance data in each application, thereby improving performance detection efficiency.
In an alternative embodiment, the performance data monitoring system may be deployed in a containerized manner in conjunction with a container (dock) engine tool, so as to facilitate rapid deployment of the performance data monitoring system, reduce difficulty in performance data monitoring, and reduce time for preparation in the early stage of pressure testing.
Therefore, the scheme provided by the application achieves the purpose of multi-dimensional performance data monitoring on the application system, thereby realizing the technical effect of improving the data richness, and further solving the technical problem that the pressure testing tool can monitor less performance data when the application system is subjected to pressure testing in the prior art, so that the data richness is low.
Example 2
According to an embodiment of the present application, there is provided an embodiment of a method of monitoring performance data, it being noted that the steps shown in the flowcharts of the figures may be performed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that herein.
Fig. 3 is a schematic diagram of an alternative method for monitoring performance data according to an embodiment of the present application, as shown in fig. 3, where the method for monitoring performance data is applied to the system for monitoring performance data, and includes the following steps:
In step S301, in the process of performing pressure test on the application system, a plurality of access requests are sent to the application system through the pressure test tool, response results of the application system to the plurality of access requests are obtained, and first performance data of the application system is determined according to the response results of the plurality of access requests, wherein the plurality of access requests are used for performing pressure test on the application system.
In this embodiment, the pressure testing tool is a Jmeter, and the pressure testing tool is used for performing pressure testing on the application system. Specifically, fig. 2 is a flowchart of an alternative monitoring performance data according to an embodiment of the present invention, as shown in fig. 2, in the pressure test process, the pressure test tool sends multiple access requests to the application system according to a preset pressure test requirement, so as to implement a pressure test of the application system. As shown in fig. 2, after the application system acquires the access request, the application system responds to the access request and feeds back a response result to the pressure test tool, so that the pressure test tool determines first performance data of the application system according to the received response result. The first performance data includes, but is not limited to, throughput, concurrent user quantity, number of errors reported, type of errors, etc. Optionally, a Backend Listener component, backend Listener, may be embedded in the pressure test tool to enable data interaction between the pressure test tool and external components. The aforementioned external components may be databases, visualization components, and the like.
Step S302, during the pressure test of the application system, collecting second performance data of the application system through a data collecting tool, wherein the second performance data comprises at least one of the following components: performance data of a server where an application in an application system is deployed, performance data of a database in the application system, and performance data of middleware in the application system.
Since the pressure test tool itself has limited performance data that can be detected, in this embodiment, a data collection tool is provided to monitor more performance data in the application system, where the data collection tool may be a Telegraf, which is a plug-in driven server agent that collects and sends metrics and events from databases, systems, etc. Specifically, the application system includes an application program, a database, middleware, and the like, where the foregoing middleware refers to software or a service, and can connect different application programs, platforms or systems and make them work cooperatively, and the middleware may be Tomcat or other middleware, where Tomcat is a container, and can run an application program. Middleware is typically located between the operating system and the application programs that supports various functions such as messaging, data storage access, transaction management, etc. Alternatively, the application, database, and middleware may be deployed on the same server or on different servers.
In this embodiment, as shown in fig. 2, the data collection function in the data collection tool may be deployed in an application system, so as to realize monitoring of the following performance data: performance data of a server on which an application program in an application system is deployed, performance data of a database in the application system, and performance data of middleware in the application system. The performance data of the server where the application program in the application system is deployed includes, but is not limited to, CPU (central processing unit ) usage, memory usage, network usage, and the like, the performance data of the database in the application system includes, but is not limited to, the number of concurrent connections, response time, and the like, and the performance data of the middleware includes, but is not limited to, memory usage, and the like.
In step S303, the first performance data and the second performance data are displayed by the visualization component.
In step S303, after the first performance data and the second performance data are acquired, the first performance data and the second performance data may be visualized by the visualization component. Specifically, the visualization component can partition and display the first performance data and the second performance data through a preset template, and can divide a plurality of time periods to display finer granularity.
Based on the above-mentioned schemes defined in step S301 to step S303, it may be known that in the embodiment of the present invention, a manner of performing multidimensional performance data monitoring on an application system is adopted, a plurality of access requests are sent to the application system through a pressure testing tool in a process of performing a pressure test on the application system, a response result of the application system to the plurality of access requests is obtained, and a first performance data of the application system is determined according to the response result of the plurality of access requests, and then, in a process of performing the pressure test on the application system, a second performance data of the application system is collected through a data collecting tool, so that the first performance data and the second performance data are displayed through a visualization component. Wherein the plurality of access requests are for stress testing the application system, and the second performance data comprises at least one of: performance data of a server where an application in an application system is deployed, performance data of a database in the application system, and performance data of middleware in the application system.
It is easy to notice that in the above process, by setting the data acquisition tool to acquire the second performance data of the application system, more performance data in the application system is monitored, so that the data richness of the monitored performance data is improved, and a more accurate evaluation result can be conveniently obtained by a worker when evaluating the performance of the application system. In addition, the first performance data and the second performance data are displayed by the visual component, so that the first performance data and the second performance data are effectively summarized, a worker can intuitively know the performance of an application system conveniently, and meanwhile, the problem that the working efficiency of a pressure testing tool is affected when the pressure testing tool is used for data display is also avoided.
Therefore, the scheme provided by the application achieves the purpose of multi-dimensional performance data monitoring on the application system, thereby realizing the technical effect of improving the data richness, and further solving the technical problem that the pressure testing tool can monitor less performance data when the application system is subjected to pressure testing in the prior art, so that the data richness is low.
In an alternative embodiment, in the process of displaying the first performance data and the second performance data through the visualization component, the visualization component may acquire an importance level of the application system, then determine a target early warning judgment rule from a plurality of early warning judgment rules according to the importance level of the application system, and then judge whether abnormal data exists in the first performance data and the second performance data based on the target early warning judgment rule, so that the first performance data and the second performance data are displayed when the abnormal data exists, and the abnormal data is displayed in a preset area of the visualization component.
Optionally, a worker may preset in advance in the visualization component the importance level of each application system to be tested that needs to be tested for performance. In this embodiment, after the visualization component obtains the first performance data and the second performance data, the visualization component may determine, according to the target system identifier of the application system, an importance level of the application system from a plurality of application systems to be tested, where the importance level characterizes a degree of influence on a user when the application system fails.
Further, different importance levels are matched with different target early warning judgment rules, so that after the importance levels are determined, the visualization component can determine the target early warning judgment rules matched with the importance levels from the plurality of early warning judgment rules according to the importance levels, and accordingly analyze the first performance data and the second performance data based on the target early warning judgment rules to judge whether abnormal data exists in the first performance data and the second performance data. The target early warning judging rule includes a plurality of sub-rules, and different sub-rules are matched with different indexes in the first performance data (or the second performance data), for example, the sub-rules matched with the index of 'error reporting number' may be: and when the error reporting number is greater than 20, determining that the data corresponding to the error reporting number index is abnormal.
Still further, if there is abnormal data, the visualization component displays the abnormal data in a preset area of the visualization component on the premise of displaying the first performance data and the second performance data.
It should be noted that, by processing the first performance data and the second performance data according to the target early warning judgment rule matched with the importance level of the application system, accurate determination of the abnormal data is realized. Further, abnormal data are displayed in the visual assembly, so that workers can review the abnormal data more timely, and performance detection efficiency is improved conveniently.
Example 3
According to an embodiment of the present invention, there is provided an embodiment of a performance data monitoring apparatus, wherein fig. 4 is a schematic diagram of an alternative performance data monitoring apparatus according to an embodiment of the present invention, as shown in fig. 4, and the apparatus includes:
the first processing module 401 is configured to send a plurality of access requests to the application system through the pressure testing tool in a process of performing pressure testing on the application system, obtain response results of the application system to the plurality of access requests, and determine first performance data of the application system according to the response results of the plurality of access requests, where the plurality of access requests are used for performing pressure testing on the application system;
a second processing module 402, configured to collect, by the data collection tool, second performance data of the application system during a pressure test of the application system, where the second performance data includes at least one of: performance data of a server deployed with an application in an application system, performance data of a database in the application system, and performance data of middleware in the application system;
a display module 403, configured to display the first performance data and the second performance data through the visualization component.
It should be noted that the first processing module 401, the second processing module 402, and the display module 403 correspond to steps S301 to S303 in the above embodiment, and the three modules are the same as examples and application scenarios implemented by the corresponding steps, but are not limited to those disclosed in embodiment 2.
Optionally, the display module further includes: the acquisition sub-module is used for acquiring the importance level of the application system; the determining submodule is used for determining a target early warning judgment rule from a plurality of early warning judgment rules according to the importance level of the application system; the judging sub-module is used for judging whether abnormal data exist in the first performance data and the second performance data or not based on the target early warning judging rule; and the display sub-module is used for displaying the first performance data and the second performance data under the condition that the abnormal data exist and displaying the abnormal data in a preset area of the visual component.
Example 4
According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium in which a computer program is stored, wherein the computer program is configured to perform the above-described performance data monitoring method at run-time.
Example 5
According to another aspect of the embodiments of the present application, there is also provided an electronic device, wherein fig. 5 is a schematic diagram of an alternative electronic device according to an embodiment of the present application, as shown in fig. 5, the electronic device including one or more processors; and a memory for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement a method for running the programs, wherein the programs are configured to perform the method of monitoring performance data as described above when run.
The foregoing embodiment numbers of the present application are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
In the foregoing embodiments of the present application, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed technology may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of units may be a logic function division, and there may be another division manner in actual implementation, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method of the various embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely a preferred embodiment of the present invention and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present invention, which are intended to be comprehended within the scope of the present invention.

Claims (12)

1. A system for monitoring performance data, comprising:
the pressure testing tool is used for performing pressure testing on the application system in a mode of sending a plurality of access requests to the application system, acquiring response results of the application system to the plurality of access requests in the pressure testing process, and determining first performance data of the application system according to the response results of the plurality of access requests;
a data collection tool for collecting second performance data of the application system during the pressure test, wherein the second performance data comprises at least one of: performance data of a server deployed with an application program in the application system, performance data of a database in the application system, and performance data of middleware in the application system;
and the visualization component is used for acquiring the first performance data determined by the pressure testing tool and the second performance data acquired by the data acquisition tool and displaying the first performance data and the second performance data.
2. The system of claim 1, wherein the data acquisition tool comprises:
the data acquisition plug-in is deployed in the application system and is used for acquiring the second performance data and sending the second performance data to the data monitoring plug-in;
the data monitoring plug-in is used for acquiring the second performance data, wherein the visualization component acquires the second performance data from the data monitoring plug-in.
3. The system of claim 1, wherein the performance data monitoring system further comprises a target database, the pressure test tool is configured to send the first performance data to the target database after the first performance data is acquired, and the visualization component is configured to acquire the first performance data from the target database.
4. The system of claim 2, wherein the performance data monitoring system further comprises a target database, the data monitoring plug-in is configured to send the second performance data to the target database after the second performance data is obtained, and the visualization component is configured to obtain the second performance data from the target database.
5. The system of claim 4, wherein the data monitoring plug-in is configured to perform data filtering on the second performance data after the second performance data is acquired to obtain filtered second performance data, and further configured to acquire a data format requirement of the target database, perform format conversion on the filtered second performance data according to the data format requirement to obtain converted second performance data, and send the converted second performance data to the target database.
6. The system of claim 1, wherein the visualization component is configured to obtain an importance level of the application system, determine a target early warning determination rule from a plurality of early warning determination rules according to the importance level of the application system, determine whether abnormal data exists in the first performance data and the second performance data based on the target early warning determination rule, and display the first performance data and the second performance data if abnormal data exists, and display the abnormal data in a preset area of the visualization component.
7. The system of claim 1, wherein the visualization component is configured to obtain a target system identification of the application system, and determine a target data presentation template from a plurality of data presentation templates according to a matching relationship between the system identification and the data presentation template, and present the first performance data and the second performance data through the target data presentation template.
8. A method of monitoring performance data, characterized by being applied to the performance data monitoring system according to any one of claims 1 to 7, the method comprising:
in the process of performing pressure test on an application system, sending a plurality of access requests to the application system through a pressure test tool, acquiring response results of the application system to the plurality of access requests, and determining first performance data of the application system according to the response results of the plurality of access requests, wherein the plurality of access requests are used for performing pressure test on the application system;
during the pressure test of the application system, acquiring second performance data of the application system through a data acquisition tool, wherein the second performance data comprises at least one of the following components: performance data of a server deployed with an application program in the application system, performance data of a database in the application system, and performance data of middleware in the application system;
the first performance data and the second performance data are presented by a visualization component.
9. The method of claim 8, wherein exposing the first performance data and the second performance data by a visualization component comprises:
Acquiring the importance level of the application system;
determining a target early warning judgment rule from a plurality of early warning judgment rules according to the importance level of the application system;
judging whether abnormal data exists in the first performance data and the second performance data or not based on the target early warning judgment rule;
and displaying the first performance data and the second performance data under the condition that abnormal data exist, and displaying the abnormal data in a preset area of the visual component.
10. A performance data monitoring apparatus, comprising:
the system comprises a first processing module, a second processing module and a third processing module, wherein the first processing module is used for sending a plurality of access requests to an application system through a pressure testing tool in the process of carrying out pressure testing on the application system, obtaining response results of the application system to the plurality of access requests, and determining first performance data of the application system according to the response results of the plurality of access requests, wherein the plurality of access requests are used for carrying out pressure testing on the application system;
the second processing module is used for acquiring second performance data of the application system through a data acquisition tool in the process of performing pressure test on the application system, wherein the second performance data comprises at least one of the following components: performance data of a server deployed with an application program in the application system, performance data of a database in the application system, and performance data of middleware in the application system;
And the display module is used for displaying the first performance data and the second performance data through a visualization component.
11. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program, wherein the computer program is arranged to execute the method of monitoring performance data according to any of the claims 8 to 9 at run-time.
12. An electronic device, the electronic device comprising one or more processors; a memory for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement a method for running a program, wherein the program is arranged to perform the method of monitoring performance data as claimed in any one of claims 8 to 9 when run.
CN202310545840.5A 2023-05-15 2023-05-15 Performance data monitoring system, method and device and electronic equipment Pending CN116841863A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310545840.5A CN116841863A (en) 2023-05-15 2023-05-15 Performance data monitoring system, method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310545840.5A CN116841863A (en) 2023-05-15 2023-05-15 Performance data monitoring system, method and device and electronic equipment

Publications (1)

Publication Number Publication Date
CN116841863A true CN116841863A (en) 2023-10-03

Family

ID=88160593

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310545840.5A Pending CN116841863A (en) 2023-05-15 2023-05-15 Performance data monitoring system, method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN116841863A (en)

Similar Documents

Publication Publication Date Title
CN111209131B (en) Method and system for determining faults of heterogeneous system based on machine learning
Syer et al. Leveraging performance counters and execution logs to diagnose memory-related performance issues
US7636871B1 (en) Method for comparing customer and test load data with comparative functional coverage hole analysis
WO2016008398A1 (en) Program performance test method and device
US20150301921A1 (en) Computer Implemented System and Method of Instrumentation for Software Applications
US20090307347A1 (en) Using Transaction Latency Profiles For Characterizing Application Updates
KR20070080313A (en) Method and system for analyzing performance of providing services to client terminal
CN108614742B (en) Report data verification method, system and device
CN112416705A (en) Abnormal information processing method and device
Nguyen et al. Automated verification of load tests using control charts
CN111400189A (en) Code coverage rate monitoring method and device, electronic equipment and storage medium
US7162390B2 (en) Framework for collecting, storing, and analyzing system metrics
CN112994972A (en) Distributed probe monitoring platform
CN113064762A (en) Service self-recovery method based on multiple detection
CN109933533B (en) Visual data testing method, device and equipment and readable storage medium
CN113238917B (en) Front-end performance monitoring method, device, equipment and storage medium
CN116909904A (en) Software function automatic test method based on high-flow high-concurrency condition
CN115248782B (en) Automatic testing method and device and computer equipment
CN116841863A (en) Performance data monitoring system, method and device and electronic equipment
CN111506470A (en) Browser error detection and alarm method, device, equipment and storage medium
CN113868094A (en) Big data abnormal information monitoring system
CN114398272A (en) Pressure measurement method and pressure measurement device for combination performance bottleneck positioning
CN114301904A (en) Monitoring method and device for big data cluster, monitoring system and readable storage medium
CN109933476A (en) A kind of display methods and device of OpenPOWER server performance
CN113037550B (en) Service fault monitoring method, system and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination