CN116610536A - Method, device, equipment and storage medium for detecting processing time consumption of business system module - Google Patents
Method, device, equipment and storage medium for detecting processing time consumption of business system module Download PDFInfo
- Publication number
- CN116610536A CN116610536A CN202310890688.4A CN202310890688A CN116610536A CN 116610536 A CN116610536 A CN 116610536A CN 202310890688 A CN202310890688 A CN 202310890688A CN 116610536 A CN116610536 A CN 116610536A
- Authority
- CN
- China
- Prior art keywords
- service system
- system module
- monitoring
- module
- user request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 73
- 238000012545 processing Methods 0.000 title claims abstract description 42
- 238000012544 monitoring process Methods 0.000 claims description 171
- 230000008569 process Effects 0.000 claims description 52
- 230000004044 response Effects 0.000 claims description 25
- 238000001514 detection method Methods 0.000 claims description 12
- 238000007726 management method Methods 0.000 description 24
- 238000004458 analytical method Methods 0.000 description 22
- 238000010586 diagram Methods 0.000 description 7
- 235000019580 granularity Nutrition 0.000 description 4
- 230000006855 networking Effects 0.000 description 4
- 238000005457 optimization Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3017—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is implementing multitasking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3051—Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The application relates to the technical field of distributed databases, and provides a method, a device, equipment and a storage medium for detecting processing time consumption of service system modules.
Description
Technical Field
The application relates to the technical field of distributed databases, in particular to a time-consuming detection method and device for processing a business system module, electronic equipment and a storage medium.
Background
The database is used as a bottom storage module of the business system, and the request of the user in the application system needs to provide quick and stable service. In a database service system, the processing flow is miscellaneous, the networking scale is large, the interaction modules are many, and once the performance attenuation problem occurs, the investigation is difficult. The service response time directly affects the user experience, but in the long-term operation process of the system, problems such as long response time or no response may occur due to performance attenuation problems. In the prior art, effective early warning is not available before the problems occur, and after the problems occur, the problems are difficult to locate and solve in a short time.
Disclosure of Invention
In order to solve the problems in the prior art, an embodiment of the present application provides a method for detecting time consumption of processing by a service system module, which is characterized by comprising:
respectively configuring monitoring modules for each service system module;
respectively configuring monitoring tasks for each monitoring module;
each monitoring module monitors and records the use condition of hardware resources and the user request condition of each service system module in real time, when a user request is issued to the service system module, the time for starting execution of the user request in the service system module is recorded; monitoring the internal processes executed by the user request in the service system module in real time, and recording the time when the user request finishes executing in the service system module and the start-stop time of executing each internal process; statistically reporting the hardware resource use condition data of the service system module and the execution time consumption data of the user request in the service system module and the execution time consumption data of each internal flow;
and according to the hardware resource use condition data of each service system module and the execution time consumption data of the user request in each service system module and the execution time consumption data of each internal flow, summarizing and analyzing the response condition of the user request.
The embodiment of the application also provides a device for detecting the processing time consumption of the service system module, which is characterized by comprising the following steps:
the first configuration module is used for respectively configuring the monitoring modules for the service system modules;
the second configuration module is used for respectively configuring the monitoring tasks for each monitoring module;
the system comprises a plurality of monitoring modules, a service system module and a service system module, wherein the monitoring modules are used for monitoring and recording the use condition of hardware resources and the user request condition of each service system module in real time, issuing a user request to the service system module, and recording the execution starting time of the user request in the service system module; monitoring the internal processes executed by the user request in the service system module in real time, and recording the time when the user request finishes executing in the service system module and the start-stop time of executing each internal process; statistically reporting the hardware resource use condition data of the service system module and the execution time consumption data of the user request in the service system module and the execution time consumption data of each internal flow;
and the summarizing and analyzing module is used for summarizing and analyzing the response condition of the user request according to the hardware resource use condition data of each service system module, the execution time consumption of the user request in each service system module and the execution time consumption data of each internal flow.
The embodiment of the application also provides electronic equipment, which comprises a processor and a memory, wherein the memory stores a program capable of running on the processor, and the electronic equipment is characterized in that the steps of the time consumption detection method for processing the business system module are realized when the program is executed by the processor.
The embodiment of the application also provides a computer readable storage medium storing at least one program, which is characterized in that the at least one program can be executed by at least one processor to realize the steps of the time-consuming detection method for processing by the business system module.
According to the scheme provided by the embodiment of the application, the hardware resource use condition and the user request condition of each service system module in the database service network are monitored in real time, the processing time consumption and the internal flow time consumption of the user request in each service module are counted, the response condition of the user request is further summarized and analyzed, the execution condition of the user request in each service system module can be comprehensively known, and detailed statistical data support is provided for optimizing the database service performance.
Drawings
Fig. 1 is a flow chart of a method for detecting time consumption of processing a service system module according to an embodiment of the present application;
FIG. 2 is a schematic flow chart of a method for configuring monitoring tasks for each monitoring module according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating another method for detecting time consumption of processing a service system module according to an embodiment of the present application;
FIG. 4 is a flowchart of another method for configuring monitoring tasks for each monitoring module according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a device for detecting time consumption in processing a service system module according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a second configuration module according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a monitoring module according to an embodiment of the present application;
FIG. 8 is a schematic structural diagram of another device for detecting time consumption in processing a business system module according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of another second configuration module according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of another monitoring module according to an embodiment of the present application;
fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the technical scheme of the present application more clearly understood, the technical scheme of the present application will be described in further detail below according to specific embodiments with reference to the accompanying drawings. It is obvious that the following examples are only some examples of the present application and do not constitute a limitation of the technical solution of the present application. Other embodiments may be made by those of ordinary skill in the art without departing from the inventive concepts herein.
It should be noted that, the step sequence described in the method embodiments in the following embodiments does not limit the technical solution of the present application, and it is possible for a person skilled in the art to reasonably adjust some step sequences according to the embodiments of the present application without any inventive effort. It should be noted that, the terms "first", "second", and the like used in the device embodiments in the following embodiments are only used to distinguish similar objects, and are not used to describe a specific sequence, and do not limit the technical solutions of the present application.
Example 1
The embodiment provides a method for detecting time consumption of processing by a service system module, as shown in fig. 1, including the following steps:
step 101, respectively configuring monitoring modules for each service system module;
specifically, the service system module is a module in a database service networking, such as a foreground application, an interface application, a database, and the like. And the configuration management node in the database service networking carries out global management, monitoring and analysis on the issued tasks. The issued task may be from a client, a network side, etc., and the embodiment does not limit the source of the task. If the task issuing management node is successful, namely the task issuing management node issues the tasks layer by layer through each service system module, and if the task issuing management node fails, the task issuing management node returns to report errors. The management node is used for respectively configuring monitoring modules for the service system modules, and each monitoring module corresponds to each service system module one by one and is used for respectively monitoring each service system module.
102, respectively configuring monitoring tasks for each monitoring module;
when the task issuing management node succeeds, the management node firstly configures the monitoring tasks for each monitoring module respectively, specifically, as shown in fig. 2, the configuration of the monitoring tasks for each monitoring module respectively includes:
step 1021, configuring hardware resource monitoring objects corresponding to the service system modules respectively.
The response time of the service system module to the user request is affected by the hardware performance, and the service system module monitors the use condition of hardware resources when analyzing the processing consumption of the service module, so that the response condition of the user request can be reflected more comprehensively and accurately. The hardware involved in each service system module is different, and when the monitoring task configuration is performed, a monitoring object, such as a disk, IO, CPU, memory, network bandwidth and the like, needs to be determined according to specific hardware resources of the service system module.
Step 1022, the user request processing flow monitoring nodes are respectively configured corresponding to the service system modules.
Specifically, the internal processes executed by the user request in different service system modules are different, and the full process monitoring of the user request in the service system modules is realized through the configuration of the monitoring node. In this embodiment, the monitoring node mainly includes: the user requests the time of starting execution and the time of ending execution in the business system module, and the user requests each internal flow executed in the business system module and the start and stop time of each internal flow execution.
The monitoring task configuration information comprises service system related information such as an upper layer IP port, user information, a user request identifier or name and the like.
Step 103, each monitoring module monitors and records the use condition of the hardware resource and the user request condition of each service system module in real time, when a user request is issued to the service system module, the time for starting execution of the user request in the service system module is recorded; monitoring the internal flow of the user request executed in the service system module in real time, wherein the monitoring comprises monitoring the execution process of the transaction and SQL sentence in the internal flow, and recording the time of ending the execution of the user request in the service system module and the start-stop time of the execution of each internal flow; recording the start-stop time of the execution of the transaction and SQL statement in the internal flow; and statistically reporting the hardware resource use condition data of the service system module, and the time-consuming execution of the user request in the service system module and the time-consuming execution data of each internal flow.
Specifically, in the process that a user requests to issue from a first layer of service system modules layer by layer, a monitoring module corresponding to each service system module receives issued service system environment information, and according to configured monitoring tasks, monitoring plug-ins are installed on corresponding monitoring objects to respectively monitor corresponding service system modules in real time until the service system module is at the last layer. The monitoring module monitors the service system module, including monitoring the use condition of the hardware resources of the service system module, monitoring the request condition of the user and the internal flow executed in the service system module by the user request, and recording the corresponding monitoring time. The hardware resource use condition data, time data and internal flow data can be obtained from the database service network through a server command. The statistically reported hardware resource usage data and the time-consuming execution data of the user request in the business system module and the time-consuming execution data of each internal flow can provide detailed statistical data support for the response analysis of the user request. In the implementation, the monitoring module reports the upper IP port and the information of the user information, the user request identifier or name and the like at the same time, so that the subsequent summary analysis is facilitated.
According to the embodiment, the monitoring module monitors the execution time consumption of different granularities such as the statistics business level, the transaction level and the statement level in real time, the monitoring of the execution time consumption of the whole process execution of the user request in the business system module is realized, the use condition of hardware resources is combined, the response condition of the user request can be comprehensively and accurately reflected, and detailed statistics data support is provided for optimizing the business performance of the database.
And 104, summarizing and analyzing the response situation of the user request according to the hardware resource use situation data of each service system module and the execution time consumption data of the user request in each service system module and the execution time consumption data of each internal flow.
Specifically, the summary analysis result contains the information of the longest time-consuming module name, the longest time-consuming process, the transaction, the SQL statement and the like, and can clearly reflect which business system modules, which internal processes, which transactions and the SQL statement consume longer time in the execution process of the user request. The summary analysis result can be further reported, and effective data support is provided for optimizing the service performance of the database.
According to the method for detecting the processing time consumption of the service system modules, the monitoring modules and the monitoring tasks thereof are configured, the use condition of hardware resources of each service system module and the user request condition are monitored in real time, the execution time consumption of the user request in each service module and the execution time consumption of the internal flow are counted, the response condition of the user request is further summarized and analyzed, the execution condition of the user request in each service system module can be comprehensively known, and detailed statistical data support is provided for optimization of the response time of the user request.
Example two
The embodiment provides a method for detecting time consumption of processing by a service system module, as shown in fig. 3, including the following steps:
step 201, respectively configuring monitoring modules for each service system module;
step 202, respectively configuring monitoring tasks for each monitoring module;
specifically, as shown in fig. 4, the configuration of the monitoring task for each monitoring module specifically includes:
step 2021, configuring hardware resource monitoring objects corresponding to the service system modules respectively;
step 2022, configuring user request processing flow monitoring nodes corresponding to the service system modules respectively;
in step 2023, timeout thresholds are respectively configured corresponding to the service system modules.
Specifically, the timeout threshold corresponding to each service system module may be determined based on an average value of historical data of time consuming execution of the user request in the service system module, and set according to a certain proportion of the average value of the historical data. The execution flow of the user request in different service system modules is different, so that the corresponding timeout thresholds of the different service system modules may not be equal.
In step 203, in the process of issuing the user request layer by layer from the first layer service system module, the monitoring module corresponding to each service system module receives the issued service system environment information, and according to the configured monitoring task, installs a monitoring plug-in on the corresponding monitoring object, and monitors the corresponding service system module in real time until the service system module is at the last layer. Each monitoring module monitors and records the use condition of hardware resources and the user request condition of each service system module in real time, when a user request is issued to the service system module, the time for starting execution of the user request in the service system module is recorded; monitoring the internal processes executed by the user request in the service system module in real time, wherein the monitoring comprises monitoring the execution process of the transactions and SQL sentences in the internal processes, and recording the time when the user request finishes executing in the service system module and the start-stop time of executing each internal process, wherein the monitoring comprises recording the start-stop time of executing the transactions and SQL sentences in the internal processes; and statistically reporting the hardware resource use condition data of the service system module, and the time-consuming execution of the user request in the service system module and the time-consuming execution data of each internal flow.
According to the method for detecting the processing time consumption of the service system module, the monitoring module and the monitoring task thereof are configured, the execution time consumption of different granularities such as the statistics service level, the transaction level and the statement level is monitored in real time, the monitoring of the execution time consumption of the whole process execution of the user request in the service system module is realized, the use condition of hardware resources is combined, the response condition of the user request can be comprehensively and accurately reflected, and detailed statistics data support is provided for optimizing the service performance of the database.
In step 204, after counting the execution time of the user request in the service system module, the monitoring module compares the execution time with the timeout threshold corresponding to the service system module, and when the execution time exceeds the timeout threshold, reports the timeout information. The timeout information comprises the normal response time and the current response time of the timeout request, the name or the identification of the module generating the timeout request and the like, and the module generating the timeout request can be rapidly positioned through analysis of the timeout information.
Step 205, according to the hardware resource usage data of each service system module and the execution time consumption data of each internal flow of the user request, summarizing and analyzing the response situation of the user request.
And 206, reporting the overtime information, analyzing and early warning the overtime information, and positioning a problem module, namely a service system module with overtime request.
According to the method for detecting the processing time consumption of the business system module, on the basis of the method provided by the embodiment 1, the configuration of the time-out threshold value is added in the monitoring task, the corresponding time-out threshold value is configured for each business system module, after the execution time consumption of the user request in the business system module is obtained through real-time monitoring statistics, the execution time consumption is compared with the time-out threshold value corresponding to the business system module, and if the execution time consumption exceeds the threshold value, the corresponding business system module may have the time-out request problem. By reporting the overtime information, the service system module with overtime problem is reported, the overtime problem can be analyzed and early-warned in time, and the problem module can be positioned rapidly, so that the problem module can be processed and optimized in time.
Example III
The embodiment provides a device for detecting processing time consumption of a service system module, which is arranged on a management node configured in a database service networking. The management node is a node responsible for global management, monitoring and analysis of the issued tasks. The issued task may be from a client, a network side, etc., and the embodiment does not limit the source of the task. If the task issuing management node is successful, namely the task issuing management node issues the tasks layer by layer through each service system module, and if the task issuing management node fails, the task issuing management node returns to report errors.
As shown in fig. 5, the service system module processing time-consuming detection apparatus of the present embodiment includes:
the first configuration module 31 is configured to configure the monitoring module for each service system module by using the management node.
And the second configuration module 32 is used for respectively configuring the monitoring tasks for each monitoring module by the management node.
Specifically, as shown in fig. 6, the second configuration module 32 of the present embodiment includes a first configuration unit 3201 and a second configuration unit 3202, where the first configuration unit 3201 is configured to configure a hardware resource monitoring object corresponding to each service system module, and the second configuration unit 3202 is configured to configure a user request processing flow monitoring node corresponding to each service system module.
The monitoring task configuration information comprises service system related information such as an upper layer IP port, user information, a user request identifier or name and the like.
And the monitoring modules 33 are used for receiving the issued service system environment information in the process of issuing the user request layer by layer from the first layer service system module, installing monitoring plug-ins on the corresponding monitoring objects according to the configured monitoring tasks, and monitoring and recording the use condition of the hardware resources of each service system module and the user request condition in real time. When a user request is issued to a service system module, a monitoring module corresponding to the service system module records the time when the user request starts to be executed in the service system module; monitoring the internal processes executed by the user request in the service system module in real time, and recording the time when the user request finishes executing in the service system module and the start-stop time of executing each internal process; and statistically reporting the hardware resource use condition data of the service system module and the time-consuming execution of the user request in the service system module and the time-consuming execution data of each internal flow.
Specifically, the monitoring module 33 of the present embodiment monitors the service system module according to the monitoring task configured by the second configuration module 32. The business system modules, the monitoring tasks and the monitoring modules are in one-to-one correspondence. As shown in fig. 7, the monitoring module 33 includes a first monitoring unit 3301, a second monitoring unit 3302, a third monitoring unit 3303, and a statistics unit 3304. The first monitoring unit 3301 monitors and records the use condition of the hardware resources of the corresponding service system module in real time. The second monitoring unit 3302 monitors and records the user request condition of the service system module in real time, when a user request is issued to the service system module, the second monitoring unit 3302 records the time when the user request starts to be executed in the service system module. The third monitoring unit 3303 monitors the internal processes, such as a business result checking process, a business statement executing process, and the like, of the user request executed in the business system module in real time, including monitoring the executing process of the business and the SQL statement in the internal processes, and records the time when the user request finishes executing in the business system module and the start and stop time when each internal process is executed, including the start and stop time when the business and the SQL statement in the internal processes are executed. The statistics unit 3304 counts the data of the hardware resource usage of the service system module, the execution time of the user request in the service system module, the execution time of each internal flow, including the transaction of each internal flow and the execution time of the SQL statement, and the like, and reports the data to the summary analysis module 34. In a specific implementation, the monitoring module 33 reports the upper layer IP port and the user information, the user request identifier or name, and other information at the same time, so that the subsequent summary analysis is facilitated.
According to the embodiment, the monitoring module monitors and counts the execution time consumption of different granularities such as the user request service level, the transaction level, the statement level and the like in real time, the monitoring of the execution time consumption of the whole process execution of the user request in the service system module is realized, the use condition of hardware resources is combined, the user request response condition can be comprehensively and accurately reflected, and detailed statistical data support is provided for optimizing the service performance of the database.
And the summarization analysis module 34 is used for summarizing and analyzing the response condition of the user request according to the hardware resource use condition data of each service system module, the execution time consumption of the user request in each service system module and the execution time consumption data of each internal flow, which are reported by each monitoring module 33.
The summary analysis result contains the information of the longest time-consuming module name, the longest time-consuming process, the transaction, the SQL statement and the like, and can clearly reflect which business system modules, which internal processes, which transaction and the SQL statement consume longer time in the execution process of the user request. The summary analysis module 34 can further report the summary analysis result, and provides effective data support for optimizing the service performance of the database.
In a specific implementation, the first configuration module 31, the second configuration module 32, the monitoring module 33 and the summarizing and analyzing module 34 are implemented in a management node, and the management node performs global management, monitoring and analysis on the issued tasks through the modules. In particular, the modules can be implemented by adopting a visualization module to support the interface configuration of related parameters and the graphical display of monitoring data.
Example IV
The present embodiment provides a device for detecting time consumption of processing by a service system module, as shown in fig. 8, including:
the first configuration module 41 is configured to configure the monitoring module for each service system module.
And a second configuration module 42, configured to configure the monitoring tasks for each monitoring module respectively.
Specifically, as shown in fig. 9, the second configuration module 42 of the present embodiment includes a first configuration unit 4201, a second configuration unit 4202, and a third configuration unit 4203, where the first configuration unit 4201 is configured to configure hardware resource monitoring objects corresponding to each service system module, the second configuration unit 4202 is configured to configure user request processing flow monitoring nodes corresponding to each service system module, and the third configuration unit 4203 is configured to configure timeout thresholds corresponding to each service system module.
And the monitoring modules 43 are used for receiving the issued service system environment information in the process of issuing the user request layer by layer from the first layer service system module, installing monitoring plug-ins on the corresponding monitoring objects according to the configured monitoring tasks, and monitoring and recording the use condition of the hardware resources of each service system module and the user request condition in real time. When a user request is issued to a service system module, a monitoring module corresponding to the service system module records the time when the user request starts to be executed in the service system module; monitoring the internal processes executed by the user request in the service system module in real time, and recording the time when the user request finishes executing in the service system module and the start-stop time of executing each internal process; and statistically reporting the hardware resource use condition data of the service system module and the time-consuming execution of the user request in the service system module and the time-consuming execution data of each internal flow.
Specifically, the monitoring module 43 of the present embodiment monitors the service system module according to the monitoring task configured by the second configuration module 42. The business system modules, the monitoring tasks and the monitoring modules are in one-to-one correspondence. As shown in fig. 10, the monitoring module 43 of the present embodiment includes a first monitoring unit 4301, a second monitoring unit 4302, a third monitoring unit 4303, a statistics unit 4304, and a comparison unit 4305. The first monitoring unit 4301 monitors and records the usage of the hardware resources of the corresponding service system module in real time. The second monitoring unit 4302 monitors and records the user request situation of the service system module in real time, and when a user request is issued to the service system module, the second monitoring unit 4302 records the time when the user request starts to be executed in the service system module. The third monitoring unit 4303 monitors the internal processes, such as a business result checking process, a business statement executing process, etc., of the user request executed in the business system module in real time, including monitoring the execution process of the transaction and the SQL statement in the internal processes, and records the time when the user request ends execution in the business system module and the start-stop time of execution of each internal process, including the start-stop time of execution of the transaction and the SQL statement in the internal processes. The statistics unit 4304 counts the data of the usage of the hardware resources of the service system module, the execution time of the user request in the service system module, the execution time of each internal flow, including the transaction of each internal flow and the execution time of the SQL statement, and the like, and reports the data to the summary analysis module 44. The comparing unit 4305 compares the execution time of the user request in the service system module counted by the counting unit 4304 with a timeout threshold corresponding to the service system module, and when the execution time exceeds the timeout threshold, reports timeout information to the summary analysis module 44.
The timeout information includes the normal response time and the current response time of the timeout request, the name or the identification of the module generating the timeout request, and the like, so that the summary analysis module 44 can quickly locate the module generating the timeout request through analysis of the timeout information.
According to the method and the device, the monitoring module monitors and counts the execution time consumption of different granularities such as a user request service level, a transaction level, a statement level and the like, monitors the execution time consumption of the whole process of the user request in the service system module, and can comprehensively and accurately reflect the user request response condition by combining the use condition of hardware resources, so that detailed statistical data support is provided for optimizing the service performance of the database.
The summarizing and analyzing module 44 summarizes and analyzes the response condition of the user request according to the hardware resource usage condition data of each service system module reported by each monitoring module 43 and the execution time consumption data of each service system module and the execution time consumption data of each internal flow requested by the user, and analyzes and pre-warns the reported time-out information to locate the problem module.
The summary analysis result contains the information of the longest time-consuming module name, the longest time-consuming process, the transaction, the SQL statement and the like, and can clearly reflect which business system modules, which internal processes, which transaction and the SQL statement consume longer time in the execution process of the user request. The summary analysis module 44 may further report the summary analysis results to provide effective data support for database business performance optimization.
In a specific implementation, the first configuration module 41, the second configuration module 42, the monitoring module 43 and the summarizing and analyzing module 44 are implemented in a management node, and the management node performs global management, monitoring and analysis on the issued tasks through the modules. In a possible embodiment, the module may be implemented in a visual manner, and supports an interface configuration of the monitoring related parameters and a graphical display of the monitoring data.
The time-consuming detection device for processing the service system modules provided in this embodiment adds a third configuration unit in the second configuration module on the basis of the device provided in embodiment 3, and is used for configuring timeout thresholds, where the timeout threshold is configured corresponding to each service system module. And a comparison unit is added in the monitoring module, after the execution time consumption of the user request in the service system module is obtained through real-time monitoring statistics, the execution time consumption is compared with a timeout threshold corresponding to the service system module, and if the execution time consumption exceeds the threshold time consumption, the problem of timeout request possibly occurs in the corresponding service system module. The service system module with the overtime problem is reported to the summarizing and analyzing module by reporting the overtime information, so that the overtime problem can be analyzed and early-warned in time, and the problem module can be positioned quickly, so that the problem module can be processed and optimized in time.
Example five
The present embodiment provides an electronic device, as shown in fig. 11, including a processor 51 and a memory 52 communicatively connected to the processor 51. The memory 52 stores a program executable on the processor 51, which when executed by the processor 51 implements the steps of the time-consuming detection method for processing by the business system module provided in the above embodiment.
Example six
The present embodiment provides a computer readable storage medium storing at least one program executable by at least one processor to implement the steps of the method for detecting time consumption of service system module processing provided in the above embodiment. The storage medium described above includes: various media capable of storing program codes, such as a U disk, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk.
It will be appreciated by those of ordinary skill in the art that the foregoing embodiments are specific examples of implementing the application, and that the application may be practiced otherwise than as specifically described. All technical schemes formed by equivalent substitution or equivalent transformation fall within the protection scope of the application.
Claims (9)
1. A method for detecting processing time consumption of a business system module, comprising:
respectively configuring monitoring modules for each service system module;
respectively configuring monitoring tasks for each monitoring module;
each monitoring module monitors and records the use condition of hardware resources and the user request condition of each service system module in real time, when a user request is issued to the service system module, the time for starting execution of the user request in the service system module is recorded; monitoring the internal processes executed by the user request in the service system module in real time, and recording the time when the user request finishes executing in the service system module and the start-stop time of executing each internal process; statistically reporting the hardware resource use condition data of the service system module and the execution time consumption data of the user request in the service system module and the execution time consumption data of each internal flow;
and according to the hardware resource use condition data of each service system module and the execution time consumption data of the user request in each service system module and the execution time consumption data of each internal flow, summarizing and analyzing the response condition of the user request.
2. The method for detecting time consumption of service system module processing according to claim 1, wherein the configuring monitoring tasks for each monitoring module respectively includes:
configuring hardware resource monitoring objects corresponding to the service system modules respectively;
and the user request processing flow monitoring nodes are respectively configured corresponding to the service system modules.
3. The method for detecting time consumption of service system module processing according to claim 1, wherein the configuring monitoring tasks for each monitoring module respectively includes:
respectively configuring timeout threshold values corresponding to the service system modules;
the method for detecting the processing time consumption of the business system module further comprises the following steps:
after counting the execution time consumption of the user request in the service system module, comparing the execution time consumption with a timeout threshold corresponding to the service system module, and reporting timeout information when the execution time consumption exceeds the timeout threshold;
and analyzing and early warning the overtime information and positioning a problem module.
4. A business system module processing time consuming detection device, comprising:
the first configuration module is used for respectively configuring the monitoring modules for the service system modules;
the second configuration module is used for respectively configuring the monitoring tasks for each monitoring module;
the system comprises a plurality of monitoring modules, a service system module and a service system module, wherein the monitoring modules are used for monitoring and recording the use condition of hardware resources and the user request condition of each service system module in real time, issuing a user request to the service system module, and recording the execution starting time of the user request in the service system module; monitoring the internal processes executed by the user request in the service system module in real time, and recording the time when the user request finishes executing in the service system module and the start-stop time of executing each internal process; statistically reporting the hardware resource use condition data of the service system module and the execution time consumption data of the user request in the service system module and the execution time consumption data of each internal flow;
and the summarizing and analyzing module is used for summarizing and analyzing the response condition of the user request according to the hardware resource use condition data of each service system module, the execution time consumption of the user request in each service system module and the execution time consumption data of each internal flow.
5. The business system module processing time consuming detection device of claim 4, wherein the second configuration module comprises:
the first configuration unit is used for respectively configuring the hardware resource monitoring objects corresponding to the service system modules;
the second configuration unit is used for respectively configuring the user request processing flow monitoring nodes corresponding to the service system modules.
6. The business system module processing time consuming detection device of claim 4, wherein the monitoring module comprises:
the first monitoring unit is used for monitoring and recording the use condition of the hardware resources of the business system module in real time;
the second monitoring unit is used for monitoring and recording the user request condition of the service system module in real time, issuing a user request to the service system module, and recording the time for starting execution of the user request in the service system module;
the third monitoring unit is used for monitoring the internal flow executed in the business system module by the user request in real time and recording the time when the user request finishes executing in the business system module and the start-stop time of executing each internal flow;
the statistics unit is used for statistically reporting the hardware resource use condition data of the service system module and the execution time consumption data of the user request in the service system module and the execution time consumption data of each internal flow.
7. The business system module processing time consuming detection device of claim 4, wherein the second configuration module comprises:
the third configuration unit is used for respectively configuring timeout threshold values corresponding to the service system modules;
the monitoring module comprises a comparison unit, a time-out module and a time-out module, wherein the comparison unit is used for comparing the execution time consumption of the user request in the service system module with the time-out threshold corresponding to the service system module, and reporting time-out information when the execution time consumption exceeds the time-out threshold;
and the summarizing and analyzing module is also used for analyzing and early warning the overtime information and positioning the problem module.
8. An electronic device comprising a processor and a memory, the memory storing a program executable on the processor, wherein the program when executed by the processor implements the steps of the business system module processing time-consuming detection method of any of claims 1-3.
9. A computer readable storage medium storing at least one program, wherein the at least one program is executable by at least one processor to implement the steps of the business system module processing time-consuming detection method of any of claims 1-3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310890688.4A CN116610536A (en) | 2023-07-20 | 2023-07-20 | Method, device, equipment and storage medium for detecting processing time consumption of business system module |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310890688.4A CN116610536A (en) | 2023-07-20 | 2023-07-20 | Method, device, equipment and storage medium for detecting processing time consumption of business system module |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116610536A true CN116610536A (en) | 2023-08-18 |
Family
ID=87685748
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310890688.4A Pending CN116610536A (en) | 2023-07-20 | 2023-07-20 | Method, device, equipment and storage medium for detecting processing time consumption of business system module |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116610536A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101187948A (en) * | 2007-12-20 | 2008-05-28 | 中国科学院计算技术研究所 | A continuous data protection system and its realization method |
| CN110086649A (en) * | 2019-03-19 | 2019-08-02 | 深圳壹账通智能科技有限公司 | Detection method, device, computer equipment and the storage medium of abnormal flow |
| US20220027365A1 (en) * | 2019-04-10 | 2022-01-27 | Ivalua Sas | Enterprise resource planning system, server and supervision method of sql queries in such a system or server |
-
2023
- 2023-07-20 CN CN202310890688.4A patent/CN116610536A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101187948A (en) * | 2007-12-20 | 2008-05-28 | 中国科学院计算技术研究所 | A continuous data protection system and its realization method |
| CN110086649A (en) * | 2019-03-19 | 2019-08-02 | 深圳壹账通智能科技有限公司 | Detection method, device, computer equipment and the storage medium of abnormal flow |
| US20220027365A1 (en) * | 2019-04-10 | 2022-01-27 | Ivalua Sas | Enterprise resource planning system, server and supervision method of sql queries in such a system or server |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20080195369A1 (en) | Diagnostic system and method | |
| US11093349B2 (en) | System and method for reactive log spooling | |
| US20140195860A1 (en) | Early Detection Of Failing Computers | |
| WO2003073203A2 (en) | System and method for analyzing input/output activity on local attached storage | |
| US20140089477A1 (en) | System and method for monitoring storage machines | |
| Tang et al. | An integrated framework for optimizing automatic monitoring systems in large IT infrastructures | |
| EP3168748A1 (en) | System and method for monitoring performance of applications | |
| US9600523B2 (en) | Efficient data collection mechanism in middleware runtime environment | |
| US20180143897A1 (en) | Determining idle testing periods | |
| CN111522703A (en) | Method, apparatus and computer program product for monitoring access requests | |
| US20180227203A1 (en) | Operation of data network | |
| US10691522B2 (en) | System and method for incident root cause analysis | |
| JP5240709B2 (en) | Computer system, method and computer program for evaluating symptom | |
| CN113127356A (en) | Pressure measurement method and device, electronic equipment and storage medium | |
| CN116069591A (en) | Interface performance monitoring method, device, equipment and storage medium | |
| CN104794040A (en) | Service monitoring method, device and system | |
| CN116610536A (en) | Method, device, equipment and storage medium for detecting processing time consumption of business system module | |
| CN111290942A (en) | Pressure testing method, device and computer readable medium | |
| US11243857B2 (en) | Executing test scripts with respect to a server stack | |
| CN113409876A (en) | Method and system for positioning fault hard disk | |
| CN114301904A (en) | Monitoring method and device for big data cluster, monitoring system and readable storage medium | |
| US20220129342A1 (en) | Conserving computer resources through query termination | |
| Gunasekaran et al. | Correlating log messages for system diagnostics | |
| CN116846782B (en) | Business anomaly observation method and device for mobile terminal of SAAS CRM system | |
| CN117573680B (en) | Positioning data transmission management system and method based on big data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |