CN105991366A - Service monitoring method and system - Google Patents
Service monitoring method and system Download PDFInfo
- Publication number
- CN105991366A CN105991366A CN201510097895.XA CN201510097895A CN105991366A CN 105991366 A CN105991366 A CN 105991366A CN 201510097895 A CN201510097895 A CN 201510097895A CN 105991366 A CN105991366 A CN 105991366A
- Authority
- CN
- China
- Prior art keywords
- service
- annotation
- library
- information
- monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 75
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000012423 maintenance Methods 0.000 claims abstract description 31
- 238000012545 processing Methods 0.000 claims abstract description 27
- 238000004088 simulation Methods 0.000 claims abstract description 15
- 238000013507 mapping Methods 0.000 claims description 39
- 238000005538 encapsulation Methods 0.000 claims description 20
- 238000004364 calculation method Methods 0.000 claims description 15
- 238000004220 aggregation Methods 0.000 claims description 9
- 230000002776 aggregation Effects 0.000 claims description 9
- 230000003247 decreasing effect Effects 0.000 claims description 7
- 238000000354 decomposition reaction Methods 0.000 claims description 6
- 238000004806 packaging method and process Methods 0.000 claims description 5
- 230000008447 perception Effects 0.000 abstract description 3
- 238000007726 management method Methods 0.000 description 28
- 238000010586 diagram Methods 0.000 description 19
- 230000006870 function Effects 0.000 description 12
- 238000004590 computer program Methods 0.000 description 7
- 238000003860 storage Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The embodiment of the invention discloses a service monitoring method and system. The method comprises a step of collecting the annotation information and time stamp information when a service application executes a system operation in each time, a step of processing the collected information and obtaining converged data, and a step of carrying out service monitoring according to the converged data. The scheme of the embodiment of the invention can provide active service monitoring, thus the realization of rapid service positioning and service simulation resource prediction is facilitated, and the service quality and flexible operation and maintenance ability can be improved from the angle of service further so as to improve customer perception and save maintenance cost.
Description
Technical Field
The present invention relates to the field of service support technologies, and in particular, to a service monitoring method and system.
Background
With the continuous enlargement of the scale of the business system and the rise of the cloud system, the difficulty of business quality management is higher and higher, the traditional network operation and maintenance means based on physical equipment and program processes are more biased to the management of physical views, and the technical scheme has the following characteristics:
1. the operation and maintenance management is mainly carried out based on physical resources (such as a host, a network, a process and a database);
2. the use of the logic service and the physical resource is split, and the running view of the physical resource is irrelevant to the service;
3. the use of physical resources by logical services is not visible.
Under the prior art scheme, the operation and maintenance system can generate the following problems:
(1) the operation and maintenance information is huge and dispersed, the monitoring and the resource mapping cannot be effectively carried out by the service dimension, and the operation and maintenance information with the service value cannot be provided in real time.
(2) The service lacks the use information of the resources, the resource occupation situation cannot be determined from the service level, and efficient resource planning and allocation are difficult to perform.
In summary, the existing operation and maintenance management and control mainly based on physical resources is difficult to provide higher-level active operation and maintenance management capabilities such as active service quality monitoring, rapid service fault location, service simulation resource prediction, and the like, so that the service quality and flexible operation and maintenance capabilities cannot be improved from the service perspective to improve customer perception and save operation and maintenance costs.
Disclosure of Invention
In view of this, in order to solve the existing technical problems, embodiments of the present invention provide:
a service monitoring method comprises the following steps:
collecting annotation information and timestamp information of the service application when the system operation is executed each time;
processing the collected information to obtain converged data;
and monitoring the service according to the converged data.
In a specific embodiment, the collecting annotation information and timestamp information of the service application each time the system operation is completed includes:
according to the configuration of a service annotation encapsulation library and/or a user-defined annotation library, collecting annotation information and timestamp information of service application when the system operation is executed each time, wherein the service annotation encapsulation library is used for taking over part of the system library and carrying out service annotation encapsulation; the user-defined annotation library is used for realizing user-defined configuration of service annotation information and establishing mapping and relation between services and resources required by operation and maintenance.
In a specific embodiment, the processing the collected information to obtain aggregated data includes:
summarizing and calculating the information collected by the service annotation lightweight library;
the information after the summary calculation is processed in a gathering way,
the method further comprises the following steps:
realizing pivot forwarding of the annotation information message stream; and performing configuration management and/or decomposition execution on the execution strategy, the acquisition rule, the summary calculation strategy and the global data aggregation rule.
In a specific embodiment, the performing service monitoring according to the aggregated data includes:
organizing a required service resource mapping view according to the aggregated data, and providing a basic view for subsequent service monitoring;
and generating a monitoring view of a service level according to the service resource mapping view and implementing monitoring.
In one embodiment, the method further comprises:
and under the condition that the application resources are insufficient, performing corresponding resource adjustment on the service process and the thread by using the service resource scheduling function.
In one embodiment, the method further comprises:
and evaluating the actual requirement of the resources according to the business volume, simulating the influence on the resources under the condition of increasing the business volume or adjusting business logic, and finally forming the investment reference for increasing and decreasing the physical resources.
An embodiment of the present invention further provides a service monitoring system, including: the system comprises a service annotation light weight library, a service data center and a service decision center; wherein,
the service annotation light-weight library is used for collecting annotation information and timestamp information of the service application when the system operation is executed each time;
the service data center is used for processing the collected information to obtain converged data;
and the service decision center is used for monitoring the service according to the converged data.
In one embodiment, the service annotation database includes: a service annotation packaging library, a user-defined annotation library and a collection thread library; wherein,
the service annotation encapsulation library is used for taking over part of the system library and carrying out service annotation encapsulation;
the user-defined annotation library is used for realizing user-defined configuration of service annotation information and establishing mapping and relation between services and resources required by operation and maintenance;
and the collection thread library is used for collecting annotation information and timestamp information of the service application when the system operation is executed each time according to the configuration of the service annotation packaging library and/or the custom annotation library.
In a specific embodiment, the service data center includes: the system comprises an acquisition processor, a convergence processor, a message driver and a strategy executor; wherein,
the acquisition processor is used for summarizing and calculating the information collected by the service annotation light weight library;
the convergence processor is used for converging the information processed by the acquisition processor;
the message driver is used for realizing the pivot forwarding of the annotation information message flow;
the strategy executor is used for carrying out configuration management and/or decomposition execution on an execution strategy, an acquisition rule, a summary calculation strategy and a global data aggregation rule.
In a specific embodiment, the service decision center includes: the system comprises a service mapping module and a service monitoring module; wherein,
the service mapping module is used for organizing a required service resource mapping view according to the converged data of the service data center and providing a basic view for subsequent service monitoring;
and the service monitoring module is used for generating a monitoring view of a service level according to the service resource mapping view and implementing monitoring.
In a specific embodiment, the business decision center further includes a resource adjustment module, and the business annotation lightweight library further includes a management thread library; wherein,
the resource adjusting module is also used for notifying the management thread library according to the condition that the service monitoring module monitors that the application resources are insufficient;
and the management thread library is used for performing corresponding resource adjustment on the service process and the thread by using a service resource scheduling function after receiving the resource adjustment notification sent by the resource adjustment module.
In one embodiment, the business decision center further comprises a resource simulation module,
and the resource simulation module is used for evaluating the actual demand of the service volume on the resources, simulating the influence on the resources under the condition of increasing the service volume or adjusting the service logic, and finally forming the investment reference for increasing or decreasing the physical resources.
According to the service monitoring method and system, annotation information and timestamp information of service application when system operation is executed each time are collected; processing the collected information to obtain converged data; and monitoring the service according to the converged data. The scheme of the embodiment of the invention can provide active service monitoring, thereby being beneficial to realizing rapid service fault positioning and service simulation resource prediction, and further improving the service quality and flexible operation and maintenance capability from the service perspective so as to improve the customer perception and save the operation and maintenance cost.
Drawings
Fig. 1 is a schematic flow chart of a service monitoring method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a service monitoring system according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of another service monitoring system according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of another service monitoring system according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of another service monitoring system according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a service monitoring system according to another embodiment of the present invention;
fig. 7 is a schematic structural diagram of another service monitoring system according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a service monitoring system according to embodiment 1 of the present invention;
fig. 9 is a schematic diagram of a physical deployment form of a service monitoring system in embodiment 1 of the present invention;
FIG. 10 is a diagram illustrating a specific module implementation of a business annotation light weight library;
fig. 11 is a schematic view of an overall processing flow of the service monitoring system in embodiment 2 of the present invention.
Detailed Description
Aiming at the problems in the prior art, an operation and maintenance capability active output system (corresponding to a service monitoring system described below) needs to be constructed for a service system so as to better meet the requirements of efficient management and control of software assets and system service continuity, and promote the capabilities of reasonable planning of the service system and the like. The operation and maintenance capability active output system should be reasonably and logically layered, a pyramid-type to top-down construction of a business, service and resource acquisition mapping model, and the information of acquisition management of each layer is different and is mutually associated. From top to bottom, each layer puts requirements on the next layer; from bottom to top, each layer provides functionality to the layer above. Meanwhile, in order to meet the requirements of high concurrency of a cloud system and low influence on a business system, a light-weight core function library based on annotation, specific event-based message communication and a real-time parallel processing computing technology are required to be adopted. The operation and maintenance capability output system of the business system has the following characteristics: 1. the mapping condition of the service and the physical resource usage can be actively output, and the software and hardware resources can be better mastered. 2. The influence on the service is avoided at a very low cost, the information related to guarantee can be provided in real time, and the requirement of real-time service operation and maintenance is met. 3. The output basic data of the business and the physical resources can realize some innovative business monitoring or auxiliary supporting capacity of resource simulation implementation for the subsequent operation and maintenance working links.
Based on the above considerations, an embodiment of the present invention provides a method for monitoring a service, as shown in fig. 1, the method includes:
step 101: collecting annotation information and timestamp information of the service application when the system operation is executed each time;
step 102: processing the collected information to obtain converged data;
step 103: and monitoring the service according to the converged data.
In a specific embodiment, the collecting annotation information and timestamp information of the service application each time the system operation is completed includes:
according to the configuration of a service annotation encapsulation library and/or a user-defined annotation library, collecting annotation information and timestamp information of service application when the system operation is executed each time, wherein the service annotation encapsulation library is used for taking over part of the system library and carrying out service annotation encapsulation; the user-defined annotation library is used for realizing user-defined configuration of service annotation information and establishing mapping and relation between services and resources required by operation and maintenance.
In a specific embodiment, the processing the collected information to obtain aggregated data includes:
summarizing and calculating the information collected by the service annotation lightweight library;
the information after the summary calculation is processed in a gathering way,
the method further comprises the following steps:
realizing pivot forwarding of the annotation information message stream; and performing configuration management and/or decomposition execution on the execution strategy, the acquisition rule, the summary calculation strategy and the global data aggregation rule.
In a specific embodiment, the performing service monitoring according to the aggregated data includes:
organizing a required service resource mapping view according to the aggregated data, and providing a basic view for subsequent service monitoring;
and generating a monitoring view of a service level according to the service resource mapping view and implementing monitoring.
In one embodiment, the method further comprises:
and under the condition that the application resources are insufficient, performing corresponding resource adjustment on the service process and the thread by using the service resource scheduling function.
In one embodiment, the method further comprises:
and evaluating the actual requirement of the resources according to the business volume, simulating the influence on the resources under the condition of increasing the business volume or adjusting business logic, and finally forming the investment reference for increasing and decreasing the physical resources.
The embodiment of the present invention further provides a service monitoring system correspondingly, as shown in fig. 2, the system includes: a service annotation light weight library 201, a service data center 202 and a service decision center 203; wherein,
the service annotation light-weight library 201 is used for collecting annotation information and timestamp information of the service application after each execution of system operation;
the service data center 202 is configured to process the collected information to obtain aggregated data;
the service decision center 203 is configured to perform service monitoring according to the aggregated data.
In a specific embodiment, as shown in fig. 3, the service annotation lightweight library 201 includes: a service annotation encapsulation library 301, a custom annotation library 302 and a collection thread library 303; wherein,
the service annotation encapsulation library 301 is used for taking over part of the system library and performing service annotation encapsulation;
the custom annotation library 302 is used for realizing custom configuration of service annotation information and establishing mapping and relation between services and resources required by operation and maintenance;
the collection thread library 303 is configured to collect annotation information and timestamp information of the service application when the system operation is executed each time according to the configuration of the service annotation encapsulation library 301 and/or the custom annotation library 302.
In a specific embodiment, as shown in fig. 4, the service data center 202 includes: an acquisition processor 401, an aggregation processor 402, a message driver 403, and a policy executor 404; wherein,
the acquisition processor 401 is configured to perform summary calculation on the information collected by the service annotation light weight library;
the convergence processor 402 is configured to perform convergence processing on the information processed by the acquisition processor;
the message driver 403 is configured to implement hub forwarding of a comment information message stream;
the policy executor 404 is configured to perform configuration management and/or decomposition execution on the execution policy, the collection rule, the summary calculation policy, and the global data aggregation rule.
In a specific embodiment, as shown in fig. 5, the service decision center 203 includes: a service mapping module 501 and a service monitoring module 502; wherein,
the service mapping module 501 is configured to organize a required service resource mapping view according to aggregated data of a service data center, and provide a basic view for subsequent service monitoring;
the service monitoring module 502 is configured to generate a monitoring view of a service level according to the service resource mapping view and perform monitoring.
In a specific embodiment, as shown in fig. 6, the business decision center 203 further includes a resource adjustment module 601, and the business annotation lightweight library 201 further includes a management thread library 602; wherein,
the resource adjusting module 601 is further configured to notify the management thread library according to the condition that the service monitoring module 502 monitors that the application resources are insufficient;
the management thread library 602 is configured to perform corresponding resource adjustment on the service process and the thread by using a service resource scheduling function after receiving the resource adjustment notification sent by the resource adjustment module 601.
In one embodiment, as shown in fig. 7, the business decision center further includes a resource emulation module 701,
the resource simulation module 701 is configured to evaluate actual demand of the traffic on the resource, simulate an influence on the resource under a condition of traffic increase or traffic logic adjustment, and finally form an investment reference for increasing or decreasing the physical resource.
The technical solution of the present invention is further described in detail by the following specific examples.
Example 1
Fig. 8 is a schematic structural diagram of a service monitoring system according to embodiment 1 of the present invention, and as shown in fig. 8, the system includes three functional modules, namely, a service annotation lightweight library (a dynamic link library, which may be seamlessly integrated with an application), a service data center, and a service decision center, and mainly includes a service annotation encapsulation library, a custom annotation library, a collection thread library, and a management thread library; the system comprises an acquisition processor, a convergence processor, a message driver and a strategy executor; the system comprises a business mapping module, a business monitoring module, a resource adjusting module, a resource simulation module and other sub-functional modules.
The service annotation light weight library calls a core system through a collection thread library and injects service information; the service data center finishes collection and warehousing and finishes service and resource mapping, summarizing, calculation and storage through MPP processing; the service decision center can perform display monitoring of service mapping through basic data of the data center, and simultaneously can perform resource simulation according to rules and perform resource adjustment through a management thread of the service.
Fig. 9 is a schematic diagram of a physical deployment form of a service monitoring system in embodiment 1 of the present invention, which is described below with reference to fig. 9:
in this embodiment, the service annotation encapsulation library provided by the service annotation lightweight library is integrated with the service, and the bearer is a specific service application (such as an account opening program), and takes over a small number of system link libraries to add service annotations or establishes an association relationship between the service and system resources required by the service in a custom annotation manner to generate service operation and maintenance information; collecting mapping information of related services, services and systems through a collection thread and submitting the mapping information to a message center for processing by a service data center; and finishing the scheduling of the application resources through the management thread. The specific module implementation is shown in fig. 10.
Specifically, in the service annotation lightweight library:
service annotation encapsulation library: taking over a small amount of system libraries, carrying out service annotation and packaging, and seamlessly accessing the operation and maintenance capability output system of the invention to the service system through the libraries. The service annotation mainly collects information including RPC call, DB access and system call. For information collection and mapping resources, refer specifically to table 1:
TABLE 1
The service annotation information mainly includes service logic information and physical resource information, and specifically refers to table 2:
| business logic information | Physical resource information |
| Business | Process/thread number |
| Service | IP information |
| Function call (optional) | Host information |
TABLE 2
Collecting a thread library: and the collection thread library is responsible for receiving the annotation information and the timestamp recorded by the business application when the system operation is executed each time.
Managing a thread library: after receiving a resource adjustment notification sent by resource adjustment of a service decision center, the service management thread library performs corresponding resource adjustment on the service process and the thread by using a service resource scheduling function.
Self-defining an annotation library: and establishing the mapping and relation between the service and the resources required by operation and maintenance through the custom configuration of the service annotation information, and providing basic configuration data for service resource planning and service management.
Specifically, in the service data center:
an acquisition processor: the collecting processor is responsible for capturing the messages from the distributed message center and carrying out secondary summary calculation, and then uniformly sending the results to the collecting processor according to the service KEY value.
A convergence processor: and the system is responsible for the convergence processing of the global data, and finally obtains the service operation and maintenance information required by the service decision center and stores the information in a storage.
A message driver: and the message processing engine realizes the pivot forwarding of the annotation information message flow through the distributed message center.
A strategy executor: all necessary data processing strategies such as an execution strategy, an acquisition rule, a secondary summary calculation strategy, a global data aggregation rule and the like acquired by the message in the service data center are configured, managed and finally decomposed and executed by an executor.
Specifically, in the business decision center:
a service mapping module: and organizing the required service resource mapping view according to the aggregated data, and providing a basic view for subsequent service monitoring.
A service monitoring module: and generating a monitoring view of a service level according to the service resource mapping view and implementing monitoring.
A resource adjusting module: and under the condition of insufficient application resources, informing the service management thread to perform a resource adjustment function through resource adjustment.
A resource simulation module: according to the actual demand evaluation of the business volume to the resources, the influence on the resources under the condition of business volume increase or business logic adjustment is simulated, and finally, the increase and decrease allocation investment reference of the physical resources is formed.
Example 2
In this embodiment, based on the system structure shown in embodiment 1, an overall processing flow of the service monitoring system is described, with reference to fig. 11, where the flow includes:
the business application replaces part of the system link library with a business annotation lightweight library (dynamic link library). And creating a collection thread and a management thread according to the access rule.
The service application generates basic service information (such as account opening service and acceptance sheet service) and basic physical information (such as process information and host information) in a public area when each service operation (such as account opening) is initialized, the service annotation lightweight library records annotation information (basic service information, basic physical information and system operation type) and time stamp of the system operation when each service operation (RPC/DB access/system call) is performed, and service and resource use running information with annotations is submitted to a collection thread after the service operation is completed.
The collection thread carries out one-time gathering and formatting processing on the annotation information, the annotation information is submitted to the distributed message center in a message form, and the massive annotation information enters the service data center through the distributed message center.
The annotation information is captured by the acquisition processor, and the same type of service information is subjected to secondary summary calculation (such as total access times, CPU/IO resource usage and network bandwidth occupation) in a certain time interval according to system operation.
And uniformly entering the summarized calculation results into a final convergence processor according to the service key values to ensure global data convergence processing, obtaining service operation and maintenance information required by a service decision center, and warehousing (by adopting large data technologies such as HADOOP (Hadoop)).
The service decision center can organize the required service resource mapping view and the service level monitoring view according to the aggregated data, and simultaneously inform a service management thread to perform resource adjustment through resource adjustment under the condition of insufficient application resources (mainly processes and threads).
The service decision center can also evaluate the actual demand of the service volume on the resources according to the converged data, simulate the influence of simulation on the resources under the condition of increased service volume or service logic adjustment, and perform investment reference for increasing and decreasing the physical resources.
Based on the scheme of the embodiment of the invention, the business annotation lightweight library innovatively injects business annotation information through taking over of bottom layer calling, so that the mapping and use relation of business logic and physical resources can be quantized, basic data is provided for business resource planning and business management, and the key capability of the scheme is provided; in addition, the embodiment of the invention ensures high performance and real-time performance of massive operation through primary collection of service data collection threads, secondary collection of computing nodes and tertiary collection of aggregation nodes, and based on event message driving and multi-level parallel collection and computation, and can provide service operation and maintenance management data support of different latitudes from top to bottom and from less to more on three levels of service, service and resources. The efficient processing mechanism and the key data design of each logic level have uniqueness; in addition, the embodiment of the invention can carry out innovative operation and maintenance support by combining with policy management under the support of data, the resource simulation capability can evaluate the influence of the service trend on hardware resources under the condition of not actually operating the service, and the data simulation capability has certain originality.
Each Unit may be implemented by a Central Processing Unit (CPU), a Digital Signal Processor (DSP), or a Programmable logic Array (FPGA) in the electronic device.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention.
Claims (12)
1. A method for monitoring service, the method comprising:
collecting annotation information and timestamp information of the service application when the system operation is executed each time;
processing the collected information to obtain converged data;
and monitoring the service according to the converged data.
2. The method of claim 1, wherein collecting annotation information and timestamp information of the business application each time the system operation is completed comprises:
according to the configuration of a service annotation encapsulation library and/or a user-defined annotation library, collecting annotation information and timestamp information of service application when the system operation is executed each time, wherein the service annotation encapsulation library is used for taking over part of the system library and carrying out service annotation encapsulation; the user-defined annotation library is used for realizing user-defined configuration of service annotation information and establishing mapping and relation between services and resources required by operation and maintenance.
3. The method of claim 1, wherein said processing the collected information to obtain aggregated data comprises:
summarizing and calculating the information collected by the service annotation lightweight library;
the information after the summary calculation is processed in a gathering way,
the method further comprises the following steps:
realizing pivot forwarding of the annotation information message stream; and performing configuration management and/or decomposition execution on the execution strategy, the acquisition rule, the summary calculation strategy and the global data aggregation rule.
4. The method of claim 1, wherein the performing traffic monitoring according to the aggregated data comprises:
organizing a required service resource mapping view according to the aggregated data, and providing a basic view for subsequent service monitoring;
and generating a monitoring view of a service level according to the service resource mapping view and implementing monitoring.
5. The method of any one of claims 1 to 4, further comprising:
and under the condition that the application resources are insufficient, performing corresponding resource adjustment on the service process and the thread by using the service resource scheduling function.
6. The method of any one of claims 1 to 4, further comprising:
and evaluating the actual requirement of the resources according to the business volume, simulating the influence on the resources under the condition of increasing the business volume or adjusting business logic, and finally forming the investment reference for increasing and decreasing the physical resources.
7. A traffic monitoring system, comprising: the system comprises a service annotation light weight library, a service data center and a service decision center; wherein,
the service annotation light-weight library is used for collecting annotation information and timestamp information of the service application when the system operation is executed each time;
the service data center is used for processing the collected information to obtain converged data;
and the service decision center is used for monitoring the service according to the converged data.
8. The system of claim 7, wherein the business annotation light weight library comprises: a service annotation packaging library, a user-defined annotation library and a collection thread library; wherein,
the service annotation encapsulation library is used for taking over part of the system library and carrying out service annotation encapsulation;
the user-defined annotation library is used for realizing user-defined configuration of service annotation information and establishing mapping and relation between services and resources required by operation and maintenance;
and the collection thread library is used for collecting annotation information and timestamp information of the service application when the system operation is executed each time according to the configuration of the service annotation packaging library and/or the custom annotation library.
9. The system of claim 7, wherein the service data center comprises: the system comprises an acquisition processor, a convergence processor, a message driver and a strategy executor; wherein,
the acquisition processor is used for summarizing and calculating the information collected by the service annotation light weight library;
the convergence processor is used for converging the information processed by the acquisition processor;
the message driver is used for realizing the pivot forwarding of the annotation information message flow;
the strategy executor is used for carrying out configuration management and/or decomposition execution on an execution strategy, an acquisition rule, a summary calculation strategy and a global data aggregation rule.
10. The system of claim 7, wherein the business decision center comprises: the system comprises a service mapping module and a service monitoring module; wherein,
the service mapping module is used for organizing a required service resource mapping view according to the converged data of the service data center and providing a basic view for subsequent service monitoring;
and the service monitoring module is used for generating a monitoring view of a service level according to the service resource mapping view and implementing monitoring.
11. The system according to any one of claims 7 to 10, wherein the business decision center further comprises a resource adjustment module, and the business annotation light weight library further comprises a management thread library; wherein,
the resource adjusting module is also used for notifying the management thread library according to the condition that the service monitoring module monitors that the application resources are insufficient;
and the management thread library is used for performing corresponding resource adjustment on the service process and the thread by using a service resource scheduling function after receiving the resource adjustment notification sent by the resource adjustment module.
12. The system according to any one of claims 7 to 10, wherein the business decision center further comprises a resource simulation module,
and the resource simulation module is used for evaluating the actual demand of the service volume on the resources, simulating the influence on the resources under the condition of increasing the service volume or adjusting the service logic, and finally forming the investment reference for increasing or decreasing the physical resources.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510097895.XA CN105991366B (en) | 2015-03-05 | 2015-03-05 | A kind of business monitoring method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510097895.XA CN105991366B (en) | 2015-03-05 | 2015-03-05 | A kind of business monitoring method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105991366A true CN105991366A (en) | 2016-10-05 |
| CN105991366B CN105991366B (en) | 2019-07-02 |
Family
ID=57038322
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510097895.XA Active CN105991366B (en) | 2015-03-05 | 2015-03-05 | A kind of business monitoring method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105991366B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108268355A (en) * | 2016-12-31 | 2018-07-10 | 中国移动通信集团四川有限公司 | For the monitoring system and method for data center |
| CN112486955A (en) * | 2020-12-04 | 2021-03-12 | 高慧军 | Data maintenance method based on big data and artificial intelligence and big data platform |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102006018232A1 (en) * | 2005-04-19 | 2006-11-02 | Hewlett-Packard Development Company, L.P., Houston | Quality of service determining method for e.g. computer network, involves calculating delayed indication of quality of service in concurrent process, after receipt of delayed data, on basis of regular information |
| CN103312851A (en) * | 2013-05-31 | 2013-09-18 | 南京大学 | Intelligent cellphone application interaction interface program usability testing method |
| CN104268056A (en) * | 2014-09-18 | 2015-01-07 | 中国科学院自动化研究所 | Complex event processing based real-time monitoring system and method for CPS (Cyber-Physical Systems) applications |
| CN104506393A (en) * | 2015-01-06 | 2015-04-08 | 北京海量数据技术股份有限公司 | System monitoring method based on cloud platform |
-
2015
- 2015-03-05 CN CN201510097895.XA patent/CN105991366B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102006018232A1 (en) * | 2005-04-19 | 2006-11-02 | Hewlett-Packard Development Company, L.P., Houston | Quality of service determining method for e.g. computer network, involves calculating delayed indication of quality of service in concurrent process, after receipt of delayed data, on basis of regular information |
| CN103312851A (en) * | 2013-05-31 | 2013-09-18 | 南京大学 | Intelligent cellphone application interaction interface program usability testing method |
| CN104268056A (en) * | 2014-09-18 | 2015-01-07 | 中国科学院自动化研究所 | Complex event processing based real-time monitoring system and method for CPS (Cyber-Physical Systems) applications |
| CN104506393A (en) * | 2015-01-06 | 2015-04-08 | 北京海量数据技术股份有限公司 | System monitoring method based on cloud platform |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108268355A (en) * | 2016-12-31 | 2018-07-10 | 中国移动通信集团四川有限公司 | For the monitoring system and method for data center |
| CN112486955A (en) * | 2020-12-04 | 2021-03-12 | 高慧军 | Data maintenance method based on big data and artificial intelligence and big data platform |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105991366B (en) | 2019-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Coutinho et al. | Elasticity in cloud computing: a survey | |
| CN104503826B (en) | The virtual machine mapping method and device of a kind of cloud computation data center | |
| CN108845878A (en) | The big data processing method and processing device calculated based on serverless backup | |
| CN104462121B (en) | Data processing method, apparatus and system | |
| CN107103064B (en) | Data statistical method and device | |
| CN107968802A (en) | The method, apparatus and filtering type scheduler of a kind of scheduling of resource | |
| CN106027328A (en) | Cluster monitoring method and system based on application container deployment | |
| CN105871957A (en) | Monitoring framework design method, monitoring server, proxy unit and center control server | |
| CN113448812A (en) | Monitoring alarm method and device under micro-service scene | |
| CN106815254A (en) | A kind of data processing method and device | |
| CN106790706A (en) | A kind of method of data resource optimization, platform and system | |
| CN113037722B (en) | Intrusion detection method and device for edge calculation scene | |
| CN104317942A (en) | Massive data comparison method and system based on hadoop cloud platform | |
| CN106131227A (en) | Balancing method of loads, meta data server system and load balance system | |
| WO2023138014A1 (en) | Intelligent operation and maintenance system oriented to computing-network integration scenario and use method thereof | |
| CN106034047B (en) | Data processing method and device | |
| CN101595680A (en) | With the relevant apparatus and method of performance management by distributed treatment | |
| Demirbaga et al. | Autodiagn: An automated real-time diagnosis framework for big data systems | |
| CN105991366B (en) | A kind of business monitoring method and system | |
| CN108304293A (en) | A kind of software systems monitoring method based on big data technology | |
| CN111324644B (en) | Method and device for monitoring database connection storm under large-scale micro-service architecture | |
| CN107995026B (en) | Management and control method, management node, managed node and system based on middleware | |
| CN106452829A (en) | Intelligent operation and maintenance method and system for cloud computation center based on BCC-KNN | |
| CN106209484A (en) | The method of testing of a kind of degree of depth net analysis system and device | |
| CN108989116B (en) | Big data collection and analysis system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |