CN113918414A - Pinpoint and prometheus-based ice monitoring method and system - Google Patents
Pinpoint and prometheus-based ice monitoring method and system Download PDFInfo
- Publication number
- CN113918414A CN113918414A CN202111143090.6A CN202111143090A CN113918414A CN 113918414 A CN113918414 A CN 113918414A CN 202111143090 A CN202111143090 A CN 202111143090A CN 113918414 A CN113918414 A CN 113918414A
- Authority
- CN
- China
- Prior art keywords
- monitoring
- ice
- plugin
- custom
- pinpoint
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3041—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is an input/output interface
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/324—Display of status information
- G06F11/327—Alarm or error message display
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a method and a system for ice monitoring based on pinpoint and prometheus, wherein the method comprises the following steps: acquiring a first preset monitoring index according to a first monitoring requirement; constructing a first custom exporter template in a grafana visualization tool based on a first preset monitoring index; monitoring pinpoint, and constructing a first self-defined ice plug-in; configuring a first self-defined ice plugin plug-in into a plugin directory according to a first configuration instruction; and introducing a first user-defined exporter template and the first user-defined ice plug-in, wherein the first preset mode is a javaagent mode, and monitoring. The technical problems that monitoring is not in place and invasion is high when a third-party plug-in is used in the prior art are solved.
Description
Technical Field
The invention relates to the technical field related to system monitoring, in particular to a method and a system for ice monitoring based on pinpoint and prometheus.
Background
Zeroc ice provides a synchronous, asynchronous invocation-supporting cross-language multi-platform efficient rpc framework based on tcp, udp, websockets, ssl, bluetooth, bi-directional transport, which multiplexes connections, uses compression, efficient binary protocols to minimize cpu and network overhead, and can be used to encrypt, decrypt, and verify data. The monitoring of the Zeroc ice parameter index is helpful for optimizing the system and preventing abnormal conditions from occurring.
In the prior art, two methods are mainly used for monitoring the Zeroc ice index: the first one is that the Ice is relied on to carry a metric function package IceMx, and mainly provides metrics information of Ice processes, such as how many times the Ice service side distributes calls initiated by the client, the number of threads currently used, the data volume transmitted by Ice connection, and the like; the second method is that the third-party metrics toolkit drowizard metrics with an open source is mainly suitable for custom metrics monitoring, developers need to write monitoring code collection monitoring items, and monitoring data can be output to an external storage in a reporter mode, such as infilxdb, elastic search, zabbix and the like. The dropwizard metrics collects monitoring data through a timing task and then outputs the monitoring data in a reporter form, historical and multiple applied metrics can be aggregated to a unified external storage, and then visualized display is carried out through the grafana and the like, so that the defects of a large IceMx are overcome.
The Ice self-contained metric function package IceMx has more than 30 attributes, has higher requirements on configuration personnel, is complex in configuration process, cannot monitor historical data, and cannot measure indexes of RPC each time; the dropwizard metrics require hard coding by the programmer and are too intrusive and do not have a single call trace on the monitored item, and cannot call trace information in detail.
However, in the process of implementing the technical solution of the invention in the embodiments of the present application, the inventors of the present application find that the above-mentioned technology has at least the following technical problems:
the technical problems of insufficient monitoring and strong invasiveness when a third-party plug-in is used exist in the prior art.
Disclosure of Invention
The embodiment of the application provides a method and a system for ice monitoring based on pinpoint and prometheus, and solves the technical problems that in the prior art, monitoring is not in place and invasion is high when a third-party plug-in is used. Constructing a user-defined exporter template in a grafana visualization tool through a preset monitoring index to display monitored data; and then, combining pinpoint monitoring to construct a self-defined ice plugin plug-in, and inserting each working module into a plugin directory to realize the monitoring of zeroc ice. And then, introducing the self-defined exporter template and the self-defined ice plugin into the zeroc ice system by utilizing a java agent mode, wherein the java agent introduction does not need to configure various parameters, and the invasiveness is weak. The technical effect of comprehensively monitoring and using the third-party plug-in with weak invasiveness is achieved.
In view of the foregoing problems, embodiments of the present application provide a method and a system for ice monitoring based on pinpoint and prometheus.
In a first aspect, an embodiment of the present application provides a method for ice monitoring based on pinpoint and prometheus, where the scheme is applied to a custom open-source monitoring system, and the method includes: acquiring a first preset monitoring index according to a first monitoring requirement; constructing a first custom exporter template in a grafana visualization tool based on the first preset monitoring index; constructing a first self-defined ice plug-in through the monitoring of the butting pinpoint; configuring the first self-defined ice plugin plug-in into a plugin directory according to a first configuration instruction; introducing the first user-defined exporter template and the first user-defined ice plugin according to a first preset mode, wherein the first preset mode is a java agent mode; and monitoring according to the first custom exporter template and the first custom ice plugin.
On the other hand, an embodiment of the present application provides a rice monitoring system based on pinpoint and prometheus, where the system includes: the first obtaining unit is used for obtaining a first preset monitoring index according to a first monitoring requirement; a second obtaining unit, configured to construct a first custom exporter template in a grafana visualization tool based on the first preset monitoring index; the first building unit is used for building a first self-defined ice plug-in through the monitoring of the butting pinpoint; the first configuration unit is used for configuring the first self-defined ice plugin plug-in into a plugin directory according to a first configuration instruction; the first import unit is used for importing the first custom exporter template and the first custom ice plugin according to a first preset mode, wherein the first preset mode is a java agent mode; and the first monitoring unit is used for monitoring according to the first custom exporter template and the first custom ice plugin.
In a third aspect, an embodiment of the present application provides a pinpoint and prometheus-based ice monitoring system, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the method according to any one of the first aspect when executing the program.
One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:
the method comprises the steps of obtaining a first preset monitoring index according to a first monitoring requirement; constructing a first custom exporter template in a grafana visualization tool based on the first preset monitoring index; constructing a first self-defined ice plug-in through the monitoring of the butting pinpoint; configuring the first self-defined ice plugin plug-in into a plugin directory according to a first configuration instruction; introducing the first user-defined exporter template and the first user-defined ice plugin according to a first preset mode, wherein the first preset mode is a java agent mode; according to the technical scheme of monitoring the first user-defined exporter template and the first user-defined ice plugin, constructing a user-defined exporter template in a grafana visualization tool through preset monitoring indexes to display monitored data; and then, combining pinpoint monitoring to construct a self-defined ice plugin plug-in, and inserting each working module into a plugin directory to realize the monitoring of zeroc ice. And then, introducing the self-defined exporter template and the self-defined ice plugin into the zeroc ice system by utilizing a java agent mode, wherein the java agent introduction does not need to configure various parameters, and the invasiveness is weak. The technical effect of comprehensively monitoring and using the third-party plug-in with weak invasiveness is achieved.
The foregoing description is only an overview of the technical solutions of the present application, and the present application can be implemented according to the content of the description in order to make the technical means of the present application more clearly understood, and the following detailed description of the present application is given in order to make the above and other objects, features, and advantages of the present application more clearly understandable.
Drawings
Fig. 1 is a schematic flowchart of a rice monitoring method based on pinpoint and prometheus according to an embodiment of the present disclosure;
fig. 2 is a schematic flowchart of a method for implementing a rice monitoring visualization interface based on pinpoint and prometheus according to an embodiment of the present disclosure;
fig. 3 is a schematic flowchart of a method for storing ice monitoring data based on pinpoint and prometheus according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of a ping monitoring system based on pinpoint and prometheus according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of an exemplary electronic device according to an embodiment of the present application.
Description of reference numerals: the system comprises a first obtaining unit 11, a second obtaining unit 12, a first constructing unit 13, a first configuring unit 14, a first introducing unit 15, a first monitoring unit 16, an electronic device 300, a memory 301, a processor 302, a communication interface 303 and a bus architecture 304.
Detailed Description
The embodiment of the application provides a method and a system for ice monitoring based on pinpoint and prometheus, and solves the technical problems that in the prior art, monitoring is not in place and invasion is high when a third-party plug-in is used. Constructing a user-defined exporter template in a grafana visualization tool through a preset monitoring index to display monitored data; and then, combining pinpoint monitoring to construct a self-defined ice plugin plug-in, and inserting each working module into a plugin directory to realize the monitoring of the zeroc ice industry. And then, introducing the self-defined exporter template and the self-defined ice plugin into the zeroc ice system by utilizing a java agent mode, wherein the java agent introduction does not need to configure various parameters, and the invasiveness is weak. The technical effect of comprehensively monitoring and using the third-party plug-in with weak invasiveness is achieved.
Summary of the application
Zeroc ice provides a synchronous, asynchronous and asynchronous call-supporting cross-language multi-platform efficient rpc framework based on tcp, udp, websockets, ssl, bluetooth, bi-directional transport, which multiplexes connections, uses compression, efficient binary protocols to minimize cpu and network overhead, and can be used to encrypt, decrypt, and verify data. The monitoring of the Zeroc ice parameter index is helpful for optimizing the system and preventing abnormal conditions from occurring.
In the prior art, two methods are mainly used for monitoring the Zeroc ice index: the first one is that the Ice is relied on to carry a metric function package IceMx, and mainly provides metrics information of Ice processes, such as how many times the Ice service side distributes calls initiated by the client, the number of threads currently used, the data volume transmitted by Ice connection, and the like; the second method is that the third-party metrics toolkit drowizard metrics with an open source is mainly suitable for custom metrics monitoring, developers need to write monitoring code collection monitoring items, and monitoring data can be output to an external storage in a reporter mode, such as infilxdb, elastic search, zabbix and the like. The Dropwizard metrics collects monitoring data through a timing task and then outputs the monitoring data in a reporter form, historical and multiple applied metrics can be aggregated to a unified external storage, and then visualized display is carried out through the grafana and the like, so that the defects of a large IceMx are overcome. The Ice self-contained metric function package IceMx has more than 30 attributes, has higher requirements on configuration personnel, is more complex in configuration process, cannot monitor historical data, and cannot measure RPC each time; the dropwizard metrics require hard coding by the programmer and are too intrusive and do not have a single call trace on the monitored item, and cannot call trace information in detail. However, the prior art has the technical problems of poor monitoring and high invasiveness when a third-party plug-in is used.
In view of the above technical problems, the technical solution provided by the present application has the following general idea:
the embodiment of the application provides a method for ice monitoring based on pinpoint and prometheus, and the scheme is applied to a user-defined open-source monitoring system, wherein the method comprises the following steps: acquiring a first preset monitoring index according to a first monitoring requirement; constructing a first custom exporter template in a grafana visualization tool based on the first preset monitoring index; constructing a first self-defined ice plug-in through the monitoring of the butting pinpoint; configuring the first self-defined ice plugin plug-in into a plugin directory according to a first configuration instruction; introducing the first user-defined exporter template and the first user-defined ice plugin according to a first preset mode, wherein the first preset mode is a java agent mode; and monitoring according to the first custom exporter template and the first custom ice plugin.
Having thus described the general principles of the present application, various non-limiting embodiments thereof will now be described in detail with reference to the accompanying drawings.
Example one
As shown in fig. 1, an embodiment of the present application provides a pinpoint and prometheus-based ice monitoring method, where the scheme is applied to a custom open-source monitoring system, where the method includes:
s100: acquiring a first preset monitoring index according to a first monitoring requirement;
specifically, the first monitoring requirement is determined according to a status indicator actually referenced by a zeroc ice framework, and includes but is not limited to: the ice server side distributes data such as the number of calls initiated by the client side, the number of threads currently used, the data volume transmitted by ice connection, the number of times of feedback information initiated by the server side is received by the ice client side, and the like; the first preset monitoring index refers to data obtained by classifying and storing the first monitoring demand information, and takes an example without limitation: monitoring data which are divided into port type requirements, such as the data corresponding to the ice service terminal and the ice client terminal; the service calls link demand monitoring data, that is, data corresponding to the call process, such as the number of threads currently used, the data amount transmitted by ice connection, the number of threads used in the past hour, and the type of threads used at a fixed point. Through the classified storage of the first preset monitoring indexes, corresponding modules can be called to monitor according to different types of demand monitoring data.
S200: constructing a first custom exporter template in a grafana visualization tool based on the first preset monitoring index;
specifically, the first custom exporter template refers to the first preset monitoring index information which is called and stored, and a parameter page to be displayed is constructed in a grafana visualization tool according to data to be monitored, so as to expose the index data of zeroc ice. The grafana visualization tool is a cross-platform open-source measurement analysis and visualization tool, can be used for inquiring collected data, visually displaying the data and timely notifying the data, is a multipurpose monitoring tool, and can be used for effectively warning and notifying the data in a mail or other modes, so that a rich and visual visualization interface is provided, and the advantages of various data source configurations are achieved. Preferably, a self-defined monitoring view is connected with a premeheus system and the grafana visualization tool through a butt joint, namely the first self-defined exporter template, wherein the premeheus system refers to an open-source monitoring alarm system, the premeheus system is provided with a visualization view interface and an alert component based on a cloud-native design and an realized time sequence database, meanwhile, the grafana self-defined monitoring view can be flexibly connected, and a server side and a client side are both opened and used without installation. And exposing the index data of zeroc ice through the first custom exporter template, analyzing according to the data and giving an alarm when the index is abnormal.
S300: constructing a first self-defined ice plug-in through the monitoring of the butting pinpoint;
specifically, the pinpoint monitoring system refers to a full link analysis tool, provides functions such as non-intrusive call chain monitoring, method execution detail checking, application state information monitoring, and the like, and can implement several monitoring functions without limitation: the method comprises the steps that index information such as a service topological graph, a real-time active thread graph, a request response scatter diagram, a request call stack check, an application state, a machine state check and the like can be obtained, and because the pinpoint monitoring can work only by selecting a proper call method and does not need to configure parameters, the monitoring intrusiveness through the pinpoint system is small, and the influence on a zeroc ice frame system is small; the first self-defined ice plugin is an plugin which is designed to extend the zeroc ice framework architecture for connecting the pinpoint monitoring system. By accessing the pinpoint monitoring system, more comprehensive monitoring can be realized, for example, index information of each time needs to be called, a certain service node can be clicked through a service topology graph, and detailed information of the node, such as current node state, request quantity and other data, can be displayed.
S400: configuring the first self-defined ice plugin plug-in into a plugin directory according to a first configuration instruction;
specifically, the plugin directory refers to each component module of the pinpoint monitoring system in the first self-defined ice plugin; the first configuration refers to a control signal which is sent by the zeroc ice framework system and starts to configure each component module of the pinpoint monitoring system in an extended architecture according to the plugin directory, and the configuration process includes: if the pinpoint monitoring system component module in the first self-defined ice plugin comprises: the Collector component: the data collection module receives the monitoring data and stores the monitoring data in a database; web UI component: and the monitoring display module displays the system calling relationship, calling details, application state and the like, supports functions such as alarming and the like, and configures the system calling relationship, the calling details, the application state and the like to the plugin directory to obtain a pinpoint collector component and a pinpoint webui component on the zeroc frame system. After the first user-defined ice plugin plug-in is configured to the plugin directory, the pinpoint monitoring system completes expansion on the zeroc ice frame system and waits for calling.
S500: introducing the first user-defined exporter template and the first user-defined ice plugin according to a first preset mode, wherein the first preset mode is a java agent mode;
s600: and monitoring according to the first custom exporter template and the first custom ice plugin.
Further, based on monitoring according to the first custom exporter template and the first custom ice plugin, the method includes:
s610: the pinpoint monitoring can check virtual machine monitoring indexes including a client and a server and service link calling details through the Web server;
s620: the virtual machine monitoring index is obtained through a first virtual machine, wherein the main program monitored by the pinpoint is deployed by the first virtual machine and comprises the Hbase database, the collector controller and a display end of the Web server.
Specifically, the first preset mode refers to a process of introducing the first custom exporter template and the first custom firmware plugin, waiting for calling to perform monitoring, and the like, the javaagent mode refers to a method for adding a monitoring code on a virtual machine layer, and a monitoring module with low invasiveness can be introduced based on the javaagent mode. After the introduction is finished, the zeroc ice frame system can be comprehensively monitored according to the first custom exporter template and the first custom ice plug-in module according to monitoring requirements, and the technical effects of comprehensive monitoring and small invasiveness are achieved.
Further, based on the configuring according to the first configuration instruction, configuring the first self-defined ice plugin into a plugin directory, where the method step S400 further includes:
s410: obtaining a first deployment instruction and a first configuration instruction;
s420: deploying an Hbase database monitored by the pinpoint, a collector controller and Web server application according to the first deployment instruction, wherein the Hbase database is used for storing monitoring information;
s430: and configuring the first self-defined ice plug-in to the collector controller and the plug-in directory of the Web server according to the first configuration instruction.
Specifically, the first deployment instruction refers to monitoring each component module according to the pinpoint of the first user-defined ice plugin, and deploying each module loading position in a framework of the plugin directory extension, such as the Hbase database, the collector controller and the Web server application, wherein the Hbase database is used for storing monitoring information; the collector controller is used for receiving the monitoring data sent by the java agentgent and storing the monitoring data into an HBase database; the Web server is applied to displaying the system calling relationship, calling details, application states and the like, and supports functions such as alarming and the like. Further, according to the first configuration instruction, loading each component module in the first user-defined ice plugin in a corresponding position in the plugin directory extension architecture, and waiting for calling, so that the monitoring function supported by pinpoint monitoring can be realized.
Further, based on monitoring according to the first custom exporter template and the first custom ice plugin, the method includes:
s610: the pinpoint monitoring can check virtual machine monitoring indexes including a client and a server and service link calling details through the Web server;
s620: the virtual machine monitoring index is obtained through a first virtual machine, wherein the main program monitored by the pinpoint is deployed by the first virtual machine and comprises the Hbase database, the collector controller and a display end of the Web server.
Specifically, the virtual machine refers to a complete computer system which has a complete hardware system function and runs in a completely isolated environment through software simulation, one or more virtual computers can be simulated on one physical computer through virtual machine software, the virtual machines completely work as real computers, the java agent mode is that monitoring codes are added on the virtual machine layer, hard coding is not needed, the intrusiveness is small, the monitoring codes are combined with each function module monitored by pinpoint, the client and the server are monitored according to port monitoring requirements in a first preset monitoring index to obtain corresponding calling and feedback information, the service link calling detail data are monitored according to service calling link requirement monitoring data in the first preset monitoring index to form the virtual machine monitoring index, the first virtual machine refers to a main program for deploying the pinpoint monitoring, comprises the Hbase database, the collector controller and a simulation computer of a display end of the Web server, deploys each monitoring module according to the first virtual machine, and is extremely small in invasiveness to an original system.
Further, based on the pinpoint monitoring, virtual machine monitoring indexes and service link calling details including a client and a server can be viewed in the Web server, and the method step S610 includes:
s611: obtaining a first historical call link according to the pinpoint monitoring;
s612: obtaining a first marking instruction based on the first historical call link;
s613: obtaining a first mark call link according to the first mark instruction;
s614: and tracking and monitoring the first mark calling link according to the first tracking instruction.
Specifically, the first historical calling link refers to a historical link calling situation from the beginning of a calling command to a certain preset time in the past, and data information conforming to the first historical calling link is screened out based on monitoring data obtained by the pinpoint monitoring and matched with the first historical calling link; furthermore, the first marking instruction is used for marking the first historical calling link, so that corresponding data can be conveniently positioned according to the mark when detailed node data needs to be called; the first marking call link is the first history call link marked according to the first marking instruction; the first tracking instruction refers to a control signal which is sent out after the historical data of the first historical calling link is matched with the first historical calling link and continuously monitors the index of the first marked calling link in real time; and further, calling link real-time tracking index information for the first mark according to the first tracking instruction. By marking the first historical calling link, the information of the detailed node can be called quickly when the information of the detailed node needs to be called, the pinpoint monitoring and identification can be facilitated to continue to track detailed data in real time, and historical data corresponding to the first historical calling link can be called according to the mark.
Further, as shown in fig. 2, the method includes step S700:
s710: obtaining a first visualization interface of the grafana visualization tool;
s720: inputting a first query instruction to the first visual interface;
s730: and obtaining a first query index according to the first query instruction, wherein the first query index comprises indexes of ice server and ice client.
Specifically, the first visualization interface refers to a display of the various indicator data based on the display of the grafana visualization tool; the first query instruction refers to a query instruction set according to the requirement index information, which is not limited: inquiring various index data such as the quantity of calling information distributed by a server in one hour; the first query index refers to corresponding index information obtained by inputting the first query instruction into a search bar of the first visual interface; the ice server refers to index information of port classes, and the index information comprises server index data and client index data; the ice client refers to the process index data of the service link class, and the ice server index and the ice client index are both contained in the first query index. And integrating the monitored index data through the first visual interface to achieve the technical effect of obtaining a uniform system view.
Further, based on the introduction of the first custom exporter template and the first custom ice plugin according to the first preset manner, the method S500 includes:
s510: obtaining a first calling method of the java agent mode according to the pinpoint monitoring;
s520: generating a first calling instruction according to the first calling method;
s530: and calling the first preset mode based on the first calling instruction.
Specifically, the first calling method refers to a method for adding a monitoring code matched with each function in combination with each function option of the pinpoint monitoring module on the first virtual machine layer according to the java agent mode; the first calling instruction refers to a control signal which is sent out after the first calling method is matched and used for calling the first user-defined exporter template and the first user-defined ice plugin; furthermore, the first user-defined exporter template and the first user-defined ice plugin are called according to the first calling method, so that the purpose of monitoring is achieved, namely, the process is introduced according to the first preset mode. By combining the java agent mode and the pinpoint monitoring, the technical effect of comprehensively monitoring the system index with small invasiveness is achieved.
Further, based on the monitoring according to the first custom exporter template and the first custom ice plugin, as shown in fig. 3, the method further includes step S800:
s810: monitoring based on the first custom exporter template and the first custom ice plugin plug-in to obtain first monitoring index data;
s820: storing the first monitoring index data in the Hbase database;
s830: and periodically storing the data in the Hbase database through a first preset data storage period.
Specifically, the first monitoring index data refers to a series of system index data obtained after the first custom exporter template and the first custom ice plugin are called according to the first calling method for monitoring; storing the first monitoring index data in the Hbase database; the first preset data storage period refers to a preset frequency of storing the first monitoring index data into the Hbase database, and can be freely defined according to actual requirements; and storing the first monitoring index data according to the first preset data storage period. By periodically storing the first monitoring index data, the technical effect of calling historical index data can be achieved.
In summary, the method and system for ice monitoring based on pinpoint and prometheus provided by the embodiments of the present application have the following technical effects:
1. the method comprises the steps of obtaining a first preset monitoring index according to a first monitoring requirement; constructing a first custom exporter template in a grafana visualization tool based on the first preset monitoring index; constructing a first self-defined ice plug-in through the monitoring of the butting pinpoint; configuring the first self-defined ice plugin plug-in into a plugin directory according to a first configuration instruction; introducing the first user-defined exporter template and the first user-defined ice plugin according to a first preset mode, wherein the first preset mode is a java agent mode; according to the technical scheme of monitoring the first user-defined exporter template and the first user-defined ice plugin, constructing a user-defined exporter template in a grafana visualization tool through preset monitoring indexes to display monitored data; and then, combining pinpoint monitoring to construct a self-defined ice plugin plug-in, and inserting each working module into a plugin directory to realize the monitoring of zeroc ice. And then, introducing the self-defined exporter template and the self-defined ice plugin into the zeroc ice system by utilizing a java agent mode, wherein the java agent introduction does not need to configure various parameters, and the invasiveness is weak. The technical effect of comprehensively monitoring and using the third-party plug-in with weak invasiveness is achieved.
2. And integrating the monitored index data through the first visual interface to achieve the technical effect of obtaining a uniform system view.
3. By periodically storing the first monitoring index data, the technical effect of calling historical index data can be achieved.
Example two
Based on the same inventive concept as the previous embodiment of a method for monitoring rice based on pinpoint and premethenus, as shown in fig. 4, an embodiment of the present application provides a system for monitoring rice based on pinpoint and premethenus, where the system includes:
the first obtaining unit 11 is configured to obtain a first preset monitoring index according to a first monitoring requirement;
a second obtaining unit 12, where the second obtaining unit 12 is configured to construct a first custom exporter template in a grafana visualization tool based on the first preset monitoring index;
the first building unit 13 is used for building a first self-defined ice plug-in through the monitoring of the docking pinpoint;
a first configuration unit 14, where the first configuration unit 14 is configured to configure the first self-defined ice plugin into a plugin directory according to a first configuration instruction;
the first importing unit 15 is configured to import the first custom exporter template and the first custom firmware plugin according to a first preset manner, where the first preset manner is a javaagent manner;
and the first monitoring unit 16, where the first monitoring unit 16 is configured to monitor according to the first custom exporter template and the first custom ice plugin.
Further, the system further comprises:
a third obtaining unit, configured to obtain a first deployment instruction and a first configuration instruction;
the first deployment unit is used for deploying the Hbase database monitored by the pinpoint, a collector controller and a Web server application according to the first deployment instruction, wherein the Hbase database is used for storing monitoring information;
and the first configuration unit is used for configuring the first self-defined ice plug-in to the collector controller and the plug-in directory of the Web server according to the first configuration instruction.
Further, the system further comprises:
the first checking unit is used for checking the virtual machine monitoring index and the service link calling details of a client and a server in the Web server by the pinpoint monitoring;
and the second deployment unit is used for acquiring the virtual machine monitoring index through a first virtual machine, wherein the first virtual machine mainly deploys the main program monitored by the pinpoint, and the main program comprises the Hbase database, the collector controller and the display end of the Web server.
Further, the system further comprises:
a fourth obtaining unit, configured to obtain a first historical call link according to the pinpoint monitoring;
a fifth obtaining unit, configured to obtain a first marking instruction based on the first history call link;
a sixth obtaining unit, configured to obtain, according to the first tag instruction, a first tag call link;
and the first calling unit is used for tracking and monitoring the first mark calling link according to a first tracking instruction.
Further, the system further comprises:
a seventh obtaining unit, configured to obtain a first visualization interface of the grafana visualization tool;
the first input unit is used for inputting a first query instruction to the first visual interface;
an eighth obtaining unit, configured to obtain a first query indicator according to the first query instruction, where the first query indicator includes each indicator of ice server and ice client.
Further, the system further comprises:
a ninth obtaining unit, configured to obtain, according to the pinpoint monitoring, a first calling method of the java agent manner;
the first generation unit is used for generating a first calling instruction according to the first calling method;
and the second calling unit is used for calling the first preset mode based on the first calling instruction.
Further, the system further comprises:
a tenth obtaining unit, configured to perform monitoring based on the first custom exporter template and the first custom ice plugin, and obtain first monitoring index data;
a first storage unit, configured to store the first monitoring index data in the Hbase database;
and the second storage unit is used for periodically storing the data in the Hbase database through a first preset data storage period.
Exemplary electronic device
The electronic device of the embodiment of the present application is described below with reference to figure 5,
based on the same inventive concept as the previous embodiment of a method for monitoring rice based on pinpoint and premethenus, the present application embodiment further provides a system for monitoring rice based on pinpoint and premethenus, including: a processor coupled to a memory for storing a program that, when executed by the processor, causes a system to perform the method of any of the first aspects
The electronic device 300 includes: processor 302, communication interface 303, memory 301. Optionally, the electronic device 300 may also include a bus architecture 304. Wherein, the communication interface 303, the processor 302 and the memory 301 may be connected to each other through a bus architecture 304; the bus architecture 304 may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus architecture 304 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown in FIG. 5, but this is not intended to represent only one bus or type of bus.
The communication interface 303 may be any device, such as a transceiver, for communicating with other devices or communication networks, such as an ethernet, a Radio Access Network (RAN), a Wireless Local Area Network (WLAN), a wired access network, and the like.
The memory 301 may be, but is not limited to, a ROM or other type of static storage device that can store static information and instructions, a RAM or other type of dynamic storage device that can store information and instructions, an electrically erasable Programmable read-only memory (EEPROM), a compact-read-only-memory (CD-ROM) or other optical disk storage, optical disk storage (including compact disk, laser disk, optical disk, digital versatile disk, blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory may be self-contained and coupled to the processor through a bus architecture 304. The memory may also be integral to the processor.
The memory 301 is used for storing computer-executable instructions for executing the present application, and is controlled by the processor 302 to execute. The processor 302 is configured to execute the computer-executable instructions stored in the memory 301, so as to implement a ping and prometheus-based ice monitoring method provided by the above-mentioned embodiments of the present application.
Optionally, the computer-executable instructions in the embodiments of the present application may also be referred to as application program codes, which are not specifically limited in the embodiments of the present application.
The embodiment of the application provides a method for ice monitoring based on pinpoint and prometheus, and the scheme is applied to a user-defined open-source monitoring system, wherein the method comprises the following steps: acquiring a first preset monitoring index according to a first monitoring requirement; constructing a first custom exporter template in a grafana visualization tool based on the first preset monitoring index; constructing a first self-defined ice plug-in through the monitoring of the butting pinpoint; configuring the first self-defined ice plugin plug-in into a plugin directory according to a first configuration instruction; introducing the first user-defined exporter template and the first user-defined ice plugin according to a first preset mode, wherein the first preset mode is a java agent mode; and monitoring according to the first custom exporter template and the first custom ice plugin. Constructing a user-defined exporter template in a grafana visualization tool through a preset monitoring index to display monitored data; and then, combining pinpoint monitoring to construct a self-defined ice plugin plug-in, and inserting each working module into a plugin directory to realize the monitoring of the zeroc ice industry. And then, introducing the self-defined exporter template and the self-defined ice plugin into the zeroc ice system by utilizing a java agent mode, wherein the java agent introduction does not need to configure various parameters, and the invasiveness is weak. The technical effect of comprehensively monitoring and using the third-party plug-in with weak invasiveness is achieved.
Those of ordinary skill in the art will understand that: the various numbers of the first, second, etc. mentioned in this application are only used for the convenience of description and are not used to limit the scope of the embodiments of this application, nor to indicate the order of precedence. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one" means one or more. At least two means two or more. "at least one," "any," or similar expressions refer to any combination of these items, including any combination of singular or plural items. For example, at least one (one ) of a, b, or c, may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or multiple.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable system. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device including one or more available media integrated servers, data centers, and the like. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
The various illustrative logical units and circuits described in this application may be implemented or operated upon by general purpose processors, digital signal processors, Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other programmable logic systems, discrete gate or transistor logic, discrete hardware components, or any combination thereof. A general-purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a digital signal processor and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a digital signal processor core, or any other similar configuration.
The steps of a method or algorithm described in the embodiments herein may be embodied directly in hardware, in a software element executed by a processor, or in a combination of the two. The software cells may be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. For example, a storage medium may be coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC, which may be disposed in a terminal. In the alternative, the processor and the storage medium may reside in different components within the terminal. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Although the present application has been described in conjunction with specific features and embodiments thereof, it will be evident that various modifications and combinations can be made thereto without departing from the spirit and scope of the application. Accordingly, the specification and figures are merely exemplary of the present application as defined in the appended claims and are intended to cover any and all modifications, variations, combinations, or equivalents within the scope of the present application. It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations.
Claims (9)
1. A ice monitoring method based on pinpoint and prometheus is applied to a self-defined open source monitoring system, wherein the method comprises the following steps:
acquiring a first preset monitoring index according to a first monitoring requirement;
constructing a first custom exporter template in a grafana visualization tool based on the first preset monitoring index;
constructing a first self-defined ice plug-in through the monitoring of the butting pinpoint;
configuring the first self-defined ice plugin plug-in into a plugin directory according to a first configuration instruction;
introducing the first user-defined exporter template and the first user-defined ice plugin according to a first preset mode, wherein the first preset mode is a java agent mode;
and monitoring according to the first custom exporter template and the first custom ice plugin.
2. The method of claim 1, wherein the configuring the first custom ice plugin into a plugin directory according to a first configuration instruction, the method comprising:
obtaining a first deployment instruction and a first configuration instruction;
deploying an Hbase database monitored by the pinpoint, a collector controller and Web server application according to the first deployment instruction, wherein the Hbase database is used for storing monitoring information;
and configuring the first self-defined ice plug-in to the collector controller and the plug-in directory of the Web server according to the first configuration instruction.
3. The method of claim 2, wherein monitoring is performed according to the first custom exporter template and the first custom ice plugin, the method comprising:
the pinpoint monitoring can check virtual machine monitoring indexes including a client and a server and service link calling details through the Web server;
the virtual machine monitoring index is obtained through a first virtual machine, wherein the main program monitored by the pinpoint is deployed by the first virtual machine and comprises the Hbase database, the collector controller and a display end of the Web server.
4. The method of claim 3, wherein the pinpoint monitoring can view the virtual machine monitoring index and the service link calling details including the client and the server through the Web server, the method comprises:
obtaining a first historical call link according to the pinpoint monitoring;
obtaining a first marking instruction based on the first historical call link;
obtaining a first mark call link according to the first mark instruction;
and tracking and monitoring the first mark calling link according to the first tracking instruction.
5. The method of claim 1, the method comprising:
obtaining a first visualization interface of the grafana visualization tool;
inputting a first query instruction to the first visual interface;
and obtaining a first query index according to the first query instruction, wherein the first query index comprises indexes of ice server and ice client.
6. The method of claim 1, wherein the importing the first custom exporter template and the first custom ice plugin plug-in according to a first preset manner, the method comprising:
obtaining a first calling method of the java agent mode according to the pinpoint monitoring;
generating a first calling instruction according to the first calling method;
and calling the first preset mode based on the first calling instruction.
7. The method of claim 1, the monitoring being performed according to the first custom exporter template and the first custom ice plugin, the method further comprising:
monitoring based on the first custom exporter template and the first custom ice plugin plug-in to obtain first monitoring index data;
storing the first monitoring index data in the Hbase database;
and periodically storing the data in the Hbase database through a first preset data storage period.
8. A pinpoint and prometheus based ice monitoring system, wherein the system comprises:
the first obtaining unit is used for obtaining a first preset monitoring index according to a first monitoring requirement;
a second obtaining unit, configured to construct a first custom exporter template in a grafana visualization tool based on the first preset monitoring index;
the first building unit is used for building a first self-defined ice plug-in through the monitoring of the butting pinpoint;
the first configuration unit is used for configuring the first self-defined ice plugin plug-in into a plugin directory according to a first configuration instruction;
the first import unit is used for importing the first custom exporter template and the first custom ice plugin according to a first preset mode, wherein the first preset mode is a java agent mode;
and the first monitoring unit is used for monitoring according to the first custom exporter template and the first custom ice plugin.
9. A pinpoint and prometheus based ice monitoring system comprising: a processor coupled with a memory for storing a program that, when executed by the processor, causes a system to perform the method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111143090.6A CN113918414A (en) | 2021-09-28 | 2021-09-28 | Pinpoint and prometheus-based ice monitoring method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111143090.6A CN113918414A (en) | 2021-09-28 | 2021-09-28 | Pinpoint and prometheus-based ice monitoring method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113918414A true CN113918414A (en) | 2022-01-11 |
Family
ID=79236706
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111143090.6A Pending CN113918414A (en) | 2021-09-28 | 2021-09-28 | Pinpoint and prometheus-based ice monitoring method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113918414A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116737514A (en) * | 2023-08-15 | 2023-09-12 | 南京国睿信维软件有限公司 | Automatic operation and maintenance method based on log and probe analysis |
-
2021
- 2021-09-28 CN CN202111143090.6A patent/CN113918414A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116737514A (en) * | 2023-08-15 | 2023-09-12 | 南京国睿信维软件有限公司 | Automatic operation and maintenance method based on log and probe analysis |
| CN116737514B (en) * | 2023-08-15 | 2023-12-22 | 南京国睿信维软件有限公司 | Automatic operation and maintenance method based on log and probe analysis |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10459780B2 (en) | Automatic application repair by network device agent | |
| US10911517B2 (en) | Determining end times for single page applications | |
| US10635566B1 (en) | Predicting code change impact within an integrated development environment | |
| US10116534B2 (en) | Systems and methods for WebSphere MQ performance metrics analysis | |
| US20200267242A1 (en) | Cloud assisted behavioral automated testing | |
| US11200139B2 (en) | Automatic configuration of software systems for optimal management and performance using machine learning | |
| US20220050902A1 (en) | Opentelemetry security extensions | |
| US10503631B1 (en) | Runtime intelligence within an integrated development environment | |
| US20090327992A1 (en) | Industry template abstracting and creation for use in industrial automation and information solutions | |
| CN107704387B (en) | Method, device, electronic equipment and computer readable medium for system early warning | |
| CN103295155A (en) | Security core service system monitoring method | |
| CN104937548A (en) | Dynamic graph performance monitoring | |
| US20210149384A1 (en) | Monitoring components of manufacturing application systems with respect to application-specific metrics | |
| US20180293147A1 (en) | Autonomous Information Technology Diagnostic Checks | |
| CN104919427A (en) | Dynamic component performance monitoring | |
| CN107094086A (en) | A kind of information acquisition method and device | |
| US11962666B2 (en) | User-configurable end user monitoring (EUM) | |
| US10805144B1 (en) | Monitoring interactions between entities in a network by an agent for particular types of interactions and indexing and establishing relationships of the components of each interaction | |
| CN113918414A (en) | Pinpoint and prometheus-based ice monitoring method and system | |
| CN116166505A (en) | Monitoring platform, method, storage medium and equipment for dual-state IT architecture in financial industry | |
| US11250100B2 (en) | Cause-based event correlation to virtual page transitions in single page applications | |
| CN108072858A (en) | Electric energy meter method for quality control, system and terminal device | |
| CN114443437A (en) | Alarm root cause output method, apparatus, device, medium, and program product | |
| CN108153654A (en) | A kind of log collecting method and device | |
| CN114070829B (en) | Abnormal data acquisition method and system based on MQTT |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 100000 floors 1-3, block a, global creative Plaza, No. 10, Furong street, Chaoyang District, Beijing Applicant after: Bairong Zhixin (Beijing) Technology Co.,Ltd. Address before: 100000 floors 1-3, block a, global creative Plaza, No. 10, Furong street, Chaoyang District, Beijing Applicant before: Bairong Zhixin (Beijing) credit investigation Co.,Ltd. |