CN115220984A - Business application monitoring method and device, electronic equipment and storage medium - Google Patents
Business application monitoring method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN115220984A CN115220984A CN202110405674.XA CN202110405674A CN115220984A CN 115220984 A CN115220984 A CN 115220984A CN 202110405674 A CN202110405674 A CN 202110405674A CN 115220984 A CN115220984 A CN 115220984A
- Authority
- CN
- China
- Prior art keywords
- monitoring
- service application
- application
- data
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
Landscapes
- Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application discloses a business application monitoring method and device, electronic equipment and a storage medium, which are executed by a monitoring server, wherein the method comprises the following steps: acquiring a monitoring request of a service application based on a monitoring interface; acquiring original monitoring data of the service application according to the monitoring request of the service application; and aggregating the original monitoring data of the service application, and storing the aggregation processing result of the service application into a service application monitoring database. According to the business application monitoring method, the data of the corresponding business application can be collected and aggregated according to the requirements of the user through the preset unified monitoring interface, the processing result is stored in the business application monitoring database, a foundation is provided for the follow-up user to inquire the monitoring data, the process does not need to manually analyze and summarize the monitoring data, a large amount of labor cost is saved, and the monitoring efficiency of the business application is improved.
Description
Technical Field
The present application relates to the field of business application monitoring technologies, and in particular, to a business application monitoring method and apparatus, an electronic device, and a storage medium.
Background
The service application monitoring means monitoring and optimizing key service applications, improving the usability and reliability index of the service applications, reducing the investment and workload of operation and maintenance on the premise of providing better service, and bringing more commercial benefits and customer experience to users.
However, the inventor finds that the existing monitoring method needs manual statistics and analysis of monitoring index data, which consumes a lot of labor cost and is not efficient in monitoring.
Disclosure of Invention
The embodiment of the application provides a business application monitoring method and device, electronic equipment and a storage medium, so that the monitoring cost of business application is reduced, and the monitoring efficiency of business application is improved.
The embodiment of the application adopts the following technical scheme:
in a first aspect, an embodiment of the present application provides a service application monitoring method, which is executed by a monitoring server, where the method includes:
acquiring a monitoring request of a service application based on a monitoring interface;
acquiring original monitoring data of the service application according to the monitoring request of the service application;
and aggregating the original monitoring data of the service application, and storing the aggregation processing result of the service application into a service application monitoring database.
Optionally, the monitoring request of the service application includes a service application name and a monitoring item, and the obtaining of the original monitoring data of the service application according to the monitoring request of the service application includes:
and acquiring monitoring item data of the service application corresponding to the service application name according to the service application name and the monitoring item, and taking the monitoring item data of the service application as original monitoring data of the service application, wherein the monitoring item data of the service application comprises service index data and hardware index data.
Optionally, the acquiring monitoring item data of the service application corresponding to the service application name includes:
determining an application log analysis rule of the service application;
and acquiring the service index data of the service application by using a corresponding data acquisition tool according to the application log analysis rule.
Optionally, the acquiring monitoring item data of the service application corresponding to the service application name includes:
obtaining a relation list of the service application and a host;
and acquiring hardware index data of the host corresponding to the service application according to the relation list.
Optionally, the host and the business application each include a plurality of hosts, the aggregation processing result includes an aggregation processing result of a host dimension and an aggregation processing result of a business application dimension, and the aggregating the original monitoring data of the business application includes:
determining service index data and hardware index data of each service application deployed on a target host, and respectively averaging the service index data and the hardware index data of each service application to obtain an aggregation processing result of the target host in the host dimension;
determining hardware index data and service index data of each host where a target service application is located, and respectively averaging the hardware index data and the service index data of each host to serve as an aggregation processing result of the target service application in service application dimensions;
the target host is any one of a plurality of hosts, and the target business application is any one of a plurality of business applications.
Optionally, the business application monitoring database is an ElasticSearch search engine, and the storing the aggregation processing result of the business application into the business application monitoring database includes:
and storing the aggregation processing result of the service application into the index fragment corresponding to the ElasticSearch search engine in a time axis form.
Optionally, the method further comprises:
receiving a monitoring data query request of a service application based on the monitoring interface;
and inquiring in the service application monitoring database according to the monitoring data inquiry request, and returning a monitoring data inquiry result.
Optionally, the monitoring data query request includes a time range, a target service application name, and a target monitoring item, and the querying in the service application monitoring database according to the monitoring data query request and returning a monitoring data query result includes:
and querying the monitoring data corresponding to the target business application name and the target monitoring item in the time range in the business application monitoring database as the monitoring data query result.
Optionally, the service application refers to a tested application in a stress test environment, the monitoring request of the service application further includes a stress test script, and the obtaining of the original monitoring data of the service application according to the monitoring request of the service application further includes:
and acquiring the original monitoring data of the tested application under the pressure test environment according to the pressure test script.
Optionally, the dimensions of the raw monitoring data include a business application dimension and a host dimension, and the business application dimension and the host dimension each include one or more of the following monitoring items: CPU utilization, memory, traffic, response times, response time, and system success rate.
In a second aspect, an embodiment of the present application further provides a service application monitoring apparatus, which is applied to a monitoring server, where the apparatus is configured to implement any one of the foregoing methods.
In a third aspect, an embodiment of the present application further provides an electronic device, including:
a processor; and
a memory arranged to store computer executable instructions that, when executed, cause the processor to perform any of the methods described above.
In a fourth aspect, embodiments of the present application further provide a computer-readable storage medium storing one or more programs that, when executed by an electronic device including a plurality of application programs, cause the electronic device to perform any of the methods described above.
The embodiment of the application adopts at least one technical scheme which can achieve the following beneficial effects: the service application monitoring method can be executed by a monitoring server which is deployed independently, and when the service application is monitored, a monitoring request of the service application is obtained based on a preset unified monitoring interface; then, according to the monitoring request of the service application, acquiring original monitoring data corresponding to the service application; and finally, carrying out aggregation processing on the original monitoring data of the service application, and storing the aggregation processing result of the service application into a service application monitoring database so as to realize the monitoring of the service application according to the data stored in the service application monitoring database. According to the business application monitoring method, the data of the corresponding business application can be collected and aggregated according to the requirements of the user through the preset unified monitoring interface, the processing result is stored in the business application monitoring database, a foundation is provided for the follow-up user to inquire the monitoring data, the process does not need to manually analyze and summarize the monitoring data, a large amount of labor cost is saved, and the monitoring efficiency of the business application is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
FIG. 1 is a schematic structural diagram of a performance baseline platform system applied in a pressure test scenario in the prior art;
fig. 2 is a schematic flowchart of a service application monitoring method according to an embodiment of the present application;
fig. 3 is a schematic view of a service application monitoring process according to an embodiment of the present application;
fig. 4 is an overall architecture diagram of a service application monitoring system according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a service application monitoring apparatus according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only a few embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The technical solutions provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings.
In practical applications, many scenarios need to monitor performance, availability, reliability, and the like of a service application, for example, in a stress test scenario, the performance, reliability, stability, and the like of the service application under test are tested by simulating software and hardware environments of the service application under test and a system load of a user during use and running the service application under test for a long time or with an excessive load. In order to find out the performance baseline of the full link applied by the tested service, standardize the pressure test process of the full link, reduce the pressure test threshold, and monitor the overall operation condition of the tested service applied in the pressure test environment.
As shown in fig. 1, a schematic structural diagram of a performance baseline platform system applied in a pressure test scenario in the prior art is provided, which mainly involves three modules: 1) The pressure sending end is used for preparing pressure sending data, producing and assembling various pressure test scripts; 2) The environment management terminal is used for quickly constructing a pressure test environment and aligning the baseline version; 3) And the monitoring terminal is used for acquiring the service and hardware monitoring indexes of each module, and performing aggregation calculation and display.
However, the existing monitoring end needs to manually check hardware monitoring indexes, application logs and the like in the Zabbix monitoring component to analyze the monitoring condition of the business application, and manually summarize monitoring index data according to the business application dimension, and this process needs to consume a large amount of labor cost, and the monitoring efficiency is not high.
Based on this, the embodiment of the present application provides a service application monitoring method for the monitoring terminal, and it should be noted here that the above listed application scenarios are only for facilitating understanding of the technical solution of the present application, and the specific application scenarios of the technical solution of the present application are not limited thereto, and for example, the application scenarios may also be applied to monitoring of a service application in a non-test scenario, so that the application scope should not be unduly limited thereby.
Specifically, the business application monitoring method provided in the embodiment of the present application is executed by a monitoring server, and as shown in fig. 2, a flow diagram of the business application monitoring method is provided, where the method includes at least the following steps S210 to S230:
step S210, acquiring a monitoring request of the service application based on the monitoring interface.
The service application monitoring method according to the embodiment of the present application may be executed by a separately deployed monitoring server, for example, the monitoring end in the performance baseline platform system listed above may be regarded as a monitoring server. Before monitoring the service application, the embodiment of the application sets a uniform monitoring interface on the monitoring server in advance, can uniformly receive the monitoring request of the service application sent by the front end, and can provide a uniform query entry for subsequent user query, thereby greatly facilitating the monitoring requirement of the user on the service application and improving the monitoring efficiency.
When monitoring the service application, the monitoring request of the service application at the front end can be acquired through the preset unified monitoring interface, the acquisition mode here can be active acquisition or passive reception, the acquisition frequency can be acquired in real time, or acquired every preset time, such as every 5 seconds, or every minute, and how to specifically acquire the monitoring request of the service application can be flexibly set by a person skilled in the art according to actual needs, and the method is not specifically limited here.
Step S220, obtaining the original monitoring data of the service application according to the monitoring request of the service application.
After the monitoring request of the service application is obtained, the original monitoring data corresponding to the service application can be collected according to the monitoring request of the service application, and the frequency of data collection can also be collected in real time, or can be collected every preset time, such as every 5 seconds, or once every minute, and can be set corresponding to the obtaining frequency of the monitoring request of the service application. Of course, how to set the data collection frequency specifically, those skilled in the art may also set the frequency flexibly according to actual requirements, and is not limited specifically herein.
The raw monitoring data can be understood as various data generated by the service application during actual operation, and the various data serve as basic data for subsequent processing.
Step S230, performing aggregation processing on the original monitoring data of the service application, and storing an aggregation processing result of the service application in a service application monitoring database.
Because the data volume and the data dimension that the business was used and is produced in the actual operation process are very abundant, for the convenience of follow-up user to monitoring data's the looking over, satisfy user's control demand, this application embodiment can carry out polymerization to above-mentioned raw monitoring data who gathers for the monitoring data after the polymerization can be more comprehensive and clear, saved the link of user's manual analysis and summary monitoring data, and then improve the monitoring efficiency of business application, satisfy user's control demand.
In order to provide a query basis for querying monitoring data by a subsequent user, the embodiment of the application can store the service application aggregation processing result obtained after aggregation processing into the service application monitoring database, so as to realize effective management of the monitoring data.
According to the business application monitoring method, the data of the corresponding business application can be collected and aggregated according to the requirements of the user through the preset unified monitoring interface, the processing result is stored in the business application monitoring database, a foundation is provided for the follow-up user to inquire the monitoring data, manual analysis and gathering of the monitoring data are not needed in the process, a large amount of labor cost is saved, and the monitoring efficiency of the business application is improved.
In an embodiment of the present application, the monitoring request of the service application includes a service application name and a monitoring item, and the obtaining the original monitoring data of the service application according to the monitoring request of the service application includes: and acquiring monitoring item data of the service application corresponding to the service application name according to the service application name and the monitoring item, and taking the monitoring item data of the service application as original monitoring data of the service application, wherein the monitoring item data of the service application comprises service index data and hardware index data.
The monitoring request of the service application in the embodiment of the present application may specifically include a service application name, a monitoring item, and other contents, where the service application name refers to a name identifier of the service application that the user wants to monitor, such as service application a, service application B, and service application C, and the monitoring item refers to data of which dimensions the user wants to monitor the service application, such as monitoring item x1, monitoring item x2, and monitoring item x 3.
In an actual application scenario, a service application list and a monitoring item list which can be monitored can be displayed for a user on a front-end page, and the user can select a service application which is desired to be monitored, such as a service application a, and corresponding monitoring items, such as a monitoring item x1 and a monitoring item x2, from the service application list. The original monitoring data can be specifically divided into service index data and hardware index data, the service index data refers to index data of the service application, and the hardware index data refers to hardware index data of a host where the service application is located.
In an embodiment of the present application, the acquiring monitoring item data of the service application corresponding to the service application name includes: determining an application log analysis rule of the service application; and acquiring the service index data of the service application by using a corresponding data acquisition tool according to the application log analysis rule.
As described above, the monitoring item data of the service application may include service index data, and in the embodiment of the present application, when the service index data of the service application is obtained, the monitoring item data is mainly obtained based on the application log of the service application, but the application log parsing rules of different service applications are different, so that in the embodiment of the present application, the application log parsing rule corresponding to the service application may be determined according to the name of the service application, and then the service index data of the service application may be collected by using a corresponding data collection tool according to the application log parsing rule.
The data collection tools may include, for example, the Flume, kafka, and logstack tools. The flash is a data acquisition system which is open in source, high in reliability, high in expansion, easy to manage and support client expansion, is constructed by JRuby and depends on a Java running environment. Kafka is a distributed, partitioned, multi-replica, multi-subscriber, zookeeper coordination based distributed logging system, often available for Web/nginx logs, access logs, message services, and the like. The Logstash is an open source data collection engine with real-time pipeline function, and can dynamically unify data from different data sources and standardize the data to a destination selected by a user.
In addition to the above listed data collection tools, the original monitoring data may be collected in a custom script manner, and of course, those skilled in the art may flexibly set the data collection tools according to actual needs, which is not specifically limited herein.
In an embodiment of the present application, the obtaining monitoring item data of a service application corresponding to the service application name includes: acquiring a relation list of the service application and a host; and acquiring hardware index data of the host corresponding to the service application according to the relation list.
As described above, the monitoring item data of the service application may further include hardware index data, in the embodiment of the present application, when acquiring the hardware index data of the service application, a relationship list between the service application and the host may be acquired first, where the relationship list between the service application and the host may be acquired from a Hippo enterprise application development platform, that is, a host list corresponding to each service application may be stored in a Hippo, and then the hardware monitoring item data of the host configured in advance by the user may be acquired from a Zabbix monitoring component according to the host list, and serve as the hardware index data of the host corresponding to the service application.
Hippo is an application release platform, and can provide a standardized deployment process for applications accessed by the application release platform, and applications meeting application standards can be accessed to the application release platform and deployed by using the standardized deployment process. Zabbix is an enterprise-level open source solution providing distributed system monitoring and network monitoring functions based on a WEB interface, and can monitor various network parameters, ensure the safe operation of a server system and provide a flexible notification mechanism to enable a system administrator to quickly locate/solve various problems. Of course, besides using these two tools to collect the hardware index data of the host, those skilled in the art may also select other tools according to actual requirements, and the method is not limited in this embodiment.
In an embodiment of the present application, the host and the business application each include a plurality of hosts, the aggregation processing result includes an aggregation processing result of a host dimension and an aggregation processing result of a business application dimension, and the aggregating the raw monitoring data of the business application includes: determining service index data and hardware index data of each service application deployed on a target host, and respectively averaging the service index data and the hardware index data of each service application to obtain an aggregation processing result of the target host in host dimensions; determining hardware index data and service index data of each host where a target service application is located, and respectively averaging the hardware index data and the service index data of each host to serve as an aggregation processing result of the target service application in service application dimensions; the target host is any one of a plurality of hosts, and the target business application is any one of a plurality of business applications. .
After the service index data of the service application and the hardware index data of the host are acquired, the hardware index data of the host and the service index data can be aggregated in the service application dimension and the host dimension, that is, the service index data and the hardware index data corresponding to each service application are associated.
Specifically, the service application dimension and the host dimension may include one or more of the following monitoring items: the CPU utilization, the memory, the flow, the response times, the response time, and the system success rate, of course, those skilled in the art may also flexibly set monitoring items of other dimensions according to actual requirements, which are not listed herein.
When the above monitoring items are aggregated, the aggregation calculation may be performed from two dimensions, namely, a service application dimension and a host dimension. For example, assuming that a service application a, a service application B, and a service application C are deployed on the host 1, for the monitoring item of the traffic, the traffic of the service application a, the service application B, and the service application C on the host 1 can be respectively obtained from the Zabbix monitoring component, and then the sum of the traffic of the service application a, the service application B, and the service application C on the host 1 is averaged to obtain the traffic of the host 1, which is used as the service index data of the host dimension.
Assuming that the host where the service application a is located has the host 1, the host 2, and the host 3, for the monitoring item of the CPU usage rate, the CPU usage rates corresponding to the host 1, the host 2, and the host 3 may be respectively obtained from the Zabbix monitoring component, and then the sum of the CPU usage rates corresponding to the host 1, the host 2, and the host 3 is averaged to obtain the CPU usage rate of the service application a, which is used as the hardware index data of the service application dimension.
Through the aggregation processing process, the service application indexes and the hardware index data of the service application can be summarized and associated, powerful support is provided for subsequent user query, links of manual analysis and summary of monitoring data of a user are saved, monitoring requirements of the user are met, and monitoring efficiency of the service application is improved.
In an embodiment of the present application, the business application monitoring database is an ElasticSearch search engine, and the storing the aggregation processing result of the business application in the business application monitoring database includes: and storing the aggregation processing result of the service application into the index fragment corresponding to the ElasticSearch search engine in a time axis form.
In order to provide a powerful support for subsequent user query, the embodiment of the application can store the aggregation processing result of the business application into the business application monitoring database. Specifically, an elastic search engine can be used for storing data, the elastic search is a search server based on Lucene, and the elastic search engine provides a distributed full-text search engine with multi-user capability, can achieve real-time search, and is stable, reliable, rapid, and convenient to install and use. Of course, in addition to the elastic search for storing data, other databases such as MySQL may also be used, and the purpose to be achieved by the embodiments of the present application can also be achieved, which is not listed here.
As described above, the acquisition and aggregation processing of the original monitoring data may be performed in real time or at a certain time interval, so that the obtained aggregation processing result may also be stored in the database in real time or at a certain time interval, and during specific storage, the original monitoring data may be stored in a time axis form, for example, if the original monitoring data is aggregated once every 5 seconds, the abscissa of the time axis may be divided at the time interval of 5 seconds, and the ordinate may be respectively set as monitoring items to be monitored, such as CPU utilization, memory, and the like, so as to obtain the change of each monitoring item index with time.
In one embodiment of the present application, the method further comprises: receiving a monitoring data query request of a service application based on the monitoring interface; and inquiring in the service application monitoring database according to the monitoring data inquiry request, and returning a monitoring data inquiry result.
The preset unified monitoring interface in the embodiment of the application can also provide a unified query service for a user, and specifically, a front-end page can provide a query interface for the user, and the user can select or input relevant information of a service application to be queried in the query interface to trigger a monitoring data query request of the service application, so that the embodiment of the application can receive the monitoring data query request of the service application triggered by the user at the front end through the monitoring interface, query in a service application monitoring database according to the monitoring data query request, and return a monitoring data query result to the front end, so that the front-end page displays the monitoring data query result.
In an embodiment of the present application, the monitoring data query request includes a time range, a target service application name, and a target monitoring item, and querying in the service application monitoring database according to the monitoring data query request and returning a monitoring data query result includes: and querying the monitoring data corresponding to the target business application name and the target monitoring item in the time range in the business application monitoring database as the monitoring data query result.
In an actual application scenario, a user may select a time range, a target service application, a target monitoring item, and the like that the user wants to query and monitor according to actual requirements, that is, a query interface at the front end may provide the function for the user, so that a received monitoring data query request carries information such as the time range, the target service application name, and the target monitoring item. When data query is performed, monitoring data corresponding to the target service application name and the target monitoring item in the time range can be queried in the service application monitoring database as a monitoring data query result. It should be noted that, what query information is specifically included in the monitoring data query request may be flexibly set by a person skilled in the art according to actual requirements, which is not listed here.
For example, assuming that the time range carried in the monitoring data query request triggered by the user is 10 am at 9/1/2020 to 11 am at 9/1/2020, the target service application name is the service application a, and the target monitoring item is the CPU utilization and the memory, the CPU utilization and the memory of the service application a may be called in the service application monitoring database, and the data in the time period from 10 am at 9/1/2020 to 11 am at 9/1/2020 is intercepted as the final monitoring data query result and returned to the front end.
As described above, a service application may be deployed on multiple hosts, and therefore in an embodiment of the present application, a monitoring data query request triggered by a user may be a query request for monitoring data on a certain host of a certain service application, or may be a query request for monitoring data on all hosts deployed by the service application. Therefore, the business application monitoring method can meet the monitoring requirements of the user on the monitoring data of the business application dimension and the host dimension at the same time, and is high in flexibility.
In an embodiment of the present application, the service application refers to a tested application in a stress test environment, the monitoring request of the service application further includes a stress test script, and the obtaining of the original monitoring data of the service application according to the monitoring request of the service application further includes: and acquiring the original monitoring data of the tested application under the pressure test environment according to the pressure test script.
As described above, the service application monitoring method according to the embodiment of the present application may be applied to a stress test scenario, and therefore the service application herein may specifically refer to a tested application in a stress test environment. In a pressure test scene, the performance, reliability and the like of the tested application can be tested through the pressure test script, so that the original monitoring data of the tested application in the pressure test environment can be obtained according to the operation of the pressure test script, and the monitoring requirement of a user on the service application in the pressure test environment is met.
To facilitate understanding of the embodiments of the present application, fig. 3 provides a schematic diagram of a business application monitoring process. As shown in fig. 3, in the service application monitoring process according to the embodiment of the present application, an application log of a service application is obtained and analyzed, so as to obtain service index data of the service application, relationship list information between the service application and a host is obtained through Hippo, and hardware index data of the host is obtained through a Zabbix monitoring component. And then, aggregating the data in the three aspects, and writing the aggregation result into a service application monitoring database for storage, thereby providing a basis for user query, so that the user can query the monitoring data through a uniform query entry.
Accordingly, FIG. 4 provides an overall architecture diagram of a business application monitoring system. As shown in fig. 4, the business application monitoring system according to the embodiment of the present application mainly includes a data acquisition layer, a data processing layer, a data storage layer, and a data service layer. The data acquisition layer is mainly used for acquiring original monitoring data of business applications by using various data acquisition tools, the data processing layer is mainly used for aggregating the acquired original monitoring data, the data storage layer is used for storing the aggregated results to provide a basis for subsequent user inquiry, and the data service layer is used for providing a uniform inquiry entrance for a user so as to meet the inquiry requirements of the user on the monitoring data of different business applications.
The business application monitoring process and the business application monitoring system can finish the collection, processing and storage of business index data and hardware index data of business application in a timed and self-driven manner, a user only needs to provide necessary information of the business application and can automatically, quickly and accurately inquire various business indexes and hardware indexes configured by the business application through a preset unified monitoring interface service, and meanwhile, the business application monitoring process and the business application monitoring system have traceability on historical data. According to the process, the monitoring data do not need to be manually inquired in different monitoring components and manually analyzed and summarized, so that a large amount of labor and material cost is saved, and the throughput and efficiency under a performance test scene are improved.
An embodiment of the present application further provides a service application monitoring apparatus 500, which is applied to a monitoring server, as shown in fig. 5, where the apparatus 500 includes: a first obtaining unit 510, a second obtaining unit 520, and an aggregation unit 530, wherein:
a first obtaining unit 510, configured to obtain a monitoring request of a service application based on a monitoring interface;
a second obtaining unit 520, configured to obtain original monitoring data of the service application according to the monitoring request of the service application;
the aggregating unit 530 is configured to aggregate the original monitoring data of the service application, and store an aggregation processing result of the service application in a service application monitoring database.
In an embodiment of the present application, the monitoring request of the service application includes a service application name and a monitoring item, and the second obtaining unit 520 is specifically configured to: and acquiring monitoring item data of the service application corresponding to the service application name according to the service application name and the monitoring item, and taking the monitoring item data of the service application as original monitoring data of the service application, wherein the monitoring item data of the service application comprises service index data and hardware index data.
In an embodiment of the present application, the second obtaining unit 520 is specifically configured to: determining an application log analysis rule of the service application; and acquiring the service index data of the service application by using a corresponding data acquisition tool according to the application log analysis rule.
In an embodiment of the application, the second obtaining unit 520 is specifically configured to: acquiring a relation list of the service application and a host; and acquiring hardware index data of the host corresponding to the service application according to the relation list.
In an embodiment of the present application, the host and the business application each include a plurality of hosts, the aggregation processing result includes an aggregation processing result of a host dimension and an aggregation processing result of a business application dimension, and the aggregation unit 530 is specifically configured to: determining service index data and hardware index data of each service application deployed on a target host, and respectively averaging the service index data and the hardware index data of each service application to obtain an aggregation processing result of the target host in host dimensions; determining hardware index data and service index data of each host where a target service application is located, and respectively averaging the hardware index data and the service index data of each host to serve as an aggregation processing result of the target service application in a service application dimension; the target host is any one of a plurality of hosts, and the target business application is any one of a plurality of business applications.
In an embodiment of the present application, the service application monitoring database is an ElasticSearch search engine, and the aggregating unit 530 is specifically configured to: and storing the aggregation processing result of the service application into the index fragment corresponding to the ElasticSearch search engine in a time axis form.
In one embodiment of the present application, the apparatus further comprises: a receiving unit, configured to receive a monitoring data query request of a service application based on the monitoring interface; and the query unit is used for querying in the service application monitoring database according to the monitoring data query request and returning a monitoring data query result.
In an embodiment of the present application, the monitoring data query request includes a time range, a target service application name, and a target monitoring item, and the query unit is specifically configured to: and querying the monitoring data corresponding to the target business application name and the target monitoring item in the time range in the business application monitoring database as the monitoring data query result.
In an embodiment of the present application, the service application refers to a tested application in a stress test environment, the monitoring request of the service application further includes a stress test script, and the second obtaining unit 520 is specifically configured to: and acquiring the original monitoring data of the tested application under the pressure test environment according to the pressure test script.
In one embodiment of the present application, the dimensions of the raw monitoring data include a business application dimension and a host dimension, and the business application dimension and the host dimension each include one or more of the following monitoring items: CPU utilization, memory, traffic, response times, response time, and system success rate.
It can be understood that, the service application monitoring apparatus can implement each step of the service application monitoring method executed by the monitoring system server provided in the foregoing embodiment, and the relevant explanations about the service application monitoring method are applicable to the service application monitoring apparatus, and are not described herein again.
Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application. Referring to fig. 6, at a hardware level, the electronic device includes a processor, and optionally further includes an internal bus, a network interface, and a memory. The Memory may include a Memory, such as a Random-Access Memory (RAM), and may further include a non-volatile Memory, such as at least 1 disk Memory. Of course, the electronic device may also include hardware required for other services.
The processor, the network interface, and the memory may be connected to each other by an internal bus, which may be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, an EISA (Extended Industry Standard Architecture) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one double-headed arrow is shown in FIG. 6, but that does not indicate only one bus or one type of bus.
And the memory is used for storing programs. In particular, the program may include program code comprising computer operating instructions. The memory may include both memory and non-volatile storage and provides instructions and data to the processor.
The processor reads the corresponding computer program from the nonvolatile memory into the memory and then runs the computer program to form the service application monitoring device on the logic level. The processor is used for executing the program stored in the memory and is specifically used for executing the following operations:
acquiring a monitoring request of a service application based on a monitoring interface;
acquiring original monitoring data of the service application according to the monitoring request of the service application;
and aggregating the original monitoring data of the service application, and storing the aggregation processing result of the service application into a service application monitoring database.
The method executed by the service application monitoring apparatus according to the embodiment shown in fig. 5 of the present application may be applied to a processor, or may be implemented by a processor. The processor may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), application Specific Integrated Circuits (ASICs), field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in a memory, and a processor reads information in the memory and completes the steps of the method in combination with hardware of the processor.
The electronic device may further execute the method executed by the service application monitoring apparatus in fig. 5, and implement the function of the service application monitoring apparatus in the embodiment shown in fig. 5, which is not described herein again in this embodiment of the present application.
An embodiment of the present application further provides a computer-readable storage medium, where the computer-readable storage medium stores one or more programs, where the one or more programs include instructions, which, when executed by an electronic device including multiple application programs, enable the electronic device to perform the method performed by the business application monitoring apparatus in the embodiment shown in fig. 5, and are specifically configured to perform:
acquiring a monitoring request of a service application based on a monitoring interface;
acquiring original monitoring data of the service application according to the monitoring request of the service application;
and aggregating the original monitoring data of the service application, and storing the aggregation processing result of the service application into a service application monitoring database.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and so forth) having computer-usable program code embodied therein.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement or the like made within the spirit and principle of the present application shall be included in the scope of the claims of the present application.
Claims (13)
1. A business application monitoring method performed by a monitoring server, wherein the method comprises:
acquiring a monitoring request of a service application based on a monitoring interface;
acquiring original monitoring data of the service application according to the monitoring request of the service application;
and aggregating the original monitoring data of the service application, and storing the aggregation processing result of the service application into a service application monitoring database.
2. The method of claim 1, wherein the monitoring request of the service application includes a service application name and a monitoring item, and the obtaining raw monitoring data of the service application according to the monitoring request of the service application includes:
and acquiring monitoring item data of the service application corresponding to the service application name according to the service application name and the monitoring item, and taking the monitoring item data of the service application as original monitoring data of the service application, wherein the monitoring item data of the service application comprises service index data and hardware index data.
3. The method of claim 2, wherein the obtaining of monitoring item data of the service application corresponding to the service application name comprises:
determining an application log analysis rule of the service application;
and acquiring the service index data of the service application by using a corresponding data acquisition tool according to the application log analysis rule.
4. The method of claim 3, wherein the obtaining monitoring item data of the service application corresponding to the service application name comprises:
acquiring a relation list of the service application and a host;
and acquiring hardware index data of the host corresponding to the service application according to the relation list.
5. The method of claim 4, wherein the host and the business application each include a plurality of hosts, the aggregation processing result includes an aggregation processing result of a host dimension and an aggregation processing result of a business application dimension, and the aggregating the raw monitoring data of the business application includes:
determining service index data and hardware index data of each service application deployed on a target host, and respectively averaging the service index data and the hardware index data of each service application to obtain an aggregation processing result of the target host in host dimensions;
determining hardware index data and service index data of each host where a target service application is located, and respectively averaging the hardware index data and the service index data of each host to serve as an aggregation processing result of the target service application in a service application dimension;
the target host is any one of a plurality of hosts, and the target business application is any one of a plurality of business applications.
6. The method of claim 1, wherein the business application monitoring database is an ElasticSearch search engine, and wherein storing the aggregated processing results of the business application into the business application monitoring database comprises:
and storing the aggregation processing result of the service application into the index fragment corresponding to the ElasticSearch search engine in a time axis form.
7. The method of claim 1, wherein the method further comprises:
receiving a monitoring data query request of a service application based on the monitoring interface;
and inquiring in the service application monitoring database according to the monitoring data inquiry request, and returning a monitoring data inquiry result.
8. The method of claim 7, wherein the monitoring data query request includes a time range, a target business application name and a target monitoring item, and the querying in the business application monitoring database according to the monitoring data query request and returning a monitoring data query result includes:
and querying the monitoring data corresponding to the target business application name and the target monitoring item in the time range in the business application monitoring database as the monitoring data query result.
9. The method of claim 1, wherein the service application refers to a tested application in a stress test environment, the monitoring request of the service application further includes a stress test script, and the obtaining raw monitoring data of the service application according to the monitoring request of the service application further includes:
and acquiring the original monitoring data of the tested application under the pressure test environment according to the pressure test script.
10. The method of any of claims 1 to 9, wherein the dimensions of the raw monitoring data include a business application dimension and a host dimension, each of the business application dimension and the host dimension including one or more of the following monitoring items: CPU utilization, memory, traffic, response times, response time, and system success rate.
11. A business application monitoring apparatus applied to a monitoring server, wherein the apparatus is configured to implement the method of any one of claims 1 to 10.
12. An electronic device, comprising:
a processor; and
a memory arranged to store computer executable instructions which, when executed, cause the processor to perform the method of any one of claims 1 to 10.
13. A computer readable storage medium storing one or more programs which, when executed by an electronic device comprising a plurality of application programs, cause the electronic device to perform the method of any of claims 1-10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110405674.XA CN115220984A (en) | 2021-04-15 | 2021-04-15 | Business application monitoring method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110405674.XA CN115220984A (en) | 2021-04-15 | 2021-04-15 | Business application monitoring method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115220984A true CN115220984A (en) | 2022-10-21 |
Family
ID=83604465
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110405674.XA Pending CN115220984A (en) | 2021-04-15 | 2021-04-15 | Business application monitoring method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115220984A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117896284A (en) * | 2024-01-17 | 2024-04-16 | 北京奇虎科技有限公司 | Performance fluctuation positioning method, device, equipment and storage medium |
-
2021
- 2021-04-15 CN CN202110405674.XA patent/CN115220984A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117896284A (en) * | 2024-01-17 | 2024-04-16 | 北京奇虎科技有限公司 | Performance fluctuation positioning method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20110191361A1 (en) | System and method for building a cloud aware massive data analytics solution background | |
| CN112307057A (en) | Data processing method and device, electronic equipment and computer storage medium | |
| CN114490268A (en) | Full link monitoring method, device, equipment, storage medium and program product | |
| CN109327353B (en) | Service flow determination method and device and electronic equipment | |
| CN111522728A (en) | Method for generating automatic test case, electronic device and readable storage medium | |
| CN113596078B (en) | Service problem positioning method and device | |
| CN114090366A (en) | Method, device and system for monitoring data | |
| CN112087320B (en) | Abnormality positioning method and device, electronic equipment and readable storage medium | |
| CN110888985A (en) | Alarm information processing method and device, electronic equipment and storage medium | |
| CN113448985A (en) | API (application program interface) interface generation method, calling method and device and electronic equipment | |
| CN112187509A (en) | Multi-architecture cloud platform execution log management method, system, terminal and storage medium | |
| CN109901991B (en) | Method and device for analyzing abnormal call and electronic equipment | |
| CN114648323A (en) | Service scene oriented call chain processing method, device and medium | |
| CN110908910A (en) | Block chain-based test monitoring method and device and readable storage medium | |
| CN115220984A (en) | Business application monitoring method and device, electronic equipment and storage medium | |
| CN112526905B (en) | Processing method and system for index abnormity | |
| CN114265904A (en) | Data processing method and cloud computing platform | |
| US11620164B1 (en) | Virtual partitioning of a shared message bus | |
| CN111045983A (en) | Nuclear power station electronic file management method and device, terminal equipment and medium | |
| CN112491943A (en) | Data request method, device, storage medium and electronic equipment | |
| CN110213123A (en) | A kind of flux monitoring method, device and equipment | |
| CN112596974A (en) | Full link monitoring method, device, equipment and storage medium | |
| CN115202973A (en) | Application running state determining method and device, electronic equipment and medium | |
| CN113792330A (en) | Sensitive data tracking method and system | |
| CN113778976A (en) | Data processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |