CN112596979A - Micro-service access data acquisition and monitoring platform, method and electronic equipment - Google Patents

Micro-service access data acquisition and monitoring platform, method and electronic equipment Download PDF

Info

Publication number
CN112596979A
CN112596979A CN202011544861.8A CN202011544861A CN112596979A CN 112596979 A CN112596979 A CN 112596979A CN 202011544861 A CN202011544861 A CN 202011544861A CN 112596979 A CN112596979 A CN 112596979A
Authority
CN
China
Prior art keywords
acquisition
access data
monitoring
service
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011544861.8A
Other languages
Chinese (zh)
Inventor
叶彦波
赵静
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Irootech Technology Co ltd
Original Assignee
Irootech Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Irootech Technology Co ltd filed Critical Irootech Technology Co ltd
Priority to CN202011544861.8A priority Critical patent/CN112596979A/en
Publication of CN112596979A publication Critical patent/CN112596979A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3089Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/903Querying
    • G06F16/90335Query processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/904Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/546Message passing systems or structures, e.g. queues
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/54Indexing scheme relating to G06F9/54
    • G06F2209/547Messaging middleware
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/54Indexing scheme relating to G06F9/54
    • G06F2209/548Queue

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention provides a micro-service access data acquisition and monitoring platform, a micro-service access data acquisition and monitoring method and electronic equipment, wherein the micro-service access data acquisition and monitoring platform comprises the following steps: the acquisition middleware is used for pushing access data corresponding to the access request in the target microservice to a message queue based on the access request initiated by the user; the acquisition service module is used for storing the access data in the message queue to a database and providing access data query service to the outside through an interface; the monitoring service module is used for inquiring target access data corresponding to the preset monitoring indexes in the database based on the interface provided by the acquisition service module and displaying the target access data in a charting mode. The acquisition and monitoring platform only comprises the acquisition middleware, the acquisition service module and the monitoring service module, when a new micro service is accessed, only one acquisition middleware is connected in the new micro service, the acquisition and monitoring can be specially carried out aiming at the access data of a user, and the acquisition and monitoring platform is convenient, flexible, convenient and practical.

Description

Micro-service access data acquisition and monitoring platform, method and electronic equipment
Technical Field
The invention relates to the technical field of micro services, in particular to a micro service access data acquisition and monitoring platform, a micro service access data acquisition and monitoring method and electronic equipment.
Background
In a micro-service architecture system, one business process is often completed by multiple micro-services deployed independently. The collection and monitoring of information for user access, hardware resources, call links, performance, etc. for individual microservices becomes more complicated than for unit applications.
The common general method is to collect log information of each microservice, then store log data, further process and extract monitoring indexes, and finally graphically display the monitoring data.
The construction of the perfect monitoring system needs continuous iterative optimization along with the change of the service scene, so the development period is long, and for the monitoring of user access data, the monitoring system is very heavy and redundant and has poor practicability.
Disclosure of Invention
In view of the above, the present invention provides a micro-service access data acquisition and monitoring platform, a method and an electronic device, so as to alleviate the technical problems of heavy redundancy and poor practicability of the existing monitoring system.
In a first aspect, an embodiment of the present invention provides an acquisition and monitoring platform for microservice access data, where the acquisition and monitoring platform includes: the system comprises a plurality of acquisition middleware, acquisition service modules and monitoring service modules, wherein each acquisition middleware is connected with one micro-service;
the acquisition middleware is used for pushing access data corresponding to an access request in a target microservice to a message queue based on the access request initiated by a user, wherein the target microservice is a microservice connected with the acquisition middleware;
the acquisition service module is used for storing the access data in the message queue to a database and providing access data query service to the outside through an interface;
the monitoring service module is used for inquiring target access data corresponding to preset monitoring indexes in the database based on the interface provided by the acquisition service module and displaying the target access data in a charting mode.
Further, the acquisition middleware comprises: the device comprises an acquisition unit, an extraction unit and a pushing unit;
the obtaining unit is configured to obtain project configuration information, an operating environment variable, and analysis data that is analyzed by an upstream module for the access request, where the upstream module includes: the system comprises a context analysis module and a user identity identification module;
the extraction unit is used for extracting preset type data from the target microservice based on the project configuration information, the operation environment variable and the analysis data;
and the pushing unit is used for pushing the preset type data serving as the access data to the message queue.
Further, the collection service module includes: the system comprises a message subscription unit, a data processing unit and a data query interface;
the message subscribing unit is used for subscribing the access data in the message queue and further storing the access data in the message queue to the database;
the data processing unit is used for processing the access data in the database according to preset indexes to obtain processed index access data;
the data query interface is used for providing rich query service based on the access data in the database.
Further, the monitoring service module includes: the system comprises a user-defined monitoring index unit, a target access data query unit, a chart configuration unit and a data visualization unit;
the user-defined monitoring index unit is used for receiving a user-defined monitoring command of rich query configured by a user;
the target access data query unit is used for querying target access data corresponding to the custom monitoring command in the database through an interface provided by the acquisition service module according to the custom monitoring command;
the chart configuration unit is used for receiving a target chart configured by a user;
the data visualization unit is used for visually displaying the target access data in the form of the target chart.
Further, the monitoring service module further includes: an index data display unit;
the index data display unit is used for receiving a target index selected by a user, acquiring processed index access data corresponding to the target index from the database through an interface provided by the acquisition service module according to the target index, and visually displaying the corresponding processed index access data in a target chart form.
Further, the preset type data at least includes: current node, service name data, access user, access time, path, and response time.
Further, the target index includes any one of: service access volume, hotspot path, response time, and error rate.
In a second aspect, an embodiment of the present invention further provides a method for acquiring and monitoring micro service access data, which is applied to the platform for acquiring and monitoring micro service access data in any one of the above first aspects, and the method includes:
the method comprises the steps that an acquisition middleware pushes access data corresponding to an access request in a target micro service to a message queue based on the access request initiated by a user, wherein the target micro service is a micro service connected with the acquisition middleware;
the acquisition service module stores the access data in the message queue to a database and provides access data query service to the outside through an interface;
and the monitoring service module inquires target access data corresponding to preset monitoring indexes in the database based on an interface provided by the acquisition service module and displays the target access data in a charting mode.
In a third aspect, an embodiment of the present invention provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the method according to any one of the above first aspects when executing the computer program.
In a fourth aspect, an embodiment of the present invention provides a computer-readable medium having non-volatile program code executable by a processor, where the program code causes the processor to perform the steps of the method according to any one of the first aspect.
In an embodiment of the present invention, an acquisition and monitoring platform for microservice access data is provided, where the acquisition and monitoring platform includes: the system comprises a plurality of acquisition middleware, acquisition service modules and monitoring service modules, wherein each acquisition middleware is connected with one micro-service; the acquisition middleware is used for pushing access data corresponding to an access request in the target microservice to a message queue based on the access request initiated by a user; the acquisition service module is used for storing the access data in the message queue to a database and providing access data query service to the outside through an interface; the monitoring service module is used for inquiring target access data corresponding to the preset monitoring indexes in the database based on the interface provided by the acquisition service module and displaying the target access data in a charting mode. According to the description, the acquisition and monitoring platform only comprises the acquisition middleware, the acquisition service module and the monitoring service module, when a new micro service is accessed, only one acquisition middleware is connected in the new micro service, the acquisition and monitoring can be specially carried out on the access data of a user, the acquisition and monitoring platform is convenient, flexible, convenient and practical, and the technical problems of heavy redundancy and poor practicability of the existing monitoring system are solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic structural diagram of a micro-service access data acquisition and monitoring platform according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an acquisition middleware provided in an embodiment of the present invention;
FIG. 3 is a schematic diagram of a location of an acquisition middleware in a microserver according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an acquisition service module according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a monitoring service module according to an embodiment of the present invention;
fig. 6 is a flowchart of a method for acquiring and monitoring microservice access data according to an embodiment of the present invention.
Icon:
11-acquisition middleware; 12-acquisition service module; 13-monitoring service module;
111-an acquisition unit; 112-an extraction unit; 113-a pushing unit;
121-a message subscription unit; 122-a data processing unit; 123-data query interface;
131-self-defining a monitoring index unit; 132-target access data query unit; 133-graph configuration unit; 134-data visualization unit.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the following embodiments, and it should be understood that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
For the convenience of understanding the embodiment, a detailed description is first given to a micro-service access data acquisition and monitoring platform disclosed in the embodiment of the present invention.
The first embodiment is as follows:
to facilitate understanding of the embodiment, first, a detailed description is given to an acquisition and monitoring platform for micro service access data disclosed in the embodiment of the present invention, referring to a schematic structural diagram of an acquisition and monitoring platform for micro service access data shown in fig. 1, where the acquisition and monitoring platform includes: the system comprises a plurality of acquisition middleware 11, an acquisition service module 12 and a monitoring service module 13, wherein each acquisition middleware 11 is connected with one micro-service;
the acquisition middleware 11 is configured to push access data corresponding to an access request in a target microservice to a message queue based on the access request initiated by a user, where the target microservice is a microservice connected to the acquisition middleware 11;
the acquisition service module 12 is used for storing the access data in the message queue to a database and providing access data query service to the outside through an interface;
the monitoring service module 13 is configured to query, in the database, target access data corresponding to a preset monitoring index based on the interface provided by the collection service module 12, and display the target access data in a charting manner.
In the embodiment of the invention, the independent acquisition middleware 11 can access the microservice in a configurable non-invasive mode, the acquisition service module 12 can be connected with the message queue, and the monitoring service module 13 is used as an independent module for visually displaying the access data.
The preset monitoring index can be a user-defined monitoring index (i.e. an index generated by a user-defined monitoring command) and a preset index (i.e. a common index).
In an embodiment of the present invention, an acquisition and monitoring platform for microservice access data is provided, where the acquisition and monitoring platform includes: the system comprises a plurality of acquisition middleware 11, an acquisition service module 12 and a monitoring service module 13, wherein each acquisition middleware 11 is connected with one micro-service; the acquisition middleware 11 is configured to push access data corresponding to an access request in a target microservice to a message queue based on the access request initiated by a user; the acquisition service module 12 is used for storing the access data in the message queue to a database and providing access data query service to the outside through an interface; the monitoring service module 13 is configured to query, in the database, target access data corresponding to a preset monitoring index based on the interface provided by the collection service module 12, and display the target access data in a charting manner. As can be seen from the above description, the acquisition and monitoring platform of the present invention only includes the acquisition middleware 11, the acquisition service module 12 and the monitoring service module 13, and when a new micro-service is accessed, only one acquisition middleware 11 needs to be connected to the new micro-service, so that the acquisition and monitoring can be performed specifically for the access data of the user, which is convenient, flexible, convenient, practical, and alleviates the technical problems of heavy redundancy and poor practicability of the existing monitoring system.
The foregoing briefly introduces the micro-service access data collection and monitoring platform of the present invention, and the following describes the detailed description of the related contents.
In an alternative embodiment of the present invention, referring to fig. 2, the acquisition middleware 11 comprises: an acquisition unit 111, an extraction unit 112, and a push unit 113;
an obtaining unit 111, configured to obtain the project configuration information, the operating environment variable, and analysis data that is analyzed by the upstream module for the access request, where the upstream module includes: the system comprises a context analysis module and a user identity identification module;
an extracting unit 112, configured to extract preset type data in the target microservice based on the project configuration information, the operating environment variable, and the analytic data;
a pushing unit 113, configured to push the preset type data to the message queue as access data.
In the embodiment of the invention, the acquisition Middleware 11 adopts the technologies such as AOP, Middleware and the like to realize the modularized Middleware for projects of different languages and frameworks such as Java/Spring, Node/Express and the like, and directly introduces the modules to be integrated into the projects.
Fig. 3 is a schematic diagram of the position of the acquisition middleware 11 in the microservice.
In an actual working process, the obtaining unit 111 in the collection middleware 11 can obtain the project configuration information, the operation environment variable, and the analysis data analyzed by the upstream module for the access request, then the extracting unit 112 extracts the preset type data (which may at least include the current node, the service name data, the access user, the access time, the path, and the response time) in the target micro-service based on the project configuration information, the operation environment variable, and the analysis data, and finally the pushing unit 113 pushes the preset type data as the access data to the message queue in an asynchronous message form.
When the preset type data is pushed to the message queue, pushing is carried out in a format similar to the following format:
{
"service":"order",
"node":"node1.servername"
"date":1604111367850,
"userld":"a8d5c3dd",
"method":"GET",
"path":"/order"
"duration":120,
"status":200,
"code":"ORDER-1001”,
}
in an alternative embodiment of the present invention, referring to fig. 4, the collection service module 12 includes: a message subscription unit 121, a data processing unit 122 and a data query interface 123;
a message subscribing unit 121, configured to subscribe to access data in a message queue, and further store the access data in the message queue in a database;
the data processing unit 122 is configured to process the access data in the database according to a preset index to obtain processed index access data;
and a data query interface 123 for providing rich query services based on the accessed data in the database.
Specifically, the acquisition of the access data is completed by a unified acquisition service module 12, wherein the message subscription unit 121 can subscribe the access data in the message queue, and further store the access data in the database, the data processing unit 122 in the acquisition service module 12 can process the access data in the database according to preset indexes (service daily access amount, service route access amount, and the like) to obtain processed index access data, and in addition, the data query interface 123 in the acquisition service module 12 can provide rich query service based on the access data in the database.
The following exemplifies the processed index access data by taking the daily access volume and the service path access volume of the service as examples:
-amount of service per day:
Figure BDA0002853406690000081
Figure BDA0002853406690000091
-service path access volume:
Figure BDA0002853406690000092
in an alternative embodiment of the present invention, referring to fig. 5, the monitoring service module 13 includes: a custom monitoring index unit 131, a target access data query unit 132, a chart configuration unit 133 and a data visualization unit 134;
a custom monitoring index unit 131, configured to receive a rich query custom monitoring command configured by a user;
a target access data query unit 132, configured to query, according to the custom monitoring command, target access data corresponding to the custom monitoring command in the database through the interface provided by the acquisition service module 12;
a chart configuration unit 133, configured to receive a target chart configured by a user;
and the data visualization unit 134 is used for visually displaying the target access data in the form of a target chart.
Specifically, the monitoring service module 13 is provided with a monitoring interface configuration, a user can configure relevant information in the interface, the customized monitoring index unit 131 receives a customized monitoring command configured by the user, the target access data query unit 132 queries target access data corresponding to the customized monitoring command in the database through an interface provided by the collection service module 12 according to the customized monitoring command, meanwhile, the graph configuration unit 133 receives a target icon configured by the user, and finally, the data visualization unit 134 obtains a target graph in the icon configuration unit, and visually displays the target access data queried by the target access data query unit 132 in the form of the target graph.
The target chart can be in the form of a curve, a bar chart and the like.
The custom monitor command for the rich query may be represented in the following format:
Figure BDA0002853406690000093
Figure BDA0002853406690000101
the self-defined monitoring command outputs average response time data displayed in order service according to date, method and path grouping, and the output data can be expressed as:
Figure BDA0002853406690000102
in an optional embodiment of the present invention, the monitoring service module 13 further includes: an index data display unit;
and the index data display unit is used for receiving the target index selected by the user, acquiring the processed index access data corresponding to the target index from the database through an interface provided by the acquisition service module 12 according to the target index, and visually displaying the corresponding processed index access data in a target chart form.
The target index includes any one of: service access volume, hotspot path, response time, and error rate.
That is, the index such as the service access amount, the hot spot path, the response time, the error rate, etc. can be used for displaying directly.
The acquisition and monitoring platform of the micro-service access data provides a convenient and fast integral scheme for acquiring and monitoring the user access data for a micro-service architecture system, so that developers can quickly access the monitoring service according to business requirements, flexibly configure and display the monitoring indexes of each micro-service in a visual chart form, and conveniently develop, operate and maintain, business and other related personnel to comprehensively know the access condition, the operation state and the troubleshooting and positioning problems of each micro-service.
Example two:
an embodiment of the present invention further provides a method for acquiring and monitoring microservice access data, where the method is applied to the platform for acquiring and monitoring microservice access data in the first embodiment, and with reference to fig. 6, the method includes:
step S602, the acquisition middleware pushes access data corresponding to an access request in a target micro service to a message queue based on the access request initiated by a user, wherein the target micro service is a micro service connected with the acquisition middleware;
step S604, the acquisition service module stores the access data in the message queue to a database and provides access data query service to the outside through an interface;
step S606, the monitoring service module inquires the target access data corresponding to the preset monitoring index in the database based on the interface provided by the acquisition service module, and displays the target access data in a charting mode.
In an embodiment of the present invention, a method for acquiring and monitoring microservice access data is provided, including: the acquisition middleware pushes access data corresponding to an access request in the target microservice to a message queue based on the access request initiated by a user; the acquisition service module stores the access data in the message queue to a database and provides access data query service to the outside through an interface; the monitoring service module inquires target access data corresponding to the preset monitoring indexes in the database based on the interface provided by the acquisition service module, and displays the target access data in a charting mode. According to the above description, the acquisition and monitoring method only comprises the acquisition middleware, the acquisition service module and the monitoring service module, when a new micro service is accessed, only one acquisition middleware needs to be connected in the new micro service, the acquisition and monitoring can be specially performed on the access data of the user, the method is convenient, flexible, convenient, practical and capable of relieving the technical problems of heavy redundancy and poor practicability of the existing monitoring system.
The computer program product of the micro-service access data acquisition and monitoring platform provided by the embodiment of the present invention includes a computer readable storage medium storing a program code, and instructions included in the program code may be used to execute the method in the foregoing method embodiment.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In addition, in the description of the embodiments of the present invention, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. A collection and monitoring platform for microservice access data, the collection and monitoring platform comprising: the system comprises a plurality of acquisition middleware, acquisition service modules and monitoring service modules, wherein each acquisition middleware is connected with one micro-service;
the acquisition middleware is used for pushing access data corresponding to an access request in a target microservice to a message queue based on the access request initiated by a user, wherein the target microservice is a microservice connected with the acquisition middleware;
the acquisition service module is used for storing the access data in the message queue to a database and providing access data query service to the outside through an interface;
the monitoring service module is used for inquiring target access data corresponding to preset monitoring indexes in the database based on the interface provided by the acquisition service module and displaying the target access data in a charting mode.
2. The acquisition and monitoring platform of claim 1, wherein the acquisition middleware comprises: the device comprises an acquisition unit, an extraction unit and a pushing unit;
the obtaining unit is configured to obtain project configuration information, an operating environment variable, and analysis data that is analyzed by an upstream module for the access request, where the upstream module includes: the system comprises a context analysis module and a user identity identification module;
the extraction unit is used for extracting preset type data from the target microservice based on the project configuration information, the operation environment variable and the analysis data;
and the pushing unit is used for pushing the preset type data serving as the access data to the message queue.
3. The acquisition and monitoring platform of claim 1, wherein the acquisition service module comprises: the system comprises a message subscription unit, a data processing unit and a data query interface;
the message subscribing unit is used for subscribing the access data in the message queue and further storing the access data in the message queue to the database;
the data processing unit is used for processing the access data in the database according to preset indexes to obtain processed index access data;
the data query interface is used for providing rich query service based on the access data in the database.
4. The acquisition and monitoring platform of claim 1, wherein the monitoring service module comprises: the system comprises a user-defined monitoring index unit, a target access data query unit, a chart configuration unit and a data visualization unit;
the user-defined monitoring index unit is used for receiving a user-defined monitoring command of rich query configured by a user;
the target access data query unit is used for querying target access data corresponding to the custom monitoring command in the database through an interface provided by the acquisition service module according to the custom monitoring command;
the chart configuration unit is used for receiving a target chart configured by a user;
the data visualization unit is used for visually displaying the target access data in the form of the target chart.
5. The acquisition and monitoring platform of claim 1, wherein the monitoring service module further comprises: an index data display unit;
the index data display unit is used for receiving a target index selected by a user, acquiring processed index access data corresponding to the target index from the database through an interface provided by the acquisition service module according to the target index, and visually displaying the corresponding processed index access data in a target chart form.
6. The acquisition and monitoring platform according to claim 2, characterized in that said preset types of data comprise at least: current node, service name data, access user, access time, path, and response time.
7. The acquisition and monitoring platform of claim 5, wherein the target metrics comprise any of: service access volume, hotspot path, response time, and error rate.
8. A method for acquiring and monitoring microservice access data, which is applied to the platform for acquiring and monitoring microservice access data according to any one of the preceding claims 1 to 7, the method comprising:
the method comprises the steps that an acquisition middleware pushes access data corresponding to an access request in a target micro service to a message queue based on the access request initiated by a user, wherein the target micro service is a micro service connected with the acquisition middleware;
the acquisition service module stores the access data in the message queue to a database and provides access data query service to the outside through an interface;
and the monitoring service module inquires target access data corresponding to preset monitoring indexes in the database based on an interface provided by the acquisition service module and displays the target access data in a charting mode.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the method of any of the preceding claims 1 to 7 are implemented when the computer program is executed by the processor.
10. A computer-readable medium having non-volatile program code executable by a processor, characterized in that the program code causes the processor to perform the steps of the method of any of the preceding claims 1 to 7.
CN202011544861.8A 2020-12-23 2020-12-23 Micro-service access data acquisition and monitoring platform, method and electronic equipment Pending CN112596979A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011544861.8A CN112596979A (en) 2020-12-23 2020-12-23 Micro-service access data acquisition and monitoring platform, method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011544861.8A CN112596979A (en) 2020-12-23 2020-12-23 Micro-service access data acquisition and monitoring platform, method and electronic equipment

Publications (1)

Publication Number Publication Date
CN112596979A true CN112596979A (en) 2021-04-02

Family

ID=75200641

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011544861.8A Pending CN112596979A (en) 2020-12-23 2020-12-23 Micro-service access data acquisition and monitoring platform, method and electronic equipment

Country Status (1)

Country Link
CN (1) CN112596979A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113778808A (en) * 2021-09-18 2021-12-10 上海中通吉网络技术有限公司 Monitoring method for server application
CN114221997A (en) * 2021-12-14 2022-03-22 国泰君安证券股份有限公司 Interface monitoring system based on micro-service gateway

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107766205A (en) * 2017-10-10 2018-03-06 武汉大学 A kind of monitoring system and method towards the tracking of micro services invoked procedure
US20180139305A1 (en) * 2016-11-17 2018-05-17 Datazoom, Inc. Method and real-time data acquisition and retrieval using a pass-through scalable architecture
CN108845910A (en) * 2018-05-31 2018-11-20 康键信息技术(深圳)有限公司 Monitoring method, device and the storage medium of extensive micro services system
CN111580986A (en) * 2020-04-17 2020-08-25 深圳震有科技股份有限公司 Data acquisition method, system and medium based on acquisition service middleware

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180139305A1 (en) * 2016-11-17 2018-05-17 Datazoom, Inc. Method and real-time data acquisition and retrieval using a pass-through scalable architecture
CN107766205A (en) * 2017-10-10 2018-03-06 武汉大学 A kind of monitoring system and method towards the tracking of micro services invoked procedure
CN108845910A (en) * 2018-05-31 2018-11-20 康键信息技术(深圳)有限公司 Monitoring method, device and the storage medium of extensive micro services system
CN111580986A (en) * 2020-04-17 2020-08-25 深圳震有科技股份有限公司 Data acquisition method, system and medium based on acquisition service middleware

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113778808A (en) * 2021-09-18 2021-12-10 上海中通吉网络技术有限公司 Monitoring method for server application
CN114221997A (en) * 2021-12-14 2022-03-22 国泰君安证券股份有限公司 Interface monitoring system based on micro-service gateway

Similar Documents

Publication Publication Date Title
US10200506B2 (en) Method, system and device for monitoring data
CN112596979A (en) Micro-service access data acquisition and monitoring platform, method and electronic equipment
US7091846B2 (en) Methods and apparatus for handling information regarding an alarm for a communication network
US9355007B1 (en) Identifying abnormal hosts using cluster processing
CN110309030A (en) Log analysis monitoring system and method based on ELK and Zabbix
JP6148732B2 (en) Data indexing method and apparatus
CN110324233B (en) Unread message corner mark prompting method, unread message corner mark prompting device, unread message corner mark prompting equipment and storage medium
CN110858192A (en) Log query method and system, log checking system and query terminal
CN109408340A (en) Store monitoring method, the storage medium of equipment
CN110932918A (en) Log data acquisition method and device and storage medium
US10097430B2 (en) Tracking and analyzing mobile application user interactions
CN111585819A (en) Distribution network communication equipment fault analysis method and system
CN113157804A (en) Account checking method and device for synchronous data, computer equipment and storage medium
US8819040B2 (en) Method and system for querying a database
CN111078737A (en) Commonality analysis method and device, data processing equipment and readable storage medium
CN102340791A (en) System used for realizing data consistency and method thereof
CN105099735A (en) Method and system for acquiring a mass of detailed logs
CN112860456B (en) Log processing method and device
EP4373047A1 (en) Network fault root cause determining method and apparatus, device, and storage medium
EP3051436A1 (en) Alarm filtering method and device in network element management system
CN111510940B (en) Signaling analysis method and device
US20170039273A1 (en) System and method for generating a customized singular activity stream
CN107480300B (en) Data storage method and device
CN111135559A (en) Game data processing method and device, electronic equipment and storage medium
CN109684159A (en) Method for monitoring state, device, equipment and the storage medium of distributed information system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Room 303-309, No.3, Pazhou Avenue East Road, Haizhu District, Guangzhou City, Guangdong Province 510000

Applicant after: Shugen Internet Co.,Ltd.

Address before: 510000 Unit 12-30, Floor 4, West Port, Guangzhou International Media Port Office Building, 218 and 220 Yuanjiangxi Road, Haizhu District, Guangzhou City, Guangdong Province (Office only)

Applicant before: IROOTECH TECHNOLOGY Co.,Ltd.

CB02 Change of applicant information
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20210402

WD01 Invention patent application deemed withdrawn after publication