CN113342606A - Data monitoring method, device, equipment and storage medium based on message middleware - Google Patents
Data monitoring method, device, equipment and storage medium based on message middleware Download PDFInfo
- Publication number
- CN113342606A CN113342606A CN202110633822.3A CN202110633822A CN113342606A CN 113342606 A CN113342606 A CN 113342606A CN 202110633822 A CN202110633822 A CN 202110633822A CN 113342606 A CN113342606 A CN 113342606A
- Authority
- CN
- China
- Prior art keywords
- data
- monitoring
- request
- asynchronous
- subscription request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 457
- 238000000034 method Methods 0.000 title claims abstract description 113
- 238000012545 processing Methods 0.000 claims abstract description 97
- 238000004590 computer program Methods 0.000 claims description 27
- 238000013079 data visualisation Methods 0.000 claims description 9
- 238000007689 inspection Methods 0.000 claims description 9
- 238000012800 visualization Methods 0.000 claims description 9
- 230000000007 visual effect Effects 0.000 claims description 6
- 238000004806 packaging method and process Methods 0.000 claims description 5
- 238000012423 maintenance Methods 0.000 abstract description 3
- 230000002159 abnormal effect Effects 0.000 description 10
- 230000008569 process Effects 0.000 description 10
- 238000004891 communication Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 238000004458 analytical method Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
- G06F11/3086—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves the use of self describing data formats, i.e. metadata, markup languages, human readable formats
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/547—Messaging middleware
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Library & Information Science (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application relates to software monitoring in the field of rack operation and maintenance, in particular to a data monitoring method and device based on message middleware, computer equipment and a storage medium. The method comprises the following steps: acquiring a data monitoring request; analyzing the data monitoring request, and acquiring target data address information corresponding to the data monitoring request and a data checking method; sending a monitoring data subscription request to a data subscription server according to the target data address information; receiving asynchronous monitoring data fed back by the data subscription server according to the monitoring data subscription request; and checking the asynchronous monitoring data by a data checking method to obtain monitoring result data. The data monitoring method can complete monitoring processing on the full amount of target data, and not only monitoring the target data of the checking time point, so that missing of faults in data monitoring can be effectively avoided, and effectiveness of data monitoring is improved.
Description
Technical Field
The present application relates to software monitoring in the field of rack operation and maintenance, and in particular, to a data monitoring method, apparatus, device and storage medium based on message middleware.
Background
Information systems (Information systems) are man-machine integrated systems consisting of computer hardware, network and communication equipment, computer software, Information resources, Information users and regulatory systems with the purpose of processing Information streams. There are mainly five basic functions, namely input, storage, processing, output and control of information. The monitoring of the information system is an indispensable link in the maintenance link of the information system, and the more important the monitoring of the information system and the detection of the fault are, the more important the monitoring of the information system and the detection of the fault are. Almost any information system needs to establish a corresponding monitoring scheme.
In a general monitoring mode, a keyword in a read log is generally used or data in a database is queried regularly, and the purpose of data monitoring is achieved by comparing differences between query results and expected data.
However, in this way, the monitoring process generally performs query results in a timing query manner, and in the timing query manner, faults between the inspection time points are easily missed and cause potential safety hazards.
Disclosure of Invention
Based on this, it is necessary to provide a message middleware-based data monitoring method, device, computer device and storage medium capable of effectively reducing missing of faults and improving effectiveness of data monitoring.
A message middleware based data monitoring method, the method comprising:
acquiring a data monitoring request sent by a user side, wherein the data monitoring request comprises a data checking method and target data address information;
sending a monitoring data subscription request to a data subscription server according to the target data address information;
receiving asynchronous monitoring data fed back by a data subscription server according to the monitoring data subscription request, wherein the asynchronous monitoring data are acquired by the data subscription server through message middleware;
and checking the asynchronous monitoring data by the data checking method to obtain monitoring result data.
The data monitoring method comprises the steps of acquiring a data monitoring request sent by a user side; sending a monitoring data subscription request to a data subscription server according to the target data address information; receiving asynchronous monitoring data fed back by the data subscription server according to the monitoring data subscription request, wherein the asynchronous monitoring data are acquired by the data subscription server through message middleware; and checking the asynchronous monitoring data by a data checking method to obtain monitoring result data. According to the data monitoring method, all asynchronous monitoring data are acquired through the monitoring data reading request, then the asynchronous monitoring data are subjected to full inspection through the data inspection method, the monitoring processing on the full target data can be completed through the data monitoring method, the target data at the inspection time point are not monitored, therefore, the missing of faults in data monitoring can be effectively avoided, and the effectiveness of data monitoring is improved.
In one embodiment, after the asynchronous monitoring data is checked by the data checking method and monitoring result data is obtained, the method further includes:
performing visualization processing on the asynchronous monitoring data and the monitoring result data through a preset data visualization method to obtain visualized monitoring data;
and feeding back the visual monitoring data to the user side.
In one embodiment, the method further comprises:
receiving interface information sent by a data subscription server, wherein the interface information is generated according to a data interface corresponding to a message middleware;
then, the sending a monitoring data subscription request to a data subscription server according to the target data address information includes:
generating a monitoring data subscription request according to the target data address information and the interface information in a packaging manner;
and sending the monitoring data subscription request to the data subscription server.
In one embodiment, after the asynchronous monitoring data is checked by the data checking method and monitoring result data is obtained, the method further includes:
and when the monitoring result data comprises a data abnormity monitoring result, monitoring and sending a corresponding data abnormity alarm according to the data abnormity.
A message middleware based data monitoring method, the method comprising:
receiving and processing a monitoring data subscription request sent by a front end;
adding a data mark corresponding to the processing front end to the monitoring data subscription request;
pushing the monitoring data subscription request to a message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request;
and feeding back the asynchronous monitoring data to the processing front end according to the data mark.
The data monitoring method based on the message middleware receives and processes a monitoring data subscription request sent by a front end; adding a data mark corresponding to the processing front end to the monitoring data subscription request; pushing the monitoring data subscription request to a message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request; and feeding back the asynchronous monitoring data to the processing front end according to the data mark. According to the data monitoring method, asynchronous monitoring data are requested to the message middleware according to the monitoring data reading request, then the obtained asynchronous monitoring data are fed back to the processing front end according to the data marks corresponding to the monitoring data subscription request, the processing process of data monitoring is completed by the processing front end, the monitoring processing of the whole amount of target data can be completed through the data monitoring method, the target data at the checking time point are not only monitored, therefore, the missing of faults in data monitoring can be effectively avoided, and the effectiveness of data monitoring is improved.
In one embodiment, the pushing the monitoring data subscription request to a message middleware, and the obtaining asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request includes:
analyzing the monitoring data subscription request, and converting the data format of the monitoring data subscription request into an identifiable format corresponding to message middleware;
and pushing the monitoring data subscription request converted into the data format to a message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request.
A message-middleware based data monitoring apparatus, the apparatus comprising:
the monitoring request acquisition module is used for acquiring a data monitoring request sent by a user side, wherein the data monitoring request comprises a data inspection method and target data address information;
the monitoring request forwarding module is used for sending a monitoring data subscription request to a data subscription server according to the target data address information;
the asynchronous data receiving module is used for receiving asynchronous monitoring data fed back by the data subscription server according to the monitoring data subscription request, and the asynchronous monitoring data is acquired by the data subscription server through message middleware; .
And the monitoring result acquisition module is used for checking the asynchronous monitoring data through the data checking method to acquire monitoring result data.
A message-middleware based data monitoring apparatus, the apparatus comprising:
a subscription request acquisition module, configured to acquire a subscription request for monitoring data sent by a processing front end;
the data marking module is used for adding a data mark corresponding to the processing front end to the monitoring data subscription request;
the data pushing module is used for pushing the monitoring data subscription request to a message middleware and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request;
and the monitoring data feedback module is used for feeding back the asynchronous monitoring data to the processing front end according to the data mark.
A computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:
acquiring a data monitoring request sent by a user side, wherein the data monitoring request comprises a data checking method and target data address information;
sending a monitoring data subscription request to a data subscription server according to the target data address information;
receiving asynchronous monitoring data fed back by a data subscription server according to the monitoring data subscription request, wherein the asynchronous monitoring data are acquired by the data subscription server through message middleware;
and checking the asynchronous monitoring data by the data checking method to obtain monitoring result data.
A computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:
receiving and processing a monitoring data subscription request sent by a front end;
adding a data mark corresponding to the processing front end to the monitoring data subscription request;
pushing the monitoring data subscription request to a message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request;
and feeding back the asynchronous monitoring data to the processing front end according to the data mark.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
acquiring a data monitoring request sent by a user side, wherein the data monitoring request comprises a data checking method and target data address information;
sending a monitoring data subscription request to a data subscription server according to the target data address information;
receiving asynchronous monitoring data fed back by a data subscription server according to the monitoring data subscription request, wherein the asynchronous monitoring data are acquired by the data subscription server through message middleware;
and checking the asynchronous monitoring data by the data checking method to obtain monitoring result data.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
receiving and processing a monitoring data subscription request sent by a front end;
adding a data mark corresponding to the processing front end to the monitoring data subscription request;
pushing the monitoring data subscription request to a message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request;
and feeding back the asynchronous monitoring data to the processing front end according to the data mark.
Drawings
FIG. 1 is a diagram of an application environment of a message middleware-based data monitoring method in one embodiment;
FIG. 2 is a flow diagram of a message-middleware-based data monitoring method in one embodiment;
FIG. 3 is a flow diagram illustrating the steps of visualizing data in one embodiment;
FIG. 4 is a schematic sub-flow chart illustrating step 205 of FIG. 2 according to one embodiment;
FIG. 5 is a flow chart illustrating a data monitoring method based on message middleware in another embodiment;
FIG. 6 is a schematic sub-flow chart of step 506 of FIG. 5 in one embodiment;
FIG. 7 is a block diagram of a data monitoring apparatus based on message middleware in one embodiment;
FIG. 8 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The data monitoring method based on the message middleware can be applied to the application environment shown in fig. 1. Wherein the processing front-end 102 communicates with the data subscription server 104 over a network. The data subscription server 104 and the message middleware server 106 communicate over a network. The processing front end 102 acquires a data monitoring request submitted by a user; analyzing the data monitoring request, and acquiring target data address information corresponding to the data monitoring request and a data checking method; sending a monitoring data subscription request to the data subscription server 104 according to the target data address information; the data subscription server 104 receives a monitoring data subscription request sent by the processing front end; adding a data mark corresponding to a processing front end for the monitoring data subscription request; pushing a monitoring data subscription request to a message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request; and feeding back the asynchronous monitoring data to a processing front end according to the data mark. And receiving asynchronous monitoring data fed back by the data subscription server according to the monitoring data subscription request. And checking the asynchronous monitoring data by a data checking method to obtain monitoring result data. The processing front end 102 may be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices, and the data subscription server 104 and the message middleware server 106 may be implemented by independent servers or a server cluster composed of a plurality of servers.
In one embodiment, as shown in fig. 2, a data monitoring method based on message middleware is provided, which is described by taking the method as an example applied to the processing front end 102 in fig. 1, and includes the following steps:
The data monitoring request refers to a request submitted by a user to the processing front end 102, and is used for requesting the processing front end to perform data monitoring on target data in the information system and confirm whether the target data is abnormal or not. The data monitoring request includes target data address information that the user wishes to monitor and a data checking method for confirming whether the target data address information is abnormal. The target data address information refers to information of a specific location of target data corresponding to the data monitoring, and the target data may be part of original data in a target information system of the data monitoring. The data checking method is a method for determining whether the requested target data has an exception. In addition, the data monitoring request may further include description information of the target data, which is used to search and determine the target data.
Specifically, the data monitoring method of the present application may specifically be implemented in the presence of a Web (World Wide Web) application on the processing front end 102. When a user needs to perform data monitoring on specified data in an information system, a data monitoring request can be directly generated and submitted on the processing front end 102, and then the web can acquire the data monitoring request submitted by the user and start subsequent data monitoring operation. The web is used as a main body of data monitoring, and a monitoring interface can be a web browser, so that a new monitoring client does not need to be installed, and the operation flow of data monitoring is further simplified. Specifically, after receiving the data monitoring request of the user, the processing front end 102 may further obtain target data address information and a data checking method by analyzing the data monitoring request submitted by the user, and further determine which target data is requested by the data monitoring request of the user. In order to subscribe original data in an information system, a monitoring user can request a data subscription server for data monitoring corresponding target data through a data subscription request, and identify and display original message data through a corresponding data checking method, and when the original message data is abnormal, an alarm can be given to achieve the purpose of data monitoring.
The monitoring data subscription request is a request for requesting the data subscription server to monitor corresponding target data, and is generated according to target data address information in the data monitoring request submitted by the user. The data subscription server refers to a server for information flow, and the data subscription server may be connected to a plurality of data processing front ends 102 and a message middleware server 106. The functions of providing a data interface, receiving subscribed monitoring data, pushing the monitoring data to the data processing front end 102, and the like are realized.
Specifically, the processing front end 102 may send a corresponding monitoring data subscription request to the data subscription server 104 according to the target data address information in the data monitoring request, so as to request the data subscription server for monitoring data.
The message middleware refers to a server responsible for sending and receiving message data and transmitting the message data by using an efficient and reliable asynchronous message transfer mechanism, and corresponds to the message middleware server 106. The asynchronous monitoring data refers to monitored target data which is searched in the message middleware by the data subscription server according to the monitoring data subscription request.
Specifically, the data subscription server 104, after receiving the monitoring data subscription request, requests the message middleware for corresponding asynchronous monitoring data. The monitoring data acquired by the data subscription server 104 from the message middleware is asynchronously acquired, so that the monitoring data can be acquired at any time and completely received, and the condition of missing errors cannot occur. Meanwhile, if the time for data logic processing is neglected, the monitoring data acquired from the data subscription server 104 is received in real time, so that the monitoring data can be received without delay, and the timeliness of data monitoring is improved.
And step 207, checking the asynchronous monitoring data through a data checking method to obtain monitoring result data.
Specifically, the processing front end 102 may perform analysis and marking on the asynchronous monitoring data by using the data checking method, and may also generate a corresponding data analysis log in the process of checking and analyzing when the asynchronous monitoring data is detected to be abnormal, so that the user may use the corresponding data analysis log in subsequent abnormal analysis of the monitoring data, thereby improving the efficiency of abnormal analysis of data monitoring.
The data monitoring method based on the message middleware firstly acquires a data monitoring request; analyzing the data monitoring request, and acquiring target data address information corresponding to the data monitoring request and a data checking method; sending a monitoring data subscription request to a data subscription server according to the target data address information; receiving asynchronous monitoring data fed back by the data subscription server according to the monitoring data subscription request; and checking the asynchronous monitoring data by a data checking method to obtain monitoring result data. According to the data monitoring method, all asynchronous monitoring data are acquired through the monitoring data reading request, then the asynchronous monitoring data are subjected to full inspection through the data inspection method, the monitoring processing on the full target data can be completed through the data monitoring method, the target data at the inspection time point are not monitored, therefore, the missing of faults in data monitoring can be effectively avoided, and the effectiveness of data monitoring is improved.
As shown in fig. 3, in one embodiment, after step 209, the method further includes:
and 302, performing visualization processing on the asynchronous monitoring data and the monitoring result data through a preset data visualization method to obtain visualized monitoring data.
And step 304, feeding back the visual monitoring data to the user terminal.
The preset data visualization method is a method for displaying asynchronous monitoring data and monitoring result data in a more intuitive mode. Specifically, the method may include generating a corresponding data change map or a data list according to the type of the data.
Specifically, after the monitoring result data is obtained, in order to more intuitively display the monitoring result data obtained by data monitoring to the user, the asynchronous monitoring data and the monitoring result data may be subjected to visualization processing, and the asynchronous monitoring data and the final monitoring result data are displayed to the user through the visualization processing. For example, in one embodiment, the obtained asynchronous monitoring data is a string of discrete numbers showing price changes, and the preset data visualization method corresponds to a line graph display. The asynchronous monitoring data can be imported into the existing line graph template, and the change process of the data is displayed in an image mode. In this embodiment, the asynchronous monitoring data and the monitoring result data in the monitoring process are displayed by a preset data visualization method, so that the data monitoring process and the monitoring result can be displayed to a user more intuitively, and the data monitoring effect is improved.
As shown in fig. 4, in one embodiment, the message-middleware-based data monitoring method of the present application further includes:
Then, step 205 comprises:
and step 403, generating a monitoring data subscription request according to the target data address information and the interface information package.
Step 405, sending a monitoring data subscription request to the data subscription server.
Wherein the interface information may specifically refer to web interface information. The Web interface is a Web Service interface, and the Web Service technology can ensure that different applications running on different machines can exchange data or be integrated with each other without additional and special third-party software or hardware. Applications implemented according to the Web Service specification may exchange data with each other regardless of the language, platform, or internal protocol used by them. Web Service is a self-describing, self-contained, available network module that can perform specific business functions.
Specifically, the data subscription server 104 may obtain web interface data corresponding to the message middleware and feed back the corresponding interface information data processing front end 102, and then the underlying message subscription server may receive a corresponding data subscription request from the data processing front end through the provided interface. In addition, in another embodiment, a process of establishing an information communication channel is further included, specifically, the data subscription server 104 receives a login request and a connection request of the processing front end 102, the data subscription server 104 searches for a corresponding front end number of the processing front end 102 according to the login request, and then establishes a connection relationship with the processing front end 102 according to the connection request and the front end number, so as to form a subscription message channel. The processing front end 102 may establish a subscription message channel with the processing front end 102, receive a data subscription request from the data processing front end, and communicate with each other, so that the subscription message can be more conveniently circulated through the subscription message channel, and the data monitoring efficiency is improved. In this embodiment, the data interface provided by the data subscription server 104 is used to establish a data relationship between the data subscription server 104 and the processing front end 102, so that the data processing efficiency in the data monitoring process can be effectively improved.
In one embodiment, after step 209, the method further includes: and when the monitoring result data comprises a data abnormity monitoring result, monitoring and sending a corresponding data abnormity alarm according to the data abnormity.
The data processing process in the scheme is mainly performed on the data processing front end, the obtained asynchronous monitoring data are mainly analyzed through a pre-data checking method, and when a data abnormal result is obtained, the data processing front end 102 can directly give an alarm to a user. And displaying abnormal data in the asynchronous monitoring data to finish the data monitoring process. In addition, the monitoring abnormity can be alarmed by sending a prompt mail. The load of the monitored asynchronous monitoring data on the information system is very low, and the processing work is put at the front end, so that no extra load is caused on the system. In this embodiment, the user can be effectively prompted that the currently monitored data is abnormal by sending a data abnormal alarm, so that the alarm timeliness of the data monitoring process is improved.
In one embodiment, as shown in fig. 5, a data monitoring method based on message middleware is provided, which is described by taking the method as an example applied to the data subscription server 104 in fig. 1, and includes the following steps:
And step 508, feeding back the asynchronous monitoring data to a processing front end according to the data marks.
The data tag may be set according to the identity information of the processing front end 102 that currently sends the monitoring data subscription request, each processing front end 102 has its corresponding tag for the data subscription server 104, and the obtained asynchronous monitoring data may be fed back to the corresponding data processing front end through the tag.
In particular, the data subscription server 104 can receive monitoring data subscription requests from a plurality of different processing front-ends 102. In order to distinguish different processing front ends, after receiving the monitoring data subscription request, the data subscription server 104 may add a data tag corresponding to the processing front end to the received monitoring data subscription request. And then, pushing a monitoring data subscription request to the message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request. And finally, feeding back the finally obtained asynchronous monitoring data to a processing front end according to the added data marks. The processing procedure at the data subscription server 104 side is completed. Through data marking, the accuracy of data feedback can be effectively improved.
The data monitoring method based on the message middleware receives and processes a monitoring data subscription request sent by a front end; adding a data mark corresponding to a processing front end for the monitoring data subscription request; pushing a monitoring data subscription request to a message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request; and feeding back the asynchronous monitoring data to a processing front end according to the data mark. According to the data monitoring method, asynchronous monitoring data are requested to the message middleware according to the monitoring data reading request, then the obtained asynchronous monitoring data are fed back to the processing front end according to the data marks corresponding to the monitoring data subscription request, the processing process of data monitoring is completed by the processing front end, the monitoring processing of the whole amount of target data can be completed through the data monitoring method, the target data at the checking time point are not only monitored, therefore, the missing of faults in data monitoring can be effectively avoided, and the effectiveness of data monitoring is improved.
In one embodiment, as shown in FIG. 6, step 506 includes:
step 601, analyzing the monitoring data subscription request, and converting the data format of the monitoring data subscription request into an identifiable format corresponding to the message middleware.
Step 603, pushing the monitoring data subscription request converted into the data format to the message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request.
Specifically, since the data subscription request obtained from the data processing front end cannot be directly read by the message middleware, the underlying message subscription server can firstly convert the data subscription request into a readable format of the message middleware by parsing the information flow server, and the specific parsing format can be set according to the type of the message middleware. By analyzing the monitoring data subscription request and performing format conversion, the readability of the monitoring data subscription request can be effectively ensured, and the data processing effectiveness in the data monitoring process is further ensured.
It should be understood that although the various steps in the flow charts of fig. 2-6 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-6 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed in turn or alternately with other steps or at least some of the other steps.
In one embodiment, as shown in fig. 7, there is provided a data monitoring apparatus based on message middleware, including: a monitoring request obtaining module 702, a monitoring request forwarding module 704, an asynchronous data receiving module 706, and a monitoring result obtaining module 708, wherein:
a monitoring request obtaining module 702, configured to obtain a data monitoring request sent by a user side, where the data monitoring request includes a data checking method and target data address information.
A monitoring request forwarding module 704, configured to send a monitoring data subscription request to the data subscription server according to the target data address information.
And the asynchronous data receiving module 706 is configured to receive asynchronous monitoring data fed back by the data subscription server according to the monitoring data subscription request, where the asynchronous monitoring data is acquired by the data subscription server through the message middleware.
The monitoring result obtaining module 708 is configured to check the asynchronous monitoring data by a data checking method, and obtain monitoring result data.
In one embodiment, the system further comprises a visualization processing module, configured to: performing visualization processing on the asynchronous monitoring data and the monitoring result data by a preset data visualization method to obtain visualized monitoring data; and feeding back visual monitoring data to the user side.
In one embodiment, the monitoring request forwarding module 705 is specifically configured to: receiving interface information sent by a data subscription server, wherein the interface information is generated according to a data interface corresponding to the message middleware; generating a monitoring data subscription request according to the address information and the interface information of the target data in a packaging manner; and sending a monitoring data subscription request to a data subscription server.
In one embodiment, the system further comprises an anomaly alarm module, configured to: and when the monitoring result data comprises a data abnormity monitoring result, monitoring and sending a corresponding data abnormity alarm according to the data abnormity.
In one embodiment, a data monitoring apparatus based on message middleware is provided, including:
and the subscription request acquisition module is used for acquiring and processing the monitoring data subscription request sent by the front end.
And the data marking module is used for adding a data mark corresponding to the processing front end for the monitoring data subscription request.
And the data pushing module is used for pushing the monitoring data subscription request to the message middleware and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request.
And the monitoring data feedback module is used for feeding back the asynchronous monitoring data to the processing front end according to the data mark.
In one of the embodiments, the first and second electrodes are,
for specific definition of the message-middleware-based data monitoring apparatus, reference may be made to the above definition of the message-middleware-based data monitoring method, which is not described herein again. The modules in the data monitoring device can be wholly or partially implemented by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 8. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a method of data monitoring. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 8 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having a computer program stored therein, the processor implementing the following steps when executing the computer program:
acquiring a data monitoring request sent by a user side, wherein the data monitoring request comprises a data checking method and target data address information;
sending a monitoring data subscription request to a data subscription server according to the target data address information;
receiving asynchronous monitoring data fed back by the data subscription server according to the monitoring data subscription request, wherein the asynchronous monitoring data are acquired by the data subscription server through message middleware;
and checking the asynchronous monitoring data by a data checking method to obtain monitoring result data.
In one embodiment, the processor, when executing the computer program, further performs the steps of: performing visualization processing on the asynchronous monitoring data and the monitoring result data by a preset data visualization method to obtain visualized monitoring data; and feeding back visual monitoring data to the user side.
In one embodiment, the processor, when executing the computer program, further performs the steps of: receiving interface information sent by a data subscription server, wherein the interface information is generated according to a data interface corresponding to the message middleware; generating a monitoring data subscription request according to the address information and the interface information of the target data in a packaging manner; and sending a monitoring data subscription request to a data subscription server.
In one embodiment, the processor, when executing the computer program, further performs the steps of: and when the monitoring result data comprises a data abnormity monitoring result, monitoring and sending a corresponding data abnormity alarm according to the data abnormity.
In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having a computer program stored therein, the processor implementing the following steps when executing the computer program:
receiving and processing a monitoring data subscription request sent by a front end;
adding a data mark corresponding to a processing front end for the monitoring data subscription request;
pushing a monitoring data subscription request to a message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request;
and feeding back the asynchronous monitoring data to a processing front end according to the data mark.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
analyzing the monitoring data subscription request, and converting the data format of the monitoring data subscription request into an identifiable format corresponding to the message middleware;
and pushing the monitoring data subscription request converted into the data format to the message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
acquiring a data monitoring request sent by a user side, wherein the data monitoring request comprises a data checking method and target data address information;
sending a monitoring data subscription request to a data subscription server according to the target data address information;
receiving asynchronous monitoring data fed back by the data subscription server according to the monitoring data subscription request, wherein the asynchronous monitoring data are acquired by the data subscription server through message middleware;
and checking the asynchronous monitoring data by a data checking method to obtain monitoring result data.
In one embodiment, the computer program when executed by the processor further performs the steps of: performing visualization processing on the asynchronous monitoring data and the monitoring result data by a preset data visualization method to obtain visualized monitoring data; and feeding back visual monitoring data to the user side.
In one embodiment, the computer program when executed by the processor further performs the steps of: receiving interface information sent by a data subscription server, wherein the interface information is generated according to a data interface corresponding to the message middleware; generating a monitoring data subscription request according to the address information and the interface information of the target data in a packaging manner; and sending a monitoring data subscription request to a data subscription server.
In one embodiment, the computer program when executed by the processor further performs the steps of: and when the monitoring result data comprises a data abnormity monitoring result, monitoring and sending a corresponding data abnormity alarm according to the data abnormity.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
receiving and processing a monitoring data subscription request sent by a front end;
adding a data mark corresponding to a processing front end for the monitoring data subscription request;
pushing a monitoring data subscription request to a message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request;
and feeding back the asynchronous monitoring data to a processing front end according to the data mark.
In one embodiment, the computer program when executed by the processor further performs the steps of: analyzing the monitoring data subscription request, and converting the data format of the monitoring data subscription request into an identifiable format corresponding to the message middleware; and pushing the monitoring data subscription request converted into the data format to the message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware related to instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above examples only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A message middleware based data monitoring method, the method comprising:
acquiring a data monitoring request sent by a user side, wherein the data monitoring request comprises a data checking method and target data address information;
sending a monitoring data subscription request to a data subscription server according to the target data address information;
receiving asynchronous monitoring data fed back by a data subscription server according to the monitoring data subscription request, wherein the asynchronous monitoring data are acquired by the data subscription server through message middleware;
and checking the asynchronous monitoring data by the data checking method to obtain monitoring result data.
2. The method according to claim 1, wherein the checking the asynchronous monitoring data by the data checking method further comprises, after obtaining monitoring result data:
performing visualization processing on the asynchronous monitoring data and the monitoring result data through a preset data visualization method to obtain visualized monitoring data;
and feeding back the visual monitoring data to the user side.
3. The method of claim 1, further comprising: receiving interface information sent by a data subscription server, wherein the interface information is generated according to a data interface corresponding to a message middleware;
then, the sending a monitoring data subscription request to a data subscription server according to the target data address information includes:
generating a monitoring data subscription request according to the target data address information and the interface information in a packaging manner;
and sending the monitoring data subscription request to the data subscription server.
4. The method according to claim 1, wherein the checking the asynchronous monitoring data by the data checking method further comprises, after obtaining monitoring result data:
and when the monitoring result data comprises a data abnormity monitoring result, sending a corresponding data abnormity alarm according to the data abnormity monitoring result.
5. A data monitoring method based on message middleware is characterized by comprising the following steps:
receiving and processing a monitoring data subscription request sent by a front end;
adding a data mark corresponding to the processing front end to the monitoring data subscription request;
pushing the monitoring data subscription request to a message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request;
and feeding back the asynchronous monitoring data to the processing front end according to the data mark.
6. The method of claim 5, wherein the pushing the monitoring data subscription request to a message middleware, and the obtaining asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request comprises:
analyzing the monitoring data subscription request, and converting the data format of the monitoring data subscription request into an identifiable format corresponding to message middleware;
and pushing the monitoring data subscription request converted into the data format to a message middleware, and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request.
7. A message-middleware-based data monitoring apparatus, the apparatus comprising:
the monitoring request acquisition module is used for acquiring a data monitoring request sent by a user side, wherein the data monitoring request comprises a data inspection method and target data address information;
the monitoring request forwarding module is used for sending a monitoring data subscription request to a data subscription server according to the target data address information;
the asynchronous data receiving module is used for receiving asynchronous monitoring data fed back by the data subscription server according to the monitoring data subscription request, and the asynchronous monitoring data is acquired by the data subscription server through message middleware; .
And the monitoring result acquisition module is used for checking the asynchronous monitoring data through the data checking method to acquire monitoring result data.
8. A message-middleware-based data monitoring apparatus, the apparatus comprising:
a subscription request acquisition module, configured to acquire a subscription request for monitoring data sent by a processing front end;
the data marking module is used for adding a data mark corresponding to the processing front end to the monitoring data subscription request;
the data pushing module is used for pushing the monitoring data subscription request to a message middleware and acquiring asynchronous monitoring data fed back by the message middleware according to the monitoring data subscription request;
and the monitoring data feedback module is used for feeding back the asynchronous monitoring data to the processing front end according to the data mark.
9. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor when executing the computer program implements the steps of the method of any one of claims 1 to 4 or 5 to 6.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 4 or 5 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110633822.3A CN113342606A (en) | 2021-06-07 | 2021-06-07 | Data monitoring method, device, equipment and storage medium based on message middleware |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110633822.3A CN113342606A (en) | 2021-06-07 | 2021-06-07 | Data monitoring method, device, equipment and storage medium based on message middleware |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113342606A true CN113342606A (en) | 2021-09-03 |
Family
ID=77475166
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110633822.3A Pending CN113342606A (en) | 2021-06-07 | 2021-06-07 | Data monitoring method, device, equipment and storage medium based on message middleware |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113342606A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102377685A (en) * | 2010-08-06 | 2012-03-14 | 阿里巴巴集团控股有限公司 | Subscription message sending system and subscription message sending method |
| US20140350888A1 (en) * | 2013-05-24 | 2014-11-27 | Software Ag | Self-monitoring event-based system and method |
| CN107015872A (en) * | 2016-12-09 | 2017-08-04 | 上海壹账通金融科技有限公司 | The processing method and processing device of monitoring data |
| JP2017174158A (en) * | 2016-03-24 | 2017-09-28 | 日本電気株式会社 | Monitoring system, monitoring method, and monitoring program |
| CN109960621A (en) * | 2017-12-22 | 2019-07-02 | 南京欣网互联网络科技有限公司 | A kind of data pick-up method based on big data visual control platform |
| CN110138634A (en) * | 2019-04-03 | 2019-08-16 | 福建天泉教育科技有限公司 | A kind of monitoring method and terminal of emphasis data |
| CN110225113A (en) * | 2019-06-10 | 2019-09-10 | 南威互联网科技集团有限公司 | A kind of service monitoring method and system |
| CN110806960A (en) * | 2019-11-01 | 2020-02-18 | 中国联合网络通信集团有限公司 | Information processing method and device and terminal equipment |
| CN112039979A (en) * | 2020-08-27 | 2020-12-04 | 中国平安财产保险股份有限公司 | Distributed data cache management method, device, equipment and storage medium |
| CN112732463A (en) * | 2021-01-16 | 2021-04-30 | 刘铮 | Message subscription method and device based on big data |
-
2021
- 2021-06-07 CN CN202110633822.3A patent/CN113342606A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102377685A (en) * | 2010-08-06 | 2012-03-14 | 阿里巴巴集团控股有限公司 | Subscription message sending system and subscription message sending method |
| US20140350888A1 (en) * | 2013-05-24 | 2014-11-27 | Software Ag | Self-monitoring event-based system and method |
| JP2017174158A (en) * | 2016-03-24 | 2017-09-28 | 日本電気株式会社 | Monitoring system, monitoring method, and monitoring program |
| CN107015872A (en) * | 2016-12-09 | 2017-08-04 | 上海壹账通金融科技有限公司 | The processing method and processing device of monitoring data |
| CN109960621A (en) * | 2017-12-22 | 2019-07-02 | 南京欣网互联网络科技有限公司 | A kind of data pick-up method based on big data visual control platform |
| CN110138634A (en) * | 2019-04-03 | 2019-08-16 | 福建天泉教育科技有限公司 | A kind of monitoring method and terminal of emphasis data |
| CN110225113A (en) * | 2019-06-10 | 2019-09-10 | 南威互联网科技集团有限公司 | A kind of service monitoring method and system |
| CN110806960A (en) * | 2019-11-01 | 2020-02-18 | 中国联合网络通信集团有限公司 | Information processing method and device and terminal equipment |
| CN112039979A (en) * | 2020-08-27 | 2020-12-04 | 中国平安财产保险股份有限公司 | Distributed data cache management method, device, equipment and storage medium |
| CN112732463A (en) * | 2021-01-16 | 2021-04-30 | 刘铮 | Message subscription method and device based on big data |
Non-Patent Citations (2)
| Title |
|---|
| 吕海林: "基于消息中间件的订阅/发布系统的研究与设计", 《中国优秀硕士学位论文全文数据库》 * |
| 王重楠等: "发布/订阅模式测控消息中间件系统设计", 《计算机应用》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108984388B (en) | Method and terminal equipment for generating automatic test case | |
| CN112148674B (en) | Log data processing method, device, computer equipment and storage medium | |
| CN112187558B (en) | Data verification method and device and electronic equipment | |
| CN111310007B (en) | Webpage interface query method and device, electronic equipment and storage medium | |
| CN110069413B (en) | Test data communication, test method, device, equipment and storage medium | |
| CN111475376A (en) | Method and device for processing test data, computer equipment and storage medium | |
| CN105205144A (en) | Method and system used for data diagnosis and optimization | |
| CN113204345A (en) | Page generation method and device, electronic equipment and storage medium | |
| CN112817831A (en) | Application performance monitoring method, device, computer system and readable storage medium | |
| CN112069384A (en) | Buried point data processing method, server and readable storage medium | |
| CN111552696A (en) | Data processing method and device based on big data, computer equipment and medium | |
| CN114153703A (en) | Micro-service exception positioning method and device, electronic equipment and program product | |
| CN112835856A (en) | Log data query method and device, equipment and medium | |
| CN112417016A (en) | Data exchange method, system, equipment and storage medium | |
| CN112437148A (en) | Service request processing method and device, service server and system | |
| CN111901383A (en) | Data request processing method and device, computer equipment and storage medium | |
| CN112130944A (en) | Page abnormity detection method, device, equipment and storage medium | |
| CN113342606A (en) | Data monitoring method, device, equipment and storage medium based on message middleware | |
| CN114546560A (en) | Data sharing method and device, storage medium and electronic equipment | |
| CN111654547B (en) | Data transmission method, device, equipment and storage medium | |
| CN109803017B (en) | File intercommunication method and device, computing equipment and computer readable storage medium | |
| CN108108369B (en) | Method and device for processing calling error of common interface library | |
| CN112364268A (en) | Resource acquisition method and device, electronic equipment and storage medium | |
| CN112560938A (en) | Model training method and device and computer equipment | |
| CN112162954A (en) | User operation log generation method, user operation log generation device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210903 |
|
| RJ01 | Rejection of invention patent application after publication |