CN112596982A - Multi-data-source project service monitoring method and device - Google Patents
Multi-data-source project service monitoring method and device Download PDFInfo
- Publication number
- CN112596982A CN112596982A CN202011556221.9A CN202011556221A CN112596982A CN 112596982 A CN112596982 A CN 112596982A CN 202011556221 A CN202011556221 A CN 202011556221A CN 112596982 A CN112596982 A CN 112596982A
- Authority
- CN
- China
- Prior art keywords
- data
- data source
- service monitoring
- abnormal
- monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 182
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000002159 abnormal effect Effects 0.000 claims abstract description 80
- 238000012806 monitoring device Methods 0.000 claims description 14
- 238000004891 communication Methods 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 6
- 230000000007 visual effect Effects 0.000 claims description 4
- 230000005856 abnormality Effects 0.000 description 12
- 238000013024 troubleshooting Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000005923 long-lasting effect Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3051—Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
- G06F11/3072—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3089—Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
- G06F11/3093—Configuration details thereof, e.g. installation, enabling, spatial arrangement of the probes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/321—Display for diagnostics, e.g. diagnostic result display, self-test user interface
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention relates to a method and a device for monitoring multiple data source project services, wherein the method comprises the following steps: respectively configuring service monitoring tasks of a plurality of data sources; running the service monitoring task at every interval of calibration time, respectively checking each data source, wherein the checking items comprise whether the address of each data source can be communicated or not and whether data can be fed back or not, whether each multi-data inquiry task is completed or not, whether the difference value between the feedback data of each data source and a predetermined predicted value exceeds a preset threshold value or not, and determining whether each data source is abnormal or not according to the checking result; and when the data source is abnormal, outputting an early warning signal, wherein the early warning signal comprises information of the abnormal data source. According to the invention, aiming at the abnormal problem in service monitoring, the system can respond in time and rapidly troubleshoot, not only is the time consumed short and the efficiency high, but also the problem can be rapidly positioned and repaired in time, and excellent use experience is brought to users.
Description
Technical Field
The invention relates to the field of service monitoring, in particular to a method and a device for monitoring multiple data source project services.
Background
At present, the following two methods are commonly adopted for monitoring the service of a data source, wherein one method is to manually check whether the data source normally operates, and the other method is to judge the data source by checking a service operation log. However, when the monitoring service is deployed on a plurality of different servers, the two methods have a great defect, when the monitored data source has problems such as unknown abnormality or unknown service stoppage and the like, the error response to the monitored data source is often not timely and rapid, and then the workers cannot be informed to perform troubleshooting in time, and the problems cannot be rapidly positioned and timely repaired after the abnormality is known, so that the problems are time-consuming, long-lasting and low-efficiency, and the users can be greatly experienced in use.
Disclosure of Invention
The invention solves the problems that the conventional service monitoring technology takes long time in the troubleshooting process when the data source service is in error, has low efficiency, cannot quickly locate the error point and the like.
In order to solve the above problems, the present invention provides a method and an apparatus for monitoring multiple data source project services.
In a first aspect, the present invention provides a method for monitoring multiple data source project services, including:
respectively configuring service monitoring tasks of a plurality of data sources;
running the service monitoring task at every interval of calibration time, and respectively checking each data source, wherein the checking items comprise whether the address of each data source can be communicated or not, whether the feedback data of each data source can be collected or not, whether each multi-data inquiry task is completed or not, whether the difference value between the feedback data of each data source and a predetermined predicted value exceeds a preset threshold value or not, and determining whether each data source is abnormal or not according to the checking result;
and when the data source is abnormal, outputting an early warning signal, wherein the early warning signal comprises the information of the abnormal data source.
Further, the service monitoring task for respectively configuring the plurality of data sources includes:
deploying the service monitoring tasks of the plurality of data sources, wherein the service monitoring tasks comprise addresses of the data sources, monitoring frequency, the preset threshold value and the early warning signal notification mode.
Further, the respectively checking each data source comprises:
respectively checking whether the addresses of the data sources can be communicated;
when the addresses of the data sources can be communicated, whether the feedback data of the data sources can be collected is respectively checked; and when the addresses of the data sources cannot be communicated, recording communication abnormal information to a service monitoring record file, wherein the communication abnormal information comprises the information of the data sources which cannot be communicated.
Further, the separately checking whether the feedback data of each of the data sources is collectable includes:
when the feedback data of each data source is normally acquired, monitoring each data source; and when the feedback data of the data source is abnormal, recording the abnormal feedback data acquisition information to the service monitoring recording file, wherein the abnormal feedback data acquisition information comprises the information of the data source which cannot acquire the feedback data.
Further, the monitoring each of the data sources comprises:
monitoring feedback data of each data source, recording the monitoring data of each data source when the feedback data acquisition of each data source is finished, and storing the monitoring data to the service monitoring record file, wherein the monitoring data comprises the number of data source execution services, acquisition time, acquisition duration and identification of the data source, and a difference value between the acquired feedback data of each data source and a predetermined predicted value is obtained; and when the feedback data acquisition of the data sources is not finished, returning and monitoring the feedback data of each data source.
Further, the obtaining the difference between the collected feedback data of each data source and the predetermined predicted value includes:
respectively determining a difference value between the feedback data of each data source and the predicted value, and comparing the difference value with a preset threshold value;
when the difference is larger than or equal to the preset threshold, recording feedback data abnormal information to the service monitoring recording file, wherein the feedback data acquisition abnormal information comprises information of the corresponding data source; and when the difference value is smaller than the preset threshold value, the data source works normally.
Further, the outputting of the warning signal and the information of the corresponding data source includes:
and determining the abnormal data source and the abnormal type according to the service monitoring record file, and outputting the information of the abnormal type and the abnormal data source for early warning.
Further, the outputting the warning signal and the information of the corresponding data source further includes:
and classifying the information in the service monitoring record file according to the data source, and outputting a classification result for visual display.
In a second aspect, the present invention provides a multiple data source project service monitoring apparatus, including:
the configuration module is used for respectively configuring service monitoring tasks of a plurality of data sources;
the checking module is used for running the service monitoring task at intervals of a set time and checking each data source respectively, wherein the checking items comprise whether the addresses of the data sources are communicated or not and whether the feedback data of the data sources can be acquired or not, and whether the difference value between the feedback data of the data sources and a predetermined predicted value exceeds a preset threshold value or not;
and the output module is used for determining whether each data source is abnormal according to the checking result, and outputting an early warning signal when the data source is abnormal, wherein the early warning signal comprises the information of the abnormal data source.
In a third aspect, the present invention provides a multiple data source project service monitoring apparatus, including a memory and a processor;
the memory for storing a computer program;
the processor is configured to implement the multiple data source project service monitoring method as described above when executing the computer program.
The method and the device for monitoring the multi-data-source project service have the beneficial effects that: after service monitoring tasks are respectively configured for multiple data source items, the running state of a data source is monitored, the state of the data source is checked, abnormal information of service monitoring is fed back, and interface display is carried out; therefore, when the service monitoring task has the stopping problems that the communication cannot be carried out, the feedback data of each data source cannot be collected, or the difference value between the feedback data and the predetermined predicted value of the data source exceeds the preset threshold value, the abnormal point can be rapidly positioned, and timely and rapid response can be made, so that the troubleshooting time of wrong tasks can be reduced, the efficiency is improved, the problem task can be rapidly positioned and timely repaired, and excellent use experience is brought to a user.
Drawings
FIG. 1 is a flowchart of a method for monitoring a multi-data-source project service according to an embodiment of the present invention;
FIG. 2 is a flow chart illustrating a method for monitoring a multi-data-source project service according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a configuration service monitoring task in an embodiment of a method for monitoring multiple data source project services according to the present invention;
FIG. 4 is a flowchart illustrating a service monitoring task operating process of an embodiment of a multi-data-source project service monitoring method according to the present invention;
FIG. 5 is a schematic diagram of a multi-data-source project service monitoring apparatus according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a multi-data-source project service monitoring apparatus according to another embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein.
As shown in fig. 1 and fig. 2, a flowchart of a multiple data source project service monitoring method is provided, where the multiple data source project service monitoring method according to an embodiment of the present invention includes:
respectively configuring service monitoring tasks of a plurality of data sources;
running the service monitoring task at every interval of calibration time, and respectively checking each data source, wherein the checking items comprise whether the address of each data source can be communicated or not, whether the feedback data of each data source can be collected or not, whether each multi-data inquiry task is completed or not, whether the difference value between the feedback data of each data source and a predetermined predicted value exceeds a preset threshold value or not, and determining whether each data source is abnormal or not according to the checking result;
and when the data source is abnormal, outputting an early warning signal, wherein the early warning signal comprises the information of the abnormal data source.
In the embodiment, after a plurality of data source service monitoring tasks are configured for a plurality of data source items, the operating state of the data source is judged, the data is compared with a threshold value and judged, and then abnormal information of the service is fed back for interface display; therefore, when the service monitoring task has the stopping problems that the communication cannot be realized, the feedback data of each data source cannot be acquired, or the difference value between the feedback data and the predetermined predicted value of the data source exceeds the preset threshold value, the error part of the task can be responded timely and rapidly and checked, the error task checking time can be shortened, the efficiency is improved, the problem task can be quickly positioned and repaired timely, and excellent use experience is brought to a user.
Optionally, first, service monitoring task information S01 is received, including information related to a source address of the monitored data, a monitoring frequency, a predicted value and a difference threshold of the data amount, and an early warning notification manner, and then service monitoring tasks of a plurality of data sources are configured respectively. The multiple data source service monitoring configuration comprises: account number, password, key bank, monitoring frequency, setting threshold and difference threshold, early warning prompting mode and monitored service source configuration address.
As shown in fig. 3, in the embodiment of the multiple data source project service monitoring method of the present invention, the service monitoring apparatus configures a task information map to be monitored, i.e. the above-mentioned step S01 is detailed. The monitoring service is deployed on a designated server or in a cluster, the source and the state of multiple data sources are required to be clear, the configuration related to the multiple data source service data query monitoring device can be selected to be configured in a single point or a cluster, and relevant data is input into the multiple data source service data query monitoring device.
Optionally, in S0101, the service monitoring apparatus needs to complete configuration of the monitoring source overall environment, where the configuration includes: carrying server wide-mouth development, service registration, feedback data input configuration and data graphical display input configuration. In step S0102, monitored data such as a data source address, an IP, a service interface, etc., a data volume prediction value, a difference threshold, and an early warning notification manner are configured in the service monitoring device.
After the service monitoring tasks of the multiple data sources are configured, the monitoring of the service is turned on or turned off S02, that is, the service monitoring device starts the service monitoring task according to the configured frequency of the service monitored task, and the service monitoring device starts or turns off the service monitoring task according to the configured frequency of the service task.
Optionally, the service monitoring task for respectively configuring the plurality of data sources includes: deploying the service monitoring tasks of the plurality of data sources, wherein the service monitoring tasks comprise addresses of the data sources, monitoring frequency, the preset threshold value and the early warning signal notification mode.
Specifically, whether the addresses of the data sources are communicated or not is respectively checked, and when the addresses of the data sources are communicated, whether the feedback data of the data sources are collectable or not is respectively checked; and when the addresses of the data sources cannot be communicated, recording communication abnormal information to a service monitoring record file, wherein the communication abnormal information comprises the information of the data sources which cannot be communicated.
In the optional embodiment, the service monitoring tasks are respectively configured for each data source, the state of each data source is monitored, and when any data source is abnormal, the data source can be quickly positioned, the abnormal troubleshooting time is shortened, and the troubleshooting efficiency is improved.
As shown in fig. 4, a specific flowchart of a service monitoring task in an embodiment of a method for monitoring multiple data source project services according to the present invention is started and executed. Including whether the multiple data source addresses are communicable with S0201; the multiple data sources judge whether each data source can be monitored or not; the multi-data source monitoring task carries out service monitoring; whether each service controlled by the multi-data source service monitoring device has feedback S0202 or not is judged, and monitored feedback data S0203 is recorded; whether the difference between the set data source acquisition result number and the data quantity predicted value exceeds a difference threshold value S0204 or not is judged by the multi-data source service monitoring device; the multi-data source service monitoring device can record data and store the data in the summary folder S0205.
The service monitoring task records the data source feedback abnormal information collected this time to a service monitoring record file, wherein the information comprises: whether a data source can be communicated or not, whether data source feedback can be acquired or not, and a service abnormality early warning is sent by an abnormal information responsible person in information such as a data source expected value, service feedback result data, time as soon as possible, monitoring duration, data source identification and the like; the multi-data-source query monitoring device feeds back a recording result to the service monitoring and displays the monitoring input result information in an interface mode. Therefore, the service monitoring device can visually display the detailed information of the data source monitoring process. The method can reduce the error troubleshooting time, quickly position the error data source, timely early warn abnormal information, display the data quality in real time and improve the service error troubleshooting efficiency.
Optionally, according to the condition of each data source in the service control process S03, each data source is checked, it is to be determined whether the monitored data source address is connectable by the service monitoring task, that is, whether the monitored service source is connectable is checked, S0301, when the monitored data source address is not connected by the service monitoring task, an early warning signal is output, the early warning signal includes information of the data source with an abnormality, the communication abnormality information of the data source monitored this time is recorded in the service monitoring record file S0302, that is, the service monitoring task records the communication abnormality information of the data source collected this time in the service monitoring record file; when the service monitoring task checks that the monitored data source addresses are communicated, whether the feedback data of each data source can be acquired or not is checked, namely, whether the service source can feed back S0303 or not is checked, the data source addresses are judged to be communicated, and the service monitoring task judges whether the feedback of the data source can be acquired or not.
Optionally, the respectively checking whether the feedback data of each data source is collectable includes: when the feedback data of each data source is normally acquired, monitoring each data source; and when the feedback data of the data source is abnormal, recording the abnormal feedback data acquisition information to the service monitoring recording file, wherein the abnormal feedback data acquisition information comprises the information of the data source which cannot acquire the feedback data.
Specifically, according to a condition that whether a difference value between the feedback data of the data source and a predetermined predicted value exceeds a preset threshold value or not, when the feedback data of each data source cannot be acquired, recording whether the result of the feedback data S0303 acquired by each data source is judged to be negative or not, outputting an early warning signal, recording that the early warning signal includes information of the data source with an abnormality, and recording that the service monitoring task cannot acquire feedback abnormal information into a service monitoring recording file S0304.
Optionally, the monitoring each of the data sources includes: monitoring feedback data of each data source, recording the monitoring data of each data source when the feedback data acquisition of each data source is finished, and storing the monitoring data to the service monitoring record file, wherein the monitoring data comprises the number of data source execution services, acquisition time, acquisition duration and identification of the data source, and a difference value between the acquired feedback data of each data source and a predetermined predicted value is obtained; and when the feedback data acquisition of the data sources is not finished, returning and monitoring the feedback data of each data source.
Specifically, when the feedback data of each data source can be collected, the service monitoring task performs a service, that is, the service to be monitored is set according to the monitoring source, monitoring S0305 is started, and the data source feedback data can be collected. And judging whether the acquisition of the feedback data is finished or not in the service monitoring task, judging whether an abnormality occurs or not S0306, and recording the service feedback data S0308 when the service monitoring task judges that the acquisition of the feedback data is not finished, and returning the feedback data for monitoring each data source.
Optionally, the obtaining of the difference between the collected feedback data of each data source and the predetermined predicted value includes determining the difference between the feedback data of each data source and the predicted value, and comparing the difference with a preset threshold; when the difference is larger than or equal to the preset threshold, recording feedback data abnormal information to the service monitoring recording file, wherein the feedback data acquisition abnormal information comprises information of the corresponding data source; and when the difference value is smaller than the preset threshold value, the data source works normally.
Specifically, the service monitoring task compares the result value of the service feedback data, compares whether the result value exceeds a preset value and a set threshold value S0307, and when the difference value is smaller than the preset threshold value, the data source works normally and the monitoring device monitors the normal operation S0308; and when the difference value is larger than the preset threshold value, recording the abnormal data result information of the data source data acquired this time to a service monitoring record file, recording the abnormal data result information of the data feedback data acquired this time to the service monitoring record file by the service ready task, recording the service monitoring feedback data when the service monitoring task is finished, and stopping monitoring the service task S0309.
In this optional embodiment, first, whether the addresses of the data sources are connectable is checked, and whether the addresses of the data sources are configured incorrectly is determined; when the addresses of the data sources can be communicated, whether the feedback data of each data source can be acquired is checked, and when the feedback data of the data sources cannot be acquired, the data sources generate or output the feedback data, the abnormality is shown; comparing the difference value between the feedback data of the data source and a preset value with a preset threshold value, and when the difference value is greater than the preset threshold value, indicating that the generation process of the feedback data is possible to be abnormal; the state of the data source is checked step by step, when the data source is abnormal, the abnormal link can be accurately positioned, the troubleshooting time is shortened, the troubleshooting efficiency is improved, and the abnormal information can be processed conveniently and timely.
Optionally, the outputting of the warning signal and the information of the corresponding data source includes: and determining the abnormal data source and the abnormal type according to the service monitoring record file, and outputting the information of the abnormal type and the abnormal data source for early warning.
Specifically, after the service monitoring task S0309 is ended, the multiple data source service monitoring device sends an early warning S04 to the administrator according to a set early warning manner, and it is worth mentioning that, in this embodiment, the acquisition service feedback abnormal data includes information that the data source is not connectable, the data source is not acquired, the expected value of the data source does not reach the standard, and the like; the abnormal early warning mode comprises log customization prompting, Webhook pushing, short message notification and mail notification.
In this optional embodiment, traversing data in the service monitoring record file, when the service monitoring record file is empty, indicating that each data source works normally, and when data exists in the service monitoring record file, quickly determining the data source with the abnormality and the type of the abnormality according to the recorded data, thereby improving the efficiency of troubleshooting the abnormality.
Optionally, the multiple data source project service monitoring method further includes: and classifying the information in the service monitoring record file according to the data source, and outputting a classification result for visual display.
Specifically, the multi-data-source service system classifies the service feedback result files according to the service data, and graphically displays the service feedback result and the service abnormal result S05; it is worth mentioning that, in this embodiment, the service monitoring record file information includes information such as whether the data source is connectable, whether the data source has normal feedback data, a data source expected value, service monitoring result data, monitoring time, monitoring duration, and a data source identifier; the interface display mode comprises a webpage list display mode, a user-defined instrument panel display mode, a user-defined graphical display mode and the like.
In the optional embodiment, the information in the service monitoring record file is classified according to the data source, the classification result is visually displayed, and when the data source has an error, compared with the method for checking error points in the log in the data source feedback process one by one, the method and the device can quickly position the erroneous data source through the visual display interface, and can quickly position abnormal information in the classification result of the erroneous data source, thereby greatly reducing error checking time and improving checking efficiency.
Fig. 5 is a schematic structural diagram of a multiple data source item service monitoring apparatus according to an embodiment of the present invention, including: the system comprises a configuration module 1, a service monitoring module and a service monitoring module, wherein the configuration module is used for respectively configuring service monitoring tasks of a plurality of data sources; the checking module 2 is configured to run the service monitoring task at every interval of the calibration time, and check each data source respectively, where a checking item includes whether an address of each data source is connectable or not, whether feedback data of each data source is collected or not, and whether a difference between the feedback data of each data source and a predetermined predicted value exceeds a preset threshold or not; and the output module 3 is used for determining whether each data source is abnormal according to the checking result, and outputting an early warning signal when the data source is abnormal, wherein the early warning signal comprises the information of the abnormal data source.
As shown in fig. 6, a schematic structural diagram of a multiple data source project service monitoring apparatus according to another embodiment of the present invention, the configuration module 1 includes a service monitoring task configuration information input module 11, configured to configure service monitoring tasks of multiple data sources respectively; in the configuration module, the data source enters the inspection module 2 as long as the configuration information of the service monitoring task related to the data source is successfully configured.
The checking module 2 comprises a monitored service source communication judging module 21, a monitored service source data feedback acquisition module 22, a monitored service source monitoring recording module 23 and a monitored service source task ending module 24. The monitored service source communication judging module 21 of the checking module is used for checking whether the data source address can be communicated and whether the data source has feedback by the service monitoring task; the monitored service source data feedback acquisition module 22 is used for acquiring data source feedback data; the monitored service source monitoring recording module 23 is used for the service monitoring task to record the data source feedback abnormal information collected this time into the service monitoring recording file; monitored service source task end module 24: and the service monitoring and displaying unit is used for finishing the service task and finally performing visualized display of the time source acquisition effect through the service monitoring and displaying unit in the output module 3.
The output module 3 includes a service monitoring and early warning module 31 and a service monitoring and feedback display module 32, where the service monitoring and early warning module 31 is configured to determine whether each data source is abnormal according to a check result, and output an early warning signal when the data source is abnormal, where the early warning signal includes information of the abnormal data source; the service monitoring presentation module 32: the service monitoring device classifies the results of the service monitoring record table according to data sources and performs interface display on feedback result information and feedback abnormal information; therefore, the data source errors do not need to be checked for the log in the feedback process of each data source so as to repair the problems in time, so that the error checking time can be reduced, the error data source can be quickly positioned, the abnormal information can be early warned in time, the data quality is displayed in real time, and the service error checking efficiency is improved.
A further embodiment of the present invention provides an apparatus for monitoring multiple data-source project services, including a memory for storing a computer program and a processor for implementing the method for monitoring multiple data-source project services as described above when the computer program is executed.
Although the present disclosure has been described above, the scope of the present disclosure is not limited thereto. Various changes and modifications may be effected therein by one of ordinary skill in the pertinent art without departing from the spirit and scope of the present disclosure, and these changes and modifications are intended to be within the scope of the present disclosure.
Claims (10)
1. A multi-data source project service monitoring method is characterized by comprising the following steps:
respectively configuring service monitoring tasks of a plurality of data sources;
running the service monitoring task at every interval of calibration time, and respectively checking each data source, wherein the checking items comprise whether the address of each data source can be communicated or not, whether the feedback data of each data source can be collected or not, whether each multi-data inquiry task is completed or not, whether the difference value between the feedback data of each data source and a predetermined predicted value exceeds a preset threshold value or not, and determining whether each data source is abnormal or not according to the checking result;
and when the data source is abnormal, outputting an early warning signal, wherein the early warning signal comprises the information of the abnormal data source.
2. The method for monitoring multiple data source project services according to claim 1, wherein said respectively configuring service monitoring tasks of multiple data sources comprises:
deploying the service monitoring tasks of the plurality of data sources, wherein the service monitoring tasks comprise addresses of the data sources, monitoring frequency, the preset threshold value and the early warning signal notification mode.
3. The method for multiple data source project service monitoring as claimed in claim 2, wherein said separately inspecting each of said data sources comprises:
respectively checking whether the addresses of the data sources can be communicated;
when the addresses of the data sources can be communicated, whether the feedback data of the data sources can be collected is respectively checked; and when the addresses of the data sources cannot be communicated, recording communication abnormal information to a service monitoring record file, wherein the communication abnormal information comprises the information of the data sources which cannot be communicated.
4. The method for monitoring project services with multiple data sources as claimed in claim 3, wherein said checking whether the feedback data of each data source is collectable comprises:
when the feedback data of each data source is normally acquired, monitoring each data source; and when the feedback data of the data source is abnormal, recording the abnormal feedback data acquisition information to the service monitoring recording file, wherein the abnormal feedback data acquisition information comprises the information of the data source which cannot acquire the feedback data.
5. The method for multiple data source project service monitoring as claimed in claim 4, wherein said monitoring each of said data sources comprises:
monitoring feedback data of each data source, recording the monitoring data of each data source when the feedback data acquisition of each data source is finished, and storing the monitoring data to the service monitoring record file, wherein the monitoring data comprises the number of data source execution services, acquisition time, acquisition duration and identification of the data source, and a difference value between the acquired feedback data of each data source and a predetermined predicted value is obtained; and when the feedback data acquisition of the data sources is not finished, returning and monitoring the feedback data of each data source.
6. The method for monitoring project services with multiple data sources as claimed in claim 5, wherein said obtaining the difference between the collected feedback data of each data source and the predetermined predicted value comprises:
respectively determining a difference value between the feedback data of each data source and the predicted value, and comparing the difference value with a preset threshold value;
when the difference is larger than or equal to the preset threshold, recording feedback data abnormal information to the service monitoring recording file, wherein the feedback data acquisition abnormal information comprises information of the corresponding data source; and when the difference value is smaller than the preset threshold value, the data source works normally.
7. The multiple data source project service monitoring method as claimed in any one of claims 3 to 6, wherein the outputting of the warning signal and the information of the corresponding data source comprises:
and determining the abnormal data source and the abnormal type according to the service monitoring record file, and outputting the information of the abnormal type and the abnormal data source for early warning.
8. The multiple data source project service monitoring method as claimed in any one of claims 1 to 6, further comprising:
and classifying the information in the service monitoring record file according to the data source, and outputting a classification result for visual display.
9. A multiple data source project service monitoring apparatus, comprising:
the configuration module is used for respectively configuring service monitoring tasks of a plurality of data sources;
the checking module is used for running the service monitoring task at intervals of a set time and checking each data source respectively, wherein the checking items comprise whether the addresses of the data sources are communicated or not and whether the feedback data of the data sources can be acquired or not, and whether the difference value between the feedback data of the data sources and a predetermined predicted value exceeds a preset threshold value or not;
and the output module is used for determining whether each data source is abnormal according to the checking result, and outputting an early warning signal when the data source is abnormal, wherein the early warning signal comprises the information of the abnormal data source.
10. A multi-data source project service monitoring device is characterized by comprising a memory and a processor;
the memory for storing a computer program;
the processor, when executing the computer program, is configured to implement the multiple data source project service monitoring method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011556221.9A CN112596982A (en) | 2020-12-24 | 2020-12-24 | Multi-data-source project service monitoring method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011556221.9A CN112596982A (en) | 2020-12-24 | 2020-12-24 | Multi-data-source project service monitoring method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112596982A true CN112596982A (en) | 2021-04-02 |
Family
ID=75202092
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011556221.9A Pending CN112596982A (en) | 2020-12-24 | 2020-12-24 | Multi-data-source project service monitoring method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112596982A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114139979A (en) * | 2021-12-03 | 2022-03-04 | 广东省科学技术情报研究所 | Service platform for specific research and development mechanism |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110532146A (en) * | 2019-07-17 | 2019-12-03 | 安徽航天信息有限公司 | A kind of data acquisition monitoring method and device |
-
2020
- 2020-12-24 CN CN202011556221.9A patent/CN112596982A/en active Pending
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110532146A (en) * | 2019-07-17 | 2019-12-03 | 安徽航天信息有限公司 | A kind of data acquisition monitoring method and device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114139979A (en) * | 2021-12-03 | 2022-03-04 | 广东省科学技术情报研究所 | Service platform for specific research and development mechanism |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20190279098A1 (en) | Behavior Analysis and Visualization for a Computer Infrastructure | |
| CN107577545B (en) | Method and device for detecting and repairing fault disk | |
| US7617086B2 (en) | Monitoring simulating device, method, and program | |
| CN103530199A (en) | Software running error repairing method, device and system | |
| CN111190755B (en) | Application program function exception handling method and device | |
| US11263072B2 (en) | Recovery of application from error | |
| CN110765018A (en) | Automatic interface testing method and equipment | |
| CN107241229A (en) | A kind of business monitoring method and device based on interface testing instrument | |
| CN112529223A (en) | Equipment fault repair method and device, server and storage medium | |
| CN110888804A (en) | Interface test method and interface test platform | |
| US9354962B1 (en) | Memory dump file collection and analysis using analysis server and cloud knowledge base | |
| CN112596982A (en) | Multi-data-source project service monitoring method and device | |
| CN110532146B (en) | Data acquisition monitoring method and device | |
| CN116991677A (en) | Timing anomaly detection method, apparatus, terminal device and storage medium | |
| CN112034820A (en) | Cloud-based hardware-in-loop system testing method and system and storage medium | |
| CN111966394B (en) | ETL-based data analysis method, device, equipment and storage medium | |
| CN112306038B (en) | Detection method, detection device and diagnosis equipment | |
| CN111143262A (en) | Switching device, instrument control system and instrument control method | |
| CN113553272A (en) | Interface abnormity monitoring method, device, medium and computer program product | |
| CN113238901A (en) | Multi-device automatic testing method and device, storage medium and computer device | |
| US10303584B2 (en) | Method for message-processing | |
| CN114301904A (en) | Monitoring method and device for big data cluster, monitoring system and readable storage medium | |
| CN110703730A (en) | Data acquisition testing method and device based on MES | |
| CN117610998A (en) | Material defect detection method, device, equipment and storage medium | |
| CN118842699A (en) | Method, device, computer equipment and storage medium for sending operation indication information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210402 |