CN110442503A - A kind of alarm method and device using log index - Google Patents
A kind of alarm method and device using log index Download PDFInfo
- Publication number
- CN110442503A CN110442503A CN201910688146.2A CN201910688146A CN110442503A CN 110442503 A CN110442503 A CN 110442503A CN 201910688146 A CN201910688146 A CN 201910688146A CN 110442503 A CN110442503 A CN 110442503A
- Authority
- CN
- China
- Prior art keywords
- log
- service
- data
- index
- alarm
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 230000002159 abnormal effect Effects 0.000 claims abstract description 44
- 230000000007 visual effect Effects 0.000 claims abstract description 15
- 238000004590 computer program Methods 0.000 claims description 12
- 238000012800 visualization Methods 0.000 claims description 9
- 238000013079 data visualisation Methods 0.000 claims description 6
- 230000003862 health status Effects 0.000 description 5
- 238000007726 management method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Medical Treatment And Welfare Office Work (AREA)
Abstract
The invention discloses a kind of alarm methods and device using log index, and it includes: the target journaling achievement data that target application is obtained from log collection storage service that wherein this, which applies the alarm method of log index,；The target journaling achievement data is visualized on visualizing screen, and mark does not meet the abnormal index data of default health regulations on the visual presentation screen；The abnormal index data for not meeting default health regulations are alerted；Wherein, the target journaling achievement data is by application active push to the log collection storage service.The present invention solves in the prior art, and alerting service applies log index come the method for realizing the health examination of application by pulling, the network model for being difficult to realize, and using in the environment that containerization service is passed unimpeded also more complicated problem.
Description
Technical field
The present invention relates to index alert applied technical field, more particularly to a kind of alarm method using log index with
Device.
Background technique
Existing log services check the mode using log, are usually to be directly viewable journal file or collector journal arrives
It is checked in elasticsearch (data storage software can store mass data), or uses this quotient of splunk
The product of industry log services company handles log.Existing alarm mode mainly has alerting service actively to check application
Health status and application oneself detect oneself health status, i.e. alerting service is applied by Fixed Time Interval access
Health (health) interface determines that the health status of oneself oneself is periodically sent to alarm by the health status of application, or application
Service notifies alerting service.The representative art scheme of the prior art is exactly alerting service Prometheus, it is a kind of quotient
The log index of industry collects software, and collection mode is to be pulled by access application service using index, it the shortcomings that be: In
In containerization service, Prometheus is difficult to accomplish the access to application service, is related to a series of problems, such as network is got through.
Prometheus by timer access apply to stationary interface, obtain the health status of application.But alerting service
Prometheus needs to have permission to access network and the port of application.It is real for the application in existing containerization platform
The address ip of example does not expose externally, that is, outside is obtained less than example state, unless by Prometheus and answering
With being deployed under the same network.
Summary of the invention
The embodiment of the present invention provides a kind of alarm method and device using log index, to solve to accuse in the prior art
Police uniform business is by pulling the method for applying log index to realize the health examination of application, in the environment that containerization service is passed unimpeded
The network model for being difficult to realize, and using also more complicated problem.
In order to solve the above technical problems, the first technical solution used in the embodiment of the present invention is as follows:
A kind of alarm method using log index comprising: target application is obtained from log collection storage service
Target journaling achievement data；The target journaling achievement data is visualized on visualizing screen, and
Mark does not meet the abnormal index data of default health regulations on the visual presentation screen；To not meeting default health regulations
The abnormal index data alerted；Wherein, the target journaling achievement data is by application active push to the log
Collect storage service.
Optionally, described to visualize the target journaling achievement data on visualizing screen, it wraps
It includes: reading the target journaling achievement data in the log collection storage service by data visualization service.
Optionally, the mark on the visual presentation screen does not meet the abnormal index number of default health regulations
According to, comprising: the mesh in the log collection storage service is scanned using the alarm module in the data visualization service
Log achievement data is marked, the abnormal index data for not meeting default health regulations are obtained；The abnormal index data are existed
It is identified on the visual presentation screen.
Optionally, the described pair of abnormal index data for not meeting default health regulations alert, comprising: send and accuse
For alert mail to the specified mailbox of developer, the alarm email includes the abnormal index data.
Optionally, the described pair of abnormal index data for not meeting default health regulations alert, comprising: send nail
Nail notifies Ding Ding group, and the nail nail notice includes the abnormal index data.
Optionally, the log collection storage service include influxdb service, elasticsearch service and
Opentsdb service.
Optionally, the Visualization Service includes Grafana service and kibana service.
In order to solve the above technical problems, the second technical solution used in the embodiment of the present invention is as follows:
A kind of alarm device using log index comprising: module is obtained, for obtaining from log collection storage service
Take the target journaling achievement data of target application；Visualization model is used for the target journaling achievement data in visualization exhibition
It is visualized on display screen curtain, and the exception that mark does not meet default health regulations on the visual presentation screen refers to
Mark data；Alarm module, for being alerted to the abnormal index data for not meeting default health regulations；Wherein, described
Target journaling achievement data is by application active push to the log collection storage service.
In order to solve the above technical problems, third technical solution used in the embodiment of the present invention is as follows:
A kind of storage medium is stored thereon with computer program, and it is such as above-mentioned that the computer program is performed realization
Using the alarm method of log index.
In order to solve the above technical problems, the 4th technical solution used in the embodiment of the present invention is as follows:
A kind of computer equipment comprising processor, memory and be stored on the memory and can be in the processing
The computer program run on device, the processor are realized when executing the computer program such as the above-mentioned index using log
Alarm method.
The beneficial effect of the embodiment of the present invention is: being in contrast to the prior art, a kind of application of the embodiment of the present invention
The alarm method and device of log index, by obtaining by target application active push to the mesh of the log collection storage service
Log achievement data is marked, and the target journaling achievement data is visualized on visualizing screen, in institute
It states and visualizes mark on screen and do not meet the abnormal index data of default health regulations, finally to not meeting default health rule
The fixed abnormal index data are alerted, and are solved in the prior art, alerting service by pull apply log index come
The method for realizing the health examination of application, the network model for being difficult to realize, and using in the environment that containerization service is passed unimpeded
Also more complicated problem.
Detailed description of the invention
Fig. 1 is the implementation flow chart of one embodiment of alarm method using log index of the embodiment of the present invention one；
Fig. 2 is the part-structure frame of one embodiment of alarm device using log index of the embodiment of the present invention two
Figure；
Fig. 3 is the part-structure frame diagram of one embodiment of storage medium of the embodiment of the present invention three；
Fig. 4 is the part-structure frame diagram of one embodiment of computer equipment of the embodiment of the present invention four.
Specific embodiment
Embodiment one
Referring to Fig. 1, Fig. 1 is the implementation flow chart of the alarm method using log index of the embodiment of the present invention.In conjunction with
Fig. 1 is available, a kind of alarm method using log index of the invention, comprising the following steps:
Step S101: the target journaling achievement data of target application is obtained from log collection storage service；
Step S102: the target journaling achievement data is visualized on visualizing screen, and
Mark does not meet the abnormal index data of default health regulations on the visual presentation screen；
Step S103: the abnormal index data for not meeting default health regulations are alerted；Wherein, the target
Log achievement data is by application active push to the log collection storage service.
In the present embodiment, optionally, described to carry out the target journaling achievement data on visualizing screen
It visualizes, comprising: the target journaling in the log collection storage service is read by data visualization service and is referred to
Mark data.
In the present embodiment, optionally, the mark on the visual presentation screen does not meet default health regulations
Abnormal index data, comprising:
First, the institute in the log collection storage service is scanned using the alarm module in the data visualization service
Target journaling achievement data is stated, the abnormal index data for not meeting default health regulations are obtained；
Second, the abnormal index data are identified on the visual presentation screen.
In the present embodiment, optionally, the described pair of abnormal index data for not meeting default health regulations are accused
It is alert, comprising:
Alarm email is sent to the specified mailbox of developer, the alarm email includes the abnormal index data.Wherein,
When certain indexs are more than the threshold value that we are arranged, give a warning.For example, memory uses more than when cpu utilization rate is more than 90%
When 90%, alarm is sent.
In the present embodiment, optionally, the described pair of abnormal index data for not meeting default health regulations are accused
It is alert, further includes:
It sends nail nail and notifies Ding Ding group, the nail nail notice includes the abnormal index data.
In the present embodiment, optionally, the log collection storage service include influxdb service,
Elasticsearch service and opentsdb service.Wherein, influxdb service is a kind of time series data library software, for depositing
Store up data.Elasticsearch service is a kind of data storage software, can store mass data.Opentsdb service is one
Kind open source time series database, stores time series data.
In the present embodiment, optionally, the Visualization Service includes Grafana service and kibana service.Wherein,
Grafana service is a kind of visualization instrument board software, can be used to the data inquired in elasticsearch service.
The embodiment of the present invention is by obtaining by target application active push to the target day of the log collection storage service
Will achievement data, and by the target journaling achievement data visualize screen on visualize, it is described can
It shows that screen subscript is known depending on changing and does not meet the abnormal index data of default health regulations, finally to not meeting default health regulations
The abnormal index data are alerted, and are solved in the prior art, and alerting service applies log index to realize by pulling
The network model that the method for the health examination of application is difficult to realize in the environment that containerization service is passed unimpeded, and uses also compares
More complex problem.
Specifically, the prior art is compared, this programme is actively to access alerting service by application to realize that index is collected,
We call to push, and the Prometheus of prior art service is then alerting service inverted access application, we, which call, is
It pulls.Push is more much easier in network management than pulling, and in containerization deployment scheme, it is easier than pulling to push.
Embodiment two
Referring to Fig. 2, Fig. 2 is the part-structure frame diagram of the alarm device using log index of the embodiment of the present invention.
A kind of alarm device 100 using log index available in conjunction with Fig. 2, of the invention, comprising:
Module 110 is obtained, for obtaining the target journaling achievement data of target application from log collection storage service.
Visualization model 120, for visualizing the target journaling achievement data on visualizing screen
It shows, and mark does not meet the abnormal index data of default health regulations on the visual presentation screen.
Alarm module 130, for being alerted to the abnormal index data for not meeting default health regulations；Wherein,
The target journaling achievement data is by application active push to the log collection storage service.
The alarm device 100 using log index of the embodiment of the present invention, by obtain by target application active push to
The target journaling achievement data of the log collection storage service, and the target journaling achievement data is being visualized into screen
It is visualized on curtain, mark does not meet the abnormal index number of default health regulations on the visual presentation screen
According to, finally the abnormal index data for not meeting default health regulations are alerted, are solved in the prior art, alarm clothes
Business applies log index come the method for realizing the health examination of application by pulling, and is difficult in the environment that containerization service is passed unimpeded
It realizes, and the network model used also more complicated problem.
Specifically, the prior art is compared, this programme is actively to access alerting service by application to realize that index is collected,
We call to push, and the Prometheus of prior art service is then alerting service inverted access application, we, which call, is
It pulls.Push is more much easier in network management than pulling, and in containerization deployment scheme, it is easier than pulling to push.
Embodiment three
Referring to Fig. 3, can see with reference to Fig. 3, a kind of storage medium 10 of the embodiment of the present invention, the storage medium
10, such as: ROM/RAM, magnetic disk, CD are stored thereon with computer program 11, and the computer program 11 is performed realization
The alarm method using log index as described in embodiment one.Since this has been implemented using the alarm method of log index
Example one is described in detail, and this will not be repeated here.
The embodiment of the present invention realize the alarm method using log index, by obtain by target application active push to
The target journaling achievement data of the log collection storage service, and the target journaling achievement data is being visualized into screen
It is visualized on curtain, mark does not meet the abnormal index number of default health regulations on the visual presentation screen
According to, finally the abnormal index data for not meeting default health regulations are alerted, are solved in the prior art, alarm clothes
Business applies log index come the method for realizing the health examination of application by pulling, and is difficult in the environment that containerization service is passed unimpeded
It realizes, and the network model used also more complicated problem.
Specifically, the prior art is compared, this programme is actively to access alerting service by application to realize that index is collected,
We call to push, and the Prometheus of prior art service is then alerting service inverted access application, we, which call, is
It pulls.Push is more much easier in network management than pulling, and in containerization deployment scheme, it is easier than pulling to push.
Example IV
Referring to Fig. 4, can see with reference to Fig. 4, a kind of computer equipment 20 of the embodiment of the present invention comprising processor
21, memory 22 and it is stored in the computer program 221 that can be run on the memory 22 and on the processor 21, it is described
Processor 21 realizes the alarm method using log index as described in embodiment one when executing the computer program 221.By
It has been described in detail in embodiment one in this using the alarm method of log index, this will not be repeated here.
The embodiment of the present invention realize the alarm method using log index, by obtain by target application active push to
The target journaling achievement data of the log collection storage service, and the target journaling achievement data is being visualized into screen
It is visualized on curtain, mark does not meet the abnormal index number of default health regulations on the visual presentation screen
According to, finally the abnormal index data for not meeting default health regulations are alerted, are solved in the prior art, alarm clothes
Business applies log index come the method for realizing the health examination of application by pulling, and is difficult in the environment that containerization service is passed unimpeded
It realizes, and the network model used also more complicated problem.
Specifically, the prior art is compared, this programme is actively to access alerting service by application to realize that index is collected,
We call to push, and the Prometheus of prior art service is then alerting service inverted access application, we, which call, is
It pulls.Push is more much easier in network management than pulling, and in containerization deployment scheme, it is easier than pulling to push.
Mode the above is only the implementation of the present invention is not intended to limit the scope of the invention, all to utilize this
Equivalent structure or equivalent flow shift made by description of the invention and accompanying drawing content, it is relevant to be applied directly or indirectly in other
Technical field is included within the scope of the present invention.
Claims (10)
1. a kind of alarm method using log index characterized by comprising
The target journaling achievement data of target application is obtained from log collection storage service；
The target journaling achievement data is visualized on visualizing screen, and in the visual presentation
Mark does not meet the abnormal index data of default health regulations on screen；
The abnormal index data for not meeting default health regulations are alerted；
Wherein, the target journaling achievement data is by application active push to the log collection storage service.
2. the alarm method according to claim 1 using log index, which is characterized in that described by the target journaling
Achievement data is visualized on visualizing screen, comprising:
The target journaling achievement data in the log collection storage service is read by data visualization service.
3. the alarm method according to claim 2 using log index, which is characterized in that described in the visualization exhibition
Mark does not meet the abnormal index data of default health regulations on display screen curtain, comprising:
The target day in the log collection storage service is scanned using the alarm module in the data visualization service
Will achievement data obtains the abnormal index data for not meeting default health regulations；
The abnormal index data are identified on the visual presentation screen.
4. the alarm method according to claim 1 using log index, which is characterized in that described pair does not meet default be good for
The abnormal index data as defined in health are alerted, comprising:
Alarm email is sent to the specified mailbox of developer, the alarm email includes the abnormal index data.
5. the alarm method according to claim 1 using log index, which is characterized in that described pair does not meet default be good for
The abnormal index data as defined in health are alerted, comprising:
It sends nail nail and notifies Ding Ding group, the nail nail notice includes the abnormal index data.
6. the alarm method according to claim 1 using log index, which is characterized in that the log collection storage clothes
Business includes influxdb service, elasticsearch service and opentsdb service.
7. the alarm method according to claim 2 using log index, which is characterized in that the Visualization Service includes
Grafana service and kibana service.
8. a kind of alarm device using log index characterized by comprising
Module is obtained, for obtaining the target journaling achievement data of target application from log collection storage service；
Visualization model, for the target journaling achievement data to be visualized on visualizing screen, and
Mark does not meet the abnormal index data of default health regulations on the visual presentation screen；
Alarm module, for being alerted to the abnormal index data for not meeting default health regulations；
Wherein, the target journaling achievement data is by application active push to the log collection storage service.
9. a kind of storage medium, which is characterized in that be stored thereon with computer program, the computer program is performed realization
The described in any item alarm methods using log index of claim 1~7.
10. a kind of computer equipment, which is characterized in that it includes processor, memory and is stored on the memory and can
The computer program run on the processor, the processor realize claim 1~7 when executing the computer program
Described in any item alarm methods using log index.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910688146.2A CN110442503A (en) | 2019-07-29 | 2019-07-29 | A kind of alarm method and device using log index |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910688146.2A CN110442503A (en) | 2019-07-29 | 2019-07-29 | A kind of alarm method and device using log index |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110442503A true CN110442503A (en) | 2019-11-12 |
Family
ID=68432011
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910688146.2A Pending CN110442503A (en) | 2019-07-29 | 2019-07-29 | A kind of alarm method and device using log index |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110442503A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113127319A (en) * | 2021-04-06 | 2021-07-16 | 北京大米科技有限公司 | Information monitoring method, related device and computer storage medium |
| CN113312321A (en) * | 2021-05-31 | 2021-08-27 | 中国民航信息网络股份有限公司 | Abnormal monitoring method for traffic and related equipment |
| CN114553740A (en) * | 2022-03-11 | 2022-05-27 | 以萨技术股份有限公司 | Method, system, readable storage medium and device for cross-network monitoring |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104036025A (en) * | 2014-06-27 | 2014-09-10 | 蓝盾信息安全技术有限公司 | Distribution-base mass log collection system |
| CN107463479A (en) * | 2017-07-11 | 2017-12-12 | 上海精数信息科技有限公司 | A kind of social data monitoring system |
| CN108259268A (en) * | 2017-12-30 | 2018-07-06 | 上海陆家嘴国际金融资产交易市场股份有限公司 | Network monitoring data processing method, device, computer equipment and storage medium |
| CN108509309A (en) * | 2018-02-13 | 2018-09-07 | 南京途牛科技有限公司 | A kind of system and method carrying out performance monitoring based on access log |
| US20190034253A1 (en) * | 2017-07-31 | 2019-01-31 | Oracle International Corporation | System and method of providing post error analysis for instances of applications in cloud service environments on a per user basis |
-
2019
- 2019-07-29 CN CN201910688146.2A patent/CN110442503A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104036025A (en) * | 2014-06-27 | 2014-09-10 | 蓝盾信息安全技术有限公司 | Distribution-base mass log collection system |
| CN107463479A (en) * | 2017-07-11 | 2017-12-12 | 上海精数信息科技有限公司 | A kind of social data monitoring system |
| US20190034253A1 (en) * | 2017-07-31 | 2019-01-31 | Oracle International Corporation | System and method of providing post error analysis for instances of applications in cloud service environments on a per user basis |
| CN108259268A (en) * | 2017-12-30 | 2018-07-06 | 上海陆家嘴国际金融资产交易市场股份有限公司 | Network monitoring data processing method, device, computer equipment and storage medium |
| CN108509309A (en) * | 2018-02-13 | 2018-09-07 | 南京途牛科技有限公司 | A kind of system and method carrying out performance monitoring based on access log |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113127319A (en) * | 2021-04-06 | 2021-07-16 | 北京大米科技有限公司 | Information monitoring method, related device and computer storage medium |
| CN113312321A (en) * | 2021-05-31 | 2021-08-27 | 中国民航信息网络股份有限公司 | Abnormal monitoring method for traffic and related equipment |
| CN114553740A (en) * | 2022-03-11 | 2022-05-27 | 以萨技术股份有限公司 | Method, system, readable storage medium and device for cross-network monitoring |
| CN114553740B (en) * | 2022-03-11 | 2023-11-10 | 以萨技术股份有限公司 | Method, system, readable storage medium and device for cross-network monitoring |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110442503A (en) | A kind of alarm method and device using log index | |
| Archambault et al. | Difference map readability for dynamic graphs | |
| CN101707632A (en) | Method for dynamically monitoring performance of server cluster and alarming real-timely | |
| JP2013533528A (en) | Dynamic adaptive process discovery and compliance | |
| US8140983B2 (en) | System and method for auto-generating threads on web forums | |
| CN106960292A (en) | A kind of operation flow monitoring system and method applied to Utilities Electric Co. | |
| US9043317B2 (en) | System and method for event-driven prioritization | |
| CN105373460B (en) | The alarm method and system of monitoring message | |
| CN110083346A (en) | Screening configuration method and device based on data visualization interface | |
| CN113032252A (en) | Method and device for collecting buried point data, client device and storage medium | |
| CN111897806A (en) | Big data offline data quality inspection method and device | |
| CN114048090A (en) | K8S-based container cloud platform monitoring method and device and storage medium | |
| Yue et al. | A new VLAD‐based control chart for detecting surgical outcomes | |
| CN104008089B (en) | For verifying the method and system of document | |
| Smith et al. | Novel public health risk assessment process developed to support syndromic surveillance for the 2012 Olympic and Paralympic Games | |
| CN112162903A (en) | Method and system for monitoring state of service system based on Flink | |
| JP2013045160A (en) | Information processing system, administrative server and information processing method | |
| US8881028B2 (en) | Reverse metadata viewing by multiple parties | |
| CN110837538A (en) | Financial knowledge map visual query and multidimensional analysis system | |
| US8001092B2 (en) | Apparatus and method for analyzing and displaying information | |
| CN111597091A (en) | Data monitoring method and system, electronic equipment and computer storage medium | |
| CN106650281A (en) | Data processing method and system, server and client | |
| CN107168846A (en) | The monitoring method and device of electronic equipment | |
| CN110113208A (en) | Alarm information processing method, device, equipment and computer readable storage medium | |
| CN115099428A (en) | Management platform for full life cycle of equipment and full-dimensional quantitative evaluation method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191112 |
|
| RJ01 | Rejection of invention patent application after publication |