CN112395180A - Method for realizing service log full link tracking - Google Patents
Method for realizing service log full link tracking Download PDFInfo
- Publication number
- CN112395180A CN112395180A CN202011434037.7A CN202011434037A CN112395180A CN 112395180 A CN112395180 A CN 112395180A CN 202011434037 A CN202011434037 A CN 202011434037A CN 112395180 A CN112395180 A CN 112395180A
- Authority
- CN
- China
- Prior art keywords
- service
- log
- link
- information
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000005070 sampling Methods 0.000 claims abstract description 20
- 230000001960 triggered effect Effects 0.000 claims abstract description 12
- 230000005540 biological transmission Effects 0.000 claims description 2
- 238000012423 maintenance Methods 0.000 abstract description 4
- 230000009286 beneficial effect Effects 0.000 abstract description 3
- 238000012544 monitoring process Methods 0.000 description 4
- 230000002159 abnormal effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention relates to a method for realizing service log full-link tracking, which comprises the following steps: 1) defining service link information from the service perspective to obtain a list of all service links; 2) setting a link level for the service link defined in the step 1; 3) performing log point burying on the service link defined in the step 1, namely setting description information for each node on the service link; 4) setting a log sampling frequency to selectively record logs; 5) setting a log sampling level, namely matching and corresponding the link level set in the step 2 and the log sampling frequency set in the step 4; 6) when the node of the service link is triggered to operate and generate log information, the generated log information is reported in a grading way; 7) and analyzing and displaying the reported log. The method is beneficial to realizing the omnibearing tracking and the quick positioning of error information on the service level and improving the operation and maintenance efficiency.
Description
Technical Field
The invention relates to a method for realizing service log full-link tracking.
Background
For a large-scale digital operation and maintenance platform with high requirements on complexity and stability, service logic is diversified and has high complexity, and in order to track and know the calling process of each service scene, the consumption performance condition of the calling process and error information and quickly locate an error log, a process tracking monitoring method capable of carrying out full link on all service calling processes from a service level is needed. The full link tracking should meet different application scenarios, and a large amount of log recording processes consume performance and occupy a lot of storage space, so that the recording of log information needs to be controlled according to local conditions.
By defining the level of a log link and setting the sampling frequency of the log, different application scenes store log information with different levels according to the actual situation of the application scenes so as to ensure that the influence of the record analysis of the log on the service is reduced to the minimum.
Disclosure of Invention
The invention aims to provide a method for realizing service log full-link tracking, which is beneficial to realizing omnibearing tracking and quick positioning of error information on a service level and improving operation and maintenance efficiency.
In order to achieve the purpose, the invention adopts the technical scheme that: a method for realizing service log full link tracking comprises the following steps:
1) defining service link information from the service perspective to obtain a list of all service links;
2) setting a link level for the service link defined in the step 1;
3) performing log point burying on the service link defined in the step 1, namely setting description information for each node on the service link;
4) setting a log sampling frequency to selectively record logs;
5) setting a log sampling level, namely matching and corresponding the link level set in the step 2 and the log sampling frequency set in the step 4;
6) when the node of the service link is triggered to operate and generate log information, the generated log information is reported in a grading way;
7) and analyzing and displaying the reported log.
Further, in the step 2, the set link levels include three levels of important, general and unimportant, the important service link is monitored in a key mode, and if error information is generated, a notification short message of the error information is immediately pushed.
Further, in step 3, a point is logged and buried in the service link, and when a corresponding node on the service link is triggered, the service information of the corresponding node is recorded, so that the service link is analyzed and displayed conveniently.
Further, in step 3, the method for embedding the log into the point includes: firstly, all nodes of each service link are subjected to node information description, and corresponding parameter description and node description are embedded, so that when service operation is triggered, each node records corresponding service operation, start time and end time, and finally, when and where the link is called is visually displayed during log analysis, and the time consumption is long.
Further, in step 5, a log sampling level is set, and it may be set to perform log collection only on important service links, or perform log collection on all service links.
Further, in step 7, based on the reported and stored log information, the analysis and display can be performed according to the service links under different modules of different systems, and the service links generating the error information can be quickly checked through the log information, including the time of generating the error, the parameter value, the return value, and the specific error information in the link transmission process, so as to quickly locate and check.
Compared with the prior art, the invention has the following beneficial effects: the invention defines the link process of the business operation from the perspective of the business, sets the embedded point of the log in the code of each business operation process, can perform key monitoring on the important business link because the log record of the whole process of the log operation can generate a large amount of log information, and can set the sampling frequency of the log according to the actual situation to prevent the sudden increase of the log information. Each node information triggered in the service operation process records related access source, access time consumption and abnormal information, so that the operation process can be analyzed in a classified manner according to the classification of services and the importance of service operation during final service log analysis, the abnormal information generating errors can be quickly positioned, and the operation and maintenance efficiency can be greatly improved.
Drawings
FIG. 1 is a flow chart of a method implementation of an embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the figures and the embodiments.
As shown in fig. 1, the present invention provides a method for implementing service log full link tracking, which includes the following steps:
1) link definition
And defining service link information from the service perspective to obtain a list of all service links.
The link tracking process generates a large amount of link logs, consumes performance and occupies a large amount of storage space, and in order to adapt to link monitoring in different application scenarios, the level of the link and the sampling frequency of the logs need to be set.
2) Link level setting
Setting link levels for the service link defined in the step 1, wherein the set link levels comprise three levels of important, general and unimportant, performing key monitoring on the important service link, and immediately pushing a notification short message of error information if the error information is generated.
3) Log embedding point
And (3) performing point logging on the service link defined in the step (1), namely setting description information for each node on the service link, and recording the service information of the corresponding node when the corresponding node on the service link is triggered so as to facilitate the analysis and display of the service link.
The method for embedding the points in the log comprises the following steps: firstly, all nodes of each service link are subjected to node information description, and corresponding parameter description and node description are embedded, so that when service operation is triggered, each node records corresponding service operation, start time and end time, and finally, when and where the link is called is visually displayed during log analysis, and the time consumption is long.
4) Log sampling frequency setting
A log sampling frequency is set to selectively log. For a large system platform, the amount of log information is very large, so that the log can be selectively recorded by setting the sampling frequency of the log.
5) Log sampling level setting
And (4) setting a log sampling level, namely matching and corresponding the link level set in the step (2) with the log sampling frequency set in the step (4). The log collection can be set only for important service links, or for all service links.
6) Log reporting
And when the nodes of the service link are triggered to operate and generate the log information, the generated log information is reported in a grading way.
Each node of each link generates log information when being triggered to operate, and the generated log information needs to be reported and stored, so that the service link can be displayed and analyzed finally.
7) Log analysis display
And analyzing and displaying the reported log. Based on the reported and stored log information, the log information can be analyzed and displayed according to the service links under different modules of different systems, and the service links generating error information can be quickly checked through the log information, wherein the log information comprises the time of generating errors, parameter values, return values, specific error information and the like, so that the check can be quickly positioned.
The above are preferred embodiments of the present invention, and all changes made according to the technical scheme of the present invention that produce functional effects do not exceed the scope of the technical scheme of the present invention belong to the protection scope of the present invention.
Claims (6)
1. A method for realizing service log full link tracking is characterized by comprising the following steps:
1) defining service link information from the service perspective to obtain a list of all service links;
2) setting a link level for the service link defined in the step 1;
3) performing log point burying on the service link defined in the step 1, namely setting description information for each node on the service link;
4) setting a log sampling frequency to selectively record logs;
5) setting a log sampling level, namely matching and corresponding the link level set in the step 2 and the log sampling frequency set in the step 4;
6) when the node of the service link is triggered to operate and generate log information, the generated log information is reported in a grading way;
7) and analyzing and displaying the reported log.
2. The method as claimed in claim 1, wherein in step 2, the set link levels include three levels of important, general and unimportant, and the important service link is monitored in an important manner, and if an error message is generated, a short message for notifying the error message is immediately pushed.
3. The method as claimed in claim 1, wherein in step 3, the service link is logged, and when the corresponding node on the service link is triggered, the service information of the corresponding node is recorded, so as to facilitate analysis and display of the service link.
4. The method for implementing service log full link tracking according to claim 1, wherein in the step 3, the method for embedding the log point is as follows: firstly, all nodes of each service link are subjected to node information description, and corresponding parameter description and node description are embedded, so that when service operation is triggered, each node records corresponding service operation, start time and end time, and finally, when and where the link is called is visually displayed during log analysis, and the time consumption is long.
5. The method as claimed in claim 1, wherein in step 5, a log sampling level is set, so that only important service links or all service links can be logged.
6. The method as claimed in claim 1, wherein in step 7, based on the reported and stored log information, the log information can be analyzed and displayed according to the service links of different modules of different systems, and the service link generating the error information can be quickly checked through the log information, including the time of generating the error, the parameter value, the return value, and the specific error information in the link transmission process, so as to quickly locate and investigate the error.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011434037.7A CN112395180A (en) | 2020-12-10 | 2020-12-10 | Method for realizing service log full link tracking |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011434037.7A CN112395180A (en) | 2020-12-10 | 2020-12-10 | Method for realizing service log full link tracking |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112395180A true CN112395180A (en) | 2021-02-23 |
Family
ID=74625640
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011434037.7A Pending CN112395180A (en) | 2020-12-10 | 2020-12-10 | Method for realizing service log full link tracking |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112395180A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113434399A (en) * | 2021-06-23 | 2021-09-24 | 青岛海尔科技有限公司 | Service node log processing method and device, storage medium and electronic device |
| CN113641554A (en) * | 2021-08-10 | 2021-11-12 | 南威软件股份有限公司 | Cross-over interface link monitoring method |
| CN113918426A (en) * | 2021-12-09 | 2022-01-11 | 山东宁泓信息技术有限公司 | Method, system and equipment for realizing Redis access full link tracking |
| CN115473839A (en) * | 2021-06-11 | 2022-12-13 | 北京字跳网络技术有限公司 | Data processing method, device and equipment based on buried point and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017173969A1 (en) * | 2016-04-06 | 2017-10-12 | 广州广电运通金融电子股份有限公司 | Log analysis-based fault location method and device |
| CN107423190A (en) * | 2017-04-19 | 2017-12-01 | 国家电网公司 | A kind of daily record data points to recognition methods and device extremely |
| CN108183927A (en) * | 2017-11-22 | 2018-06-19 | 链家网（北京）科技有限公司 | The monitoring method and system that a kind of distributed system link calls |
| CN109104302A (en) * | 2018-07-18 | 2018-12-28 | 杭州鑫合汇互联网金融服务有限公司 | A kind of full link tracing monitoring method |
| CN109284257A (en) * | 2018-08-10 | 2019-01-29 | 锐捷网络股份有限公司 | A kind of log write-in method, apparatus, electronic equipment and storage medium |
-
2020
- 2020-12-10 CN CN202011434037.7A patent/CN112395180A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017173969A1 (en) * | 2016-04-06 | 2017-10-12 | 广州广电运通金融电子股份有限公司 | Log analysis-based fault location method and device |
| CN107423190A (en) * | 2017-04-19 | 2017-12-01 | 国家电网公司 | A kind of daily record data points to recognition methods and device extremely |
| CN108183927A (en) * | 2017-11-22 | 2018-06-19 | 链家网（北京）科技有限公司 | The monitoring method and system that a kind of distributed system link calls |
| CN109104302A (en) * | 2018-07-18 | 2018-12-28 | 杭州鑫合汇互联网金融服务有限公司 | A kind of full link tracing monitoring method |
| CN109284257A (en) * | 2018-08-10 | 2019-01-29 | 锐捷网络股份有限公司 | A kind of log write-in method, apparatus, electronic equipment and storage medium |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115473839A (en) * | 2021-06-11 | 2022-12-13 | 北京字跳网络技术有限公司 | Data processing method, device and equipment based on buried point and storage medium |
| CN115473839B (en) * | 2021-06-11 | 2024-03-05 | 北京字跳网络技术有限公司 | Buried point-based data processing method, device, equipment and storage medium |
| CN113434399A (en) * | 2021-06-23 | 2021-09-24 | 青岛海尔科技有限公司 | Service node log processing method and device, storage medium and electronic device |
| CN113434399B (en) * | 2021-06-23 | 2023-06-16 | 青岛海尔科技有限公司 | Service node log processing method and device, storage medium and electronic device |
| CN113641554A (en) * | 2021-08-10 | 2021-11-12 | 南威软件股份有限公司 | Cross-over interface link monitoring method |
| CN113641554B (en) * | 2021-08-10 | 2023-10-27 | 南威软件股份有限公司 | Cross-over interface link monitoring method |
| CN113918426A (en) * | 2021-12-09 | 2022-01-11 | 山东宁泓信息技术有限公司 | Method, system and equipment for realizing Redis access full link tracking |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112395180A (en) | Method for realizing service log full link tracking | |
| CN110659173B (en) | Operation and maintenance system and method | |
| CN101446914B (en) | Database monitoring method and device | |
| CN102801785B (en) | System and method for monitoring advertisement putting engine | |
| CN102523137B (en) | Fault monitoring method, device and system | |
| CN105550100A (en) | Method and system for automatic fault recovery of information system | |
| CN107977823A (en) | Accident treating method and apparatus | |
| CN111259073A (en) | Intelligent business system running state studying and judging system based on logs, flow and business access | |
| CN113542039A (en) | Method for positioning 5G network virtualization cross-layer problem through AI algorithm | |
| CN110224865A (en) | A kind of log warning system based on Stream Processing | |
| CN111444067A (en) | Rule engine-based configuration system monitoring method, device and equipment | |
| CN105917625A (en) | Classification of detected network anomalies using additional data | |
| CN112769605A (en) | Heterogeneous multi-cloud operation and maintenance management method and hybrid cloud platform | |
| CN111314137A (en) | Information communication network automation operation and maintenance method, device, storage medium and processor | |
| CN112711493A (en) | Scenario root cause analysis application | |
| CN114172921A (en) | Log auditing method and device for scheduling recording system | |
| CN110609761B (en) | Method and device for determining fault source, storage medium and electronic equipment | |
| CN115174350B (en) | Operation and maintenance alarm method, device, equipment and medium | |
| CN114500178B (en) | Self-operation intelligent Internet of things gateway | |
| CN112860527A (en) | Fault monitoring method and device of application server | |
| CN108710573A (en) | It is a kind of that test method, device, storage medium and terminal a little are buried based on daily record | |
| CN107341086A (en) | Method and system for monitoring running state of server | |
| CN113110977B (en) | Safety monitoring method based on block chain system | |
| CN116582410B (en) | Intelligent operation and maintenance service method and device based on ITSM system | |
| CN113138875B (en) | Fault detection method, terminal and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210223 |