CN101043375A - Distributed system journal collecting method and system - Google Patents

Distributed system journal collecting method and system Download PDF

Info

Publication number
CN101043375A
CN101043375A CN 200710064430 CN200710064430A CN101043375A CN 101043375 A CN101043375 A CN 101043375A CN 200710064430 CN200710064430 CN 200710064430 CN 200710064430 A CN200710064430 A CN 200710064430A CN 101043375 A CN101043375 A CN 101043375A
Authority
CN
China
Prior art keywords
journal file
journal
module
business module
daily record
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200710064430
Other languages
Chinese (zh)
Other versions
CN100461710C (en
Inventor
吴金坤
朱云峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CNB200710064430XA priority Critical patent/CN100461710C/en
Publication of CN101043375A publication Critical patent/CN101043375A/en
Application granted granted Critical
Publication of CN100461710C publication Critical patent/CN100461710C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Debugging And Monitoring (AREA)

Abstract

The related distributed system log collection method comprises: receiving log data or file from every business module periodically or aperiodically to gather into new log file for storage; when receiving log collection command with collection condition, transmitting proper log file to the appointed device. This invention has no effect on system performance, and can extract log message efficiently.

Description

Distributed system journal collecting method and system
Technical field
The present invention relates to the distributed system field, the collection method of daily record in especially a kind of distributed system, and result collection system.
Background technology
Traditional communication operation usually adopts centralized way to manage, in recent years because distributed system has advantages such as easy extendibility, load balancing, good reliability, and being penetrated in the middle of the modern communications operation management gradually.Each business module is realized separate business function as a subsystem respectively in distributed system, and is responsible for it by an operation maintenance center and administers and maintains, and each subsystem is to disperse mutually usually on the region.In each business module independent operating process of distributed system,, need the various daily records of record usually for the ease of system is carried out maintenance and management.
The log management of distributed system mainly contains two types, a kind of is by log collection program independently overall collection to be carried out in the daily record of whole system, and a kind of is by log collection program independently log information in a certain respect to be collected targetedly.This log management of two types all has certain defective, and the redundant log information that the former collects is too much, and the case study personnel search very difficulty of useful information in the log information of magnanimity; The latter has ignored the correlation between the various daily records, only in a certain respect or module carry out log collection, possibly can't obtain the needed information of problem analysis, but also need all develop the log collection program separately each aspect, cost is higher.
Summary of the invention
The objective of the invention is to propose a kind of distributed system journal collecting method and system, can manage concentratedly, and collect targetedly to make things convenient for the case study personnel that daily record is effectively extracted to the daily record of each business module in the distributed system.
For achieving the above object, one embodiment of the present of invention provide a kind of distributed system journal collecting method, may further comprise the steps:
Receive each business module reports with predetermined period or predetermined condition in the distributed system daily record data or journal file, perhaps gather the daily record data or the journal file of described each business module with predetermined period or predetermined condition;
Described daily record data or journal file gathered be new journal file, and new journal file is stored;
When reception comprised the log collection instruction of collection condition, the journal file that will meet described collection condition according to described log collection instruction was transferred to designated equipment.
To achieve these goals, one embodiment of the present of invention provide a kind of distributed system journal gathering system, comprising:
Last transmission module, link to each other with each business module in the distributed system, be used for receiving daily record data or the journal file that each business module reports, perhaps gather the daily record data or the journal file of described each business module with predetermined period or predetermined condition with predetermined period or predetermined condition;
Operation maintenance center, link to each other with the described transmission module of going up, be used for daily record data gathered and be journal file, and journal file stored, when reception comprises the log collection instruction of collection condition, operation maintenance center is transferred to designated equipment according to the journal file that described log collection instruction will meet described collection condition, or the download service of journal file is provided.
Based on technique scheme, embodiments of the invention have the following advantages: the journal file that is reported by operation maintenance center's maintenance service module in the embodiment of the invention, only when the user files a request, just the journal file that meets classification, time requirement is collected, influence systematic function thereby both can in system's running, not extract lot of data, also can carry out the extraction of effective journal file to a great extent targetedly.
Below by drawings and Examples, technical scheme of the present invention is described in further detail.
Description of drawings
Fig. 1 is the schematic flow sheet of an embodiment of distributed system journal collecting method of the present invention.
Fig. 2 is the schematic flow sheet of another embodiment of distributed system journal collecting method of the present invention.
Fig. 3 is the schematic flow sheet of the another embodiment of distributed system journal collecting method of the present invention.
Fig. 4 is the structural representation of an embodiment of distributed system journal gathering system of the present invention.
Fig. 5 is the structural representation of another embodiment of distributed system journal gathering system of the present invention.
Fig. 6 is the structural representation of the another embodiment of distributed system journal gathering system of the present invention.
Embodiment
Embodiments of the invention are the journal files that utilize operation maintenance center's maintenance service module to report, and when the user need analyze certain aspect situation, collect the journal file that satisfies time or class condition from operation maintenance center.By log collection program independently, this mode can overcome a large amount of and the irrelevant redundant log information of problem in the prior art in the prior art, provide the user some have the daily record data of being convenient to analyze of relevance.
As shown in Figure 1, be the schematic flow sheet of an embodiment of distributed system journal collecting method of the present invention, present embodiment may further comprise the steps:
Step 101, operation maintenance center receive daily record data or the journal file that each business module reports with predetermined period or predetermined condition in the distributed system, perhaps gather the daily record data or the journal file of described each business module with predetermined period or predetermined condition, operation maintenance center safeguards after collecting log information always, when collecting generation, collect from the log information that operation maintenance center safeguarded, rather than directly from business module, collect data, the efficient and the fail safe that can improve collector journal so greatly in the prior art;
Step 102, operation maintenance center gather daily record data or journal file and are new journal file, and to new journal file storage, log information in operation maintenance center is to exist with the journal file with time and/or classification logotype, the classification of daily record helps to collect targetedly, also be convenient to user inquiring, daily record can comprise running log, Operation Log, security log, debugging log, alarm, network environment, system resource etc. for instance;
Step 103, when operation maintenance center receives the log collection instruction comprise log category and/or time range, operation maintenance center is transferred to designated equipment according to the journal file that described log collection instruction will meet log category and/or time range.
The embodiment of the invention is maintained in operation maintenance center with log information, directly collects from operation maintenance center when needed, has so both made things convenient for specific aim to collect the efficient and the fail safe that have also improved collector journal greatly.
Whether actual business module according to having the business module that local hard drive is divided into the business module of no disc system and disc system is arranged, and is directed to have provided two embodiment below this two classes business module and describe.
As shown in Figure 2, be the schematic flow sheet of another embodiment of distributed system journal collecting method of the present invention, in the present embodiment, therefore no disc system owing to can not directly be sent to operation maintenance center with daily record data last giving the correct time at local storing daily record data.The present embodiment concrete steps are as follows:
Step 201, when business module during for the business module of no disc system, directly report daily record data with predetermined period or predetermined condition to operation maintenance center, perhaps with the daily record data of predetermined period or described each business module of predetermined condition collection;
The described daily record data that step 202, operation maintenance center will receive gathers and is journal file, and journal file is stored;
Step 203, operation maintenance center are in the process of the daily record data that the reception business module reports, the monitoring daily record reports process, reports disappearance or does not receive daily record data if detect daily record data, then writes down this detection content, and give notice, initiate the filling mining request to this business module simultaneously;
Step 204, when operation maintenance center receives the log collection instruction comprise log category and/or time range, operation maintenance center is transferred to designated equipment according to the journal file that described log collection instruction will meet log category and/or time range.
In step 203, operation maintenance center need report daily record and monitor for the integrality of daily record data, when detecting when reporting process to make mistakes, detected problem log is got off, and, initiate the filling mining request to this business module then to user's information of giving notice.No disc system is safeguarded a buffer queue, daily record data is arranged in buffer queue, comprise the daily record data that sends to operation maintenance center, after described business module receives the filling mining request, from the buffer queue of safeguarding at no disc system, obtain corresponding daily record data and return to operation maintenance center.Can buffer number be set for the buffer queue that no disc system is safeguarded, when reaching predetermined buffer and count, just delete in the buffer queue daily record data of time early, up to meeting predetermined buffer number.
After operation maintenance center receives the collection instruction that the user sends, just can collect, the user can pass through man-machine language (Man Machine Language, being called for short MML) the order log collection instruction that will have log category and/or a time range is input to remote computer or local computer, again by the collection of remote computer or local computer to operation maintenance center's Request Log information.In addition, operation maintenance center can also offer graphical interface of user, sends the log collection instruction by the operation to graphical interfaces to operation maintenance center.
The daily record of collecting can be undertaken functional or relevance refinement and combination by classification, thereby marks off the type of multiple collection, and can optionally collect, and carries out the extraction of valid data to the full extent, also can carry out the full combination of journal file and collect.The daily record of collecting can also limit according to acquisition time, for example according to the date with carry out time qualifiedly constantly, can also carry out time range to a time period and limit.Under default situations, can also be set to fulltime log collection.
The called function combination is meant that the function that has according to whole system carries out daily record classification, when realizing certain function, can produce some daily records, it is meaningful to the running status of analyzing this function to have some daily records in these daily records again, these daily records just can be by functional combination together, in the time of can going wrong in a certain function of system like this, the daily record relevant with this function of these collections can make things convenient for the user to analyze.For instance, the example of functional combination comprises: background maintenance, foreground business, user's access, centre management etc., and to notice that when design category granularity can not be meticulous, otherwise can cause the volatile growth of log category.So-called correlation combination is meant the influence that can be subjected to other daily records for the generation of some daily record, therefore must consider other related daily record to a kind of analysis of daily record, by analyzing these related daily records, can comprehensively analyze the log information relevant with problem.For instance, can when collecting running log, network environment, system journal, security log be collected in the lump; When collecting Operation Log, running log, alarm log etc. can be collected in the lump.
No disc system only can be kept the daily record data of a constant volume when operation, therefore in the present embodiment operation maintenance center by receiving the daily record data that no disc system reports, can keep the log information of long period, for carry out incident or transaction analysis in the future.
As shown in Figure 3, schematic flow sheet for the another embodiment of distributed system journal collecting method of the present invention, in the present embodiment, business module is the business module that disc system is arranged, owing to memory space is arranged in business module this locality, therefore daily record data can be stored as file, perhaps store with extended formatting, report operation maintenance center last giving the correct time with journal file or through the journal file after the format conversion, idiographic flow is as follows:
Step 301, when business module be when the business module of disc system is arranged, report the direct-recording journal file of described business module or, perhaps gather the direct-recording journal file of described each business module or the journal file after the process format conversion to operation maintenance center with predetermined period or predetermined condition with predetermined period or predetermined condition through the journal file after the format conversion;
Step 302, operation maintenance center store the journal file that receives;
Step 303, operation maintenance center are in the process of the journal file that the reception business module reports, the monitoring daily record reports process, reports disappearance or does not receive journal file if detect journal file, then writes down this detection content, and give notice, initiate the filling mining request to this business module simultaneously;
Step 304, when operation maintenance center receives the log collection instruction comprise log category and/or time range, operation maintenance center is transferred to designated equipment according to the journal file that described log collection instruction will meet log category and/or time range.
Can safeguard the journal file of scheduled time scope and/or capacity at the local hard drive of business module, when the daily record file exceeds scheduled time scope and/or predetermined volumes, then delete in the described business module journal file of time early, up to meeting scheduled time scope and/or predetermined volumes.The time range here and the parameter of capacity can be provided with by producer when system start-up or manually be provided with by the user.
There is disc system can keep the journal file of a constant volume, and store with specific form, in the last advanced row format conversion of giving the correct time, then journal file is sent to operation maintenance center, operation maintenance center also can carry out sort merge according to information such as the classification of different journal files, rise times.
In order to save volume of transmitted data, can also pack to compress to the journal file of collecting and handle, after the packing compression, can directly the packaging file after the compression be uploaded to designated equipment by the FTP mode, packaging file after perhaps will compressing is generated to ftp server a kind of download service is provided, when receiving the instruction that indication that the user sends downloads, the relevant packaging file of requested daily record is sent to designated equipment by the FTP mode.
If in above-mentioned three embodiment, consider the situation of the superfluous calamity of data, then need to set up the mechanism that a superfluous calamity is recovered, can utilize the data backup program or the special-purpose data backup hardware of operation maintenance center's operation, according to predetermined period with journal file from operation maintenance center's full backup and/or incremental backup to the proprietary backup server, for full backup, can in the long cycle, carry out, and for incremental backup, then can carry out than the short period, these two kinds of backup modes can be distinguished use separately, also can be used in combination.
The present invention is except providing distributed system journal collecting method, the embodiment of several distributed system journal gathering systems also is provided, as shown in Figure 4, structural representation for an embodiment of distributed system journal gathering system of the present invention, present embodiment comprises transmission module 1 and operation maintenance center 2, wherein going up transmission module 1 links to each other with each business module in the distributed system, can receive daily record data or the journal file that each professional mould reports with predetermined period or predetermined condition, perhaps gather the daily record data or the journal file of described each business module with predetermined period or predetermined condition.Operation maintenance center 2 links to each other with last transmission module 1, daily record data can be gathered and be journal file, and journal file stored, when reception comprises the log collection instruction of collection condition (for example log category and/or time range), operation maintenance center is transferred to designated equipment according to the journal file that described log collection instruction will meet collection condition (log category and/or time range), or the download service of journal file is provided.
Operation maintenance center 2 specifically comprises following module: summarizing module 4, memory module 5 and collection module 6.Wherein summarizing module 4 can gather and is journal file going up daily record data that transmission module 1 transmitted, sends to then in the memory module 5 and stores, and for the journal file that last transmission module 1 directly transmits, can directly send to memory module 5 and carry out centralized stores.Collection module 6 links to each other with memory module 5, can instruct the journal file that will meet log category and/or time range to be transferred to designated equipment according to log collection, analyzes for the user, and the download service of journal file perhaps is provided for the user.
Operation maintenance center 2 stores a large amount of journal files in memory module 5, be convenient to user's collection analysis, and this centralized management can make full use of the ability of operation maintenance center, also can realize very complicated acquisition logic.
Whether there is local hard drive business module to be divided into the business module and the business module that disc system is arranged of no disc system according to business module, as shown in Figure 5, structural representation for another embodiment of distributed system journal gathering system of the present invention, wherein going up transmission module can be divided into no disc system and upload submodule 11 and have disc system to upload submodule 12, wherein not having disc system uploads the business module of the no disc system in submodule 11 and the distributed system and links to each other with summarizing module 4, receive the daily record data that reports of described each business module with predetermined period or predetermined condition, perhaps gather the daily record data of described each business module with predetermined period or predetermined condition, link to each other with memory module 5 with the business module that disc system is arranged in the distributed system and there is disc system to upload submodule 12, can receive reporting direct-recording journal file or, perhaps gathering the direct-recording journal file of described each business module or the journal file after the process format conversion of described each business module with predetermined period or predetermined condition with predetermined period or predetermined condition through the journal file after the format conversion.Uploading submodule for these two kinds can accept or reject according to the business module type in the distributed system, when having disc system and no disc system all to exist, can use two kinds simultaneously and upload submodule, if and have only a kind of business module that disc system is arranged or do not have disc system, the single submodule of uploading then can only be set cooperate with it.
As shown in Figure 6, structural representation for the another embodiment of distributed system journal gathering system of the present invention, compare with preceding two embodiment, present embodiment has increased filling mining module 7 in operation maintenance center 2, can be in the process of the journal file that reports at the reception business module, and the monitoring daily record reports process, if detecting journal file reports disappearance or does not receive journal file, then write down this detection content, and give notice, initiate the filling mining request to this business module simultaneously.In addition, data volume when reducing collector journal, can in collection module, increase by the first compression submodule or the second compression submodule, the first compression submodule can be packed and compresses journal file, packaging file after directly will compressing by the FTP mode then uploads to designated equipment, and the difference of the second compression submodule and the first compression submodule is behind packing and compression journal file, be saved on the ftp server as a kind of download service, when the user needs journal file, can send download instruction to the second compression submodule by the man-machine language instruction, the packaging file after the second compression submodule can will compress by the FTP mode is sent to designated equipment.
Reporting of journal file or daily record data may appear in operation maintenance center 2 in receiving journal file or daily record data process interrupts or mistake, therefore needs to adopt filling mining module 7 to guarantee the integrality of data.
In above several system embodiments, in order to realize the recovery of the superfluous calamity of data, can also further in operation maintenance center, increase the Log backup module, according to predetermined period with journal file from operation maintenance center's full backup and/or incremental backup to the proprietary backup server, the mode of backup can adopt the full backup of longer cycle, perhaps more short-period incremental backup, this dual mode may be used alone, can also be used in combination.In operation maintenance center daily record is set accordingly and recovers module, when receiving the recovery instruction, the journal file that will meet some recovery time returns to operation maintenance center from the proprietary backup server.
In sum, the journal file that reports by operation maintenance center's maintenance service module in the embodiment of the invention, only when the user files a request, just the journal file that meets classification, time requirement is collected, therefore both can in system's running, not extract lot of data and influence systematic function, also can carry out the extraction of effective journal file to a great extent targetedly, thereby be convenient to the better problem analysis of user.
Should be noted that at last: above embodiment is only in order to illustrate that technical scheme of the present invention is not intended to limit; Although with reference to preferred embodiment the present invention is had been described in detail, those of ordinary skill in the field are to be understood that: still can make amendment or the part technical characterictic is equal to replacement the specific embodiment of the present invention; And not breaking away from the spirit of technical solution of the present invention, it all should be encompassed in the middle of the technical scheme scope that the present invention asks for protection.

Claims (21)

1, a kind of distributed system journal collecting method is characterized in that, may further comprise the steps:
Receive each business module reports with predetermined period or predetermined condition in the distributed system daily record data or journal file, perhaps gather the daily record data or the journal file of described each business module with predetermined period or predetermined condition;
Described daily record data or journal file gathered be new journal file, and new journal file is stored;
When reception comprised the log collection instruction of collection condition, the journal file that will meet described collection condition according to described log collection instruction was transferred to designated equipment.
2, distributed system journal collecting method according to claim 1, it is characterized in that, when business module is the business module of no disc system, described operation maintenance center receives the daily record data that the business module of described no disc system directly reports with predetermined period or predetermined condition, perhaps gathers the daily record data of described each business module with predetermined period or predetermined condition.
3, distributed system journal collecting method according to claim 2, it is characterized in that, operation maintenance center is in the process of the daily record data that the reception business module reports, the monitoring daily record reports process, if detecting daily record data reports disappearance or does not receive daily record data, then write down this detection content, and give notice, initiate the filling mining request to this business module simultaneously.
4, distributed system journal collecting method according to claim 3, it is characterized in that, after described business module receives described filling mining request, from the buffer queue of safeguarding at described no disc system, obtain corresponding daily record data and return to described operation maintenance center.
5, distributed system journal collecting method according to claim 4, it is characterized in that, when the buffer queue of safeguarding when described no disc system reaches predetermined buffer number, delete in the described buffer queue daily record data of time early, up to meeting predetermined buffer number.
6, distributed system journal collecting method according to claim 1, it is characterized in that, when business module is when the business module of disc system is arranged, the reception of described operation maintenance center is described to have the business module of disc system to report the direct-recording journal file of described business module with predetermined period or predetermined condition or through the journal file after the format conversion, perhaps gather the direct-recording journal file of described each business module or the journal file after the process format conversion with predetermined period or predetermined condition.
7, distributed system journal collecting method according to claim 6, it is characterized in that, operation maintenance center is in the process of the journal file that the reception business module reports, the monitoring daily record reports process, if detecting journal file reports disappearance or does not receive journal file, then write down this detection content, and give notice, initiate the filling mining request to this business module simultaneously.
8, distributed system journal collecting method according to claim 6, it is characterized in that, journal file exceeds scheduled time scope and/or predetermined volumes in described business module, then delete in the described business module journal file of time early, up to meeting scheduled time scope and/or predetermined volumes.
9, distributed system journal collecting method according to claim 1, it is characterized in that, when described collection condition was log category and/or time range, operation maintenance center was transferred to designated equipment according to the journal file that described log collection instruction will meet described log category and/or time range.
10, distributed system journal collecting method according to claim 1, it is characterized in that, before operation maintenance center receives the log collection instruction, remote computer or local computer send the log collection instruction according to the order of man-machine language order that receives or graphical interfaces triggering to described operation maintenance center.
11, distributed system journal collecting method according to claim 1, it is characterized in that, after operation maintenance center receives the log collection instruction that comprises collection condition, also comprise the operation of journal file being divided and collecting according to log category, be specially: operation maintenance center carries out functional according to log category to the stored log file or the relevance combination is collected based on the combination of log category with acquisition or full combination is collected.
12, distributed system journal collecting method according to claim 1, it is characterized in that, the described operation that journal file is transferred to designated equipment is specially: described journal file is packed and compressed, and the packaging file after will compressing by the FTP mode then uploads to designated equipment.
13, distributed system journal collecting method according to claim 1, it is characterized in that, the described operation that journal file is transferred to designated equipment is specially: described journal file is packed and is compressed to ftp server, when receiving the user instruction that indication downloads, the packaging file after will compressing by the FTP mode is sent to designated equipment.
14, according to the arbitrary described distributed system journal collecting method of claim 1-13, it is characterized in that, also comprise the operation of backup log, specifically comprise: according to predetermined period with journal file from operation maintenance center's full backup and/or incremental backup to the proprietary backup server;
When receiving the recovery instruction, the journal file that will meet some recovery time returns to operation maintenance center from the proprietary backup server.
15, a kind of distributed system journal gathering system is characterized in that, comprising:
Last transmission module, link to each other with each business module in the distributed system, be used for receiving daily record data or the journal file that each business module reports, perhaps gather the daily record data or the journal file of described each business module with predetermined period or predetermined condition with predetermined period or predetermined condition;
Operation maintenance center, link to each other with the described transmission module of going up, be used for daily record data gathered and be journal file, and journal file stored, when reception comprises the log collection instruction of collection condition, operation maintenance center is transferred to designated equipment according to the journal file that described log collection instruction will meet described collection condition, or the download service of journal file is provided.
16, distributed system journal gathering system according to claim 15 is characterized in that, described operation maintenance center comprises:
Summarizing module links to each other with the described transmission module of going up, and is used for described daily record data gathered being journal file;
Memory module links to each other with summarizing module with the described transmission module of going up, and is used for journal file is carried out centralized stores;
Collection module links to each other with described memory module, is used for instructing the journal file that will meet described collection condition to be transferred to designated equipment according to log collection, or the download service of journal file is provided.
17, distributed system journal gathering system according to claim 16 is characterized in that, the described transmission module of going up comprises:
No disc system is uploaded submodule, link to each other with summarizing module with the business module of no disc system in the distributed system, be used for receiving the daily record data that reports of described each business module, perhaps gather the daily record data of described each business module with predetermined period or predetermined condition with predetermined period or predetermined condition;
And/or there is disc system to upload submodule, link to each other with memory module with the business module that disc system is arranged in the distributed system, be used for receiving reporting direct-recording journal file or, perhaps gathering the direct-recording journal file of described each business module or the journal file after the process format conversion of described each business module with predetermined period or predetermined condition through the journal file after the format conversion with predetermined period or predetermined condition.
18, distributed system journal gathering system according to claim 16 is characterized in that operation maintenance center also comprises:
The filling mining module, link to each other with the described transmission module of going up, be used in the process that receives the journal file that business module reports, the monitoring daily record reports process, if detecting journal file reports disappearance or does not receive journal file, then write down this detection content, and give notice, initiate the filling mining request to this business module simultaneously.
19, distributed system journal gathering system according to claim 16, it is characterized in that, also comprise the first compression submodule in the collection module, be used for described journal file is packed and compressed that the packaging file after will compressing by the FTP mode then uploads to designated equipment.
20, distributed system journal gathering system according to claim 16, it is characterized in that, also comprise the second compression submodule in the collection module, be used for described journal file is packed and is compressed to ftp server, when receiving the user instruction that indication downloads, the packaging file after will compressing by the FTP mode is sent to designated equipment.
21, according to the arbitrary described distributed system journal gathering system of claim 15-20, it is characterized in that, operation maintenance center also comprises the Log backup module, is used for according to predetermined period journal file from operation maintenance center's full backup and/or incremental backup to the proprietary backup server;
Daily record recovers module, is used for when receiving the recovery instruction, and the journal file that will meet some recovery time returns to operation maintenance center from the proprietary backup server.
CNB200710064430XA 2007-03-15 2007-03-15 Distributed system journal collecting method and system Active CN100461710C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB200710064430XA CN100461710C (en) 2007-03-15 2007-03-15 Distributed system journal collecting method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB200710064430XA CN100461710C (en) 2007-03-15 2007-03-15 Distributed system journal collecting method and system

Publications (2)

Publication Number Publication Date
CN101043375A true CN101043375A (en) 2007-09-26
CN100461710C CN100461710C (en) 2009-02-11

Family

ID=38808606

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB200710064430XA Active CN100461710C (en) 2007-03-15 2007-03-15 Distributed system journal collecting method and system

Country Status (1)

Country Link
CN (1) CN100461710C (en)

Cited By (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101179436B (en) * 2007-11-23 2010-10-27 上海华为技术有限公司 Correlation method and device of implementing debug log
CN101534213B (en) * 2009-04-09 2011-02-02 成都市华为赛门铁克科技有限公司 Acquisition method of log and log server
CN102088376A (en) * 2010-12-31 2011-06-08 中国航空工业集团公司第六三一研究所 Communication monitoring system and method for integrated avionics system
CN102158748A (en) * 2010-05-14 2011-08-17 青岛海信传媒网络技术有限公司 Methods and systems for collecting and uploading logs
CN102208994A (en) * 2010-03-31 2011-10-05 株式会社理光 Log management system, and transmission system, and log management method
CN102541850A (en) * 2010-12-09 2012-07-04 北京北方微电子基地设备工艺研究中心有限责任公司 Methods and devices and systems for obtaining and uploading log records
CN102780726A (en) * 2011-05-13 2012-11-14 中兴通讯股份有限公司 Log analysis method and log analysis system based on WEB platform
CN102780777A (en) * 2012-07-19 2012-11-14 北京蓝汛通信技术有限责任公司 Log collecting method and log collecting system
WO2012159484A1 (en) * 2011-05-24 2012-11-29 中兴通讯股份有限公司 Log record management method and system
CN102970363A (en) * 2012-11-21 2013-03-13 用友软件股份有限公司 Long-distance journal downloading system and long-distance journal downloading method
CN103138964A (en) * 2011-11-25 2013-06-05 上海晨兴希姆通电子科技有限公司 Log information recording device and recording method thereof
CN103326896A (en) * 2013-06-07 2013-09-25 合一信息技术(北京)有限公司 System and method for collecting information data generated by a user on Internet
CN103377116A (en) * 2012-04-27 2013-10-30 国际商业机器公司 Method and device for recording and analyzing log in distributed information system
CN103473169A (en) * 2013-09-24 2013-12-25 北京京东尚科信息技术有限公司 Log file collection method and device
CN103475535A (en) * 2013-08-23 2013-12-25 汉柏科技有限公司 Log management system of cloud computing server
CN103763368A (en) * 2014-01-20 2014-04-30 浪潮电子信息产业股份有限公司 Cross-data-center data synchronism method
CN103927338A (en) * 2014-03-26 2014-07-16 网神信息技术(北京)股份有限公司 Log information storage processing method and log information storage processing device
CN103942210A (en) * 2013-01-21 2014-07-23 中国移动通信集团上海有限公司 Processing method, device and system of mass log information
CN104572475A (en) * 2015-01-30 2015-04-29 北京京东尚科信息技术有限公司 Method and device for checking source codes of programs
CN104572415A (en) * 2014-12-23 2015-04-29 国云科技股份有限公司 Event log recording method applicable to distributed system
CN104639393A (en) * 2015-01-07 2015-05-20 烽火通信科技股份有限公司 Passive optical network flow whole-network acquisition device and passive optical network flow whole-network acquisition method
CN104714880A (en) * 2012-09-25 2015-06-17 北京奇虎科技有限公司 Log data transmission method and system as well as log server
CN104883275A (en) * 2015-05-15 2015-09-02 烽火通信科技股份有限公司 Log cache method and system of communication device
CN105025090A (en) * 2015-06-24 2015-11-04 上海斐讯数据通信技术有限公司 Data transmission customization system and method
CN105071958A (en) * 2015-07-29 2015-11-18 上海斐讯数据通信技术有限公司 Server console log management system and method
CN105205167A (en) * 2015-10-10 2015-12-30 国网信息通信产业集团有限公司 Log data system
CN105278996A (en) * 2015-11-03 2016-01-27 亚信科技(南京)有限公司 Log collection method and device and log service system
CN105335145A (en) * 2014-08-06 2016-02-17 中兴通讯股份有限公司 Operation result processing method, device and system
CN105577445A (en) * 2015-12-30 2016-05-11 北京京东尚科信息技术有限公司 Method and device for collecting and reporting logs
CN105630869A (en) * 2015-12-15 2016-06-01 北京奇虎科技有限公司 Voice data storage method and device
CN105808414A (en) * 2016-03-08 2016-07-27 联想(北京)有限公司 Log processing method and log processing electronic equipment
CN106155875A (en) * 2016-06-29 2016-11-23 北京小米移动软件有限公司 A kind of method and apparatus of guiding system daily record
CN106341278A (en) * 2016-10-28 2017-01-18 广州华多网络科技有限公司 Log reporting method and device and terminal equipment
CN106802904A (en) * 2015-11-26 2017-06-06 北京国双科技有限公司 Log processing method, apparatus and system
CN106878093A (en) * 2017-03-31 2017-06-20 努比亚技术有限公司 One kind is without response log analytic method and terminal
CN106980572A (en) * 2016-01-19 2017-07-25 阿里巴巴集团控股有限公司 The on-line debugging method and system of distributed system
CN107305521A (en) * 2016-04-20 2017-10-31 百度在线网络技术(北京)有限公司 Log recording method and device
CN107423188A (en) * 2016-03-07 2017-12-01 阿里巴巴集团控股有限公司 Log processing method and equipment
CN107818039A (en) * 2016-09-13 2018-03-20 阿姆有限公司 The management of daily record data in electronic system
WO2020001138A1 (en) * 2018-06-29 2020-01-02 深圳市同泰怡信息技术有限公司 Server system log collection method
CN110968561A (en) * 2018-09-30 2020-04-07 北京国双科技有限公司 Log storage method and distributed system
CN111404960A (en) * 2020-03-26 2020-07-10 军事科学院系统工程研究院网络信息研究所 Attribute extraction method applied to heaven-earth integrated network access control system
CN112433873A (en) * 2020-10-31 2021-03-02 中国航空工业集团公司洛阳电光设备研究所 Embedded airborne recording equipment log recording and analyzing system
CN112783724A (en) * 2021-01-26 2021-05-11 上海商米科技集团股份有限公司 Log capture debugging method and system, intelligent device and storage medium
CN113190410A (en) * 2021-05-10 2021-07-30 芯讯通无线科技(上海)有限公司 Log collection method, system, client and storage medium
CN115277382A (en) * 2022-07-27 2022-11-01 腾讯音乐娱乐科技(深圳)有限公司 Log acquisition method, log platform and computer program product
CN115277382B (en) * 2022-07-27 2024-06-04 腾讯音乐娱乐科技(深圳)有限公司 Log acquisition method, log platform and computer program product

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1150717C (en) * 2001-06-21 2004-05-19 华为技术有限公司 Journal management system of integrated network manager
CN100375047C (en) * 2004-03-17 2008-03-12 联想(北京)有限公司 Management method for computer log
CN100518078C (en) * 2004-04-02 2009-07-22 鸿富锦精密工业(深圳)有限公司 Network daily-record data management system and method
JP2006107217A (en) * 2004-10-06 2006-04-20 Ricoh Co Ltd Image forming apparatus, log transfer method and log transfer system
CN100383750C (en) * 2006-06-07 2008-04-23 中国科学院计算技术研究所 High-reliable journal system realizing method facing to large-scale computing system

Cited By (66)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101179436B (en) * 2007-11-23 2010-10-27 上海华为技术有限公司 Correlation method and device of implementing debug log
CN101534213B (en) * 2009-04-09 2011-02-02 成都市华为赛门铁克科技有限公司 Acquisition method of log and log server
CN102208994A (en) * 2010-03-31 2011-10-05 株式会社理光 Log management system, and transmission system, and log management method
US9077621B2 (en) 2010-03-31 2015-07-07 Ricoh Company, Ltd. Apparatus, system, and method of log management, and recording medium storing log management program
CN102208994B (en) * 2010-03-31 2014-07-23 株式会社理光 Log management system, and transmission system, and log management method
CN102158748A (en) * 2010-05-14 2011-08-17 青岛海信传媒网络技术有限公司 Methods and systems for collecting and uploading logs
CN102541850A (en) * 2010-12-09 2012-07-04 北京北方微电子基地设备工艺研究中心有限责任公司 Methods and devices and systems for obtaining and uploading log records
CN102088376A (en) * 2010-12-31 2011-06-08 中国航空工业集团公司第六三一研究所 Communication monitoring system and method for integrated avionics system
CN102088376B (en) * 2010-12-31 2013-04-24 中国航空工业集团公司第六三一研究所 Communication monitoring system and method for integrated avionics system
WO2012155455A1 (en) * 2011-05-13 2012-11-22 中兴通讯股份有限公司 Log analysis method and system based on web platform
CN102780726A (en) * 2011-05-13 2012-11-14 中兴通讯股份有限公司 Log analysis method and log analysis system based on WEB platform
CN102780726B (en) * 2011-05-13 2016-12-07 国网山东省电力公司蒙阴县供电公司 A kind of log analysis method based on WEB platform and system
WO2012159484A1 (en) * 2011-05-24 2012-11-29 中兴通讯股份有限公司 Log record management method and system
CN103138964A (en) * 2011-11-25 2013-06-05 上海晨兴希姆通电子科技有限公司 Log information recording device and recording method thereof
CN103377116B (en) * 2012-04-27 2016-02-10 国际商业机器公司 For record in distributed information system and the method and apparatus analyzing daily record
CN103377116A (en) * 2012-04-27 2013-10-30 国际商业机器公司 Method and device for recording and analyzing log in distributed information system
CN102780777A (en) * 2012-07-19 2012-11-14 北京蓝汛通信技术有限责任公司 Log collecting method and log collecting system
CN102780777B (en) * 2012-07-19 2015-04-08 北京蓝汛通信技术有限责任公司 Log collecting method and log collecting system
CN104714880B (en) * 2012-09-25 2018-07-27 北京奇虎科技有限公司 Daily record data transmission method, system and log server
CN104714880A (en) * 2012-09-25 2015-06-17 北京奇虎科技有限公司 Log data transmission method and system as well as log server
CN102970363A (en) * 2012-11-21 2013-03-13 用友软件股份有限公司 Long-distance journal downloading system and long-distance journal downloading method
CN103942210A (en) * 2013-01-21 2014-07-23 中国移动通信集团上海有限公司 Processing method, device and system of mass log information
CN103326896A (en) * 2013-06-07 2013-09-25 合一信息技术(北京)有限公司 System and method for collecting information data generated by a user on Internet
CN103326896B (en) * 2013-06-07 2016-04-27 合一信息技术(北京)有限公司 The system and method for the information data that a kind of user of collection produces on the internet
CN103475535A (en) * 2013-08-23 2013-12-25 汉柏科技有限公司 Log management system of cloud computing server
CN103473169A (en) * 2013-09-24 2013-12-25 北京京东尚科信息技术有限公司 Log file collection method and device
CN103473169B (en) * 2013-09-24 2016-04-06 北京京东尚科信息技术有限公司 A kind of log file collection method and device
CN103763368B (en) * 2014-01-20 2016-07-06 浪潮电子信息产业股份有限公司 A kind of method of data synchronization across data center
CN103763368A (en) * 2014-01-20 2014-04-30 浪潮电子信息产业股份有限公司 Cross-data-center data synchronism method
CN103927338A (en) * 2014-03-26 2014-07-16 网神信息技术(北京)股份有限公司 Log information storage processing method and log information storage processing device
CN105335145A (en) * 2014-08-06 2016-02-17 中兴通讯股份有限公司 Operation result processing method, device and system
CN105335145B (en) * 2014-08-06 2019-06-25 中兴通讯股份有限公司 Operating result processing method, apparatus and system
CN104572415B (en) * 2014-12-23 2018-01-30 国云科技股份有限公司 A kind of transaction log record method suitable for distributed system
CN104572415A (en) * 2014-12-23 2015-04-29 国云科技股份有限公司 Event log recording method applicable to distributed system
CN104639393A (en) * 2015-01-07 2015-05-20 烽火通信科技股份有限公司 Passive optical network flow whole-network acquisition device and passive optical network flow whole-network acquisition method
CN104572475A (en) * 2015-01-30 2015-04-29 北京京东尚科信息技术有限公司 Method and device for checking source codes of programs
CN104883275A (en) * 2015-05-15 2015-09-02 烽火通信科技股份有限公司 Log cache method and system of communication device
CN105025090A (en) * 2015-06-24 2015-11-04 上海斐讯数据通信技术有限公司 Data transmission customization system and method
CN105025090B (en) * 2015-06-24 2018-05-01 上海斐讯数据通信技术有限公司 A kind of data transfer custom-built system and method
CN105071958A (en) * 2015-07-29 2015-11-18 上海斐讯数据通信技术有限公司 Server console log management system and method
CN105071958B (en) * 2015-07-29 2018-07-31 上海斐讯数据通信技术有限公司 A kind of server console Log Administration System and method
CN105205167A (en) * 2015-10-10 2015-12-30 国网信息通信产业集团有限公司 Log data system
CN105278996A (en) * 2015-11-03 2016-01-27 亚信科技(南京)有限公司 Log collection method and device and log service system
CN106802904A (en) * 2015-11-26 2017-06-06 北京国双科技有限公司 Log processing method, apparatus and system
CN105630869B (en) * 2015-12-15 2019-02-05 北京奇虎科技有限公司 A kind of storage method and device of voice data
CN105630869A (en) * 2015-12-15 2016-06-01 北京奇虎科技有限公司 Voice data storage method and device
CN105577445A (en) * 2015-12-30 2016-05-11 北京京东尚科信息技术有限公司 Method and device for collecting and reporting logs
CN106980572A (en) * 2016-01-19 2017-07-25 阿里巴巴集团控股有限公司 The on-line debugging method and system of distributed system
CN107423188B (en) * 2016-03-07 2021-05-07 阿里巴巴集团控股有限公司 Log processing method and device
CN107423188A (en) * 2016-03-07 2017-12-01 阿里巴巴集团控股有限公司 Log processing method and equipment
CN105808414A (en) * 2016-03-08 2016-07-27 联想(北京)有限公司 Log processing method and log processing electronic equipment
CN107305521A (en) * 2016-04-20 2017-10-31 百度在线网络技术(北京)有限公司 Log recording method and device
CN106155875A (en) * 2016-06-29 2016-11-23 北京小米移动软件有限公司 A kind of method and apparatus of guiding system daily record
CN107818039A (en) * 2016-09-13 2018-03-20 阿姆有限公司 The management of daily record data in electronic system
CN106341278A (en) * 2016-10-28 2017-01-18 广州华多网络科技有限公司 Log reporting method and device and terminal equipment
CN106878093A (en) * 2017-03-31 2017-06-20 努比亚技术有限公司 One kind is without response log analytic method and terminal
WO2020001138A1 (en) * 2018-06-29 2020-01-02 深圳市同泰怡信息技术有限公司 Server system log collection method
CN110968561A (en) * 2018-09-30 2020-04-07 北京国双科技有限公司 Log storage method and distributed system
CN110968561B (en) * 2018-09-30 2024-02-13 北京国双科技有限公司 Log storage method and distributed system
CN111404960A (en) * 2020-03-26 2020-07-10 军事科学院系统工程研究院网络信息研究所 Attribute extraction method applied to heaven-earth integrated network access control system
CN111404960B (en) * 2020-03-26 2022-02-25 军事科学院系统工程研究院网络信息研究所 Attribute extraction method applied to heaven-earth integrated network access control system
CN112433873A (en) * 2020-10-31 2021-03-02 中国航空工业集团公司洛阳电光设备研究所 Embedded airborne recording equipment log recording and analyzing system
CN112783724A (en) * 2021-01-26 2021-05-11 上海商米科技集团股份有限公司 Log capture debugging method and system, intelligent device and storage medium
CN113190410A (en) * 2021-05-10 2021-07-30 芯讯通无线科技(上海)有限公司 Log collection method, system, client and storage medium
CN115277382A (en) * 2022-07-27 2022-11-01 腾讯音乐娱乐科技(深圳)有限公司 Log acquisition method, log platform and computer program product
CN115277382B (en) * 2022-07-27 2024-06-04 腾讯音乐娱乐科技(深圳)有限公司 Log acquisition method, log platform and computer program product

Also Published As

Publication number Publication date
CN100461710C (en) 2009-02-11

Similar Documents

Publication Publication Date Title
CN101043375A (en) Distributed system journal collecting method and system
CN102799514B (en) Method and system for managing log records
CN101197621B (en) Method and system for remote diagnosing and locating failure of network management system
CN102780726A (en) Log analysis method and log analysis system based on WEB platform
CN111241050B (en) Linkage analysis system and method for big data platform
CN1992632A (en) Communication network warning method and warning system
CN114449018B (en) Automatic log file uploading method and system for power acquisition terminal
CN102820983A (en) Method for collecting system abnormality information, and manager
CN111092759A (en) Log management method, device and medium in JBOD (just in Bunch) out-of-band management system
CN104601374A (en) Network fault processing method and device for numerical control machine tool
CN112069049A (en) Data monitoring management method and device, server and readable storage medium
CN102984013B (en) Alarm analysis method for communication transmission network
CN114253806A (en) Access stratum log collection, analysis and early warning system
CN114610567A (en) Container monitoring method, network device and storage medium
CN200959133Y (en) Apparatus for phonetic record and telecommunication of locomotive
CN117453137A (en) Cloud intelligent operation and maintenance system data management system
WO2021258360A1 (en) On-board data storage method and system
KR20140013224A (en) Host management system
CN111625517B (en) New energy real-time data processing method and device based on change storage
CN116126935A (en) Distributed test data storage system and storage method
CN101541021B (en) Method for automatically generating capacity-warning reports
CN104021079A (en) Real-time monitoring and analyzing system and method for host system data
CN113886126A (en) Fault-tolerant server-based intelligent management and control system and method
CN1251085C (en) Method of monitoring machine group system operation procedure and monitoring management device
CN113539510A (en) Novel infectious disease discovery and management and control system based on intelligent contract

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant