CN103853743A - Distributed system and log query method thereof - Google Patents
Distributed system and log query method thereof Download PDFInfo
- Publication number
- CN103853743A CN103853743A CN201210501969.8A CN201210501969A CN103853743A CN 103853743 A CN103853743 A CN 103853743A CN 201210501969 A CN201210501969 A CN 201210501969A CN 103853743 A CN103853743 A CN 103853743A
- Authority
- CN
- China
- Prior art keywords
- log
- query
- daily record
- machine
- control module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2471—Distributed queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Probability & Statistics with Applications (AREA)
- Fuzzy Systems (AREA)
- Debugging And Monitoring (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a distributed system and a log query method thereof. The log query method comprises the steps that a control unit inputs predetermined keywords and time information as parameter values into a predetermined log query foot script template, generates a log query foot script and sends the generated log query foot script to a machine cluster, and a log query unit of a machine in the machine cluster queries a log in a storage unit according to the log query foot script and returns the found log to the control unit. According to the adopted technical scheme, real-time query of logs in machines can be realized.
Description
[technical field]
The present invention relates to the search technique in internet, applications field, relate in particular to a kind of distributed system and log inquiring method thereof.
[background technology]
At present, in large-scale distributed type assemblies, usually be deployed with up to a hundred machines, the size of the journal file of the program of every machine deploy is even more up to hundreds of G, in the time carrying out system debug and procedural problem analysis, O&M personnel need to input key word, check the journal file of program on machine.In prior art, on machine, the querying method of the journal file of program is: the journal file on every machine in clusters of machines is all copied in the storage system of building, set up search index again and inquire about for O&M personnel in storage system.
There is following problem in the inquiry mode of journal file at present:
1, need to build a storage system, and the journal file of magnanimity is set up to index, therefore inquire about cost higher.
2, the journal file on every machine in clusters of machines is all copied in the storage system of building and will take a large amount of transmission times, wasted a large amount of time resources and storage resources.
3, in storage system, when inquiry log, need to move Index Algorithm and carry out inquiry log, the journal file of Index Algorithm inquiry is many, and operation time is longer, often needs the time of several hours just can obtain Query Result, and therefore search efficiency is lower.
[summary of the invention]
The invention provides a kind of distributed system and log inquiring method thereof, can realize the real-time query of daily record in machine.
Concrete technical scheme of the present invention is as follows:
According to one preferred embodiment of the present invention, a kind of distributed system, comprising: control module and clusters of machines; Described clusters of machines comprises more than one machine, and described machine comprises log query unit and storage unit; Wherein,
Control module, for default key word and temporal information are input to default log query script template as parameter value, generates log query script and sends to clusters of machines;
Log query unit, at storage unit inquiry log, returns to control module by the daily record of finding for the described log query script of foundation.
In said system, this system also comprises:
Interactive unit, for receiving the key word of user input and the temporal information of daily record, and is carried at described key word and described temporal information in inquiry request, to send to control module.
In said system, described log query script template comprises following content: catalogue and the described temporal information of in the operation that in clusters of machines, machine is carried out, the filename prefix of preserving the file of Query Result, machine, preserving journal file.
In said system, log query unit specifically comprises in the time of inquiry log:
Described log query script is resolved, in the storage unit of machine, find the catalogue of preserving journal file according to resolving the parameter obtaining;
According to the title suffix of journal file, the journal file under the catalogue of described preservation journal file is classified;
In the journal file of each type, extract the journal file of corresponding temporal information according to temporal information;
According to the log query operation that needs to carry out, in the journal file extracting according to daily record corresponding to keyword query.
In said system, log query unit specifically comprises in the time that the daily record of finding is returned to control module:
Filename prefix according to the file of default preservation Query Result creates the file of preserving Query Result, be saved in the daily record inquiring as Query Result in the file of described preservation Query Result, the file of described preservation Query Result is reported to control module.
In said system,
Described control module, the daily record also reporting for receiving the log query unit of machine; When the default wait timeout time then after, Query Result is shown to user by interactive unit; Described Query Result comprises: the particular content of mark, daily record time, daily record classification and the daily record of machine.
A log inquiring method for distributed system, comprising:
Control module is input to default log query script template using default key word and temporal information as parameter value, generates log query script and sends to clusters of machines;
In clusters of machines, the log query unit of machine, according to described log query script inquiry log in storage unit, returns to control module by the daily record of finding.
In said method, the method also comprises:
Interactive unit receives the key word of user input and the temporal information of daily record, and described key word and described temporal information are carried at and in inquiry request, send to control module.
In said method, described log query script template comprises following content: catalogue and the described temporal information of in the operation that in clusters of machines, machine is carried out, the filename prefix of preserving the file of Query Result, machine, preserving journal file.
In said method, the method for log query unit inquiry log is:
Described log query script is resolved, in the storage unit of machine, find the catalogue of preserving journal file according to resolving the parameter obtaining;
According to the title suffix of journal file, the journal file under the catalogue of described preservation journal file is classified;
In the journal file of each type, extract the journal file of corresponding temporal information according to temporal information;
According to the log query operation that needs to carry out, in the journal file extracting according to daily record corresponding to keyword query.
In said method, the method that the daily record of finding is returned to control module by log query unit is:
Log query unit creates according to the filename prefix of the file of default preservation Query Result the file of preserving Query Result, be saved in the daily record inquiring as Query Result in the file of described preservation Query Result, the file of described preservation Query Result is reported to control module.
In said method, the method also comprises:
The daily record that the log query unit of control module reception machine reports;
The default wait timeout time then after, control module is shown to user by Query Result by interactive unit; Described Query Result comprises: the particular content of mark, daily record time, daily record classification and the daily record of machine.
As can be seen from the above technical solutions, technical scheme provided by the invention has following beneficial effect:
Control module adopts the concurrent control and management of multi-process to distributed clusters of machines, each machine is started to an independent process and complete mutual control, can realize real-time log query, make the deadline of daily record real-time query and the scale of clusters of machines of clusters of machines irrelevant, the no matter scale of clusters of machines, query time is all to depend on query time machine at most, thereby has good extendability.
[accompanying drawing explanation]
Fig. 1 is the structural representation that the present invention realizes the preferred embodiment of distributed system;
Fig. 2 is the schematic flow sheet that the present invention realizes the preferred embodiment of the log inquiring method of distributed system.
[embodiment]
Basic thought of the present invention is: control module is input to default log query script template using default key word and temporal information as parameter value, generates log query script and sends to clusters of machines; In clusters of machines, the log query unit of machine, according to described log query script inquiry log in storage unit, returns to control module by the daily record of finding.
In order to make the object, technical solutions and advantages of the present invention clearer, describe the present invention below in conjunction with the drawings and specific embodiments.
The invention provides a kind of distributed system, Fig. 1 is the structural representation that the present invention realizes the preferred embodiment of distributed system, and as shown in Figure 1, this distributed system comprises: interactive unit 10, control module 11 and clusters of machines; Clusters of machines comprises more than one machine, and machine further comprises log query unit 12 and storage unit 13.
Based on said system, the invention provides a kind of log inquiring method of distributed system, Fig. 2 is the schematic flow sheet that the present invention realizes the preferred embodiment of the log inquiring method of distributed system, as shown in Figure 2, the preferred embodiment comprises the following steps:
Step 201, interactive unit receives key word and the temporal information of user's input, and is transmitted to control module.
Concrete, interactive unit provides input frame and time option to user, and in order to receive user according to the key word of query demand input and to need the temporal information of the daily record of inquiry, this temporal information can comprise date and concrete period.
Interactive unit is carried at key word and temporal information in inquiry request, to send to control module; In practical application, described interactive unit can be web page, can input key word select time by this web page user, can also check the Query Result that key word is corresponding; Described web page can utilize hypertext pre-service language (PHP, PHP:Hypertext Preprocessor) to realize.
Here, in interactive unit, select the date and time section of the daily record that needs inquiry, can dwindle query context, reduce query time, improve webpage response speed.
Step 202, control module is input to default log query script template using key word and temporal information as parameter value, generates log query script and sends to clusters of machines.
Concrete, control module can adopt the control and management mechanism of multi-course concurrency, and more than one machine in clusters of machines is carried out to log query control and management; When from interactive unit is received inquiry request, from inquiry request, obtain key word and temporal information.
Default more than one script template in control module, as, log query script template, traffic statistics script template and Disk Cleanup script template etc.; In this preferred embodiment, be take log query as example, log query script template can be mcontrol (list, cmd, outfile, errfile, directory, time); Wherein the parameter value of list parameter is the mark of machine in clusters of machines, as machine name, domain name or IP address, control module can be from the hlist file of user preset the mark of each machine in read machine cluster; The parameter value of cmd parameter is the concrete operation of carrying out of machine in clusters of machines, in this preferred embodiment, the parameter value of cmd parameter represents inquiry log operation, cmd parameter is as concrete log query order, when directory parameter and time parameter can be carried out log query in log query unit as the input of this log query order; The parameter value of outfile parameter is the filename prefix of preserving the file of Query Result, the parameter value of errfile parameter is the prefix of preserving the filename of the file of error result, the parameter value of directory parameter is the catalogue of preserving journal file in machine, and the parameter value of time parameter is the temporal information that user inputs.
The key word of user's input is field, and control module carries out pre-service to this field; For example, judge that key word is illegal input or legal input; If key word is URL, judge that this URL is non-method network address or legal network address, or in the time that the length of URL is longer, URL is reduced to processing, delete the field such as " http ", "/" wherein.
Control module is input to log query script template using the mark of pretreated key word, the temporal information of receiving and machine as parameter value, generate log query script, other parameter values in log query script template are all fixed, can unify to arrange, it is variable only having these three parameter values; The log query script of generation is sent to machine corresponding with the mark of machine in log query script in clusters of machines by control module, realize log query script automatic distributing is deployed on each machine in distributed type assemblies, so, just can with clusters of machines in machine between set up multiple processes and link, to control machine starting log query task, realize in clusters of machines the concurrent query manipulation of daily record on machine; Described clusters of machines comprises more than one machine.
Step 203, the log query unit of machine, according to log query script inquiry log in storage unit, returns to control module by the daily record of finding.
Concrete, in clusters of machines, be deployed with the entity of the script executable operations issuing according to control module, this preferred embodiment is take log query as example, this entity is log query unit; On machine in clusters of machines, be also deployed with storage unit.
Log query unit is received after the log query script of control module transmission, this log query script is resolved, the parameter that parsing is obtained is as the input parameter of self, first determine that according to cmd parameter needing the operation of carrying out is log query operation, then in the storage unit of machine, find the catalogue of preserving journal file according to the parameter value of directory parameter, here, in storage unit, store the journal file of magnanimity, here only according to the catalogue of the preservation journal file configuring, can find fast the daily record that needs inquiry; , according to the title suffix of journal file, classifying to the journal file in the catalogue of the preservation journal file finding in log query unit, for example, is divided into constructed type, integrated type etc.; The time parameter that log query unit obtains according to parsing is extracted the journal file of date and time section in corresponding time parameter in the journal file of each type, in the journal file extracting according to resolving daily record corresponding to keyword query obtaining; Log query unit creates according to the parameter value of outfile parameter the file of preserving Query Result, is then saved in the daily record inquiring as Query Result in this file, and the file of preserving Query Result is reported to control module; Wherein, log query unit also can create the file of preserving error result according to the parameter value of errfile parameter, under normal circumstances, this file is empty, only has the just error message of meeting log inquiry of log query unit under abnormal conditions, as read journal file unsuccessfully etc., log query unit can report control module by abnormal conditions by the file of preserving error result.
In this preferred embodiment, in the process of log query unit inquiry log, the executing state of the process that control module is set up by monitoring and each machine, obtain and show whether the inquiry progress of log query unit on each machine, for example inquiry complete, inquire about whether occur abnormal etc.
Step 204, control module is shown to user by the daily record of finding by interactive unit.
Concrete, control module receives the file of the preservation Query Result that the log query unit of each machine reports, and after Query Result is gathered, is shown to user by interactive unit; The particular content of mark, daily record time, daily record classification and daily record that the Query Result after described gathering comprises machine.
Wherein, control module can also be saved in this locality by the Query Result of receiving simultaneously, and the Query Result of each machine can be stored in separately in a file.
Here, can in control module, configure the wait timeout time according to query demand in advance, even if exist the log query unit of machine not report the file of preserving Query Result within the wait timeout time, the Query Result that control module also reports in the log query unit of then rear line demonstration of wait timeout time other machines.
For realizing said method, as shown in Figure 1, in distributed system:
Log query unit 12, at storage unit 13 inquiry logs, returns to control module 11 by the daily record of finding for the described log query script of foundation.
Wherein, described log query script template comprises following content: catalogue and the described temporal information of in the operation that in clusters of machines, machine is carried out, the filename prefix of preserving the file of Query Result, machine, preserving journal file.
Wherein, log query unit 12 specifically comprises in the time of inquiry log:
Described log query script is resolved, in the storage unit of machine, find the catalogue of preserving journal file according to resolving the parameter obtaining;
According to the title suffix of journal file, the journal file under the catalogue of described preservation journal file is classified;
In the journal file of each type, extract the journal file of corresponding temporal information according to temporal information;
According to the log query operation that needs to carry out, in the journal file extracting according to daily record corresponding to keyword query.
Wherein, log query unit 12 specifically comprises in the time that the daily record of finding is returned to control module:
Filename prefix according to the file of default preservation Query Result creates the file of preserving Query Result, be saved in the daily record inquiring as Query Result in the file of described preservation Query Result, the file of described preservation Query Result is reported to control module.
Described control module 11, the daily record also reporting for receiving the log query unit 12 of machine; When the default wait timeout time then after, Query Result is shown to user by interactive unit 10; Described Query Result comprises: the particular content of mark, daily record time, daily record classification and the daily record of machine.
Technique scheme of the present invention has following useful technique effect:
1, control module adopts the concurrent control and management of multi-process to distributed clusters of machines, each machine is started to an independent process and complete mutual control, can realize real-time log query, make the deadline of daily record real-time query and the scale of clusters of machines of clusters of machines irrelevant, the no matter scale of clusters of machines, query time is all to depend on query time machine at most, thereby has good extendability.For example, for the clusters of machines with 30 machines, applying technical scheme of the present invention realizes after the inquiry of URL, the query time of wall scroll URL is 4s left and right, the process that in the past journal file was saved in to storage system and set up index just needs at least one hour, therefore, cannot meet the demand of real-time query.
2, distributed system can be applied to any distributed type assemblies, as the inquiry of alternative document, traffic statistics and Disk Cleanup etc., for different distributed systems, only need to carry out entity (as log query unit) to operation and upgrade.
3, do not need to create special storage system and set up index, therefore can save bandwidth resources and storage space, reducing inquiry cost, improving search efficiency.
4, control module can carry out flexible configuration to log query unit, to meet different query demands.
5, distributed system is simple in structure clear, is unified to control by control module, has higher feasibility.
The foregoing is only preferred embodiment of the present invention, in order to limit the present invention, within the spirit and principles in the present invention not all, any modification of making, be equal to replacement, improvement etc., within all should being included in the scope of protection of the invention.
Claims (12)
1. a distributed system, is characterized in that, this system comprises: control module and clusters of machines; Described clusters of machines comprises more than one machine, and described machine comprises log query unit and storage unit; Wherein,
Control module, for default key word and temporal information are input to default log query script template as parameter value, generates log query script and sends to clusters of machines;
Log query unit, at storage unit inquiry log, returns to control module by the daily record of finding for the described log query script of foundation.
2. system according to claim 1, is characterized in that, this system also comprises:
Interactive unit, for receiving the key word of user input and the temporal information of daily record, and is carried at described key word and described temporal information in inquiry request, to send to control module.
3. system according to claim 1, it is characterized in that, described log query script template comprises following content: catalogue and the described temporal information of in the operation that in clusters of machines, machine is carried out, the filename prefix of preserving the file of Query Result, machine, preserving journal file.
4. system according to claim 1, is characterized in that, log query unit specifically comprises in the time of inquiry log:
Described log query script is resolved, in the storage unit of machine, find the catalogue of preserving journal file according to resolving the parameter obtaining;
According to the title suffix of journal file, the journal file under the catalogue of described preservation journal file is classified;
In the journal file of each type, extract the journal file of corresponding temporal information according to temporal information;
According to the log query operation that needs to carry out, in the journal file extracting according to daily record corresponding to keyword query.
5. system according to claim 1, is characterized in that, log query unit specifically comprises in the time that the daily record of finding is returned to control module:
Filename prefix according to the file of default preservation Query Result creates the file of preserving Query Result, be saved in the daily record inquiring as Query Result in the file of described preservation Query Result, the file of described preservation Query Result is reported to control module.
6. system according to claim 1, is characterized in that,
Described control module, the daily record also reporting for receiving the log query unit of machine; When the default wait timeout time then after, Query Result is shown to user by interactive unit; Described Query Result comprises: the particular content of mark, daily record time, daily record classification and the daily record of machine.
7. a log inquiring method for distributed system, is characterized in that, the method comprises:
Control module is input to default log query script template using default key word and temporal information as parameter value, generates log query script and sends to clusters of machines;
In clusters of machines, the log query unit of machine, according to described log query script inquiry log in storage unit, returns to control module by the daily record of finding.
8. method according to claim 7, is characterized in that, the method also comprises:
Interactive unit receives the key word of user input and the temporal information of daily record, and described key word and described temporal information are carried at and in inquiry request, send to control module.
9. method according to claim 7, it is characterized in that, described log query script template comprises following content: catalogue and the described temporal information of in the operation that in clusters of machines, machine is carried out, the filename prefix of preserving the file of Query Result, machine, preserving journal file.
10. method according to claim 7, is characterized in that, the method for log query unit inquiry log is:
Described log query script is resolved, in the storage unit of machine, find the catalogue of preserving journal file according to resolving the parameter obtaining;
According to the title suffix of journal file, the journal file under the catalogue of described preservation journal file is classified;
In the journal file of each type, extract the journal file of corresponding temporal information according to temporal information;
According to the log query operation that needs to carry out, in the journal file extracting according to daily record corresponding to keyword query.
11. methods according to claim 7, is characterized in that, the method that the daily record of finding is returned to control module by log query unit is:
Log query unit creates according to the filename prefix of the file of default preservation Query Result the file of preserving Query Result, be saved in the daily record inquiring as Query Result in the file of described preservation Query Result, the file of described preservation Query Result is reported to control module.
12. methods according to claim 7, is characterized in that, the method also comprises:
The daily record that the log query unit of control module reception machine reports;
The default wait timeout time then after, control module is shown to user by Query Result by interactive unit; Described Query Result comprises: the particular content of mark, daily record time, daily record classification and the daily record of machine.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210501969.8A CN103853743A (en) | 2012-11-29 | 2012-11-29 | Distributed system and log query method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210501969.8A CN103853743A (en) | 2012-11-29 | 2012-11-29 | Distributed system and log query method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103853743A true CN103853743A (en) | 2014-06-11 |
Family
ID=50861410
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210501969.8A Pending CN103853743A (en) | 2012-11-29 | 2012-11-29 | Distributed system and log query method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103853743A (en) |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105099764A (en) * | 2015-06-29 | 2015-11-25 | 百度在线网络技术（北京）有限公司 | Log processing method and log processing device |
| CN105117411A (en) * | 2015-07-29 | 2015-12-02 | 上海斐讯数据通信技术有限公司 | Server log file management system and method |
| CN105740348A (en) * | 2016-01-25 | 2016-07-06 | 武汉精伦电气有限公司 | Key log information extraction method and system based on distributed terminal system |
| CN105824958A (en) * | 2016-03-31 | 2016-08-03 | 广州华多网络科技有限公司 | Method, device and system for inquiring log |
| CN105897834A (en) * | 2015-12-04 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | Hive client, Hive server and Hive execution log remote monitoring system and method |
| CN106227727A (en) * | 2016-06-30 | 2016-12-14 | 乐视控股（北京）有限公司 | Daily record update method, device and the system of a kind of distributed system |
| CN106682868A (en) * | 2015-11-10 | 2017-05-17 | 北京计算机技术及应用研究所 | Online data extracting device and method for office automation equipment storage component |
| CN106908258A (en) * | 2015-12-23 | 2017-06-30 | 阿里巴巴集团控股有限公司 | The method and device of performance test |
| CN107465549A (en) * | 2017-08-18 | 2017-12-12 | 北京奇艺世纪科技有限公司 | A kind of distributed message processing method and system |
| CN107644017A (en) * | 2016-07-20 | 2018-01-30 | 平安科技（深圳）有限公司 | The querying method and device of journal file |
| WO2018035799A1 (en) * | 2016-08-25 | 2018-03-01 | 阿里巴巴集团控股有限公司 | Data query method, application and database servers, middleware, and system |
| CN107784050A (en) * | 2016-12-14 | 2018-03-09 | 平安科技（深圳）有限公司 | Log information lookup method and device |
| CN107943591A (en) * | 2017-12-05 | 2018-04-20 | 郑州云海信息技术有限公司 | A kind of method of more host processes management based on linux |
| CN108427705A (en) * | 2018-01-17 | 2018-08-21 | 平安科技（深圳）有限公司 | Electronic device, distributed system journal querying method and storage medium |
| CN108737467A (en) * | 2017-04-19 | 2018-11-02 | 腾讯科技（深圳）有限公司 | A kind of server log inspection method, device and system |
| CN109885548A (en) * | 2019-02-22 | 2019-06-14 | 网易（杭州）网络有限公司 | Log inquiring method, device, storage medium and electronic device |
| CN112463738A (en) * | 2020-11-20 | 2021-03-09 | 中国建设银行股份有限公司 | Log retrieval method, system, computer device and storage medium |
| CN112579009A (en) * | 2019-09-30 | 2021-03-30 | 北京国双科技有限公司 | Error log printing method and device, storage medium and electronic equipment |
| CN113590372A (en) * | 2021-08-10 | 2021-11-02 | 平安普惠企业管理有限公司 | Log-based link tracking method and device, computer equipment and storage medium |
| CN113765694A (en) * | 2021-03-24 | 2021-12-07 | 北京京东拓先科技有限公司 | Log information display method and device, electronic equipment and computer readable medium |
| WO2023123397A1 (en) * | 2021-12-31 | 2023-07-06 | 深圳晶泰科技有限公司 | Multi-cloud log processing method, storage method, and computer storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101582087A (en) * | 2009-06-16 | 2009-11-18 | 恒生电子股份有限公司 | Log extracting method and device |
| US20100228784A1 (en) * | 2009-02-23 | 2010-09-09 | Iron Mountain Incorporated | Methods and Systems for Single Instance Storage of Asset Parts |
| CN101902505A (en) * | 2009-05-31 | 2010-12-01 | 中国科学院计算机网络信息中心 | Distributed DNS inquiry log real-time statistic device and method thereof |
| US20110179013A1 (en) * | 2010-01-21 | 2011-07-21 | Microsoft Corporation | Search Log Online Analytic Processing |
| US20120197928A1 (en) * | 2011-01-31 | 2012-08-02 | Splunk Inc. | Real time searching and reporting |
-
2012
- 2012-11-29 CN CN201210501969.8A patent/CN103853743A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100228784A1 (en) * | 2009-02-23 | 2010-09-09 | Iron Mountain Incorporated | Methods and Systems for Single Instance Storage of Asset Parts |
| CN101902505A (en) * | 2009-05-31 | 2010-12-01 | 中国科学院计算机网络信息中心 | Distributed DNS inquiry log real-time statistic device and method thereof |
| CN101582087A (en) * | 2009-06-16 | 2009-11-18 | 恒生电子股份有限公司 | Log extracting method and device |
| US20110179013A1 (en) * | 2010-01-21 | 2011-07-21 | Microsoft Corporation | Search Log Online Analytic Processing |
| US20120197928A1 (en) * | 2011-01-31 | 2012-08-02 | Splunk Inc. | Real time searching and reporting |
Cited By (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105099764A (en) * | 2015-06-29 | 2015-11-25 | 百度在线网络技术（北京）有限公司 | Log processing method and log processing device |
| CN105099764B (en) * | 2015-06-29 | 2019-01-18 | 北京音之邦文化科技有限公司 | Log processing method and device |
| CN105117411A (en) * | 2015-07-29 | 2015-12-02 | 上海斐讯数据通信技术有限公司 | Server log file management system and method |
| CN106682868B (en) * | 2015-11-10 | 2021-01-08 | 北京计算机技术及应用研究所 | On-line data extraction device and method for office automation equipment storage component |
| CN106682868A (en) * | 2015-11-10 | 2017-05-17 | 北京计算机技术及应用研究所 | Online data extracting device and method for office automation equipment storage component |
| CN105897834A (en) * | 2015-12-04 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | Hive client, Hive server and Hive execution log remote monitoring system and method |
| CN106908258A (en) * | 2015-12-23 | 2017-06-30 | 阿里巴巴集团控股有限公司 | The method and device of performance test |
| CN105740348A (en) * | 2016-01-25 | 2016-07-06 | 武汉精伦电气有限公司 | Key log information extraction method and system based on distributed terminal system |
| CN105824958A (en) * | 2016-03-31 | 2016-08-03 | 广州华多网络科技有限公司 | Method, device and system for inquiring log |
| CN105824958B (en) * | 2016-03-31 | 2019-06-18 | 广州华多网络科技有限公司 | A kind of methods, devices and systems of inquiry log |
| CN106227727A (en) * | 2016-06-30 | 2016-12-14 | 乐视控股（北京）有限公司 | Daily record update method, device and the system of a kind of distributed system |
| CN107644017A (en) * | 2016-07-20 | 2018-01-30 | 平安科技（深圳）有限公司 | The querying method and device of journal file |
| WO2018035799A1 (en) * | 2016-08-25 | 2018-03-01 | 阿里巴巴集团控股有限公司 | Data query method, application and database servers, middleware, and system |
| CN107784050A (en) * | 2016-12-14 | 2018-03-09 | 平安科技（深圳）有限公司 | Log information lookup method and device |
| CN108737467A (en) * | 2017-04-19 | 2018-11-02 | 腾讯科技（深圳）有限公司 | A kind of server log inspection method, device and system |
| CN108737467B (en) * | 2017-04-19 | 2021-03-26 | 腾讯科技（深圳）有限公司 | Server log viewing method, device and system |
| CN107465549A (en) * | 2017-08-18 | 2017-12-12 | 北京奇艺世纪科技有限公司 | A kind of distributed message processing method and system |
| CN107465549B (en) * | 2017-08-18 | 2021-03-02 | 北京奇艺世纪科技有限公司 | Distributed message processing method and system |
| CN107943591A (en) * | 2017-12-05 | 2018-04-20 | 郑州云海信息技术有限公司 | A kind of method of more host processes management based on linux |
| CN108427705B (en) * | 2018-01-17 | 2022-04-12 | 平安科技（深圳）有限公司 | Electronic device, distributed system log query method and storage medium |
| WO2019140828A1 (en) * | 2018-01-17 | 2019-07-25 | 平安科技（深圳）有限公司 | Electronic apparatus, method for querying logs in distributed system, and storage medium |
| CN108427705A (en) * | 2018-01-17 | 2018-08-21 | 平安科技（深圳）有限公司 | Electronic device, distributed system journal querying method and storage medium |
| CN109885548A (en) * | 2019-02-22 | 2019-06-14 | 网易（杭州）网络有限公司 | Log inquiring method, device, storage medium and electronic device |
| CN112579009A (en) * | 2019-09-30 | 2021-03-30 | 北京国双科技有限公司 | Error log printing method and device, storage medium and electronic equipment |
| CN112463738A (en) * | 2020-11-20 | 2021-03-09 | 中国建设银行股份有限公司 | Log retrieval method, system, computer device and storage medium |
| CN113765694A (en) * | 2021-03-24 | 2021-12-07 | 北京京东拓先科技有限公司 | Log information display method and device, electronic equipment and computer readable medium |
| CN113765694B (en) * | 2021-03-24 | 2024-04-19 | 北京京东拓先科技有限公司 | Log information display method, device, electronic equipment and computer readable medium |
| CN113590372A (en) * | 2021-08-10 | 2021-11-02 | 平安普惠企业管理有限公司 | Log-based link tracking method and device, computer equipment and storage medium |
| WO2023123397A1 (en) * | 2021-12-31 | 2023-07-06 | 深圳晶泰科技有限公司 | Multi-cloud log processing method, storage method, and computer storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103853743A (en) | Distributed system and log query method thereof | |
| US20130282737A1 (en) | Method and apparatus for intelligently deploying an application, method and apparatus for processing application access, system for intelligently deploying and scheduling an application | |
| CN101098248B (en) | Method and system for implementing universal network management based on configuration describing document | |
| CN101651707A (en) | Method for automatically acquiring user behavior log of network | |
| CN102663062A (en) | Method and device for processing invalid links in search result | |
| CN102446222A (en) | Method, device and system of webpage content preloading | |
| CN102098229B (en) | Method and device for optimizing and auditing uniform resource locator (URL) as well as network device | |
| CN103617287A (en) | Log management method and device in distributed environment | |
| CN106789377B (en) | Service parameter updating method of network element cluster | |
| CN101799751A (en) | Method for building monitoring agent software of host machine | |
| CN101046806B (en) | Search engine system and method | |
| CN101945013A (en) | System and method for implementing server configuration management | |
| CN102480510B (en) | The implementation method of C/S and B/S mixed architecture and device | |
| CN103297275A (en) | Dynamic discovery and loading system and method for Web network management client module | |
| CN107766509B (en) | Method and device for static backup of webpage | |
| CN103312544A (en) | Method, equipment and system for controlling terminals during log file reporting | |
| CN102663049B (en) | A kind of renewal search engine URL library method and device | |
| CN105045905A (en) | Log maintenance method and system based on full-text retrieval | |
| CN109634753B (en) | Data processing method, device, terminal and storage medium for switching browser kernels | |
| CN101355590A (en) | Method, system and apparatus for prompting download | |
| CN100534084C (en) | Long-distance XML data updating method and system | |
| CN103440302B (en) | The method and system of Real Data Exchangs | |
| CN109766488B (en) | Data acquisition method based on Scapy | |
| CN1975726A (en) | Data center server, data service system and data query method | |
| Anbukodi et al. | Reducing web crawler overhead using mobile crawler |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140611 |