CN103678092B - log analysis method and system - Google Patents
log analysis method and system Download PDFInfo
- Publication number
- CN103678092B CN103678092B CN201310743923.1A CN201310743923A CN103678092B CN 103678092 B CN103678092 B CN 103678092B CN 201310743923 A CN201310743923 A CN 201310743923A CN 103678092 B CN103678092 B CN 103678092B
- Authority
- CN
- China
- Prior art keywords
- analysis
- data
- processing unit
- data processing
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention relates to a log analysis method and system. The log analysis method includes the following steps that a data processing unit receives a user request sent by a client end; the data processing unit processes the user request as a task message and sends the task message to a data analysis unit; the data analysis unit carries out log analysis according to the received task message, generates an analysis result and sends the analysis result to the data processing unit; the data processing unit processes the analysis result as a reply message and sends the reply message to the client end. According to the log analysis method and system, real-time performance is achieved, log information analysis can be carried out on original data at any dimensionalities, and the requirements of users for multidimensional data query can be met.
Description
Technical field
The present invention relates to computer realm, more particularly, to a kind of log analysis method and system.
Background technology
Developing rapidly with computer technology, data volume increases sharply, and the accumulation of data is also increasing, and this also just anticipates
Taste the mass data epoch and has been arrived.In transmission, exchange and the processing procedure carrying out data, safety be one very heavy
The factor wanted, therefore, many equipment related to information processing are (as fire wall, system for monitoring intrusion, router server
Deng) all can produce daily record.The daily various things occurring on log recording equipment and on network, we can pass through
The methods such as the inquiry of daily record, statistics are understood with the situation of each equipment and whole network.
However, in the face of the daily record data of magnanimity, how faster could more accurately counting, analyzing the information wanting to obtain
Have become as we will faced by a difficult problem.For this reason, ariel rabkin of princeton university et al. proposes
A kind of " distributed data analyzing method ", log data will be carried out the gathering of early stage, collects, puts in storage, analyzing, thus
Reduce data scale, thus having reached the requirement of " real-time ".But, in existing log analysis technology, major part all with
Premised on " daily record data concentrates storage ", and log analysis do not have real-time；Especially in the environment of wide area network, due to
When " log information transmission " and analysis, " each equipment information interaction " more can lead to real-time to be remarkably decreased.And prior art
In, not only increased the transmission scale of data when data early stage collects, and paid " the other dimension data information of loss "
Cost it is impossible to meet the demand of multidimensional data query；And prior art also has that high cost, efficiency are low and time-consuming etc. to be lacked
Point.
Content of the invention
The purpose of the present invention is for the problems referred to above, there is provided a kind of have efficiency high, real-time log analysis side
Method and system.
For achieving the above object, the invention provides a kind of log analysis method, comprise the following steps:
Data processing unit receives the user's request that client sends；
Described user's request is processed as mission bit stream by described data processing unit, and described mission bit stream is sent to institute
State data analysis unit；
Described data analysis unit carries out log analysis according to the described mission bit stream receiving and generates analysis result, and will
Described analysis result is sent to data processing unit；
Described data processing unit is processed as return information to described analysis result, and described return information is sent to institute
State client.
Preferably, described user's request is processed as mission bit stream and specifically includes by described data processing unit:
Described user's request is converted to data call parameters by data processing unit, and described call parameters are generated task-set
Close, and corresponding for described set of tasks mission bit stream is sent to data analysis unit.
Preferably, described user's request is processed as mission bit stream and specifically also includes by described data processing unit:
Judge whether described set of tasks is stored in local cache；
If described set of tasks is stored in the middle of local cache, by described set of tasks in local Cache associativity extremely
This task；If described set of tasks is not stored in the middle of local cache, the corresponding mission bit stream of described set of tasks is sent out
Give described data analysis unit.
Preferably, described user's request is processed as mission bit stream and specifically also includes by described data processing unit:
Judge whether described user's request is converted to data call parameters；
If described user's request is converted to data call parameters, directly return；If described user's request does not turn
It is changed to data call parameters, then user's request is not converted into data call parameters, and monitor in real time basis in monitoring period
The execution state of secondary log analysis.
Preferably, described in monitoring period the execution state of this log analysis of monitor in real time specifically include:
If in described monitoring period, analysis result is sent to described data processing list by described data analysis unit
Unit, then described data processing unit current state is updated to complete；
If in described monitoring period, error message is sent to several data processing lists by described data analysis unit
Unit, then described data processing unit current state is updated to failure, error message described in described data processing unit record；
If in described monitoring period, described data analysis unit does not send information to described data processing unit,
Then current state is updated to time-out by described data processing unit, and time-out described in described data processing unit record.
Preferably, described analysis result is processed as described return information and specifically includes by described data processing single pair of:
Described data processing unit receives the described analysis result that described data analysis unit sends, described data processing list
Unit carries out secondary Macro or mass analysis to described analysis result, and the result treatment of described secondary Macro or mass analysis is return information.
A kind of Log Analysis System, described system includes:
Data processing unit, for the collection of user's request, analysis, described user's request is converted to mission bit stream, and
And the analysis result that receiving data analytic unit sends, described analysis result is sent to client；
Data analysis unit, for receiving the mission bit stream that described data processing unit sends, according to described mission bit stream
Daily record data is analyzed and generates with described analysis result, and described analysis result is sent to described data processing unit.
Preferably, described data processing unit includes: data access interface, data collection scheduler module,
Data analysis module, the first memory module, the second memory module, data collection module；
Described data access interface, for receiving described user's request, user's request is converted to described collection and dispatches mould
The call parameters of block data analysis module, and receive the analysis result of institute's data analysis module；
Described data collection scheduler module, receives the call parameters of described data access interface, will visit from described data
Ask that the call parameters of interface are converted to set of tasks, and issue all tasks in task-set, turning for described user's request
Change, monitor, the initialization of environment and cleaning；
Described data analysis module, carries out Macro or mass analysis to the cohersive and integrated data in described second memory module, and will collect
The result of data analysiss is sent to described data access interface, for carrying out two to all data in described data processing unit
Secondary Macro or mass analysis；
Described data collection module, receives the task that described data collection scheduler module issues, by under described mission bit stream
Issue described data analysis module, and receive the analysis result of described data analysis module, issuing and data for task
Collect；
Described first memory module, the described task-set for receiving described data collection calling module merges storage；
Described second memory module, the analysis result for sending to described data analysis module stores.
The present invention has the benefit that the log analysis method of the present invention and system have real-time, can be to former
Beginning data carries out log information analysis in any dimension, disclosure satisfy that the demand of user's multidimensional data query.
Brief description
Fig. 1 is the theory diagram of one embodiment of the invention；
Fig. 2 is the flow chart of log analysis method in the embodiment of the present invention；
Fig. 3 is the schematic diagram of Log Analysis System deployment in one embodiment of the invention;
Fig. 4 is the system principle schematic diagram in Fig. 1 of the present invention.
Specific embodiment
Below by drawings and Examples, technical scheme is described in further detail.
Fig. 1 is the theory diagram of one embodiment of the invention.
As shown in figure 1, using this law in an embodiment of log analysis, user sends user by client 100 please
Ask 11, user's request 11 is sent to data processing unit 200 by client 100.In the present embodiment, user's request 11 can be
The statistics (as server ip address, flow etc.) of the accurate inquiry of daily record or data, can also be that user's is self-defined
Inquiry, the needs according to user carry out the inquiry of full dimension.Above user's request 11 includes but is not limited to this.
In FIG, data processing phrase 200 receives client 100 user's request 11, and data processing unit 200 can will be used
Family request 11 such as is changed, stored and is analyzed at the operation, makes user's request 11 be processed as mission bit stream 12 and is sent to data analysiss
Unit 300.Data analysis unit 300 is analyzed to local daily record data according to the mission bit stream 12 receiving, and by day
Will analyzes and processes and is sent to data processing unit 200 for analysis result 13.Data processing unit 200 is according to receiving from data
The analysis result 13 that analytic unit 300 sends is processed, and analysis result 300 is processed as return information 14 is sent to client
End 100.User returns return information 14 by client 100 and obtains data message to be inquired about.
Fig. 2 is the flow chart of one embodiment of the invention.
As shown in Fig. 2 in step 401, data processing unit 200 receives the user's request 11 that client 100 sends.With
Required information is sent to data processing unit by client 100 in the form of user's request 11 by family.The request letter of user
Breath can be various, and as described above, here is omitted.
In fig. 2, user's request 11 is processed as mission bit stream 12 for data processing unit 200 by step 402, and by task
Information 12 is sent to described data analysis unit 300.
When data processing unit 200 receives after the user's request 11 that client 100 sends, data processing unit
200 first determine whether and analyze user's request result to whether there is in the middle of local cache, if data processing unit 200 finds
User's request result Already in the middle of local cache, then directly returns.If data processing unit 200 is through discriminatory analysis
This user's request result does not exist in the middle of local cache, then user's request 11 is converted to and calls ginseng by data processing unit 200
Number, and t analysis time is set, the execution state of this analysis of monitor in real time in time t.
If in monitoring period t, data processing unit 200 receives the analysis sending from data analysis unit 300
As a result 13, then data processing 200 unit current state is updated to complete.
If in monitoring period t, data processing unit 200 receives the mistake sending from data analysis unit 300
Information, then data processing unit 200 current state is updated to failure, and data processing unit 200 misregistration information.
If in monitoring period t, data processing unit 200 is not received by from data analysis unit 300 transmission
Analysis result 13, then data processing unit current state is updated to time-out, and data processing unit record timeout mode.
Call parameters are converted to set of tasks by data processing unit 200, and store tasks set.When a user please
When asking 11 to be sent to data processing unit 200, the task that data processing unit 200 finally can be converted to this user's request 11
Set carries out discriminatory analysis, and when this set of tasks is stored in the middle of local cache, data processing unit 200 is then by task-set
Conjunction is associated with the middle of this subtask；If data processing unit 200 does not find this set of tasks at this through discriminatory analysis
Store in ground caching, then this set of tasks is sent to data analysiss in the form of mission bit stream 12 by data processing unit 200
Unit 300.
In step 403, data analysis unit 300 carries out log analysis generation according to the described mission bit stream 12 receiving
Analysis result 13, and analysis result 13 is sent to data processing unit 200.
In step 404, data processing unit 200 is processed as return information 14 to analysis result 13, and by return information
14 are sent to client 100.Data processing unit 200 receives the analysis result 13 sending from data analysis unit 300, and right
Analysis result 13 carries out secondary Macro or mass analysis.The result of secondary Macro or mass analysis is stored and processed as replying letter by data processing unit
Breath 14 is sent to client 100.
It is the schematic diagram of Log Analysis System deployment in one embodiment of the invention as shown in Figure 3, the embodiment of the present invention is Sino-Japan
The system preferred distribution formula storage of will analysis, data processing unit 200 is deployed in data center server 310, data analysiss list
Unit 300 is deployed in the log server 320 in wide area network, and the log information on each equipment is stored in the log services in network
Device 320.Data analysis unit 300 can carry out early stage to the log data being stored on log server in wide area network
The process such as assemble, collect, put in storage and analyze, the scale of daily record data can be reduced, the effect of real-time can be reached.
Above-mentioned steps be log analysis method of the present invention preferred steps, concrete protection domain with claims be according to
According to.Wherein, step 404 and step 403 are not necessarily the ordering relation of " successively ", that is, when data analysis unit 300 returning part
During analysis result 13, step 404 can also execute, and can execute repeatedly in once " analysis process ", to meet user
The real-time demand of data query.
Fig. 4 is the systematic schematic diagram of an embodiment in Fig. 1 of the present invention.
As shown in figure 4, data processing unit 200 includes:
Data access interface 201, connects client 100, data collection scheduler module 202 data analysis module 203.Number
Accept the user's request 11 from client according to access interface 201, and user's request 11 is resolved to collection request, for logarithm
Call according to collecting scheduler module 202 data analysis module, and for return information 14 is returned to client 100.
Data collection scheduler module 202, connects data access interface, the first memory module and data collection module 204, its
The collection request sending for receiving data access interface 201, and request task is carried out changing, monitors, and for ring
The initialization in border and cleaning.The collection that data collection scheduler module 202 receiving data access interface 201 sends is asked and will be collected
Request is converted into a series of mission bit streams that can execute on different devices, and mission bit stream is converted to set of tasks storage
In the first memory module 205.
Data analysis module 203, connects data access interface 201 and the second memory module, and it is used for data center is taken
All data of business device 310 carry out secondary Macro or mass analysis.
Data collection module 204, connect data access interface 201, the first memory module 205, the second memory module 506 and
Data analysis unit 300, it is used for issuing and data collection of set of tasks.Data collection module 204 manages each equipment
Connect, and record the contextual information being connected with each equipment, and data collection module 204 is right by each in set of tasks
The mission bit stream answered is issued in the middle of corresponding equipment.Data collection module 204 is also used for sending data analysis unit 300
Analysis result 13 is sent to the second memory module.
First memory module 205, connects data collection scheduler module 202 data collection module 204, for data storage
Collect the set of tasks that scheduler module 202 generates.
Second memory module 206, connects data collection scheduler module 202, data analysis module 203 data collection module
204, it is used for the data that data storage analytic unit 300 sends, and the second memory module can be used for data collection scheduling mould
Block 202 creates the temporary data structure that log analysis use.The analysis result that data storage receiving data collection module 204 sends
13 and stored.
As shown in Fig. 4 and description of the invention other accompanying drawing, the operation principle of the present invention is as follows:
The information (as information such as the accurate inquiry of daily record, statistical information and self-defined inquiries) needing inquiry is passed through by user
Client 100 inputs, and client 100 is sent to number by receiving from the Query Information of user and be converted into user's request 11
According to access interface 201, the user's request receiving 11 is resolved to collection request by data access interface 201, for receiving to data
Collection scheduler module 202 data analysis module is called.Data access interface 201 is analyzed first and is judged whether user's request 11 stores
In the middle of local cache, if user's request 11 is present in the middle of local cache, then data access interface 201 can directly return
Return；If user's request 11 do not exist with local cache in the middle of, data access interface 201, user's request 11 is converted to collection
Request, both call parameters of data collection scheduler module 202 data analysis module 203.Data access interface 201 calls first
Data collection scheduler module 202, and monitoring period t is set.If in monitoring period t, data processing unit 200 receives
From data analysis unit 300 send analysis result 13, then data processing 200 unit current state is updated to complete.As
In monitoring period t, data processing unit 200 receives the error message sending from data analysis unit 300, then data to fruit
Current state is updated to failure by processing unit 200, and data processing unit 200 misregistration information.If in monitoring
Between in t, data processing unit 200 is not received by the analysis result 13 sending from data analysis unit 300, then data processing
Current state is updated to time-out by unit, and data processing unit record timeout mode.
Data access interface 201 monitors the execution state of this log analysis in monitoring period.Data collection dispatches mould
The collection that block 202 receiving data access interface 201 sends is asked and is converted into collecting request and can execute on different devices
A series of mission bit streams, and mission bit stream be converted to set of tasks be stored in the first memory module 205.Data collection module
204 judge whether each mission bit stream in set of tasks has been buffered in the middle of the second memory module, if set of tasks
In each mission bit stream be buffered in the middle of the second memory module, then this task requests is associated with this task；Otherwise,
If the mission bit stream in set of tasks is not buffered in the middle of the second memory module, then data collection module is then by task-set
In conjunction, corresponding mission bit stream is sent to data analysis unit 300.
Data analysis unit 300 is deployed in log server 320, and log server 320 is assembled by data analysis unit 300
To equipment on log information carry out data analysiss, and by mission bit stream carry out log analysis generate analysis result 13, data
Analysis result is sent to data collection module 204 by analytic unit 300.When carrying out first client transmission user's request 11,
This corresponding script module of user's request 11 can be sent to the log server 320 of correlation by data processing unit 200.Wherein,
The parsing of user's request 11 is to be internal representation structure by user's request 11 character string parsing, and according to log server 320
Classification, respectively generates a mission bit stream for related log server 320, forms set of tasks.
The analysis result that data collection module 204 receiving data analytic unit 300 sends, data collection module 204 ought
Front task status is updated to complete, and analysis result 13 is stored in the middle of the second memory module 206.Data analysis module
203 pairs of cohersive and integrated data being stored in the middle of the second memory module 206 are analyzed, and the result of analysis is sent to data access
Interface 201, the result treatment of analysis is sent to client 100 for return information by data access interface 201.
In sum, can be used for realizing in the log information of magnanimity using the log analysis method and system of the present invention
In real time information needed is inquired about, have the advantages that in real time, quickly and efficiently.
Professional should further appreciate that, each example describing in conjunction with the embodiments described herein
Unit and algorithm steps, can be hard in order to clearly demonstrate with electronic hardware, computer software or the two be implemented in combination in
Part and the interchangeability of software, generally describe composition and the step of each example in the above description according to function.
These functions to be executed with hardware or software mode actually, the application-specific depending on technical scheme and design constraint.
Professional and technical personnel can use different methods to each specific application realize described function, but this realization
It is not considered that it is beyond the scope of this invention.
The step of the method in conjunction with the embodiments described herein description or algorithm can be with hardware, computing device
Software module, or the combination of the two is implementing.Software module can be placed in random access memory (ram), internal memory, read only memory
(rom), electrically programmable rom, electrically erasable rom, depositor, hard disk, moveable magnetic disc, cd-rom or technical field
In interior known any other form of storage medium.
Above-described specific embodiment, has been carried out to the purpose of the present invention, technical scheme and beneficial effect further
Describe in detail, be should be understood that the specific embodiment that the foregoing is only the present invention, be not intended to limit the present invention
Protection domain, all any modification, equivalent substitution and improvement within the spirit and principles in the present invention, done etc., all should comprise
Within protection scope of the present invention.
Claims (7)
1. a kind of log analysis method is it is characterised in that comprise the following steps:
Data processing unit receives the user's request that client sends；
Described data processing unit is used for judging whether described user's request is converted to data call parameters；
When described user's request is not converted into data call parameters, described user's request is changed by described data processing unit
For data call parameters, described data call parameters are generated set of tasks；
Described data processing unit is used for judging whether described set of tasks is stored in local cache；
When described set of tasks is not stored in the middle of local cache, described set of tasks is corresponded to by described data processing unit
Mission bit stream be sent to data analysis unit；
Described user's request is processed as mission bit stream by described data processing unit, and described mission bit stream is sent to described number
According to analytic unit；
Described data analysis unit carries out log analysis according to the described mission bit stream receiving and generates analysis result, and will be described
Analysis result is sent to data processing unit；
Described data processing unit is processed as return information to described analysis result, and described return information is sent to described visitor
Family end.
2. log analysis method as claimed in claim 1 is it is characterised in that described data processing unit is used for judging described appointing
Whether business set is stored in local cache and specifically includes:
If described set of tasks is stored in the middle of local cache, by described set of tasks in local Cache associativity to this
Business；If described set of tasks is not stored in the middle of local cache, the corresponding mission bit stream of described set of tasks is sent to
Described data analysis unit.
3. log analysis method as claimed in claim 1 is it is characterised in that described data processing unit is used for judging described use
Whether family request is converted to data call parameters specifically also includes:
If described user's request is converted to data call parameters, directly return；If described user's request is not converted into
Data call parameters, then be converted to data call parameters by user's request, and this daily record of monitor in real time divides in monitoring period
The execution state of analysis.
4. log analysis method as claimed in claim 3 it is characterised in that described in monitoring period this next day of monitor in real time
The execution state of will analysis specifically includes:
If in described monitoring period, analysis result is sent to described data processing unit by described data analysis unit, then
Current state is updated to complete by described data processing unit；
If in described monitoring period, error message is sent to described data processing unit by described data analysis unit, then
Current state is updated to failure by described data processing unit, error message described in described data processing unit record；
If in described monitoring period, described data analysis unit does not send information to described data processing unit, then institute
State data processing unit and current state is updated to time-out, and time-out described in described data processing unit record.
5. log analysis method as claimed in claim 1 is it is characterised in that described data processing single pair of is by described analysis result
It is processed as described return information to specifically include:
Described data processing unit receives the described analysis result that described data analysis unit sends, described data processing unit pair
Described analysis result carries out secondary Macro or mass analysis, and the result treatment of described secondary Macro or mass analysis is return information.
6. a kind of Log Analysis System is it is characterised in that described system includes:
Data processing unit, for the collection of user's request, analysis, is judging that described user's request is not converted into data call
During parameter, described user's request is converted to after data call parameters, described data call parameters are generated set of tasks, and
When judging that described set of tasks is not stored in local cache, corresponding for described set of tasks mission bit stream is sent to number
According to analytic unit, and receive the analysis result that described data analysis unit sends, described analysis result is sent to client；
Data analysis unit, for receiving the mission bit stream that described data processing unit sends, according to described mission bit stream to day
Will data is analyzed and generates described analysis result, and described analysis result is sent to described data processing unit.
7. Log Analysis System as claimed in claim 6 is it is characterised in that described data processing unit includes: data access
Interface, data collection scheduler module, data analysis module, the first memory module, the second memory module, data collection module；
Described data access interface, for receiving described user's request, and judges whether described user's request is stored in and locally delays
In depositing；If described user's request is buffered in local cache, described user's request is returned；If described user's request does not have
It is buffered in local cache, then described user's request is converted to and described collects calling of scheduler module and receipt analysis module
Parameter, and receive the analysis result of described data analysis module；
Described data collection scheduler module, receives the call parameters of described data access interface, will connect from described data access
The call parameters of mouth are converted to set of tasks, and issue all tasks in task-set, for the conversion of described user's request, prison
Control, the initialization of environment and cleaning；
Described data analysis module, carries out Macro or mass analysis to the cohersive and integrated data in described second memory module, and by cohersive and integrated data
The result of analysis is sent to described data access interface, for carrying out secondary remittance to all data in described data processing unit
Bulk analysis；
Described data collection module is used for judging whether each mission bit stream of described mission bit stream has been buffered in the second storage
In module；If described each mission bit stream is buffered in the middle of described second memory module, then described each task requests association
To corresponding task；If described each mission bit stream is not buffered in the middle of described second memory module, will be described each
The corresponding mission bit stream of task requests is handed down to data analysis module, and receives the analysis result of described data analysis module, uses
The collection issuing with data in task；
Described first memory module, the described task-set for receiving described data collection scheduler module merges storage；
Described second memory module, the analysis result for sending to described data analysis module stores.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310743923.1A CN103678092B (en) | 2013-12-30 | 2013-12-30 | log analysis method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310743923.1A CN103678092B (en) | 2013-12-30 | 2013-12-30 | log analysis method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103678092A CN103678092A (en) | 2014-03-26 |
| CN103678092B true CN103678092B (en) | 2017-01-25 |
Family
ID=50315733
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310743923.1A Active CN103678092B (en) | 2013-12-30 | 2013-12-30 | log analysis method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103678092B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108737467B (en) * | 2017-04-19 | 2021-03-26 | 腾讯科技（深圳）有限公司 | Server log viewing method, device and system |
| CN109189993A (en) * | 2018-08-16 | 2019-01-11 | 深圳云安宝科技有限公司 | Big data processing method, device, server and storage medium |
| CN113868100B (en) * | 2021-10-27 | 2024-08-13 | 北京值得买科技股份有限公司 | Automatic dispatching acquisition system for data in electronic commerce field |
| CN117235130A (en) * | 2023-09-14 | 2023-12-15 | 中国联合网络通信集团有限公司 | A log processing method, device, electronic equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102053983A (en) * | 2009-11-02 | 2011-05-11 | 阿里巴巴集团控股有限公司 | Method, system and device for querying vertical search |
| CN102915269A (en) * | 2012-09-20 | 2013-02-06 | 山东浪潮齐鲁软件产业股份有限公司 | Method for analyzing common logs of B/S (browser/server) software system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8990294B2 (en) * | 2012-04-18 | 2015-03-24 | International Business Machines Corporation | File system optimization by log/metadata analysis |
| KR101252471B1 (en) * | 2012-10-05 | 2013-04-09 | 주식회사 시큐브 | Analysis of chain based integrated log correlation analysis system and method |
-
2013
- 2013-12-30 CN CN201310743923.1A patent/CN103678092B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102053983A (en) * | 2009-11-02 | 2011-05-11 | 阿里巴巴集团控股有限公司 | Method, system and device for querying vertical search |
| CN102915269A (en) * | 2012-09-20 | 2013-02-06 | 山东浪潮齐鲁软件产业股份有限公司 | Method for analyzing common logs of B/S (browser/server) software system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103678092A (en) | 2014-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107992398B (en) | Monitoring method and monitoring system of service system | |
| US11575579B2 (en) | Systems and methods for networked microservice modeling | |
| US10747592B2 (en) | Router management by an event stream processing cluster manager | |
| CN112703487B (en) | Hierarchical collection of samples in a data center | |
| Yan et al. | A survey of traffic classification in software defined networks | |
| CN100568193C (en) | Systems and methods for performance management in a multi-tier computing environment | |
| US8732302B2 (en) | Method and system for monitoring performance of an application system | |
| CN111124819A (en) | Method and device for monitoring full link | |
| Zhang et al. | Towards cloud-edge collaborative online video analytics with fine-grained serverless pipelines | |
| US20050216241A1 (en) | Method and apparatus for gathering statistical measures | |
| CN113676400B (en) | Cloud gateway system for Internet of things access of environment-friendly data acquisition equipment | |
| Sukhija et al. | Event management and monitoring framework for HPC environments using ServiceNow and Prometheus | |
| CN103678092B (en) | log analysis method and system | |
| CN106506266B (en) | Network flow analysis method based on GPU, Hadoop/Spark mixing Computational frame | |
| Amer et al. | Management of sampled real-time network measurements | |
| CN109120463A (en) | Method for predicting and device | |
| CN118964470A (en) | Efficient data processing system based on cloud-network integration and its implementation method | |
| CN111198806A (en) | Service call data statistical analysis method and system based on service open platform | |
| Zheng et al. | Rethinking fine-grained measurement from software-defined perspective: A survey | |
| CN118394713A (en) | Log data processing method, device, equipment, storage medium and program product | |
| CN109460829A (en) | Based on the intelligent monitoring method and platform under big data processing and cloud transmission | |
| CN114268477A (en) | Security resource dynamic scheduling system and method based on multi-mode load balancing | |
| US20070150430A1 (en) | Decision support methods and apparatus | |
| CN100394729C (en) | Storage server performance comprehensive test system | |
| Songwattana | Mining web logs for prediction in prefetching and caching |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |