CN106844495A - A kind of acquisition methods and device of website operation daily record - Google Patents
A kind of acquisition methods and device of website operation daily record Download PDFInfo
- Publication number
- CN106844495A CN106844495A CN201611217543.4A CN201611217543A CN106844495A CN 106844495 A CN106844495 A CN 106844495A CN 201611217543 A CN201611217543 A CN 201611217543A CN 106844495 A CN106844495 A CN 106844495A
- Authority
- CN
- China
- Prior art keywords
- operation log
- setting
- daily record
- log
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/11—File system administration, e.g. details of archiving or snapshots
- G06F16/116—Details of conversion of file system types or formats
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/1734—Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
- Computer And Data Communications (AREA)
Abstract
The present invention proposes a kind of acquisition methods and device of website operation daily record, and the method includes：By by result collection system real-time collecting to each server in website in Operation Log store to distributed file system；The Operation Log stored in the distributed file system is obtained by Log Analysis System, the illegal Operation Log that the Log Analysis System is obtained is filtered, and the valid operation daily record that will be obtained is stored to database with setting journal format.The acquisition methods and device of a kind of website operation daily record of the present invention, improve the Operation Log analysis efficiency of large-scale website；The workload of inquiry operation daily record is reduced, is effectively shortened and the judgement cycle for judging whether account is safe is analyzed by Operation Log；By the interface display Operation Log information for setting, make analysis operation daily record more directly perceived and convenient.
Description
Technical field
The present invention relates to Internet technical field, more particularly to a kind of acquisition methods and device of website operation daily record.
Background technology
Because the Operation Log of large-scale website platform is dispersed in each service line server of website, and each business
Line server is all more than ten platforms, at most up to a hundred servers at least with clustered deploy(ment).If desired certain account of website platform is determined
Whether number it is stolen, then needs to inquire about each service line server, acquisition is stolen the Operation Log of account.Due to clothes
Business device is numerous, and the workload for inquiring about the Operation Log of the account that is stolen is huge, influences each service line server normally to work；
The Operation Log form disunity of each service line server record, Operation Log readability difference is, it is necessary to each service line is serviced
Device provides the Operation Log explanation document of the service line server record, and Operation Log analysis is cumbersome；Operation Log analysis result
Cannot persistent storage, and succinct page presentation cannot be used.
The content of the invention
The technical problem to be solved in the present invention is to provide a kind of acquisition methods and device of website operation daily record, overcomes existing
Account number safety analyzes cumbersome defect caused by having the Operation Log form disunity recorded due to different server in technology.
The technical solution adopted by the present invention is, a kind of acquisition methods of website operation daily record, including：
By by result collection system real-time collecting to each server in website in Operation Log store to distributed text
Part system；
The Operation Log stored in the distributed file system is obtained by Log Analysis System, the daily record point is filtered
The illegal Operation Log that analysis system is obtained, and the valid operation daily record that will be obtained stored to database with setting journal format.
It is further, described that the Operation Log stored in the distributed file system is obtained by Log Analysis System,
Filter after the illegal Operation Log that the Log Analysis System is obtained, methods described also includes：
The inquiry Operation Log related to setting account in the valid operation daily record for obtaining, and will inquire and setting
Account associated oplog is stored to the database with setting form.
Further, described inquiring is stored to the data with setting account associated oplog with setting form
Storehouse, including：
An Operation Log file for setting form is merged into setting account associated oplog by inquiring, and will
The Operation Log file is stored to database.
Further, the valid operation daily record that will be obtained is stored to database with setting journal format, described
Method also includes：
The Operation Log read from the database is carried out into matching judgment with the dangerous account journal file of setting；
If from the database read Operation Log with set dangerous account journal file match, judge from
The corresponding account safety exception of Operation Log read in the database；
Otherwise judge the corresponding account safety of Operation Log read from the database.
Further, the valid operation daily record that will be obtained is stored to database with setting journal format, described
Method also includes：
Inquiry in the database sets the Operation Log of account, and the setting account for inquiring is shown in interface is set
The Operation Log at family.
The present invention also provides a kind of acquisition device of website operation daily record, including：
Collection module, for by by result collection system real-time collecting to each server in website in Operation Log deposit
Store up to distributed file system；
Processing module, for obtaining the Operation Log stored in the distributed file system by Log Analysis System,
The illegal Operation Log that the Log Analysis System is obtained is filtered, and the valid operation daily record that will be obtained is to set journal format
Store to database.
Further, the processing module, specifically for：
The Operation Log stored in the distributed file system is obtained by Log Analysis System, the daily record point is filtered
The illegal Operation Log that analysis system is obtained, the inquiry operation day related to setting account in the valid operation daily record for obtaining
Will, and will inquire with setting account associated oplog stored to the database with setting form.
Further, the processing module, specifically for：
The Operation Log stored in the distributed file system is obtained by Log Analysis System, the daily record point is filtered
The illegal Operation Log that analysis system is obtained, the inquiry operation day related to setting account in the valid operation daily record for obtaining
Will, an Operation Log file for setting form is merged into by inquiring with setting account associated oplog, and will be described
Operation Log file is stored to database.
Further, described device also includes：
Judge module, for the Operation Log that will be read from the database and the dangerous account journal file for setting
Carry out matching judgment；
If from the database read Operation Log with set dangerous account journal file match, judge from
The corresponding account safety exception of Operation Log read in the database；
Otherwise judge the corresponding account safety of Operation Log read from the database.
Further, described device also includes：
Display module, is stored to number for the valid operation daily record that will be obtained in the processing module with setting journal format
After according to storehouse, inquiry in the database sets the Operation Log of account, and the setting for inquiring is shown in interface is set
The Operation Log of account.
Using above-mentioned technical proposal, the present invention at least has following advantages：
The acquisition methods and device of a kind of website operation daily record of the present invention, improve the Operation Log point of large-scale website
Analysis efficiency；The workload of inquiry operation daily record is reduced, is effectively shortened and is judged whether account is safe by Operation Log analysis
The judgement cycle；By the interface display Operation Log information for setting, make analysis operation daily record more directly perceived and convenient.
Brief description of the drawings
Fig. 1 is the acquisition methods flow chart of the website operation daily record of first embodiment of the invention；
Fig. 2 is the acquisition methods flow chart of the website operation daily record of second embodiment of the invention；
Fig. 3 is the acquisition device composition structural representation of the website operation daily record of fourth embodiment of the invention；
Fig. 4 is the acquisition device composition structural representation of the website operation daily record of fifth embodiment of the invention.
Specific embodiment
Further to illustrate the present invention to reach technological means and effect that predetermined purpose is taken, below in conjunction with accompanying drawing
And preferred embodiment, the present invention is described in detail as after.
First embodiment of the invention, a kind of acquisition methods of website operation daily record, as shown in figure 1, including walking in detail below
Suddenly：
Step S101, by by result collection system real-time collecting to each server in website in Operation Log store to
Distributed file system.
Specifically, step S101, including：
Will by Flume (tank) result collection system real-time collectings to each server in website in Operation Log store
To HDFS (Hadoop Distributed File System, extra large dupp distributed file system).
Step S102, the Operation Log stored in distributed file system, filtering log are obtained by Log Analysis System
The illegal Operation Log that analysis system is obtained, and the valid operation daily record that will be obtained stored to data with setting journal format
Storehouse.
Specifically, step S102, including：
The Operation Log stored in HDFS is obtained by MapReduce Log Analysis Systems, filtering log analysis system is obtained
The illegal Operation Log for taking, and the valid operation daily record that will be obtained stored to Hbase databases with setting journal format.
For example：The Operation Log stored in HDFS, filtering log analysis system are obtained by MapReduce Log Analysis Systems
Unite obtain illegal JSON format strings daily record, and the valid operation daily record that will be obtained with set journal format store to
MapReduce Log Analysis System result files and Hbase databases.
Filtered by by illegal daily record, and stored to database after legal daily record is converted into consolidation form,
The workload of inquiry operation daily record can be reduced；Improve the Operation Log analysis efficiency of large-scale website；Effectively shorten logical
Cross Operation Log analysis and judge the account whether safe judgement cycle.
Second embodiment of the invention, a kind of acquisition methods of website operation daily record, as shown in Fig. 2 including walking in detail below
Suddenly：
Step S201, by by result collection system real-time collecting to each server in website in Operation Log store to
Distributed file system.
Specifically, step S201, including：
Will by Flume (tank) result collection system real-time collectings to each server in website in Operation Log store
To HDFS (Hadoop Distributed File System, extra large dupp distributed file system).
Step S202, the Operation Log stored in distributed file system, filtering log are obtained by Log Analysis System
The illegal Operation Log that analysis system is obtained, obtains legal daily record；
The valid operation daily record that will be obtained is stored to database with setting journal format；
Or, in the valid operation daily record for obtaining inquiry with set the related Operation Log of account, and will inquire
Stored to database with setting form with setting account associated oplog.
Specifically, step S202, including：
The Operation Log stored in HDFS is obtained by MapReduce Log Analysis Systems, filtering log analysis system is obtained
The illegal Operation Log for taking, obtains legal daily record；
The valid operation daily record that will be obtained is stored to Hbase databases with setting journal format；
Or, in the valid operation daily record for obtaining inquiry with set the related Operation Log of account, and will inquire
Stored to Hbase databases with setting form with setting account associated oplog.
For example：The Operation Log stored in HDFS, filtering log analysis system are obtained by MapReduce Log Analysis Systems
The illegal JSON format strings daily record that system is obtained, obtains legal daily record；
The valid operation daily record that will be obtained is stored to MapReduce Log Analysis System results with setting journal format
File and Hbase databases；
Or, in the valid operation daily record for obtaining inquiry with set the related Operation Log of account, and will inquire
Stored to Hbase databases with setting form with setting account associated oplog.
Filtered by by illegal daily record, and stored to database after legal daily record is converted into consolidation form,
The workload of inquiry operation daily record can be reduced；Improve the Operation Log analysis efficiency of large-scale website.
Stored to database by by the daily record related to setting account, effectively shorten and judgement is analyzed by Operation Log
Account whether safety the judgement cycle.
Step S203, the Operation Log read from database is matched with the dangerous account journal file of setting
Judge.
Specifically, step S203, including：
If the Operation Log read from database is matched with the dangerous account journal file of setting, judge from data
The corresponding account safety exception of Operation Log read in storehouse；
If the Operation Log read from database is mismatched with the dangerous account journal file of setting, judge from number
According to the corresponding account safety of Operation Log read in storehouse.
For example：If the Operation Log read from Hbase databases is matched with the dangerous account journal file of setting,
Judge the corresponding account safety exception of Operation Log read from Hbase databases；
If the Operation Log read from Hbase databases is mismatched with the dangerous account journal file of setting, sentence
The fixed corresponding account safety of Operation Log read from Hbase databases.
Matching judgment is carried out with the dangerous account journal file of setting by by the Operation Log read from database,
Can be in the case where personnel be not involved in, whether the corresponding account of automatic decision daily record is safe, effectively increases large-scale website
Operation Log analysis efficiency.
Step S204, inquires about the Operation Log of setting account in database, and shows what is inquired in interface is set
Set the Operation Log of account.
For example：The Operation Log of setting account is inquired about in Hbase databases, and is shown in WEB (network) page is set
Show the Operation Log of the setting account for inquiring.
The Operation Log of the setting account inquired by the display in interface is set, makes analysis operation daily record more directly perceived
And facility.
Third embodiment of the invention, a kind of acquisition methods of website operation daily record, including step in detail below：
Step S301, by by result collection system real-time collecting to each server in website in Operation Log store to
Distributed file system.
Specifically, step S301, including：
Will by Flume (tank) result collection system real-time collectings to each server in website in Operation Log store
To HDFS (Hadoop Distributed File System, extra large dupp distributed file system).
Step S302, the Operation Log stored in distributed file system, filtering log are obtained by Log Analysis System
The illegal Operation Log that analysis system is obtained, obtains legal daily record；
The valid operation daily record that will be obtained is stored to database with setting journal format；
Or, in the valid operation daily record for obtaining inquiry with set the related Operation Log of account, and will inquire
With setting account associated oplog merge into one setting form Operation Log file, and by Operation Log file store to
Database.
Specifically, step S302, including：
The Operation Log stored in HDFS is obtained by MapReduce Log Analysis Systems, filtering log analysis system is obtained
The illegal Operation Log for taking, obtains legal daily record；
The valid operation daily record that will be obtained is stored to Hbase databases with setting journal format；
Or, in the valid operation daily record for obtaining inquiry with set the related Operation Log of account, and will inquire
With setting account associated oplog merge into one setting form Operation Log file, and by Operation Log file store to
Hbase databases.
For example：The Operation Log stored in HDFS, filtering log analysis system are obtained by MapReduce Log Analysis Systems
The illegal JSON format strings daily record that system is obtained, obtains legal daily record；
The valid operation daily record that will be obtained is stored to MapReduce Log Analysis System results with setting journal format
File and Hbase databases；
Or, in the valid operation daily record for obtaining inquiry with set the related Operation Log of account, and will inquire
With setting account associated oplog merge into one setting form Operation Log file, and by Operation Log file store to
Hbase databases.
Filtered by by illegal daily record, and stored to database after legal daily record is converted into consolidation form,
The workload of inquiry operation daily record can be reduced；Improve the Operation Log analysis efficiency of large-scale website.
Stored to database by the way that the daily record related to setting account is merged into a journal file, effectively shortened logical
Cross Operation Log analysis and judge the account whether safe judgement cycle.
Step S303, the Operation Log read from database is matched with the dangerous account journal file of setting
Judge.
Specifically, step S303, including：
If the Operation Log read from database is matched with the dangerous account journal file of setting, judge from data
The corresponding account safety exception of Operation Log read in storehouse；
If the Operation Log read from database is mismatched with the dangerous account journal file of setting, judge from number
According to the corresponding account safety of Operation Log read in storehouse.
For example：If the Operation Log read from Hbase databases is matched with the dangerous account journal file of setting,
Judge the corresponding account safety exception of Operation Log read from Hbase databases；
If the Operation Log read from Hbase databases is mismatched with the dangerous account journal file of setting, sentence
The fixed corresponding account safety of Operation Log read from Hbase databases.
Matching judgment is carried out with the dangerous account journal file of setting by by the Operation Log read from database,
Can be in the case where personnel be not involved in, whether the corresponding account of automatic decision daily record is safe, effectively increases large-scale website
Operation Log analysis efficiency.
Step S304, inquires about the Operation Log of setting account in database, and shows what is inquired in interface is set
Set the Operation Log of account.
For example：The Operation Log of setting account is inquired about in Hbase databases, and is shown in WEB (network) page is set
Show the Operation Log of the setting account for inquiring.
The Operation Log of the setting account inquired by the display in interface is set, makes analysis operation daily record more directly perceived
And facility.
Fourth embodiment of the invention, a kind of acquisition device of website operation daily record, as shown in figure 3, including consisting of portion
Point：
Collection module 100, for will pass through result collection system real-time collecting to each server in website in operation day
Will is stored to distributed file system.
Specifically, collection module 100, is used for：
Will by Flume (tank) result collection system real-time collectings to each server in website in Operation Log store
To HDFS (Hadoop Distributed File System, extra large dupp distributed file system).
Processing module 200, for obtaining the Operation Log stored in distributed file system, mistake by Log Analysis System
Filter Log Analysis System obtain illegal Operation Log, and the valid operation daily record that will be obtained with set journal format store to
Database.
Specifically, processing module 200, is used for：
The Operation Log stored in HDFS is obtained by MapReduce Log Analysis Systems, filtering log analysis system is obtained
The illegal Operation Log for taking, and the valid operation daily record that will be obtained stored to Hbase databases with setting journal format.
For example：Processing module 200, for obtaining the operation day stored in HDFS by MapReduce Log Analysis Systems
Will, filtering log analysis system obtain illegal JSON format strings daily record, and the valid operation daily record that will be obtained with
Setting journal format is stored to MapReduce Log Analysis System result files and Hbase databases.
Illegal daily record is filtered by processing module 200, and is deposited after legal daily record is converted into consolidation form
Storage can reduce the workload of inquiry operation daily record to database；Improve the Operation Log analysis efficiency of large-scale website；Have
Effect is shortened analyzes the judgement cycle for judging whether account is safe by Operation Log.
Fifth embodiment of the invention, a kind of acquisition device of website operation daily record, as shown in figure 4, including following tool composition
Part：
Collection module 100, for will pass through result collection system real-time collecting to each server in website in operation day
Will is stored to distributed file system.
Specifically, collection module 100, is used for：
Will by Flume (tank) result collection system real-time collectings to each server in website in Operation Log store
To HDFS (Hadoop Distributed File System, extra large dupp distributed file system).
Processing module 200, for obtaining the Operation Log stored in distributed file system, mistake by Log Analysis System
The illegal Operation Log that filter Log Analysis System is obtained, obtains legal daily record；
The valid operation daily record that will be obtained is stored to database with setting journal format；
Or, in the valid operation daily record for obtaining inquiry with set the related Operation Log of account, and will inquire
Stored to database with setting form with setting account associated oplog.
Specifically, processing module 200, is used for：
The Operation Log stored in HDFS is obtained by MapReduce Log Analysis Systems, filtering log analysis system is obtained
The illegal Operation Log for taking, obtains legal daily record；
The valid operation daily record that will be obtained is stored to Hbase databases with setting journal format；
Or, in the valid operation daily record for obtaining inquiry with set the related Operation Log of account, and will inquire
Stored to Hbase databases with setting form with setting account associated oplog.
For example：Processing module 200, for obtaining the operation day stored in HDFS by MapReduce Log Analysis Systems
Will, the illegal JSON format strings daily record that filtering log analysis system is obtained, obtains legal daily record；
The valid operation daily record that will be obtained is stored to MapReduce Log Analysis System results with setting journal format
File and Hbase databases；
Or, in the valid operation daily record for obtaining inquiry with set the related Operation Log of account, and will inquire
Stored to Hbase databases with setting form with setting account associated oplog.
Illegal daily record is filtered by processing module 200, and is deposited after legal daily record is converted into consolidation form
Storage can reduce the workload of inquiry operation daily record to database；Improve the Operation Log analysis efficiency of large-scale website.
The daily record related to setting account is stored to database by processing module 200, is effectively shortened by operation
Log analysis judge account whether safety the judgement cycle.
Judge module 300, for the Operation Log that will be read from database and the dangerous account journal file for setting
Carry out matching judgment.
Specifically, judge module 300, is used for：
If the Operation Log read from database is matched with the dangerous account journal file of setting, judge from data
The corresponding account safety exception of Operation Log read in storehouse；
If the Operation Log read from database is mismatched with the dangerous account journal file of setting, judge from number
According to the corresponding account safety of Operation Log read in storehouse.
For example：Judge module 300, if for the Operation Log read from Hbase databases and the dangerous account for setting
Family journal file matching, then judge the corresponding account safety exception of Operation Log read from Hbase databases；
If the Operation Log read from Hbase databases is mismatched with the dangerous account journal file of setting, sentence
The fixed corresponding account safety of Operation Log read from Hbase databases.
Matching judgment is carried out with the dangerous account journal file of setting by by the Operation Log read from database,
Can be in the case where personnel be not involved in, whether the corresponding account of automatic decision daily record is safe, effectively increases large-scale website
Operation Log analysis efficiency.
Display module 400, the Operation Log for inquiring about setting account in database, and show and look into interface is set
The Operation Log of the setting account ask.
For example：Display module 400, the Operation Log for inquiring about setting account in Hbase databases, and in setting
The Operation Log of the setting account that display is inquired in WEB (network) page.
The Operation Log of the setting account inquired by the display in interface is set, makes analysis operation daily record more directly perceived
And facility.
Sixth embodiment of the invention, a kind of acquisition device of website operation daily record, including consisting of part：
Collection module 100, for will pass through result collection system real-time collecting to each server in website in operation day
Will is stored to distributed file system.
Specifically, collection module 100, is used for：
Will by Flume (tank) result collection system real-time collectings to each server in website in Operation Log store
To HDFS (Hadoop Distributed File System, extra large dupp distributed file system).
Processing module 200, for obtaining the Operation Log stored in distributed file system, mistake by Log Analysis System
The illegal Operation Log that filter Log Analysis System is obtained, obtains legal daily record；
The valid operation daily record that will be obtained is stored to database with setting journal format；
Or, in the valid operation daily record for obtaining inquiry with set the related Operation Log of account, and will inquire
With setting account associated oplog merge into one setting form Operation Log file, and by Operation Log file store to
Database.
Specifically, processing module 200, is used for：
The Operation Log stored in HDFS is obtained by MapReduce Log Analysis Systems, filtering log analysis system is obtained
The illegal Operation Log for taking, obtains legal daily record；
The valid operation daily record that will be obtained is stored to Hbase databases with setting journal format；
Or, in the valid operation daily record for obtaining inquiry with set the related Operation Log of account, and will inquire
With setting account associated oplog merge into one setting form Operation Log file, and by Operation Log file store to
Hbase databases.
For example：Processing module 200, for obtaining the operation day stored in HDFS by MapReduce Log Analysis Systems
Will, the illegal JSON format strings daily record that filtering log analysis system is obtained, obtains legal daily record；
The valid operation daily record that will be obtained is stored to MapReduce Log Analysis System results with setting journal format
File and Hbase databases；
Or, in the valid operation daily record for obtaining inquiry with set the related Operation Log of account, and will inquire
With setting account associated oplog merge into one setting form Operation Log file, and by Operation Log file store to
Hbase databases.
Processing module 200 is filtered by by illegal daily record, and is deposited after legal daily record is converted into consolidation form
Storage can reduce the workload of inquiry operation daily record to database；Improve the Operation Log analysis efficiency of large-scale website.
Stored to database by the way that the daily record related to setting account is merged into a journal file, effectively shortened logical
Cross Operation Log analysis and judge the account whether safe judgement cycle.
Judge module 300, for the Operation Log that will be read from database and the dangerous account journal file for setting
Carry out matching judgment.
Specifically, judge module 300, is used for：
If the Operation Log read from database is matched with the dangerous account journal file of setting, judge from data
The corresponding account safety exception of Operation Log read in storehouse；
If the Operation Log read from database is mismatched with the dangerous account journal file of setting, judge from number
According to the corresponding account safety of Operation Log read in storehouse.
For example：Judge module 300, if for the Operation Log read from Hbase databases and the dangerous account for setting
Family journal file matching, then judge the corresponding account safety exception of Operation Log read from Hbase databases；
If the Operation Log read from Hbase databases is mismatched with the dangerous account journal file of setting, sentence
The fixed corresponding account safety of Operation Log read from Hbase databases.
Matching judgment is carried out with the dangerous account journal file of setting by by the Operation Log read from database,
Can be in the case where personnel be not involved in, whether the corresponding account of automatic decision daily record is safe, effectively increases large-scale website
Operation Log analysis efficiency.
Display module 400, the Operation Log for inquiring about setting account in database, and show and look into interface is set
The Operation Log of the setting account ask.
For example：Display module 400, the Operation Log for inquiring about setting account in Hbase databases, and in setting
The Operation Log of the setting account that display is inquired in WEB (network) page.
The Operation Log of the setting account that display module 400 is inquired by the display in interface is set, makes analysis operation
Daily record is more directly perceived and convenient.
By the explanation of specific embodiment, should to the present invention for reach technological means that predetermined purpose is taken and
Effect is able to more go deep into and specific understanding, but appended diagram is only to provide reference and purposes of discussion, not for originally
Invention is any limitation as.
Claims (10)
1. a kind of acquisition methods of website operation daily record, it is characterised in that including：
By by result collection system real-time collecting to each server in website in Operation Log store to distributed field system
System；
The Operation Log stored in the distributed file system is obtained by Log Analysis System, the log analysis system is filtered
Unite the illegal Operation Log for obtaining, and the valid operation daily record that will be obtained stored to database with setting journal format.
2. method according to claim 1, it is characterised in that described that the distributed text is obtained by Log Analysis System
The Operation Log stored in part system, after the illegal Operation Log that the filtering Log Analysis System is obtained, methods described
Also include：
The inquiry Operation Log related to setting account in the valid operation daily record for obtaining, and will inquire and setting account
Associated oplog is stored to the database with setting form.
3. method according to claim 2, it is characterised in that described to inquire and set account associated oplog
Stored to the database with setting form, including：
An Operation Log file for setting form is merged into setting account associated oplog by inquiring, and will be described
Operation Log file is stored to database.
4. method according to claim 1, it is characterised in that the valid operation daily record that will be obtained is setting daily record lattice
Formula is stored to database, and methods described also includes：
The Operation Log read from the database is carried out into matching judgment with the dangerous account journal file of setting；
If the Operation Log read from the database is matched with the dangerous account journal file for setting, judge from described
The corresponding account safety exception of Operation Log read in database；
Otherwise judge the corresponding account safety of Operation Log read from the database.
5. method according to claim 1, it is characterised in that the valid operation daily record that will be obtained is setting daily record lattice
Formula is stored to database, and methods described also includes：
The Operation Log of inquiry setting account, and the setting account that display is inquired in interface is set in the database
Operation Log.
6. a kind of acquisition device of website operation daily record, it is characterised in that including：
Collection module, for by by result collection system real-time collecting to each server in website in Operation Log store to
Distributed file system；
Processing module, for obtaining the Operation Log stored in the distributed file system, filtering by Log Analysis System
The illegal Operation Log that the Log Analysis System is obtained, and the valid operation daily record that will be obtained is setting journal format storage
To database.
7. device according to claim 6, it is characterised in that the processing module, specifically for：
The Operation Log stored in the distributed file system is obtained by Log Analysis System, the log analysis system is filtered
The illegal Operation Log that system is obtained, the inquiry Operation Log related to setting account in the valid operation daily record for obtaining, and
To inquire and stored to the database with setting form with setting account associated oplog.
8. device according to claim 7, it is characterised in that the processing module, specifically for：
The Operation Log stored in the distributed file system is obtained by Log Analysis System, the log analysis system is filtered
The illegal Operation Log that system is obtained, the inquiry Operation Log related to setting account in the valid operation daily record for obtaining, will
What is inquired merges into an Operation Log file for setting form with setting account associated oplog, and by the operation day
Will file is stored to database.
9. device according to claim 6, it is characterised in that described device also includes：
Judge module, for the Operation Log read from the database to be carried out with the dangerous account journal file of setting
Matching judgment；
If the Operation Log read from the database is matched with the dangerous account journal file for setting, judge from described
The corresponding account safety exception of Operation Log read in database；
Otherwise judge the corresponding account safety of Operation Log read from the database.
10. device according to claim 6, it is characterised in that described device also includes：
Display module, is stored to database for the valid operation daily record that will be obtained in the processing module with setting journal format
Afterwards, inquiry sets the Operation Log of account in the database, and the setting account for inquiring is shown in interface is set
Operation Log.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611217543.4A CN106844495A (en) | 2016-12-26 | 2016-12-26 | A kind of acquisition methods and device of website operation daily record |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611217543.4A CN106844495A (en) | 2016-12-26 | 2016-12-26 | A kind of acquisition methods and device of website operation daily record |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106844495A true CN106844495A (en) | 2017-06-13 |
Family
ID=59135642
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611217543.4A Pending CN106844495A (en) | 2016-12-26 | 2016-12-26 | A kind of acquisition methods and device of website operation daily record |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106844495A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107861994A (en) * | 2017-10-18 | 2018-03-30 | 福建中金在线信息科技有限公司 | Daily record method for sorting and device |
| CN111800295A (en) * | 2020-06-23 | 2020-10-20 | 四川虹美智能科技有限公司 | Server audit management method, device and system |
| CN112256530A (en) * | 2020-10-27 | 2021-01-22 | 广州助蜂网络科技有限公司 | Log service method capable of tracking link and system thereof |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101192227A (en) * | 2006-11-30 | 2008-06-04 | 阿里巴巴公司 | Log file analytical method and system based on distributed type computing network |
| CN103235811A (en) * | 2013-04-24 | 2013-08-07 | 微梦创科网络科技（中国）有限公司 | Data storage method and device |
| US20140082513A1 (en) * | 2012-09-20 | 2014-03-20 | Appsense Limited | Systems and methods for providing context-sensitive interactive logging |
| CN104937886A (en) * | 2013-01-30 | 2015-09-23 | 日本电信电话株式会社 | Log analysis device, information processing method and program |
| CN106126551A (en) * | 2016-06-13 | 2016-11-16 | 浪潮电子信息产业股份有限公司 | A kind of generation method of Hbase database access daily record, Apparatus and system |
-
2016
- 2016-12-26 CN CN201611217543.4A patent/CN106844495A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101192227A (en) * | 2006-11-30 | 2008-06-04 | 阿里巴巴公司 | Log file analytical method and system based on distributed type computing network |
| US20140082513A1 (en) * | 2012-09-20 | 2014-03-20 | Appsense Limited | Systems and methods for providing context-sensitive interactive logging |
| CN104937886A (en) * | 2013-01-30 | 2015-09-23 | 日本电信电话株式会社 | Log analysis device, information processing method and program |
| CN103235811A (en) * | 2013-04-24 | 2013-08-07 | 微梦创科网络科技（中国）有限公司 | Data storage method and device |
| CN106126551A (en) * | 2016-06-13 | 2016-11-16 | 浪潮电子信息产业股份有限公司 | A kind of generation method of Hbase database access daily record, Apparatus and system |
Non-Patent Citations (2)
| Title |
|---|
| 段娟等: ""基于Web应用的安全日志审计系统研究与设计"", 《信息网络安全》 * |
| 王锡强: ""基于日志的网络安全审计系统的设计与实现"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107861994A (en) * | 2017-10-18 | 2018-03-30 | 福建中金在线信息科技有限公司 | Daily record method for sorting and device |
| CN107861994B (en) * | 2017-10-18 | 2021-07-02 | 福建中金在线信息科技有限公司 | Log sorting method and device |
| CN111800295A (en) * | 2020-06-23 | 2020-10-20 | 四川虹美智能科技有限公司 | Server audit management method, device and system |
| CN112256530A (en) * | 2020-10-27 | 2021-01-22 | 广州助蜂网络科技有限公司 | Log service method capable of tracking link and system thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102662966B (en) | Method and system for obtaining subject-oriented dynamic page content | |
| CN105488185B (en) | A kind of optimization method and device of knowledge base | |
| CN104050281A (en) | Webpage information extraction method and device based on http protocol | |
| US20140012800A1 (en) | Apparatus and method for providing application for processing big data | |
| CN102467633A (en) | Method and system for safely browsing webpage | |
| US20170053031A1 (en) | Information forecast and acquisition method based on webpage link parameter analysis | |
| CN105117484A (en) | Internet public opinion monitoring method and system | |
| CN104572976B (en) | Website data update method and system | |
| CN103077250B (en) | A kind of capturing webpage contents method and device | |
| CN105049247A (en) | Network safety log template extraction method and device | |
| CN106844495A (en) | A kind of acquisition methods and device of website operation daily record | |
| CN104346328A (en) | Vertical intelligent crawler data collecting method based on webpage data capture | |
| CN106599160A (en) | Content rule base management system and encoding method thereof | |
| CN104182465A (en) | Network-based big data processing method | |
| CN106599001A (en) | Webpage content acquisition method and system | |
| CN105354697A (en) | Financial account rule base based automatic online auditing method and system | |
| CN111177332A (en) | Method and device for automatically extracting referee document case-related mark and referee result | |
| CN104199850A (en) | Method and device for processing essential data | |
| CN104598598A (en) | Method for evaluating relational data standard | |
| CN112269879B (en) | Method and equipment for analyzing middle station log based on k-means algorithm | |
| CN111611483B (en) | Object portrait construction method, device and equipment and storage medium | |
| CN108334629A (en) | A kind of grid equipment state data acquisition system based on automated test frame | |
| CN105550910A (en) | Application of electronic invoice technology and added-value tax smart cloud in cooperative work | |
| CN107391695A (en) | A kind of information extracting method based on big data | |
| CN105653625A (en) | Analysis method and device of abnormal data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170613 |