CN106202219A - A kind of update method of network monitoring daily record - Google Patents
A kind of update method of network monitoring daily record Download PDFInfo
- Publication number
- CN106202219A CN106202219A CN201610490609.0A CN201610490609A CN106202219A CN 106202219 A CN106202219 A CN 106202219A CN 201610490609 A CN201610490609 A CN 201610490609A CN 106202219 A CN106202219 A CN 106202219A
- Authority
- CN
- China
- Prior art keywords
- data
- daily record
- network monitoring
- value
- monitoring daily
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
- G06F11/3072—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
- G06F11/3079—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting the data filtering being achieved by reporting only the changes of the monitored data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computer Hardware Design (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Computer And Data Communications (AREA)
- Debugging And Monitoring (AREA)
Abstract
A kind of update method of network monitoring daily record, set up mapping table, described mapping table storage has key value, tables of data, data base, the corresponding relation of API daily record, each data base comprises multiple tables of data, in each tables of data, record has the value value corresponding with key value, the invention has the beneficial effects as follows: the update method of the network monitoring daily record of the present invention passes through Distributed Calculation, can information relevant for daily record be enriched in the middle of the network monitoring daily record of magnanimity in the way of unifying and being prone to retrieval and inquisition, ensure that real-time and the effectiveness of information, the efficient retrieval of the information of being conducive to and inquiry.
Description
Technical field
The present invention relates to network monitoring daily record, especially relate to the update method of a kind of network monitoring daily record.
Background technology
Along with constantly the expanding of scope of the enterprise, being continuously increased of the network bandwidth, the quantity of the daily record of corresponding network monitoring
Also constantly increasing, difficulty and the workload of network monitoring increase the most therewith.Such as, when pinpointing the problems we it is to be appreciated that
Which employee that ip address in daily record is corresponding is, the ip address of access is a what kind of address, or the territory accessed
Name is the safest etc., and can only carry out manual association by the different data base of lookup under existence conditions and just can know that above
Information, this obvious efficiency is the lowest.
Summary of the invention
The present invention is the update method of a kind of network monitoring daily record provided for overcoming the deficiencies in the prior art.
The technical solution used in the present invention is: the update method of a kind of network monitoring daily record, it is characterised in that set up correspondence
Relation table, described mapping table storage has key value, tables of data, data base, the corresponding relation of API daily record, and each data base wraps
Containing multiple tables of data, in each tables of data, record has the value value corresponding with key value, and described update method also includes following step
Rapid: S1, acquisition network monitoring daily record are also updated, by described network monitoring daily record to be sent to message handling system；S2, disappear
Each node of breath processing system obtains described network monitoring daily record；S3, traversal obtain in the data of described network monitoring daily record
Key value and value value；S4, according in S3 obtain each key value from described mapping table, search corresponding data base
And tables of data；S5, generation trusted file list: comprise the following steps: in acquisition system disk, each system file is unique
Mark；By described identification record in a dynamic library file；According to described dynamic library file, generate a trusted file list.?
Corresponding tables of data searches the corresponding data of acquisition using the value value of acquisition in described S3 step as search condition will search
To data content run after fame to weigh with key-value and be newly packaged into the data of json form, by the data after encapsulation and described net
The initial data combination of network monitoring daily record.
As a further improvement on the present invention, the data after combination are stored in a network log information retrieval system.
As a further improvement on the present invention, the sequence formed from the hash value of each system file of described dynamic library file
In row, form described trusted file list.
As a further improvement on the present invention, described dynamic base can dynamically apply for the hash value of multiple described system file.
The invention has the beneficial effects as follows: the update method of the network monitoring daily record of the present invention passes through Distributed Calculation, permissible
Information relevant for daily record is enriched in the way of unifying and being prone to retrieval and inquisition in the middle of the network monitoring daily record of magnanimity, it is ensured that
The efficient retrieval of the real-time of information and effectiveness, beneficially information and inquiry.
Accompanying drawing explanation
Fig. 1 is the FB(flow block) of the present invention
Detailed description of the invention
Below in conjunction with the accompanying drawings, the present invention is described further.
As it is shown in figure 1, embodiment 1: the technical solution used in the present invention is: the update method of a kind of network monitoring daily record,
It is characterized in that, set up mapping table, described mapping table storage have key value, tables of data, data base, API daily record right
Should be related to, each data base comprises multiple tables of data, and in each tables of data, record has a value value corresponding with key value, described more
New method is further comprising the steps of: S1, acquisition network monitoring daily record are also updated, by described network monitoring daily record to be sent to
Message handling system；S2, each node of message handling system obtain described network monitoring daily record；S3, traversal obtain described net
Key value in the data of network monitoring daily record and value value；S4, according in S3 obtain each key value from described mapping table
The corresponding data base of middle lookup and tables of data；S5, generation trusted file list: comprise the following steps: obtain in system disk
Unique mark of each system file；By described identification record in a dynamic library file；According to described dynamic library file, generate
One trusted file list.
Embodiment 2: the technical solution used in the present invention is: the update method of a kind of network monitoring daily record, it is characterised in that
Setting up mapping table, described mapping table storage has key value, tables of data, data base, the corresponding relation of API daily record, each
Data base comprises multiple tables of data, and in each tables of data, record has the value value corresponding with key value, and described update method is also wrapped
Include following steps: S1, obtain network monitoring daily record and be updated, by described network monitoring daily record to be sent to Message Processing system
System；S2, each node of message handling system obtain described network monitoring daily record；S3, traversal obtain described network monitoring daily record
Data in key value and value value；S4, according in S3 obtain each key value search from described mapping table accordingly
Data base and tables of data；S5, generation trusted file list: comprise the following steps: obtain each system literary composition in system disk
Unique mark of part；By described identification record in a dynamic library file；According to described dynamic library file, generate a trusted file
List.Corresponding tables of data is searched using the value value of acquisition in described S3 step as search condition and obtains corresponding number
According to.
Embodiment 3: the technical solution used in the present invention is: the update method of a kind of network monitoring daily record, it is characterised in that
Setting up mapping table, described mapping table storage has key value, tables of data, data base, the corresponding relation of API daily record, each
Data base comprises multiple tables of data, and in each tables of data, record has the value value corresponding with key value, and described update method is also wrapped
Include following steps: S1, obtain network monitoring daily record and be updated, by described network monitoring daily record to be sent to Message Processing system
System；S2, each node of message handling system obtain described network monitoring daily record；S3, traversal obtain described network monitoring daily record
Data in key value and value value；S4, according in S3 obtain each key value search from described mapping table accordingly
Data base and tables of data；S5, generation trusted file list: comprise the following steps: obtain each system literary composition in system disk
Unique mark of part；By described identification record in a dynamic library file；According to described dynamic library file, generate a trusted file
List.Run after fame with key-value to weigh by the data content found and be newly packaged into the data of json form, by the number after encapsulation
Combine according to the initial data with described network monitoring daily record.
Embodiment 4: the technical solution used in the present invention is: the update method of a kind of network monitoring daily record, it is characterised in that
Setting up mapping table, described mapping table storage has key value, tables of data, data base, the corresponding relation of API daily record, each
Data base comprises multiple tables of data, and in each tables of data, record has the value value corresponding with key value, and described update method is also wrapped
Include following steps: S1, obtain network monitoring daily record and be updated, by described network monitoring daily record to be sent to Message Processing system
System；S2, each node of message handling system obtain described network monitoring daily record；S3, traversal obtain described network monitoring daily record
Data in key value and value value；S4, according in S3 obtain each key value search from described mapping table accordingly
Data base and tables of data；S5, generation trusted file list: comprise the following steps: obtain each system literary composition in system disk
Unique mark of part；By described identification record in a dynamic library file；According to described dynamic library file, generate a trusted file
List.Data after combination are stored in a network log information retrieval system.
Embodiment 5: the technical solution used in the present invention is: the update method of a kind of network monitoring daily record, it is characterised in that
Setting up mapping table, described mapping table storage has key value, tables of data, data base, the corresponding relation of API daily record, each
Data base comprises multiple tables of data, and in each tables of data, record has the value value corresponding with key value, and described update method is also wrapped
Include following steps: S1, obtain network monitoring daily record and be updated, by described network monitoring daily record to be sent to Message Processing system
System；S2, each node of message handling system obtain described network monitoring daily record；S3, traversal obtain described network monitoring daily record
Data in key value and value value；S4, according in S3 obtain each key value search from described mapping table accordingly
Data base and tables of data；S5, generation trusted file list: comprise the following steps: obtain each system literary composition in system disk
Unique mark of part；By described identification record in a dynamic library file；According to described dynamic library file, generate a trusted file
List.From the sequence that the hash value of each system file of described dynamic library file is formed, form described trusted file row
Table.
Embodiment 6: the technical solution used in the present invention is: the update method of a kind of network monitoring daily record, it is characterised in that
Setting up mapping table, described mapping table storage has key value, tables of data, data base, the corresponding relation of API daily record, each
Data base comprises multiple tables of data, and in each tables of data, record has the value value corresponding with key value, and described update method is also wrapped
Include following steps: S1, obtain network monitoring daily record and be updated, by described network monitoring daily record to be sent to Message Processing system
System；S2, each node of message handling system obtain described network monitoring daily record；S3, traversal obtain described network monitoring daily record
Data in key value and value value；S4, according in S3 obtain each key value search from described mapping table accordingly
Data base and tables of data；S5, generation trusted file list: comprise the following steps: obtain each system literary composition in system disk
Unique mark of part；By described identification record in a dynamic library file；According to described dynamic library file, generate a trusted file
List.Described dynamic base can dynamically apply for the hash value of multiple described system file.
Those skilled in the art are it is to be understood that the protection scheme of the present invention is not limited only to the above embodiments, it is also possible to
Various permutation and combination and conversion is carried out, on the premise of spirit of the present invention, to the present invention on the basis of above-described embodiment
The various conversion carried out all fall within protection scope of the present invention.
Claims (4)
1. the update method of a network monitoring daily record, it is characterised in that set up mapping table, described mapping table stores
Having key value, tables of data, data base, the corresponding relation of API daily record, each data base comprises multiple tables of data, in each tables of data
Record has the value value corresponding with key value, and described update method is further comprising the steps of: S1, acquisition network monitoring daily record are gone forward side by side
Row updates, by described network monitoring daily record to be sent to message handling system；S2, each node of message handling system obtain institute
State network monitoring daily record；S3, traversal obtain the key value in the data of described network monitoring daily record and value value；S4, according to S3
Each key value of middle acquisition searches corresponding data base and tables of data from described mapping table；S5, generation trusted file
List: comprise the following steps: obtain unique mark of each system file in system disk；Described identification record is dynamic one
In library file；According to described dynamic library file, generate a trusted file list；With in described S3 step in corresponding tables of data
The value value obtained is searched as search condition and is obtained corresponding data；The data content found is run after fame with key-value
Weigh and be newly packaged into the data of json form, by the initial data combination of the data after encapsulation with described network monitoring daily record.
The update method of network monitoring daily record the most according to claim 1, it is characterised in that by the data storage after combination
In a network log information retrieval system.
The update method of network monitoring daily record the most according to claim 1, it is characterised in that from described dynamic library file
In the sequence that the hash value of each system file is formed, form described trusted file list.
The update method of network monitoring daily record the most according to claim 1, it is characterised in that described dynamic base can dynamic Shen
Please the hash value of multiple described system files.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610490609.0A CN106202219A (en) | 2016-06-27 | 2016-06-27 | A kind of update method of network monitoring daily record |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610490609.0A CN106202219A (en) | 2016-06-27 | 2016-06-27 | A kind of update method of network monitoring daily record |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106202219A true CN106202219A (en) | 2016-12-07 |
Family
ID=57462279
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610490609.0A Withdrawn CN106202219A (en) | 2016-06-27 | 2016-06-27 | A kind of update method of network monitoring daily record |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106202219A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108399175A (en) * | 2017-02-07 | 2018-08-14 | 阿里巴巴集团控股有限公司 | A kind of storage of data, querying method and its device |
| CN108459939A (en) * | 2018-01-08 | 2018-08-28 | 平安科技（深圳）有限公司 | A kind of log collecting method, device, terminal device and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100318527A1 (en) * | 2009-05-26 | 2010-12-16 | Sagnik Nandy | Dynamically generating aggregate tables |
| CN102930207A (en) * | 2012-04-27 | 2013-02-13 | 北京金山安全软件有限公司 | API log monitoring method and device |
| CN103379140A (en) * | 2012-04-17 | 2013-10-30 | 中国移动通信集团公司 | Log processing rule synchronization method and relative device and system |
| CN104965935A (en) * | 2015-08-06 | 2015-10-07 | 携程计算机技术（上海）有限公司 | Update method for network monitoring log |
-
2016
- 2016-06-27 CN CN201610490609.0A patent/CN106202219A/en not_active Withdrawn
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100318527A1 (en) * | 2009-05-26 | 2010-12-16 | Sagnik Nandy | Dynamically generating aggregate tables |
| CN103379140A (en) * | 2012-04-17 | 2013-10-30 | 中国移动通信集团公司 | Log processing rule synchronization method and relative device and system |
| CN102930207A (en) * | 2012-04-27 | 2013-02-13 | 北京金山安全软件有限公司 | API log monitoring method and device |
| CN104965935A (en) * | 2015-08-06 | 2015-10-07 | 携程计算机技术（上海）有限公司 | Update method for network monitoring log |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108399175A (en) * | 2017-02-07 | 2018-08-14 | 阿里巴巴集团控股有限公司 | A kind of storage of data, querying method and its device |
| CN108399175B (en) * | 2017-02-07 | 2022-04-12 | 阿里巴巴集团控股有限公司 | Data storage and query method and device |
| CN108459939A (en) * | 2018-01-08 | 2018-08-28 | 平安科技（深圳）有限公司 | A kind of log collecting method, device, terminal device and storage medium |
| CN108459939B (en) * | 2018-01-08 | 2020-06-23 | 平安科技（深圳）有限公司 | Log collection method and device, terminal equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103488704B (en) | A kind of date storage method and device | |
| IL273860A (en) | Event context management system | |
| CN102799628B (en) | The method and apparatus of data partition is carried out in key-value database | |
| US9817858B2 (en) | Generating hash values | |
| CN104965935B (en) | The update method of network monitoring daily record | |
| CN103294785B (en) | A kind of packet-based metadata server cluster management method | |
| CN102663007B (en) | Data storage and query method supporting agile development and lateral spreading | |
| CN104216962A (en) | Mass network management data indexing design method based on HBase | |
| CN106790749A (en) | A kind of method that optimizing field name resolution speed is updated based on hosts | |
| CN107153644A (en) | A kind of method of data synchronization and device | |
| CN102402586A (en) | Distributed data storage method | |
| CN104462161A (en) | Structural data query method based on distributed database | |
| CN108337100B (en) | Cloud platform monitoring method and device | |
| CN102609464A (en) | Method and device for associative table query of MONGODB shards | |
| CN108322393B (en) | Routing link management method and system, virtual routing gateway and host machine gateway | |
| CN110427364A (en) | A kind of data processing method, device, electronic equipment and storage medium | |
| WO2014149671A3 (en) | Gateway system and process for ip enabled devices | |
| CN106202219A (en) | A kind of update method of network monitoring daily record | |
| CN104598652B (en) | A kind of data base query method and device | |
| CN107169003B (en) | Data association method and device | |
| US20210279240A1 (en) | Efficient storage method for time series data | |
| CN106126671A (en) | A kind of update method of network log | |
| CN103092767B (en) | A kind of management method to cloud computing internal physical machine information memory pool | |
| Schales et al. | FCCE: highly scalable distributed feature collection and correlation engine for low latency big data analytics | |
| KR101451280B1 (en) | Distributed database management system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20161207 |