CN108268342A - The storage arithmetic system and method for extensive IT monitoring datas - Google Patents
The storage arithmetic system and method for extensive IT monitoring datas Download PDFInfo
- Publication number
- CN108268342A CN108268342A CN201611262821.8A CN201611262821A CN108268342A CN 108268342 A CN108268342 A CN 108268342A CN 201611262821 A CN201611262821 A CN 201611262821A CN 108268342 A CN108268342 A CN 108268342A
- Authority
- CN
- China
- Prior art keywords
- data
- zabbix
- modules
- monitoring
- tairdb
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3034—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a storage system, e.g. DASD based or network based
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3055—Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a kind of the storage arithmetic systems and method of extensive IT monitoring datas, the storage arithmetic system of extensive IT monitoring datas includes Zabbix modules and TairDB modules, wherein Zabbix modules include Zabbix Agent modules etc., and wherein TairDB modules include distribution KV library modules, the first storage engines module, the second storage engines module.The storage operation method of extensive IT monitoring datas includes the following steps：Step 1: by the data of Zabbix modules, Step 2: the data of step 1 are converted, Step 3: the data of step 2 are saved in TairDB modules.The present invention can real-time monitoring data, storage and management mass data, operation is simple and speed is fast, and can manage 5,000 50000 equipment.
Description
Technical field
The present invention relates to the storage system and operation method of a kind of data, more particularly to a kind of extensive IT monitoring datas
Storage arithmetic system and method.
Background technology
Class software long-play is monitored, generates many data, a large amount of data can drag the operation of slow monitoring software, finally
Generate numerous failures.
The solution of traditional monitoring software is as follows：Tenth, limit equipment number and limit monitor control index, 11, reduce adopt
Collect frequency, 12, limit data retention over time.Traditional monitoring software, if not using cluster or distribution, it is most that list covers system
1000 equipment can about be managed.
Current data is intended to centralization, in extensive IT (Information Technology, Internet technology) ring
Under border, such as cloud computing environment, traditional monitoring software has been unable to meet actual monitored demand under these limiting factor (s)s：13, cloud
Calculating the extensive application of lower virtual machine, equipment number is into geometric growth, and 14, in order to find failure in time, failure is gripped
Kill in the primary stage, frequency acquisition cannot be below acquiring for 1 minute 1,15, for IT O＆Ms department, the even running of IT with
Effectively planning is the basic of guarantee business, and monitoring data is more and more important.
Invention content
The technical problems to be solved by the invention are to provide storage arithmetic system and the side of a kind of extensive IT monitoring datas
Method, can real-time monitoring data, storage and management mass data, operation is simple and speed is fast, and can manage 5000-
50000 equipment.
The present invention is to solve above-mentioned technical problem by following technical proposals：A kind of extensive IT monitoring datas are deposited
Arithmetic system is stored up, including：
Zabbix modules are connected with TairDB modules, for monitoring various network parameters, ensure the safety of server system
Operation, and it is existing various to solve the problems, such as system manager to be allowed quickly to position to provide flexible informing mechanism；
TairDB modules, data are deposited in disk, are led to data loss problem to solve disk failures, are counted
According to being backed up.
Preferably, the Zabbix modules include：
Zabbix Agent modules are connected with Zabbix Proxy modules, for sending the data after acquiring；
Zabbix Proxy modules are connected with Zabbix Server modules, for collecting data, and are uniformly sent to
Zabbix Server modules；
Zabbix Server modules are connected with Zabbix Agent modules, are sent for receiving Zabbix Agent modules
Report information core component, statistical data and operation data confirmed by it, and carries out data receipts to historical data
It holds back；
Mysql modules are connected with Zabbix Server modules, for reading the information of monitoring data；
Zabbix Web modules, are connected with Mysql modules, for checking the Zabbix pages, and read phase from Mysql modules
Close data.
Preferably, the TairDB modules include：
Distributed KV library modules are connected with the first storage engines module, are connected with the second storage engines module, for reading
With rewriting monitoring data；
LevelDB that first storage engines module and the second storage engines module are all increased income using Google, high performance
As the storage engines of bottom, when being used for the system failure, it can ensure that data are not lost.
The present invention also provides a kind of storage operation methods of extensive IT monitoring datas, include the following steps：
Step 1: Zabbix Server are analyzed and are handled to monitoring data, it is most of to send for result data
To TairDB, fraction is sent to Mysql；
Step 2: Zabbix Server are if necessary, history monitoring datas are read from TairDB；It is read from Mysql
Trends trend datas are wherefrom written data, just wherefrom read data；
Step 3: when user uses Zabbix Web checking monitoring results, monitoring strategies and trend number are read from Mysql
According to from TairDB reading monitoring datas.
Preferably, the type of monitoring data includes in the step 1：Floating number, daily record, character string, long character string, just
Integer.
Preferably, be sent in the step 1 TairDB result data include history, history_log,
The several history lists of history_str, history_text, history_uint, this partial data is very more, and TairDB is to storage
Data, all by string processing, therefore, it is necessary to correctly identify former data format；The result data for being sent to Mysql includes
Two Trends Sheets of trends, trends_uint, this partial data are fewer.
Preferably, in the step 2 from TairDB read data, need to be converted into former data format be：Floating number,
Daily record, character string, long character string, positive integer.
Preferably, Zabbix Server can be cached and subsequently be used and are transmitted across from Zabbix Proxy in the step 2
Come real-time monitoring data and a small amount of uncached historical data is only read from TairDB.
Preferably, Zabbix Web use the PHP pages in the step 3, need to add the reading to TairDB data
Driving is supported；Zabbix Web employ the order of sql sentences and read monitoring data, and the data in TairDB libraries are converted into required
Sql sentence order requests result.
Preferably, Zabbix Web are that batch reads monitoring data in most cases in the step 3, are utilized
The batch reading order of TairDB.
The positive effect of the present invention is：The present invention can remain the monitoring function and effect of Zabbix modules,
Manageable equipment scale is significantly greatly increased, easy means realize the redundancy of data service, storage and management mass data, real
When monitor class data, realize the reading and analysis of data, with TairDB modules, solve the storage and operation of extensive monitoring data
Problem, and the present invention can manage 5000-50000 platform equipment.
Description of the drawings
Fig. 1 is the structural diagram of the present invention.
Fig. 2 is the flow chart of operation method of the present invention.
Specific embodiment
Present pre-ferred embodiments are provided below in conjunction with the accompanying drawings, with the technical solution that the present invention will be described in detail.
As shown in Figure 1, the storage arithmetic system of the extensive IT monitoring datas of the present invention includes Zabbix (network monitoring) mould
Block, TairDB (storage database) module, wherein：
Zabbix modules are connected with TairDB modules, for monitoring various network parameters, ensure the safety of server system
Operation, and it is existing various to solve the problems, such as system manager to be allowed quickly to position to provide flexible informing mechanism；
TairDB modules, data are deposited in disk, are led to data loss problem to solve disk failures, are counted
According to being backed up.
The Zabbix modules include Zabbix Agent (agency) module, Zabbix Proxy (proxy server) mould
Block, Zabbix Server (server) module, Mysql (Relational DBMS) module, Zabbix Web (websites
Server) module, wherein：
Zabbix Agent modules are connected with Zabbix Proxy modules, for sending the data after acquiring；
Zabbix Proxy modules are connected with Zabbix Server modules, for collecting data, and are uniformly sent to
Zabbix Server modules；
Zabbix Server modules are connected with Zabbix Agent modules, are sent for receiving Zabbix Agent modules
Report information core component, statistical data and operation data confirmed by it, and carries out data receipts to historical data
It holds back；
Mysql modules are connected with Zabbix Server modules, for reading the information of monitoring data；
Zabbix Web modules, are connected with Mysql modules, for checking the Zabbix pages, and read phase from Mysql modules
Close data.
The TairDB modules include distribution KV (Key-Value stores database) library module, the first storage engines mould
Block, the second storage engines module, wherein：
Distributed KV library modules are connected with the first storage engines module, are connected with the second storage engines module, for reading
With rewriting monitoring data；
First storage engines module and the second storage engines module are all increased income using Google (Google), high-performance
Storage engines of the LevelDB (Google realize very efficient kv databases) as bottom, when being used for the system failure,
It can ensure that data are not lost.
As shown in Fig. 2, the storage operation method of the extensive IT monitoring datas of the present invention includes the following steps：
Step 1: Zabbix Server are analyzed and are handled to monitoring data, it is most of to send for result data
To TairDB, fraction is sent to Mysql；
Step 2: Zabbix Server are if necessary, history monitoring datas are read from TairDB；It is read from Mysql
Trends (for the font in terms of advertisement design) trend data, is wherefrom written data, just wherefrom reads data；
Step 3: when user uses Zabbix Web checking monitoring results, monitoring strategies and trend number are read from Mysql
According to from TairDB reading monitoring datas.
The type of monitoring data includes in the step 1：Floating number, daily record, character string, long character string, positive integer.
The result data that TairDB is sent in the step 1 includes history (floating number history lists), history_
Log (log history table), history_str (character string history lists), history_text (long character string history lists),
History_uint (positive integer history lists) several history lists, this partial data is very more, and TairDB is to the data of storage, whole
By string processing, therefore, it is necessary to correctly identify former data format.
The result data that Mysql is sent in the step 1 includes trends (floating number Trends Sheet), trends_uint
(positive integer Trends Sheet) two Trends Sheets, this partial data are fewer.
In the step 2 from TairDB read data, need to be converted into former data format be：Floating number, daily record, word
Accord with string, long character string, positive integer.
In the step 2 Zabbix Server can cache and subsequently use sended over from Zabbix Proxy it is real-time
Monitoring data and a small amount of uncached historical data is only read from TairDB.
Zabbix Web use PHP (HyperText Preprocessor) page in the step 3, need addition to TairDB numbers
According to reading driving support.
Zabbix Web employ sql (Structured Query Language, structuralized query in the step 3
Language) sentence order reading monitoring data, by the data in TairDB libraries, it is converted into the result of required sql sentence order requests.
Zabbix Web are that batch reads monitoring data in most cases in the step 3, utilize batch of TairDB
Reading order is measured, improves reading efficiency.
The operation principle of the present invention is as follows：User defines monitoring strategies (monitored object and monitoring mould in Zabbix Web
Formula), Mysql is written；Zabbix Server read monitoring strategies (monitored object and monitoring mode) from Mysql, are issued to
Zabbix Agent；A large amount of Zabbix Agent read monitoring data from monitored object, are sent to Zabbix Proxy；
Monitoring data after judging data validation, is sent to Zabbix Server by Zabbix Proxy as transfer.
Monitoring data has the characteristics that：
First, form is single；One equipment includes multiple components and includes hardware, operating system and multiple application software, each
Acquisition component includes multiple acquisition indexes, for ease of retrieval, can define：Acquire item=collecting device+acquisition component+acquisition
Index；Acquire item acquisition as a result, general divide floating number, such as CPU (Central Processing Unit, central processing unit)
Utilization rate, integer, such as process number, character string, such as a kind of syslog (the log recording sides provided in the outstanding Nice systems of UNIX
Method)；
2nd, data volume is big；If 5000 machines, 100 indexs of every machine acquire, wouldn't calculate acquisition and refer to for 1 minute 1
Extra data caused by mark, 1 day acquisition index number：5000*100*60*24=720.000.000=7.2 hundred million；If one
Acquisition index stores 40 bytes, 1 day data amount of storage：720.000.000*40=26Gbytes；30 days acquisition index numbers：
720.000.000*30=21.600.000.000=216 hundred million；30 day data amount of storage：26Gbytes (byte) * 30=
780Gbytes；
3rd, batch write and read；Acquisition module, such as by the Agent on pipe host, when carrying out index collection, usually once
The multiple indexs of batch capture, then, Agent is uniformly sent to central processing module, such as manages the Server of system, to reduce data
Library access times improve data storage efficiency, and Server is optimized to that multiple gathered datas are once written in batches as possible, show/point
Reading of the module to monitoring data is analysed, individual data reading or batch data is needed to read, individual data is read, and is such as adopted to some
Collect item, read the data of some time, batch data is read, and such as to some acquisition item, reads the data of some time interval；
4th, operation is simple；From in relevant database user's table, the management such as equipment list data it is different, monitoring data is transported
It is fairly simple, generally only individual data is needed to read, batch data is read, and batch data is restrained according to the time period；
5th, Data Convergence；The data of original detail, because the too big sometimes inconvenient intuitive presentation of amount, carries out Data Convergence,
Such as to 1 minute data, every 60 data can be carried out a Data Convergence, obtain 60 minutes monitored results, it can after Data Convergence
It obtains：Item, time started are acquired, end time, maximum value, minimum value, average value, wherein time are 60 minutes.
The storage of monitoring data has the characteristics that with operation：
6th, real-time；After monitoring data collection, Model Comparison need to be carried out immediately, if meeting certain condition, that is, generate alarm
Event, some monitoring systems are first put in storage, then read out analysis, relatively succinct in this way in design；Some monitoring systems are put in storage on one side,
It analyzes on one side, such operation efficiency is higher；
7th, large capacity；By analyzing above, even the gathered data of 1 day, quantity is also very big, relational database
The so big amount of management is not very real, preferably with Nonsql (database of non-relational) database；
8th, it is distributed；Single Nonsql databases also can not meet the requirement of magnanimity monitoring data, need using expansible
Distributed data base, data preferably can be shared equally multiple memory nodes, and read and write access can also share equally, entirely access road
It should not there are performance bottlenecks on diameter；
It 9th, can redundancy；Such a large amount of data, loss of data will be great loss, redundancy be supported also to be necessary, most
Strange land redundancy can be supported well.
Particular embodiments described above, the technical issues of to the solution of the present invention, technical solution and advantageous effect carry out
It is further described, it should be understood that the above is only a specific embodiment of the present invention, is not limited to
The present invention, all within the spirits and principles of the present invention, any modification, equivalent substitution, improvement and etc. done should be included in this
Within the protection domain of invention.
Claims (10)
1. a kind of storage arithmetic system of extensive IT monitoring datas, which is characterized in that it includes：
Zabbix modules are connected with TairDB modules, for monitoring various network parameters, ensure the safety fortune of server system
Battalion, and it is existing various to solve the problems, such as system manager to be allowed quickly to position to provide flexible informing mechanism；
TairDB modules, data are deposited in disk, lead to data loss problem to solve disk failures, by its data into
Row backup.
2. the storage arithmetic system of extensive IT monitoring datas as described in claim 1, which is characterized in that the Zabbix moulds
Block includes：
Zabbix Agent modules are connected with Zabbix Proxy modules, for sending the data after acquiring；
Zabbix Proxy modules are connected with Zabbix Server modules, for collecting data, and are uniformly sent to Zabbix
Server modules；
Zabbix Server modules are connected with Zabbix Agent modules, for receiving the report of Zabbix Agent modules transmission
The core component of information is accused, statistical data and operation data are confirmed by it, and carry out Data Convergence to historical data；
Mysql modules are connected with Zabbix Server modules, for reading the information of monitoring data；
Zabbix Web modules, are connected with Mysql modules, for checking the Zabbix pages, and read dependency number from Mysql modules
According to.
3. the storage arithmetic system of extensive IT monitoring datas as described in claim 1, which is characterized in that the TairDB moulds
Block includes：
Distributed KV library modules are connected with the first storage engines module, are connected with the second storage engines module, for reading and changing
Write monitoring data；
LevelDB that first storage engines module and the second storage engines module are all increased income using Google, high performance as
The storage engines of bottom when being used for the system failure, can ensure that data are not lost.
4. a kind of storage operation method of extensive IT monitoring datas, which is characterized in that it includes the following steps：
Step 1: Zabbix Server are analyzed and handled to monitoring data, for result data, largely it is sent to
TairDB, fraction are sent to Mysql；
Step 2: Zabbix Server are if necessary, history monitoring datas are read from TairDB；It is read from Mysql
Trends trend datas are wherefrom written data, just wherefrom read data；
Step 3: when user uses Zabbix Web checking monitoring results, monitoring strategies and trend data are read from Mysql, from
TairDB reads monitoring data.
5. the storage operation method of extensive IT monitoring datas as claimed in claim 4, which is characterized in that in the step 1
The type of monitoring data includes：Floating number, daily record, character string, long character string, positive integer.
6. the storage operation method of extensive IT monitoring datas as claimed in claim 4, which is characterized in that in the step 1
Be sent to TairDB result data include history, history_log, history_str, history_text,
The several history lists of history_uint, this partial data is very more, and TairDB is to the data of storage, all by string processing,
Therefore, it is necessary to correctly identify former data format；The result data for being sent to Mysql becomes including trends, trends_uint two
Gesture table, this partial data are fewer.
7. the storage operation method of extensive IT monitoring datas as claimed in claim 4, which is characterized in that in the step 2
From TairDB read data, need to be converted into former data format be：Floating number, daily record, character string, long character string, positive integer.
8. the storage operation method of extensive IT monitoring datas as claimed in claim 4, which is characterized in that in the step 2
Zabbix Server can be cached and subsequently be used from the Zabbix Proxy real-time monitoring datas sended over and from TairDB only
Read a small amount of uncached historical data.
9. the storage operation method of extensive IT monitoring datas as claimed in claim 4, which is characterized in that in the step 3
Zabbix Web use the PHP pages, and the driving for adding the reading to TairDB data is needed to support；Zabbix Web are employed
Monitoring data is read in the order of sql sentences, by the data in TairDB libraries, is converted into the result of required sql sentence order requests.
10. the storage operation method of extensive IT monitoring datas as claimed in claim 4, which is characterized in that the step 3
Middle Zabbix Web are that batch reads monitoring data in most cases, utilize the batch reading order of TairDB.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611262821.8A CN108268342A (en) | 2016-12-30 | 2016-12-30 | The storage arithmetic system and method for extensive IT monitoring datas |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611262821.8A CN108268342A (en) | 2016-12-30 | 2016-12-30 | The storage arithmetic system and method for extensive IT monitoring datas |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108268342A true CN108268342A (en) | 2018-07-10 |
Family
ID=62755339
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611262821.8A Pending CN108268342A (en) | 2016-12-30 | 2016-12-30 | The storage arithmetic system and method for extensive IT monitoring datas |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108268342A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112732514A (en) * | 2020-12-22 | 2021-04-30 | 航天信息股份有限公司 | Zabbix monitoring system based on distributed relational database |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103338135A (en) * | 2013-07-05 | 2013-10-02 | 山东大学 | Real-time monitoring method of cluster storage capacity |
| CN103605722A (en) * | 2013-11-15 | 2014-02-26 | 北京奇虎科技有限公司 | Method, device and equipment for database monitoring |
| CN104331505A (en) * | 2014-11-20 | 2015-02-04 | 合一网络技术(北京)有限公司 | Distributed acquisition and storage-based monitoring system |
| US20150106485A1 (en) * | 2013-10-15 | 2015-04-16 | Tata Consultancy Services Limited | System and Method for Facilitating Design Configuration and Management of Data Center |
| CN106250305A (en) * | 2016-08-17 | 2016-12-21 | 浪潮电子信息产业股份有限公司 | Self-adaptive control method for data acquisition period of monitoring system in cloud computing environment |
-
2016
- 2016-12-30 CN CN201611262821.8A patent/CN108268342A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103338135A (en) * | 2013-07-05 | 2013-10-02 | 山东大学 | Real-time monitoring method of cluster storage capacity |
| US20150106485A1 (en) * | 2013-10-15 | 2015-04-16 | Tata Consultancy Services Limited | System and Method for Facilitating Design Configuration and Management of Data Center |
| CN103605722A (en) * | 2013-11-15 | 2014-02-26 | 北京奇虎科技有限公司 | Method, device and equipment for database monitoring |
| CN104331505A (en) * | 2014-11-20 | 2015-02-04 | 合一网络技术(北京)有限公司 | Distributed acquisition and storage-based monitoring system |
| CN106250305A (en) * | 2016-08-17 | 2016-12-21 | 浪潮电子信息产业股份有限公司 | Self-adaptive control method for data acquisition period of monitoring system in cloud computing environment |
Non-Patent Citations (3)
| Title |
|---|
| 何文涛: "面向集群监控的数据采集处理及存储系统的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 刘浩DE技术博客: "Tair监控及统计技巧", 《HTTPS://WWW.CNBLOGS.COM/LIUHAO/ARCHIVE/2013/04/11/3015329.HTML?UTM_SOURCE=TUICOOL》 * |
| 茁壮的小草: "zabbix实现原理及架构详解", 《HTTPS://WWW.CNBLOGS.COM/MYSQL-DBA/P/5010902.HTML》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112732514A (en) * | 2020-12-22 | 2021-04-30 | 航天信息股份有限公司 | Zabbix monitoring system based on distributed relational database |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11316727B2 (en) | Method and system for clustering event messages and manage event-message clusters | |
| US11238069B2 (en) | Transforming a data stream into structured data | |
| AU2017202873B2 (en) | Efficient query processing using histograms in a columnar database | |
| US9052938B1 (en) | Correlation and associated display of virtual machine data and storage performance data | |
| JP6388655B2 (en) | Generation of multi-column index of relational database by data bit interleaving for selectivity | |
| US11977532B2 (en) | Log record identification using aggregated log indexes | |
| CN108021809A (en) | A kind of data processing method and system | |
| US10860562B1 (en) | Dynamic predicate indexing for data stores | |
| CN104426713A (en) | Method and device for monitoring network site access effect data | |
| CN107729219A (en) | Resource monitoring method, device and terminal based on super fusion storage system | |
| CN107343021A (en) | A kind of Log Administration System based on big data applied in state's net cloud | |
| CN108337100B (en) | Cloud platform monitoring method and device | |
| AU2021244852B2 (en) | Offloading statistics collection | |
| CN103530429A (en) | Webpage content extracting method | |
| CN110598051A (en) | Power industry monitoring system, method and device | |
| CN109543089A (en) | Classification method, system and related device of network security information data | |
| CN112506954A (en) | Database auditing method and device | |
| CN114398343A (en) | Database abnormal key processing method, device, equipment and medium | |
| CN106570151A (en) | Data collection processing method and system for mass files | |
| CN109446167A (en) | A kind of storage of daily record data, extracting method and device | |
| CN109614380A (en) | Log processing method, system, computer equipment and readable medium | |
| CN113722416A (en) | Data cleaning method, device and equipment and readable storage medium | |
| CN108268342A (en) | The storage arithmetic system and method for extensive IT monitoring datas | |
| CN115168474B (en) | Internet of things central station system building method based on big data model | |
| CN105245394A (en) | Method and equipment for analyzing network access log based on layered approach |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180710 |
|
| RJ01 | Rejection of invention patent application after publication |