CN104579777A - Log management system and implementation method - Google Patents
Log management system and implementation method Download PDFInfo
- Publication number
- CN104579777A CN104579777A CN201510005070.0A CN201510005070A CN104579777A CN 104579777 A CN104579777 A CN 104579777A CN 201510005070 A CN201510005070 A CN 201510005070A CN 104579777 A CN104579777 A CN 104579777A
- Authority
- CN
- China
- Prior art keywords
- daily record
- log
- node
- unit
- control unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention provides a log management system and an implementation method. The system comprises one or more log pushing units, a log collecting unit, a log calculation and analysis unit and a log service control unit, wherein the log pushing unit pushes logs generated by one or more application operation nodes to the log collecting unit; the log collecting unit is used for collecting received logs, caching the logs, sending the logs to a log storage unit in an event form and monitoring whether the logs have been stored in the log storage unit, and if the logs have been stored in the log storage unit, the cached logs are deleted; the log calculation and analysis unit is used for analyzing and calculating the logs stored in the log storage unit according to analysis and computation rules, having access to the log storage unit after receiving an inquiry request sent by the log service control unit, obtaining a corresponding log and returning the corresponding log to the log service control unit; the log service control unit sends the analysis and computation rules to the log calculation and analysis unit, sends the inquiry request and provides the received logs for users. Problems generated by decentralized management of logs can be solved according to the log management system and the implementation method.
Description
Technical field
The present invention relates to field of computer technology, particularly Log Administration System and implementation method.
Background technology
In computer communication technology, in order to record the access behavior of application access person, a large amount of daily records can be produced at network side.These daily records can save by network side, so that subsequent query.
At present, the method that daily record manages is comprised: application runs node and produces daily record according to the access behavior of application access person, and preserves daily record in self; Follow-up, when needs inquiry log, obtain the IP address that corresponding application runs node, run inquiry log node from this application.
Described as can be seen from above, in the prior art, daily record is that distributed and saved is run on node in each application, that is, different application runs the daily record distributed and saved that node produces, and due to application, to run number of nodes numerous and IP address different, like this, during user's inquiry log, not easily obtain the concrete IP address needing the application of inquiry to run node.Further, due to daily record distributed and saved, not easily integrated management is carried out to daily record, reduce the flexibility of business realizing.
Summary of the invention
The embodiment of the present invention provides Log Administration System and method, solves the decentralized problem of daily record.
The first Log Administration System, comprising:
Daily record push unit, for preserving predefined journal format, is pushed to log collection unit by the daily record that more than one application runs node generation according to described journal format;
Log collection unit, collects the daily record received, carry out buffer memory, daily record is sent to log storage unit with event form, and whether monitoring journal is stored into log storage unit to daily record, if so, then deletes the daily record of institute's buffer memory;
Log storage unit, the daily record received by storage;
Daily record computational analysis unit, according to analytical calculation rule, analysis and calculation is carried out to the daily record stored in log storage unit, after receiving the inquiry request that log services control unit sends, access log memory cell, obtain corresponding daily record, return to log services control unit;
Log services control unit, sends analytical calculation rule to daily record computational analysis unit, and sends inquiry request, provide the daily record received to user.
Described daily record computational analysis unit accesses the data in described log storage unit in the form of streaming.
The second Log Administration System, comprising:
Daily record pushes engine, and more than one application being arranged in paas platform runs node, for preserving predefined journal format, the daily record that more than one application operation node produces is pushed to flume node according to described journal format;
Flume node, for collecting the daily record received, carrying out buffer memory, daily record is sent to HDFS with event form to daily record, and whether monitoring journal is stored into HDFS, if so, then deletes the daily record of institute's buffer memory;
HDFS, the daily record received by storage;
Impala node, carries out analysis and calculation according to analytical calculation rule to the daily record stored in HDFS, and after receiving the inquiry request that log services control unit sends, access HDFS, obtains corresponding daily record, return to log services control unit;
Log services control unit, sends analytical calculation rule to impala node and sends inquiry request, providing the daily record received to user.
In the second Log Administration System, described impala node accesses the data in described HDFS in the form of streaming.
In the second Log Administration System, described impala node provides SQL semantic further, to inquire about the data in described HDFS.
A kind of blog management method, be applied in any one structure of the first Log Administration System above-mentioned, the method comprises:
The daily record that more than one application runs node generation is pushed to log collection unit according to default journal format by more than one daily record push unit;
Log collection unit collects the daily record received, and carries out buffer memory, daily record is sent to log storage unit with event form to daily record,
Daily record received by log storage unit stores;
Whether log collection unit monitoring journal is stored into log storage unit, if so, then deletes the daily record of institute's buffer memory;
The analytical calculation rule that daily record computational analysis unit is sent according to log services control unit carries out analysis and calculation to the daily record stored in log storage unit;
After daily record computational analysis unit receives the inquiry request that log services control unit sends, access log memory cell, obtains corresponding daily record, returns to log services control unit;
Log services control unit provides the daily record received to user.
A kind of blog management method, be applied in any one structure of above-mentioned the second Log Administration System, the method comprises:
Daily record pushes engine and the daily record that more than one application runs node generation is pushed to flume node according to described journal format;
Flume node collects the daily record received, and carries out buffer memory, daily record is sent to HDFS with event form to daily record, and whether monitoring journal is stored into HDFS, if so, then deletes the daily record of institute's buffer memory;
Log services control unit sends analytical calculation rule to impala node, and impala node carries out analysis and calculation according to analytical calculation rule to the daily record stored in HDFS;
Log services control unit sends log query request to impala node, and impala node visit HDFS, obtains corresponding daily record, returns to log services control unit;
Log services control unit provides the daily record received to user.
Described impala node visit HDFS comprises: described impala node accesses the data in described HDFS in the form of streaming.
Comprise further: described impala node provides SQL semantic further, to inquire about the data in described HDFS.
Embodiments provide a kind of Log Administration System and method, utilize the compounding practice of daily record push unit, log collection unit, log storage unit, daily record computational analysis unit and log services control unit, the unified of daily record can be realized collect, store, manage and inquire about, thus solve the decentralized problem of daily record, such as, due to unified query daily record, therefore unified address is used to inquire about, when avoiding user's inquiry log in prior art, not easily obtain the concrete IP address needing the application of inquiry to run node.For another example, concentrate due to daily record and preserve, integrated management can be carried out to daily record, improve the flexibility of business realizing.
Further, a kind of distributed information log management system implementation method that the embodiment of the present invention provides, the problem that inconvenience checks is deposited in the application daily record dispersion that can solve many tenants in paas platform; Solve the problem that inconvenience management is deposited in daily record dispersion; Solve by these collection of log data to together, for this technical barrier of subsequent analysis.Meanwhile, by HDFS stores service, both can support the quick storage of massive logs data, the rapid analysis inquiry of daily record data can be realized again by impala technology.The embodiment of the present invention have multinode daily record data unify maintenance management, the inquiry of massive logs data quick storage, easy to use, reduce configuration difficulty, reduce the features such as operation management difficulty, have good value for applications.
Accompanying drawing explanation
Fig. 1 is the structural representation of Log Administration System in one embodiment of the invention.
Fig. 2 is the structural representation of Log Administration System in another embodiment of the present invention.
Fig. 3 is the flow chart of blog management method in one embodiment of the invention.
Fig. 4 is the flow chart of blog management method in another embodiment of the present invention.
Embodiment
One embodiment of the invention proposes a kind of Log Administration System, and see Fig. 1, this system comprises:
Daily record push unit 101, for preserving predefined journal format, is pushed to log collection unit 102 by the daily record that more than one application runs node generation according to described journal format;
Log collection unit 102, collects the daily record received, carry out buffer memory, daily record is sent to log storage unit 103 with event form, and whether monitoring journal has been stored into log storage unit 103 to daily record, if so, then deletes the daily record of institute's buffer memory;
Log storage unit 103, the daily record received by storage;
Daily record computational analysis unit 104, according to analytical calculation rule, analysis and calculation is carried out to the daily record stored in log storage unit 103, after receiving the inquiry request that log services control unit 105 sends, access log memory cell 103, obtain corresponding daily record, return to log services control unit 105;
Log services control unit 105, sends analytical calculation rule to daily record computational analysis unit 104, and sends inquiry request, provides the daily record received to user.
Another embodiment of the present invention proposes another kind of Log Administration System, see Fig. 2, this system is particularly useful for the management of the application daily record of many tenants in paas platform, and, can collect daily record, HDFS technology storing daily record and impala technology based on flume technology and carry out log analysis inquiry, the conbined usage based on these technology can better manage daily record.The system construction drawing of the embodiment of the present invention based on this situation can be shown in Figure 2, comprising:
Daily record pushes engine 201, and more than one application being arranged in paas platform runs node, for preserving predefined journal format, the daily record that more than one application operation node produces is pushed to flume node 202 according to described journal format;
Flume node 202, for collecting the daily record received, carries out buffer memory to daily record, daily record is sent to HDFS 203 with event form, and whether monitoring journal has been stored into HDFS 203, if so, then deletes the daily record of institute's buffer memory;
HDFS 203, the daily record received by storage;
Impala node 204, according to analytical calculation rule, analysis and calculation is carried out to the daily record stored in HDFS 203, after receiving the inquiry request that log services control unit 205 sends, access HDFS 203, obtain corresponding daily record, return to log services control unit 205;
Log services control unit 205, sends analytical calculation rule to impala node 204 and sends inquiry request, providing the daily record received to user.
Based on system shown in Figure 2, in some embodiments of the invention, impala node 204 accesses the data in described HDFS 203 in the form of streaming.
Based on system shown in Figure 2, in some embodiments of the invention, impala node 204 provides SQL semantic further, to inquire about the data in described HDFS 203.
Based on system shown in Figure 2, in some embodiments of the invention, daily record propelling movement engine 201 is connected with flume node 202 by Log4j interface.
Based on the system of the embodiment of the present invention shown in above-mentioned Fig. 2, daily record computational analysis unit 104 in impala node can utilize impala technology, analysis and calculation is carried out according to the daily record of the rule preset to the log storage unit 103 being arranged in HDFS, and by the data in the log storage unit 103 in the form access HDFS of stream.
In the business realizing of reality, along with the development of computer science and technology, the arrival of cloud computing, a lot of application has been deployed to no longer separately independently on server, but operates in paas platform with the deployment that the mode of tenant is unified.In paas platform, every day all can produce massive logs like this; the application developer be published on platform often can be checked the application daily record of oneself to check the running status of application and to check application system problem simultaneously; due to dispersiveness, the magnanimity of daily record data, the non-singularity of tenant of application example, these provide application-specific daily record to bring certain difficulty to appointment developer all to paas platform.The system of the embodiment of the present invention shown in Fig. 2 can unified for all application daily records of all tenants collection, unified storage, unified calculation, unified query, unified management, all like this developers only need unified log services control desk to arrange according to the application of oneself daily record that specified conditions just can check oneself very easily, operation maintenance personnel also can in service console control and management log services, so just can improve the operating efficiency of developer and operation maintenance personnel.
In addition, in the system of the embodiment of the present invention, because flume node is after the daily record that have collected each application operation node, not only send to HDFS, but the daily record also received by further buffer memory, determining to aim at day storing successfully in HDFS, just can delete the daily record of buffer memory, thus further ensure the fail safe of daily record preservation.
See Fig. 3, one embodiment of the invention also proposed a kind of blog management method, and the method is based on the structure of the Log Administration System shown in Fig. 1, and the method comprises:
Step 301: the daily record that more than one application runs node generation is pushed to log collection unit according to default journal format by more than one daily record push unit.
Step 302: log collection unit collects the daily record received, and carries out buffer memory, daily record is sent to log storage unit with event form to daily record.
Step 303: the daily record received by log storage unit stores.
Step 304: whether log collection unit monitoring journal is stored into log storage unit, if so, then deletes the daily record of institute's buffer memory.
Step 305: the analytical calculation rule that daily record computational analysis unit is sent according to log services control unit carries out analysis and calculation to the daily record stored in log storage unit.
Step 306: after daily record computational analysis unit receives the inquiry request that log services control unit sends, access log memory cell, obtains corresponding daily record, returns to log services control unit.
Step 307: log services control unit provides the daily record received to user.
See Fig. 4, another embodiment of the present invention also proposed a kind of blog management method, and the method is based on the structure of the Log Administration System shown in Fig. 2, and the method comprises:
In step 401:paas platform, more than one daily record pushes engine and the daily record that more than one application runs node generation is pushed to flume node according to default journal format.
In each embodiment of the present invention, daily record pushes the daily record propelling movement engine that engine can be lightweight.
Step 402:flume node adopts flume technology to collect the daily record received, and carries out buffer memory, daily record is sent to HDFS with event form to daily record.
Daily record received by step 403:HDFS stores.
Whether the daily record of step 404:flume node monitors is stored into HDFS, if so, then deletes the daily record of institute's buffer memory.
Step 405:impala node adopts impala technology, carries out analysis and calculation according to the analytical calculation rule that log services control unit is sent to the daily record stored in HDFS.
After step 406:impala node receives the inquiry request that log services control unit sends, access HDFS, obtains corresponding daily record, returns to log services control unit.
Step 407: log services control unit provides the daily record received to user.
It should be noted that, in this article, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or equipment and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or equipment.When not more restrictions, the key element " being comprised " limited by statement, and be not precluded within process, method, article or the equipment comprising described key element and also there is other identical factor.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment made, equivalent replacement, improvement etc., all should be included within the scope of protection of the invention.
Claims (10)
1. a Log Administration System, is characterized in that, comprising:
Daily record push unit, for preserving predefined journal format, is pushed to log collection unit by the daily record that more than one application runs node generation according to described journal format;
Log collection unit, collects the daily record received, carry out buffer memory, daily record is sent to log storage unit with event form, and whether monitoring journal is stored into log storage unit to daily record, if so, then deletes the daily record of institute's buffer memory;
Log storage unit, the daily record received by storage;
Daily record computational analysis unit, according to analytical calculation rule, analysis and calculation is carried out to the daily record stored in log storage unit, after receiving the inquiry request that log services control unit sends, access log memory cell, obtain corresponding daily record, return to log services control unit;
Log services control unit, sends analytical calculation rule to daily record computational analysis unit, and sends inquiry request, provide the daily record received to user.
2. system according to claim 1, is characterized in that, described daily record computational analysis unit accesses the data in described log storage unit in the form of streaming.
3. a Log Administration System, is characterized in that, comprising:
Daily record pushes engine, and more than one application being arranged in paas platform runs node, for preserving predefined journal format, the daily record that more than one application operation node produces is pushed to flume node according to described journal format;
Flume node, for collecting the daily record received, carrying out buffer memory, daily record is sent to HDFS with event form to daily record, and whether monitoring journal is stored into HDFS, if so, then deletes the daily record of institute's buffer memory;
HDFS, the daily record received by storage;
Impala node, carries out analysis and calculation according to analytical calculation rule to the daily record stored in HDFS, and after receiving the inquiry request that log services control unit sends, access HDFS, obtains corresponding daily record, return to log services control unit;
Log services control unit, sends analytical calculation rule to impala node and sends inquiry request, providing the daily record received to user.
4. system according to claim 3, is characterized in that, described impala node accesses the data in described HDFS in the form of streaming.
5. according to described system arbitrary in claims 1 to 3, it is characterized in that, described impala node provides SQL semantic further, to inquire about the data in described HDFS.
6. according to described system arbitrary in claims 1 to 3, it is characterized in that, described daily record is pushed engine and is connected with flume node by Log4j interface.
7. a blog management method, is characterized in that, be applied in system as claimed in claim 1 or 2, the method comprises:
The daily record that more than one application runs node generation is pushed to log collection unit according to default journal format by more than one daily record push unit;
Log collection unit collects the daily record received, and carries out buffer memory, daily record is sent to log storage unit with event form to daily record,
Daily record received by log storage unit stores;
Whether log collection unit monitoring journal is stored into log storage unit, if so, then deletes the daily record of institute's buffer memory;
The analytical calculation rule that daily record computational analysis unit is sent according to log services control unit carries out analysis and calculation to the daily record stored in log storage unit;
After daily record computational analysis unit receives the inquiry request that log services control unit sends, access log memory cell, obtains corresponding daily record, returns to log services control unit;
Log services control unit provides the daily record received to user.
8. a blog management method, is characterized in that, be applied to as in the system as described in arbitrary in claim 3 to 6, the method comprises:
Daily record pushes engine and the daily record that more than one application runs node generation is pushed to flume node according to described journal format;
Flume node collects the daily record received, and carries out buffer memory, daily record is sent to HDFS with event form to daily record, and whether monitoring journal is stored into HDFS, if so, then deletes the daily record of institute's buffer memory;
Log services control unit sends analytical calculation rule to impala node, and impala node carries out analysis and calculation according to analytical calculation rule to the daily record stored in HDFS;
Log services control unit sends log query request to impala node, and impala node visit HDFS, obtains corresponding daily record, returns to log services control unit;
Log services control unit provides the daily record received to user.
9. method according to claim 8, is characterized in that, described impala node visit HDFS comprises: described impala node accesses the data in described HDFS in the form of streaming.
10. method according to claim 8 or claim 9, is characterized in that, comprise further: described impala node provides SQL semantic further, to inquire about the data in described HDFS.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510005070.0A CN104579777A (en) | 2015-01-06 | 2015-01-06 | Log management system and implementation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510005070.0A CN104579777A (en) | 2015-01-06 | 2015-01-06 | Log management system and implementation method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104579777A true CN104579777A (en) | 2015-04-29 |
Family
ID=53095042
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510005070.0A Pending CN104579777A (en) | 2015-01-06 | 2015-01-06 | Log management system and implementation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104579777A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105005549A (en) * | 2015-07-31 | 2015-10-28 | 山东蚁巡网络科技有限公司 | User-defined chained log analysis device and method |
| CN105069108A (en) * | 2015-08-07 | 2015-11-18 | 新浪网技术(中国)有限公司 | Method and device for massive data query based on PaaS (Platform as a Service) system |
| CN105095502A (en) * | 2015-08-26 | 2015-11-25 | 浪潮电子信息产业股份有限公司 | Log collection method of cluster storage system |
| CN105306261A (en) * | 2015-09-29 | 2016-02-03 | 北京奇艺世纪科技有限公司 | Method, device and system for collecting logs |
| CN105553716A (en) * | 2015-12-12 | 2016-05-04 | 天津南大通用数据技术股份有限公司 | Fetch and display system of each node log under large-scale cluster |
| CN105808414A (en) * | 2016-03-08 | 2016-07-27 | 联想(北京)有限公司 | Log processing method and log processing electronic equipment |
| CN106708917A (en) * | 2016-06-30 | 2017-05-24 | 腾讯科技（深圳）有限公司 | Data processing method and device and OLAP system |
| CN107609158A (en) * | 2017-09-26 | 2018-01-19 | 北京计算机技术及应用研究所 | A kind of Highly reliable data acquisition and storage method based on Flume |
| CN107704478A (en) * | 2017-01-16 | 2018-02-16 | 贵州白山云科技有限公司 | A kind of method and system for writing daily record |
| CN108073349A (en) * | 2016-11-08 | 2018-05-25 | 北京国双科技有限公司 | The transmission method and device of data |
| CN109977090A (en) * | 2019-01-25 | 2019-07-05 | 福建天泉教育科技有限公司 | A kind of method and terminal to HDFS write-in data |
| CN111427903A (en) * | 2020-03-27 | 2020-07-17 | 四川虹美智能科技有限公司 | Log information acquisition method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110145217A1 (en) * | 2009-12-15 | 2011-06-16 | Maunder Anurag S | Systems and methods for facilitating data discovery |
| CN102111285A (en) * | 2009-12-24 | 2011-06-29 | 北京云快线软件服务有限公司 | Method and system for managing log information |
| CN102411533A (en) * | 2011-08-08 | 2012-04-11 | 浪潮电子信息产业股份有限公司 | Log-management optimizing method for clustered storage system |
| CN102750326A (en) * | 2012-05-30 | 2012-10-24 | 浪潮电子信息产业股份有限公司 | Log management optimization method of cluster system based on downsizing strategy |
-
2015
- 2015-01-06 CN CN201510005070.0A patent/CN104579777A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110145217A1 (en) * | 2009-12-15 | 2011-06-16 | Maunder Anurag S | Systems and methods for facilitating data discovery |
| CN102111285A (en) * | 2009-12-24 | 2011-06-29 | 北京云快线软件服务有限公司 | Method and system for managing log information |
| CN102411533A (en) * | 2011-08-08 | 2012-04-11 | 浪潮电子信息产业股份有限公司 | Log-management optimizing method for clustered storage system |
| CN102750326A (en) * | 2012-05-30 | 2012-10-24 | 浪潮电子信息产业股份有限公司 | Log management optimization method of cluster system based on downsizing strategy |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105005549A (en) * | 2015-07-31 | 2015-10-28 | 山东蚁巡网络科技有限公司 | User-defined chained log analysis device and method |
| CN105069108B (en) * | 2015-08-07 | 2019-05-07 | 新浪网技术(中国)有限公司 | Based on PaaS system big data querying method and device |
| CN105069108A (en) * | 2015-08-07 | 2015-11-18 | 新浪网技术(中国)有限公司 | Method and device for massive data query based on PaaS (Platform as a Service) system |
| CN105095502A (en) * | 2015-08-26 | 2015-11-25 | 浪潮电子信息产业股份有限公司 | Log collection method of cluster storage system |
| CN105306261A (en) * | 2015-09-29 | 2016-02-03 | 北京奇艺世纪科技有限公司 | Method, device and system for collecting logs |
| CN105553716A (en) * | 2015-12-12 | 2016-05-04 | 天津南大通用数据技术股份有限公司 | Fetch and display system of each node log under large-scale cluster |
| CN105808414A (en) * | 2016-03-08 | 2016-07-27 | 联想(北京)有限公司 | Log processing method and log processing electronic equipment |
| CN106708917A (en) * | 2016-06-30 | 2017-05-24 | 腾讯科技（深圳）有限公司 | Data processing method and device and OLAP system |
| CN106708917B (en) * | 2016-06-30 | 2019-03-15 | 腾讯科技（深圳）有限公司 | A kind of data processing method, device and OLAP system |
| CN108073349B (en) * | 2016-11-08 | 2021-02-12 | 北京国双科技有限公司 | Data transmission method and device |
| CN108073349A (en) * | 2016-11-08 | 2018-05-25 | 北京国双科技有限公司 | The transmission method and device of data |
| CN107704478A (en) * | 2017-01-16 | 2018-02-16 | 贵州白山云科技有限公司 | A kind of method and system for writing daily record |
| CN107609158A (en) * | 2017-09-26 | 2018-01-19 | 北京计算机技术及应用研究所 | A kind of Highly reliable data acquisition and storage method based on Flume |
| CN109977090A (en) * | 2019-01-25 | 2019-07-05 | 福建天泉教育科技有限公司 | A kind of method and terminal to HDFS write-in data |
| CN111427903A (en) * | 2020-03-27 | 2020-07-17 | 四川虹美智能科技有限公司 | Log information acquisition method and device |
| CN111427903B (en) * | 2020-03-27 | 2023-04-21 | 四川虹美智能科技有限公司 | Log information acquisition method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104579777A (en) | Log management system and implementation method | |
| US10021202B1 (en) | Pushed based real-time analytics system | |
| CN104506632B (en) | One kind is based on distributed polycentric resource sharing system and method | |
| US9317223B2 (en) | Method and apparatus for automated migration of data among storage centers | |
| CN105335513B (en) | A kind of distributed file system and file memory method | |
| US10459884B1 (en) | Filesystem block sampling to identify user consumption of storage resources | |
| CN105824744A (en) | Real-time log collection and analysis method on basis of B2B (Business to Business) platform | |
| CN107800808A (en) | A kind of data-storage system based on Hadoop framework | |
| JP2014528126A (en) | Distributing multi-source push notifications to multiple targets | |
| CN108763436A (en) | A kind of distributed data-storage system based on ElasticSearch and HBase | |
| CN101753617A (en) | Cloud storage system and method | |
| CN103067525A (en) | Cloud storage data backup method based on characteristic codes | |
| CN103207920A (en) | Parallel metadata acquisition system | |
| CN107343021A (en) | A kind of Log Administration System based on big data applied in state's net cloud | |
| CN104298669A (en) | Person geographic information mining model based on social network | |
| Magdy et al. | Venus: Scalable real-time spatial queries on microblogs with adaptive load shedding | |
| CN104281980A (en) | Remote diagnosis method and system for thermal generator set based on distributed calculation | |
| CN113127526A (en) | Distributed data storage and retrieval system based on Kubernetes | |
| US8606907B1 (en) | Multi-tiered system for receiving and reporting web site traffic data | |
| Lee et al. | Geopot: a Cloud-based geolocation data service for mobile applications | |
| Suleykin et al. | Distributed big data driven framework for cellular network monitoring data | |
| CN107341249A (en) | The storage of server info and extracting method and system, extraction element | |
| CN104714923A (en) | Method and device for achieving equipment sharing | |
| CN109408479A (en) | Daily record data adding method, system, computer equipment and storage medium | |
| CN110457307A (en) | Metadata management system, user's cluster creation method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150429 |