CN109344139A - A kind of polymerization and relevant apparatus of storage system operation log - Google Patents
A kind of polymerization and relevant apparatus of storage system operation log Download PDFInfo
- Publication number
- CN109344139A CN109344139A CN201811296971.XA CN201811296971A CN109344139A CN 109344139 A CN109344139 A CN 109344139A CN 201811296971 A CN201811296971 A CN 201811296971A CN 109344139 A CN109344139 A CN 109344139A
- Authority
- CN
- China
- Prior art keywords
- congruent point
- log
- polymerization
- aggregation
- point quantity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
This application discloses a kind of polymerizations of storage system operation log, comprising: determines congruent point quantity according to polymerization methods, the circular list of congruent point is constructed according to the congruent point quantity；Log aggregation successively is carried out to the polymerization dot cycle in the circular list according to the polymerization methods；When being recycled to the congruent point for having carried out log aggregation, the operation log of the congruent point is deleted, log aggregation is carried out to the congruent point of delete operation log.Polymerization dot cycle by the way that log aggregation to be distributed in circular list carries out log aggregation, when being recycled to the congruent point for having carried out log aggregation, it only needs to delete original operation log, log aggregation is carried out again, realize being automatically deleted for operation log, it avoids and is manually operated, improve the reliability of storage system.Disclosed herein as well is polyplant, server and the computer readable storage mediums of a kind of storage system operation log, have the above beneficial effect.
Description
Technical field
This application involves field of computer technology, in particular to a kind of polymerization of storage system operation log, polymerization
Device, server and computer readable storage medium.
Background technique
At present in distributed objects storage, corresponding operation log can be obtained by operating to storing data, including with
Family grade operation log and bucket grade operation log.By the tracing function to operation log, user can be convenient in a period of time
The data manipulation of user or bucket traces, to restore to data.As long as the start recording in distributed memory system
The operation log of distributed objects storage, will constantly record the operation log of distributed storage, and system is generally with hour
Daily record data is polymerize for unit, is the polymerization methods of unit according to hour when the concurrent flow of system is increasing,
The data of single congruent point can be made excessive, influence the runnability of system.
In the prior art, in order to solve the problems, such as congruent point overabundance of data, typically system manager empirically
Delete operation or reservation operations are carried out to data, distributed memory system autonomous, automatically can not select daily record data.
But when unattended, the operation deleted the operation log of distributed memory system has just been lacked, has operated day
Will can save excessively as time goes by, influence performance of storage system.Also, in order to which the operation log deleted in storage system must
Need administrative staff operate, increase the maintenance cost of distributed memory system, not can avoid the mistake of manual operation also,
Reduce the reliability of distributed memory system.
Therefore, how to make the operation log of distributed memory system carry out deleting in the course of the polymerization process automatically is this field skill
The Important Problems of art personnel concern.
Summary of the invention
The purpose of the application be to provide the polymerization of storage system operation log a kind of, polyplant, server and
Computer readable storage medium, the polymerization dot cycle by the way that log aggregation to be distributed in circular list carries out log aggregation, when following
When ring is to the congruent point for having carried out log aggregation, it is only necessary to original operation log is deleted, then carries out log aggregation, it is real
Show being automatically deleted for operation log, avoided and manually operated, improves the reliability of storage system.
In order to solve the above technical problems, the application provides a kind of polymerization of storage system operation log, comprising:
Congruent point quantity is determined according to polymerization methods, and the circular list of congruent point is constructed according to the congruent point quantity；
Log aggregation successively is carried out to the polymerization dot cycle in the circular list according to the polymerization methods；
When being recycled to the congruent point for having carried out log aggregation, the operation log of the congruent point is deleted, to deleting
Except the congruent point of operation log carries out log aggregation.
Optionally, congruent point quantity is determined according to polymerization methods, the circulation of congruent point is constructed according to the congruent point quantity
List, comprising:
Characteristic acquisition is carried out to the polymerization methods, obtains aggregation features data；
Sample calculating is carried out to the aggregation features data according to congruent point quantity machine learning model, obtains the polymerization
Point quantity, the circular list of congruent point is constructed according to the congruent point quantity；
Wherein, the congruent point quantity machine learning model is trained according to log aggregation sample.
Optionally, congruent point quantity is determined according to polymerization methods, the circulation of congruent point is constructed according to the congruent point quantity
List, comprising:
System hardware resources are obtained, determine congruent point quantity, root according to the system hardware resources and the polymerization methods
According to the circular list of congruent point quantity construction congruent point.
Optionally, further includes:
Acquisition system Real-time hardware resource；
Dynamic adjustment is carried out according to congruent point quantity of the Real-time hardware resource to the circular list.
The application also provides a kind of polyplant of storage system operation log, comprising:
Circular list constructing module, for determining congruent point quantity according to polymerization methods, according to the congruent point quantity structure
Make the circular list of congruent point；
Log aggregation module, for successively being carried out to the polymerization dot cycle in the circular list according to the polymerization methods
Log aggregation；
Log removing module, for when being recycled to the congruent point for having carried out log aggregation, by the operation of the congruent point
Log is deleted, and carries out log aggregation to the congruent point of delete operation log.
Optionally, the circular list constructing module, comprising:
Aggregation features obtain module, for carrying out characteristic acquisition to the polymerization methods, obtain aggregation features data；
Machine learning computing module, for being carried out according to congruent point quantity machine learning model to the aggregation features data
Sample calculates, and obtains the congruent point quantity, and the circular list of congruent point is constructed according to the congruent point quantity；Wherein, described
Congruent point quantity machine learning model is trained according to log aggregation sample.
Optionally, the circular list constructing module is specifically used for obtaining system hardware resources, according to the system hardware
Resource and the polymerization methods determine congruent point quantity, and the circular list of congruent point is constructed according to the congruent point quantity.
Optionally, further includes:
Real-time hardware obtains module, for obtaining system Real-time hardware resource；
Dynamic adjustment module, for being moved according to congruent point quantity of the Real-time hardware resource to the circular list
State adjustment.
The application also provides a kind of server, comprising:
Memory, for storing computer program；
Processor, the step of polymerization as described above is realized when for executing the computer program.
The application also provides a kind of computer readable storage medium, and calculating is stored on the computer readable storage medium
The step of machine program, the computer program realizes polymerization as described above when being executed by processor.
The polymerization of a kind of storage system operation log provided herein, comprising: determined according to polymerization methods poly-
Chalaza quantity constructs the circular list of congruent point according to the congruent point quantity；It is successively followed to described according to the polymerization methods
Polymerization dot cycle in circular row table carries out log aggregation；When being recycled to the congruent point for having carried out log aggregation, by the polymerization
The operation log of point is deleted, and carries out log aggregation to the congruent point of delete operation log.
By the way that the converging operation of operation log to be distributed in multiple congruent points, each congruent point averagely assumes responsibility for operating
The data of log store, and quantity of the congruent point in storage system is limited, it is possible to according to the circulation of congruent point
List carries out log aggregation to the polymerization dot cycle in circular list, when being recycled to the congruent point of execution journal polymerization,
The original operation log of the congruent point is deleted and carries out log aggregation again, that is, carries out new log to congruent point every time
When converging operation, subsequent log aggregation can the data to operation log before carry out covering deletion, and then realize operation day
Will is automatically deleted, and is avoided manually carrying out delete operation, is reduced the maintenance cost of storage system, improve the reliable of storage system
Property.
The application also provides polyplant, server and the computer-readable storage medium of a kind of storage system operation log
Matter has the above beneficial effect, and this will not be repeated here.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The embodiment of application for those of ordinary skill in the art without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is a kind of flow chart of the polymerization of storage system operation log provided by the embodiment of the present application；
Fig. 2 is a kind of structural schematic diagram of the polyplant of storage system operation log provided by the embodiment of the present application.
Specific embodiment
The core of the application be to provide the polymerization of storage system operation log a kind of, polyplant, server and
Computer readable storage medium, the polymerization dot cycle by the way that log aggregation to be distributed in circular list carries out log aggregation, when following
When ring is to the congruent point for having carried out log aggregation, it is only necessary to original operation log is deleted, then carries out log aggregation, it is real
Show being automatically deleted for operation log, avoided and manually operated, improves the reliability of storage system.
To keep the purposes, technical schemes and advantages of the embodiment of the present application clearer, below in conjunction with the embodiment of the present application
In attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is
Some embodiments of the present application, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art
Every other embodiment obtained without making creative work, shall fall in the protection scope of this application.
In the prior art, in order to solve the problems, such as congruent point overabundance of data, typically system manager empirically
Delete operation or reservation operations are carried out to data, distributed memory system autonomous, automatically can not select daily record data.
But when unattended, the operation deleted the operation log of distributed memory system has just been lacked, has operated day
Will can save excessively as time goes by, influence performance of storage system.Also, in order to which the operation log deleted in storage system must
Need administrative staff operate, increase the maintenance cost of distributed memory system, not can avoid the mistake of manual operation also,
Reduce the reliability of distributed memory system.
Therefore, the embodiment of the present application provides a kind of polymerization of storage system operation log, by by operation log
Converging operation is distributed in multiple congruent points, and each congruent point averagely assumes responsibility for the data storage of operation log, and polymerize
Quantity of the point in storage system is limited, it is possible to be followed according to the circular list of congruent point to the congruent point in circular list
Ring carries out log aggregation, when being recycled to the congruent point of execution journal polymerization, by the original operation log of the congruent point into
When going to delete and carry out log aggregation again, that is, carrying out new log aggregation operation to congruent point every time, subsequent log aggregation
The data of operation log before can be carried out with covering deletion, and then realize being automatically deleted for operation log, avoid manually carrying out
Delete operation reduces the maintenance cost of storage system, improves the reliability of storage system.
Referring to FIG. 1, Fig. 1 is a kind of stream of the polymerization of storage system operation log provided by the embodiment of the present application
Cheng Tu.
This method may include:
S101 determines congruent point quantity according to polymerization methods, and the circular list of congruent point is constructed according to congruent point quantity；
This step is intended to the polymerization methods according to applied by the present embodiment and determines that the circulation with limited quantity congruent point arranges
Table, so that subsequent step can successively selective polymerization point carries out log aggregation by the circular list.
Wherein, log aggregation or polymerization are the logs that will be scattered on each machine in the cluster, are aggregated in the same machine
On, in order to by the log of polymerization according to different form classification store, prevent all logs it is all single be stored in one
Within congruent point, multiple congruent points can be distributed according to chronomere or threshold function table, then gather respectively to each congruent point
Closing operation.For example, when being polymerize according to chronomere, with per hour for a congruent point, therefore day can will be operated
For will according in the time corresponding congruent point for being aggregated in each hour, 8 points are a congruent point, and 9 points are a congruent point, 8 points
55 points of operation logs issued should be aggregated in 8 points of congruent point, and 9 points to the 9 points log aggregations issued in 59 minutes are poly- at 9 points
In chalaza.
Wherein it is possible to be distributed multiple congruent points with specific reference to Threshold function (threshold function table).
Therefore, it is necessary first to determine congruent point quantity according to polymerization methods, that is, if with chronomere for polymerization side
24 congruent points, or 48 congruent points of setting, or the more congruent point quantity of setting are arranged in formula.Wherein, polymerization points
The set-up mode of amount can be configured according to actual application demand, for example, system hardware resources it is more can be set it is less
The polymerization task of the congruent point of quantity, each congruent point carrying is more or system hardware resources are less, it is necessary to which setting is more
Congruent point, the polymerization task of each congruent point carrying is less, and the pressure of hardware resource is distributed in more congruent points, is subtracted
The consumption of few hardware resource.
Then, the circular list of congruent point is constructed according to determining congruent point quantity, that is, includes polymerization points
Measure the circular list of a congruent point OID (Object identifier object identity).For example, congruent point quantity is 8, then following
The object identity of the congruent point from OID1, OID2 to OID8 is saved in circular row table, from these OID when to carry out log aggregation
The object identity of middle selective polymerization point, to carry out log aggregation in corresponding congruent point according to the object identity.
S102 successively carries out log aggregation to the polymerization dot cycle in circular list according to polymerization methods；
On the basis of step S101, this step is intended to according to selected polymerization methods successively to the polymerization in circular list
Point carries out log aggregation.Selective polymerization point is namely recycled in the fixed congruent point of quantity, and it is poly- to carry out log to congruent point
It closes.OID1, OID2, OID3, OID4, OID5 respectively for example, there is 5 congruent points, when OID1, which polymerize, to be completed, to OID2 into
Row log aggregation carries out log aggregation to OID1 when OID5, which polymerize, to be completed.
Wherein, any one log aggregation side that the method for the log aggregation of the present embodiment can be provided using the prior art
Method is not specifically limited herein.
S103 deletes the operation log of congruent point when being recycled to the congruent point for having carried out log aggregation, to deleting
Except the congruent point of operation log carries out log aggregation.
On the basis of step S102, this step is intended to polymerize when being recycled to the congruent point for having carried out log aggregation
The operation log of point is deleted, and carries out log aggregation to the congruent point of delete operation log.Namely execute when being recycled to
When crossing the congruent point of converging operation, original operation log can be carried out covering deletion by log aggregation operation, then is carried out log and gathered
It closes, realizes and be automatically deleted operation log.
Optionally, the step S101 in the present embodiment may include:
Step 1: carrying out characteristic acquisition to polymerization methods, aggregation features data are obtained；
Step 2: carrying out sample calculating to aggregation features data according to congruent point quantity machine learning model, it is polymerize
Point quantity, the circular list of congruent point is constructed according to congruent point quantity；
Wherein, congruent point quantity machine learning model is trained according to log aggregation sample.
The method that this optinal plan mainly passes through machine learning determines congruent point quantity, and then according to the congruent point quantity
Construct the circular list of congruent point.It is envisioned that the congruent point quantity machine learning model in this optinal plan is first root
It is trained according to the training data of log aggregation, should also include testing the machine learning model after training,
To improve the accuracy rate of machine learning model.
It selects the method for machine learning to determine congruent point quantity in this optinal plan, improves the suitable journey of congruent point quantity
Degree, by log aggregation task distribution in the suitable congruent point of quantity, improves the efficiency and resources occupation rate of log aggregation, most
Resource utilization of bigization during log aggregation.
Optionally, the step S101 in the present embodiment also may include:
System hardware resources are obtained, congruent point quantity are determined according to system hardware resources and polymerization methods, according to congruent point
The circular list of quantity construction congruent point.
This optinal plan mainly determines congruent point quantity according to system hardware resources, compares a upper optinal plan, originally may be used
The step of selecting scheme to determine congruent point quantity is simply easy to implement.
Optionally, the present embodiment can also include:
Step 1: obtaining system Real-time hardware resource；
Step 2: carrying out dynamic adjustment according to congruent point quantity of the Real-time hardware resource to circular list.
This optinal plan carries out dynamic to congruent point quantity mainly in the process of running, by system Real-time hardware resource
Adjustment improves log aggregation mistake to be adjusted to the data volume of congruent point when the fluctuation of the data processing amount of log aggregation
The treatment effeciency and hardware resource utilization of journey.
To sum up, the present embodiment is by the way that the converging operation of operation log to be distributed in multiple congruent points, each congruent point
The data storage of operation log is averagely assumed responsibility for, and quantity of the congruent point in storage system is limited, it is possible to according to
The circular list of congruent point carries out log aggregation to the polymerization dot cycle in circular list, polymerize when being recycled to execution journal
Congruent point when, the original operation log of the congruent point is deleted and carries out log aggregation again, that is, every time to congruent point
When carrying out new log aggregation operation, subsequent log aggregation can the data to operation log before carry out covering deletion, into
And realize being automatically deleted for operation log, it avoids manually carrying out delete operation, reduces the maintenance cost of storage system, improve storage
The reliability of system.
A kind of polyplant of storage system operation log provided by the embodiments of the present application is introduced below, is hereafter retouched
A kind of polyplant for the storage system operation log stated and a kind of above-described polymerization of storage system operation log
Reference can be corresponded to each other.
Referring to FIG. 2, Fig. 2 is a kind of knot of the polyplant of storage system operation log provided by the embodiment of the present application
Structure schematic diagram.
The apparatus may include:
Circular list constructing module 100 is constructed for determining congruent point quantity according to polymerization methods according to congruent point quantity
The circular list of congruent point；
Log aggregation module 200, for successively carrying out log to the polymerization dot cycle in circular list according to polymerization methods
Polymerization；
Log removing module 300, for when being recycled to the congruent point for having carried out log aggregation, by the operation day of congruent point
Will is deleted, and carries out log aggregation to the congruent point of delete operation log.
Optionally, the circular list constructing module 100, comprising:
Aggregation features obtain module, for carrying out characteristic acquisition to polymerization methods, obtain aggregation features data；
Machine learning computing module, for carrying out sample to aggregation features data according to congruent point quantity machine learning model
It calculates, obtains congruent point quantity, the circular list of congruent point is constructed according to congruent point quantity；Wherein, congruent point quantity engineering
Practising model is trained according to log aggregation sample.
Optionally, the circular list constructing module 100, specifically can be used for obtaining system hardware resources, hard according to system
Part resource and polymerization methods determine congruent point quantity, and the circular list of congruent point is constructed according to congruent point quantity.
Optionally, which can also include:
Real-time hardware obtains module, for obtaining system Real-time hardware resource；
Dynamic adjustment module, for carrying out dynamic adjustment according to congruent point quantity of the Real-time hardware resource to circular list.
The embodiment of the present application can also provide a kind of server, comprising:
Memory, for storing computer program；
Processor, the step of polymerization as described above in Example is realized when for executing the computer program.
The embodiment of the present application can also provide a kind of computer readable storage medium, on the computer readable storage medium
It is stored with computer program, the computer program realizes polymerization as described above in Example when being executed by processor
Step.
The computer readable storage medium may include: USB flash disk, mobile hard disk, read-only memory (Read-Only
Memory, ROM), random access memory (RandomAccess Memory, RAM), magnetic or disk etc. is various to deposit
Store up the medium of program code.
Each embodiment is described in a progressive manner in specification, the highlights of each of the examples are with other realities
The difference of example is applied, the same or similar parts in each embodiment may refer to each other.For device disclosed in embodiment
Speech, since it is corresponded to the methods disclosed in the examples, so being described relatively simple, related place is referring to method part illustration
?.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure
And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and
The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These
Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession
Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered
Think beyond scope of the present application.
The step of method described in conjunction with the examples disclosed in this document or algorithm, can directly be held with hardware, processor
The combination of capable software module or the two is implemented.Software module can be placed in random access memory (RAM), memory, read-only deposit
Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology
In any other form of storage medium well known in field.
Above to the polymerization, polyplant, server of a kind of storage system operation log provided herein with
And computer readable storage medium is described in detail.Used herein principle and embodiment party of the specific case to the application
Formula is expounded, the description of the example is only used to help understand the method for the present application and its core ideas.It should refer to
It out, for those skilled in the art, can also be to the application under the premise of not departing from the application principle
Some improvement and modification can also be carried out, these improvement and modification are also fallen into the protection scope of the claim of this application.
Claims (10)
1. a kind of polymerization of storage system operation log characterized by comprising
Congruent point quantity is determined according to polymerization methods, and the circular list of congruent point is constructed according to the congruent point quantity；
Log aggregation successively is carried out to the polymerization dot cycle in the circular list according to the polymerization methods；
When being recycled to the congruent point for having carried out log aggregation, the operation log of the congruent point is deleted, is grasped to deleting
The congruent point for making log carries out log aggregation.
2. polymerization according to claim 1, which is characterized in that congruent point quantity is determined according to polymerization methods, according to
The circular list of the congruent point quantity construction congruent point, comprising:
Characteristic acquisition is carried out to the polymerization methods, obtains aggregation features data；
Sample calculating is carried out to the aggregation features data according to congruent point quantity machine learning model, obtains the polymerization points
Amount constructs the circular list of congruent point according to the congruent point quantity；
Wherein, the congruent point quantity machine learning model is trained according to log aggregation sample.
3. polymerization according to claim 1, which is characterized in that congruent point quantity is determined according to polymerization methods, according to
The circular list of the congruent point quantity construction congruent point, comprising:
System hardware resources are obtained, congruent point quantity are determined according to the system hardware resources and the polymerization methods, according to institute
State the circular list of congruent point quantity construction congruent point.
4. polymerization according to claim 1, which is characterized in that further include:
Acquisition system Real-time hardware resource；
Dynamic adjustment is carried out according to congruent point quantity of the Real-time hardware resource to the circular list.
5. a kind of polyplant of storage system operation log characterized by comprising
Circular list constructing module constructs poly- for determining congruent point quantity according to polymerization methods according to the congruent point quantity
The circular list of chalaza；
Log aggregation module, for successively carrying out log to the polymerization dot cycle in the circular list according to the polymerization methods
Polymerization；
Log removing module, for when being recycled to the congruent point for having carried out log aggregation, by the operation log of the congruent point
It is deleted, log aggregation is carried out to the congruent point of delete operation log.
6. polyplant according to claim 1, which is characterized in that the circular list constructing module, comprising:
Aggregation features obtain module, for carrying out characteristic acquisition to the polymerization methods, obtain aggregation features data；
Machine learning computing module, for carrying out sample to the aggregation features data according to congruent point quantity machine learning model
It calculates, obtains the congruent point quantity, the circular list of congruent point is constructed according to the congruent point quantity；Wherein, the polymerization
Point quantity machine learning model is trained according to log aggregation sample.
7. polyplant according to claim 1, which is characterized in that the circular list constructing module, specifically for obtaining
System hardware resources are taken, congruent point quantity are determined according to the system hardware resources and the polymerization methods, according to the polymerization
The circular list of point quantity construction congruent point.
8. polyplant according to claim 1, which is characterized in that further include:
Real-time hardware obtains module, for obtaining system Real-time hardware resource；
Dynamic adjustment module, for carrying out dynamic tune according to congruent point quantity of the Real-time hardware resource to the circular list
It is whole.
9. a kind of server characterized by comprising
Memory, for storing computer program；
Processor realizes the step such as the described in any item polymerizations of Claims 1-4 when for executing the computer program
Suddenly.
10. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium
Program realizes the step such as the described in any item polymerizations of Claims 1-4 when the computer program is executed by processor
Suddenly.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811296971.XA CN109344139A (en) | 2018-11-01 | 2018-11-01 | A kind of polymerization and relevant apparatus of storage system operation log |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811296971.XA CN109344139A (en) | 2018-11-01 | 2018-11-01 | A kind of polymerization and relevant apparatus of storage system operation log |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109344139A true CN109344139A (en) | 2019-02-15 |
Family
ID=65313446
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811296971.XA Pending CN109344139A (en) | 2018-11-01 | 2018-11-01 | A kind of polymerization and relevant apparatus of storage system operation log |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109344139A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101018121A (en) * | 2007-03-15 | 2007-08-15 | 杭州华为三康技术有限公司 | Log convergence processing method and convergence processing device |
| CN101635651A (en) * | 2009-08-31 | 2010-01-27 | 杭州华三通信技术有限公司 | Method, system and device for managing network log data |
| CN102411533A (en) * | 2011-08-08 | 2012-04-11 | 浪潮电子信息产业股份有限公司 | Log-management optimizing method for clustered storage system |
| US20120117037A1 (en) * | 2010-11-09 | 2012-05-10 | Fuji Xerox Co., Ltd. | Log consolidation device, log consolidation method, and computer-readable medium |
| CN102724063A (en) * | 2012-05-11 | 2012-10-10 | 北京邮电大学 | Log collection server, data packet delivering and log clustering methods and network |
| CN103020175A (en) * | 2012-11-28 | 2013-04-03 | 深圳市华为技术软件有限公司 | Method and device for acquiring aggregated data |
| CN105574156A (en) * | 2015-12-16 | 2016-05-11 | 华为技术有限公司 | Text clustering method and device, and computing device |
| CN105975495A (en) * | 2016-04-26 | 2016-09-28 | 北京奇虎科技有限公司 | Big data storage and search method and apparatus |
| CN107508718A (en) * | 2016-06-14 | 2017-12-22 | 阿里巴巴集团控股有限公司 | Log Collect System, log collection unit and log collection method |
| CN107908632A (en) * | 2017-07-26 | 2018-04-13 | 上海壹账通金融科技有限公司 | Site file processing method, device, site file processing platform and storage medium |
-
2018
- 2018-11-01 CN CN201811296971.XA patent/CN109344139A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101018121A (en) * | 2007-03-15 | 2007-08-15 | 杭州华为三康技术有限公司 | Log convergence processing method and convergence processing device |
| CN101635651A (en) * | 2009-08-31 | 2010-01-27 | 杭州华三通信技术有限公司 | Method, system and device for managing network log data |
| US20120117037A1 (en) * | 2010-11-09 | 2012-05-10 | Fuji Xerox Co., Ltd. | Log consolidation device, log consolidation method, and computer-readable medium |
| CN102411533A (en) * | 2011-08-08 | 2012-04-11 | 浪潮电子信息产业股份有限公司 | Log-management optimizing method for clustered storage system |
| CN102724063A (en) * | 2012-05-11 | 2012-10-10 | 北京邮电大学 | Log collection server, data packet delivering and log clustering methods and network |
| CN103020175A (en) * | 2012-11-28 | 2013-04-03 | 深圳市华为技术软件有限公司 | Method and device for acquiring aggregated data |
| CN105574156A (en) * | 2015-12-16 | 2016-05-11 | 华为技术有限公司 | Text clustering method and device, and computing device |
| CN105975495A (en) * | 2016-04-26 | 2016-09-28 | 北京奇虎科技有限公司 | Big data storage and search method and apparatus |
| CN107508718A (en) * | 2016-06-14 | 2017-12-22 | 阿里巴巴集团控股有限公司 | Log Collect System, log collection unit and log collection method |
| CN107908632A (en) * | 2017-07-26 | 2018-04-13 | 上海壹账通金融科技有限公司 | Site file processing method, device, site file processing platform and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107844837B (en) | Method and system for adjusting and optimizing algorithm parameters aiming at machine learning algorithm | |
| WO2020207268A1 (en) | Database performance adjustment method and apparatus, device, system, and storage medium | |
| US8768878B2 (en) | Characterizing business intelligence workloads | |
| CN110517148B (en) | Control method, system and device for executing quantitative transaction strategy | |
| CN109614045A (en) | A kind of metadata rule method, apparatus and relevant device | |
| CN104794687A (en) | Point clouds simplifying system and method | |
| CN110047512A (en) | A kind of ambient sound classification method, system and relevant apparatus | |
| CN111506504B (en) | Software development process measurement-based software security defect prediction method and device | |
| US20120221373A1 (en) | Estimating Business Service Responsiveness | |
| CN108563789A (en) | Data cleaning method based on Spark frames and device | |
| TWI734920B (en) | Method and device for real-time detection of transaction risk | |
| CN105160145B (en) | A kind of method and system of gas station's automatic oil discharge detection | |
| CN108629375A (en) | Power customer sorting technique, system, terminal and computer readable storage medium | |
| CN106603673A (en) | Fine-grained cloud storage scheduling method based on erasure codes | |
| CN109582649A (en) | A kind of metadata storing method, device, equipment and readable storage medium storing program for executing | |
| CN107315652B (en) | Data backup method and cloud HDFS system | |
| CN109002359A (en) | A kind of dispatching method and relevant apparatus of calculate node server | |
| CN109289196A (en) | Game achieves processing method and processing device | |
| CN110597821B (en) | Method and device for changing database table structure | |
| CN108073582B (en) | Computing framework selection method and device | |
| CN109977977B (en) | Method for identifying potential user and corresponding device | |
| CN109344139A (en) | A kind of polymerization and relevant apparatus of storage system operation log | |
| CN102546235A (en) | Performance diagnosis method and system of web-oriented application under cloud computing environment | |
| CN109032509A (en) | A kind of data-erasure method and relevant apparatus of distributed memory system | |
| CN110956675B (en) | Method and device for automatically generating technology maturity curve |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190215 |