CN104331487A - Method and device for processing logs - Google Patents

Method and device for processing logs Download PDF

Info

Publication number
CN104331487A
CN104331487A CN201410640694.5A CN201410640694A CN104331487A CN 104331487 A CN104331487 A CN 104331487A CN 201410640694 A CN201410640694 A CN 201410640694A CN 104331487 A CN104331487 A CN 104331487A
Authority
CN
China
Prior art keywords
data acquisition
daily record
memory
module
target journaling
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410640694.5A
Other languages
Chinese (zh)
Other versions
CN104331487B (en
Inventor
刘扬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Ctrip Business Co Ltd
Original Assignee
Ctrip Computer Technology Shanghai Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ctrip Computer Technology Shanghai Co Ltd filed Critical Ctrip Computer Technology Shanghai Co Ltd
Priority to CN201410640694.5A priority Critical patent/CN104331487B/en
Publication of CN104331487A publication Critical patent/CN104331487A/en
Application granted granted Critical
Publication of CN104331487B publication Critical patent/CN104331487B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/172Caching, prefetching or hoarding of files
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/1734Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/1737Details of further file system functions for reducing power consumption or coping with limited storage space, e.g. in mobile devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/1805Append-only file systems, e.g. using logs or journals to store data
    • G06F16/1815Journaling file systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a method and a device for processing logs. The processing method is used for processing all logs of a task, and comprises the following steps for a target log in all logs: setting a memory area in a memory, separating parameters of each sentence of the target log, recording the parameters into a data collection matched with the target log according to the configuration information, recording the number of the target log into the data collection, enabling the sentence after parameter separation to generate a log template corresponding to the data collection according to the information, recording the number of the log template into the data collection, storing the data collection in the memory area into a storage magnetic disc, generating the number of the log template and recording in the data collection, and storing the data collection in the memory area and the corresponding log template into the storage magnetic disc. The method and the device for processing the logs have the advantages that the consumption of a server memory in the log recording process is effectively saved, and the log recording time and log storage time are shortened.

Description

The disposal route of daily record and device
Technical field
The present invention relates to a kind of disposal route and device of daily record.
Background technology
Daily record is the information of hardware in register system, software and system problem, simultaneously event in all right surveillance.User can check the reason that mistake occurs or the vestige that when finding under attack, assailant stays by it.Daily record comprises system journal, application log and security log etc.
Because output journal needs to take a large amount of disk space, consume disk read-write resource, influential system performance, and a large amount of daily records also affects follow-up reading analysis, so must limit log information output quantity.The common practice of this area and publication number are record similar in the patent of CN101753344A, log content are stored in the form of text in buffer memory, are collectively written into file, take buffer memory more, have a strong impact on the speed of system.
Summary of the invention
The technical problem to be solved in the present invention is write in order to overcome daily record in prior art, export that to take spatial cache more, have a strong impact on the defect of the travelling speed of system, a kind of memory consumption when saving log is provided, reduces disposal route and the device of the daily record of log required time.
The present invention solves above-mentioned technical matters by following technical proposals: a kind of disposal route of daily record, its feature is, described disposal route, for the treatment of all daily records of a task, for the target journaling in described all daily records, the treating method comprises:
One region of memory is set in internal memory, in described region of memory by the parameters separated in each statement of described target journaling out, by described parameter by a configuration information record in the data acquisition mated with described target journaling, and by the number record of described target journaling in described data acquisition, statement after separation parameter is generated as the daily record template corresponding with data acquisition by described configuration information
When having described daily record template in a memory disk for storing daily record, that records described daily record template is numbered in described data acquisition, after described all daily records have all processed, the data acquisition in region of memory is stored in memory disk;
When not having described daily record template in a memory disk for storing daily record, generate the numbering of described daily record template and be recorded in described data acquisition, after described all daily records have all processed, the daily record template of the data acquisition in region of memory and correspondence is stored in memory disk;
Wherein, described configuration information is the mapping relations of separation point position in described parameter and statement.
In a data processing system, one needs performing of task usually to have multiple daily record needing record, each daily record comprises multiple statement (can be description type statement), parameter transformable in each statement and changeless clause are preserved respectively to omit on storage space and store same log template, reach the object of saving storage space.Further, the data acquisition after separation and daily record template are stored in disk space and call for when exporting, and save the space of internal memory (buffer memory), improve the usability of system.
Preferably, the treating method comprises:
After receiving the request of an output target journaling, the numbering according to the daily record in request obtains data acquisition;
Parameter in the data acquisition of acquisition is write in corresponding daily record template according to described configuration information to revert to target journaling and to export.
According to the numbering of daily record, system can obtain the daily record of request.Data acquisition in a daily record is corresponding with daily record template, data acquisition comprises the numbering of corresponding daily record template, the daily record template corresponding with described data acquisition can be obtained according to described numbering system, in the parameter read-in in data acquisition to daily record template, just can restore the daily record before separation.
Utilize described numbering, if the daily record template in disk exists, then system no longer needs daily record template to be sent in memory disk, only needs data acquisition to be sent in memory disk, greatly reduces the data volume of transmission.
Preferably, the treating method comprises: data acquisition before being stored in memory disk through overcompression process,
Decompression processing is carried out to the data acquisition obtained, the parameter in data acquisition after decompress(ion) is write in corresponding daily record template to revert to target journaling and to export according to described configuration information.
Preferably, described internal memory is used for arranging multiple described region of memory, the daily record of the task that each region of memory alignment processing is different.
The present invention also provides a kind for the treatment of apparatus of daily record, its feature is, described treating apparatus is for the treatment of all daily records in a task, and described treating apparatus comprises one and arranges module, a processing module and a memory module, for the target journaling in a task
The described module that arranges for arranging a region of memory in internal memory;
Described processing module be used in described region of memory by the parameters separated in each statement of described target journaling out, by described parameter by a configuration information record in the data acquisition mated with described target journaling, and by the number record of described target journaling in described data acquisition, the statement after separation parameter is generated as the daily record template corresponding with data acquisition by described configuration information;
Described memory module is used for there is described daily record template in a memory disk for storing daily record, that records described daily record template is numbered in described data acquisition, after described all daily records have all processed, the data acquisition in region of memory is stored in memory disk;
Described memory module also for there not being described daily record template in a memory disk for storing daily record, generate the numbering of described daily record template and be recorded in described data acquisition, after described all daily records have all processed, the daily record template of the data acquisition in region of memory and correspondence is stored in memory disk;
Wherein, described configuration information is the mapping relations of separation point position in described parameter and statement.
Preferably, described treating apparatus also comprises an acquisition module and and recovers module,
Described acquisition module is used for after reception one exports the request of target journaling, and the numbering according to the daily record in request obtains data acquisition;
Described recovery module is used for the parameter in the data acquisition of acquisition to write in corresponding daily record template according to described configuration information to revert to target journaling and to export.
Preferably, described treating apparatus also comprises a compression module, described compression module is used for before data acquisition is stored in memory disk, compress described data acquisition, described compression module also for carrying out decompression processing to the data acquisition obtained, then calling described recovery module and the parameter in data acquisition after decompress(ion) being write in corresponding daily record template to revert to target journaling and to export according to described configuration information.
Preferably, the multiple described region of memory of described memory setting, the daily record of the task that each region of memory alignment processing is different.
On the basis meeting this area general knowledge, above-mentioned each optimum condition, can combination in any, obtains the preferred embodiments of the invention.
Positive progressive effect of the present invention is: the disposal route of the application and device effectively can save server memory consumption during log, reduces log and daily record storage required time.Volume of transmitted data reduces greatly, because server does not need to process complete daily record, only needs process daily record template sequence number, and the parameter needed for template, has therefore lacked internal memory use, has improve the performance of system.
Accompanying drawing explanation
Fig. 1 is the process flow diagram of the disposal route of the embodiment of the present invention.
Fig. 2 is the structural representation of the treating apparatus of the embodiment of the present invention.
Embodiment
Mode below by embodiment further illustrates the present invention, but does not therefore limit the present invention among described scope of embodiments.
Embodiment
See Fig. 2, the present embodiment provides a kind for the treatment of apparatus 1 of daily record, the treating apparatus of the present embodiment is for the treatment of the daily record in two tasks, wherein, include 3 daily records in each task, described treating apparatus comprises one and arranges module 11, processing module 12, memory module 13, acquisition module 14, recovery module 15 and a compression module 16.
A target journaling in a task:
The described module that arranges for arranging a region of memory in internal memory, and 3 daily records in described task all process in region of memory, and described region of memory only processes the daily record of a task, and another task processes in another region of memory.
Described processing module be used in described region of memory by the parameters separated in each statement of described target journaling out, by described parameter by a configuration information record in the data acquisition mated with described target journaling, and by the number record of described target journaling in described data acquisition, the statement after separation parameter is generated as the daily record template corresponding with data acquisition by described configuration information.Wherein, described configuration information is the mapping relations of separation point position in described parameter and statement.
For there being described daily record template in a memory disk for storing daily record, that records described daily record template is numbered in described data acquisition, after described all daily records have all processed, the data acquisition in region of memory is stored in memory disk.
Described memory module also for there not being described daily record template in a memory disk for storing daily record, generate the numbering of described daily record template and be recorded in described data acquisition, after described all daily records have all processed, the daily record template of the data acquisition in region of memory and correspondence is stored in memory disk.
Described acquisition module is used for after reception one exports the request of target journaling, and the numbering according to the daily record in request obtains data acquisition.
Described compression module is used for before data acquisition is stored in memory disk, compress described data acquisition, described compression module also for carrying out decompression processing to the data acquisition obtained, then calling described recovery module and the parameter in data acquisition after decompress(ion) being write in corresponding daily record template to revert to target journaling and to export according to described configuration information.
The multiple described region of memory of described memory setting, the daily record of the task that each region of memory alignment processing is different.
See Fig. 1, utilize above-mentioned treating apparatus, the present embodiment also provides a kind of disposal route of daily record, the daily record of described disposal methods is equipped with numbering, utilize 3 daily records in described disposal methods task, one of them is numbered to the target journaling of 19, described target journaling is:
Have sent 1024 bytes to No. 5 servers;
Have sent 2048 bytes to No. 7 servers.
For above-mentioned target journaling, the treating method comprises:
Step 100, a region of memory is set in internal memory, in described region of memory by the parameters separated in each statement of described target journaling out, by described parameter by a configuration information record in the data acquisition mated with described target journaling, and by the number record of described target journaling in described data acquisition, statement after separation parameter is generated as the daily record template corresponding with data acquisition by described configuration information, wherein, described configuration information is the mapping relations of separation point position in described parameter and statement.
That is, in two statements in described target journaling, 5,1024,7,2048 are the parameter needing to be separated, by 5,1024,7,2048 according to described configuration information record in data acquisition, the daily record template that statement after separation parameter generates is:
To { 0} server have sent { 1} byte;
To { 0} server have sent { 1} byte.
Data acquisition is:
19,1377;
5,1024;
7,2048;
Above-mentioned data acquisition generates according to configuration information, the first row of data acquisition is made to represent the identity of target journaling and corresponding daily record template, second row represents concrete parameter, the line number of parameter is corresponding with daily record template, namely utilize configuration information, described parameter can be corresponding with separation point position in statement.
The numbering 1377 of this daily record template is also had, for target journaling described in System recover in described data acquisition.Daily record numbering 19 is had for target journaling described in system call in described data acquisition.
Step 101, judge in a memory disk for storing daily record, whether have described daily record template, if then perform step 102, then perform step 103 if not.
Step 102, record described daily record template be numbered in described data acquisition, after described all daily records have all processed, the data acquisition in region of memory has been stored in memory disk, has then performed step 104.
Step 103, generate described daily record template numbering and be recorded in described data acquisition, after described all daily records have all processed, the daily record template of the data acquisition in region of memory and correspondence has been stored in memory disk.
Wherein, data acquisition through overcompression process, makes daily record take the space of disk less before being stored in memory disk.In described memory disk, if the daily record template being numbered 1377 exists, system is judging can only be stored in memory disk by data acquisition corresponding for the daily record template of numbering 1377 in the already present situation of daily record template, and no longer storing daily record template, thus reduce the transmission quantity of data and the space hold amount of memory disk.
After step 104, reception one export the request of target journaling, the numbering according to the daily record in request obtains data acquisition.
Step 105, decompression processing is carried out to the data acquisition obtained, by the parameter in data acquisition after decompress(ion) according in daily record template corresponding to described configuration information write to revert to target journaling and to export.
At step 104, require in described request to export the daily record being numbered 19, system obtains data acquisition according to numbering 19, and obtain daily record template corresponding to data acquisition according to numbering 1377, then in a buffer memory, 5 in data acquisition, 1024,7,2048 is filled in daily record template, restore target journaling, and described target journaling is exported.
The disposal route of the present embodiment and device effectively can save server memory consumption during log, reduce log and daily record storage required time.Volume of transmitted data reduces greatly, because server does not need to process complete daily record, only needs process daily record template sequence number, and the parameter needed for template, has therefore lacked internal memory use, has improve the performance of system.
Although the foregoing describe the specific embodiment of the present invention, it will be understood by those of skill in the art that these only illustrate, protection scope of the present invention is defined by the appended claims.Those skilled in the art, under the prerequisite not deviating from principle of the present invention and essence, can make various changes or modifications to these embodiments, but these change and amendment all falls into protection scope of the present invention.

Claims (8)

1. a disposal route for daily record, is characterized in that, described disposal route, for the treatment of all daily records of a task, for the target journaling in described all daily records, the treating method comprises:
One region of memory is set in internal memory, in described region of memory by the parameters separated in each statement of described target journaling out, by described parameter by a configuration information record in the data acquisition mated with described target journaling, and by the number record of described target journaling in described data acquisition, statement after separation parameter is generated as the daily record template corresponding with data acquisition by described configuration information
When having described daily record template in a memory disk for storing daily record, that records described daily record template is numbered in described data acquisition, after described all daily records have all processed, the data acquisition in region of memory is stored in memory disk;
When not having described daily record template in a memory disk for storing daily record, generate the numbering of described daily record template and be recorded in described data acquisition, after described all daily records have all processed, the daily record template of the data acquisition in region of memory and correspondence is stored in memory disk;
Wherein, described configuration information is the mapping relations of separation point position in described parameter and statement.
2. disposal route as claimed in claim 1, is characterized in that, the treating method comprises:
After receiving the request of an output target journaling, the numbering according to the daily record in request obtains data acquisition;
Parameter in the data acquisition of acquisition is write in corresponding daily record template according to described configuration information to revert to target journaling and to export.
3. disposal route as claimed in claim 2, is characterized in that, the treating method comprises: data acquisition before being stored in memory disk through overcompression process,
Decompression processing is carried out to the data acquisition obtained, the parameter in data acquisition after decompress(ion) is write in corresponding daily record template to revert to target journaling and to export according to described configuration information.
4. disposal route as claimed in claim 1, it is characterized in that, described internal memory is used for arranging multiple described region of memory, the daily record of the task that each region of memory alignment processing is different.
5. a treating apparatus for daily record, is characterized in that, described treating apparatus is for the treatment of all daily records in a task, and described treating apparatus comprises one and arranges module, a processing module and a memory module, for the target journaling in a task,
The described module that arranges for arranging a region of memory in internal memory;
Described processing module be used in described region of memory by the parameters separated in each statement of described target journaling out, by described parameter by a configuration information record in the data acquisition mated with described target journaling, and by the number record of described target journaling in described data acquisition, the statement after separation parameter is generated as the daily record template corresponding with data acquisition by described configuration information;
Described memory module is used for there is described daily record template in a memory disk for storing daily record, that records described daily record template is numbered in described data acquisition, after described all daily records have all processed, the data acquisition in region of memory is stored in memory disk;
Described memory module also for there not being described daily record template in a memory disk for storing daily record, generate the numbering of described daily record template and be recorded in described data acquisition, after described all daily records have all processed, the daily record template of the data acquisition in region of memory and correspondence is stored in memory disk;
Wherein, described configuration information is the mapping relations of separation point position in described parameter and statement.
6. treating apparatus as claimed in claim 5, is characterized in that, described treating apparatus also comprises an acquisition module and and recovers module,
Described acquisition module is used for after reception one exports the request of target journaling, and the numbering according to the daily record in request obtains data acquisition;
Described recovery module is used for the parameter in the data acquisition of acquisition to write in corresponding daily record template according to described configuration information to revert to target journaling and to export.
7. treating apparatus as claimed in claim 6, it is characterized in that, described treating apparatus also comprises a compression module, described compression module is used for before data acquisition is stored in memory disk, compress described data acquisition, described compression module also for carrying out decompression processing to the data acquisition obtained, then calling described recovery module and the parameter in data acquisition after decompress(ion) being write in corresponding daily record template to revert to target journaling and to export according to described configuration information.
8. treating apparatus as claimed in claim 5, is characterized in that, the multiple described region of memory of described memory setting, the daily record of the task that each region of memory alignment processing is different.
CN201410640694.5A 2014-11-13 2014-11-13 The processing method and processing device of log Active CN104331487B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410640694.5A CN104331487B (en) 2014-11-13 2014-11-13 The processing method and processing device of log

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410640694.5A CN104331487B (en) 2014-11-13 2014-11-13 The processing method and processing device of log

Publications (2)

Publication Number Publication Date
CN104331487A true CN104331487A (en) 2015-02-04
CN104331487B CN104331487B (en) 2019-03-12

Family

ID=52406214

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410640694.5A Active CN104331487B (en) 2014-11-13 2014-11-13 The processing method and processing device of log

Country Status (1)

Country Link
CN (1) CN104331487B (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105975376A (en) * 2016-04-28 2016-09-28 广州市锲致智能技术有限公司 Log processing based numerical control system security processing method
WO2016202070A1 (en) * 2015-06-16 2016-12-22 中兴通讯股份有限公司 Method and device for recording log in network system
CN109684290A (en) * 2018-12-20 2019-04-26 东软集团股份有限公司 Log storing method, device, equipment and computer readable storage medium
CN109885545A (en) * 2019-02-02 2019-06-14 华为技术有限公司 It stores, the method, apparatus of inquiry log information
WO2019161551A1 (en) * 2018-02-24 2019-08-29 黄裕才 Method for processing log based on logrotate technology
WO2019184218A1 (en) * 2018-03-27 2019-10-03 平安科技(深圳)有限公司 Log archiving method, electronic device, and readable storage medium
CN111538712A (en) * 2020-04-30 2020-08-14 恒生电子股份有限公司 Log recording method, processing node, electronic device and storage medium
CN112286896A (en) * 2020-11-19 2021-01-29 北京百家科技集团有限公司 Log file processing method and device, computer equipment and storage medium
CN112559458A (en) * 2020-12-11 2021-03-26 深圳金信诺高新技术股份有限公司 Method and system for reducing log size
CN113179265A (en) * 2021-04-26 2021-07-27 湖南蚁坊软件股份有限公司 Log compression encryption method, device, equipment and storage medium
CN118409808A (en) * 2024-07-04 2024-07-30 山东云海国创云计算装备产业创新中心有限公司 Method, device, equipment, program product and medium for managing drive log

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2521078A1 (en) * 2011-05-06 2012-11-07 Sap Ag Systems and methods for business process logging
CN103412924A (en) * 2013-08-12 2013-11-27 东软集团股份有限公司 Log multi-language query method and system
CN103440297A (en) * 2013-08-20 2013-12-11 苏州迈科网络安全技术股份有限公司 Method for recording and reading user operation log information
CN103577307A (en) * 2013-11-07 2014-02-12 浙江中烟工业有限责任公司 Method for automatically extracting and analyzing firewall logs based on XML rule model

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2521078A1 (en) * 2011-05-06 2012-11-07 Sap Ag Systems and methods for business process logging
CN103412924A (en) * 2013-08-12 2013-11-27 东软集团股份有限公司 Log multi-language query method and system
CN103440297A (en) * 2013-08-20 2013-12-11 苏州迈科网络安全技术股份有限公司 Method for recording and reading user operation log information
CN103577307A (en) * 2013-11-07 2014-02-12 浙江中烟工业有限责任公司 Method for automatically extracting and analyzing firewall logs based on XML rule model

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016202070A1 (en) * 2015-06-16 2016-12-22 中兴通讯股份有限公司 Method and device for recording log in network system
CN105975376A (en) * 2016-04-28 2016-09-28 广州市锲致智能技术有限公司 Log processing based numerical control system security processing method
WO2019161551A1 (en) * 2018-02-24 2019-08-29 黄裕才 Method for processing log based on logrotate technology
WO2019184218A1 (en) * 2018-03-27 2019-10-03 平安科技(深圳)有限公司 Log archiving method, electronic device, and readable storage medium
CN109684290B (en) * 2018-12-20 2021-08-17 东软集团股份有限公司 Log storage method, device, equipment and computer readable storage medium
CN109684290A (en) * 2018-12-20 2019-04-26 东软集团股份有限公司 Log storing method, device, equipment and computer readable storage medium
CN109885545A (en) * 2019-02-02 2019-06-14 华为技术有限公司 It stores, the method, apparatus of inquiry log information
CN111538712A (en) * 2020-04-30 2020-08-14 恒生电子股份有限公司 Log recording method, processing node, electronic device and storage medium
CN111538712B (en) * 2020-04-30 2023-07-21 恒生电子股份有限公司 Log recording method, processing node, electronic equipment and storage medium
CN112286896A (en) * 2020-11-19 2021-01-29 北京百家科技集团有限公司 Log file processing method and device, computer equipment and storage medium
CN112286896B (en) * 2020-11-19 2024-02-06 北京百家科技集团有限公司 Log file processing method and device, computer equipment and storage medium
CN112559458A (en) * 2020-12-11 2021-03-26 深圳金信诺高新技术股份有限公司 Method and system for reducing log size
CN112559458B (en) * 2020-12-11 2021-11-30 深圳金信诺高新技术股份有限公司 Method and system for reducing log size
CN113179265A (en) * 2021-04-26 2021-07-27 湖南蚁坊软件股份有限公司 Log compression encryption method, device, equipment and storage medium
CN118409808A (en) * 2024-07-04 2024-07-30 山东云海国创云计算装备产业创新中心有限公司 Method, device, equipment, program product and medium for managing drive log

Also Published As

Publication number Publication date
CN104331487B (en) 2019-03-12

Similar Documents

Publication Publication Date Title
CN104331487A (en) Method and device for processing logs
CN103955530B (en) Data reconstruction and optimization method of on-line repeating data deletion system
CN106649828B (en) Data query method and system
CN103778259A (en) Method for realizing data recovery of smart phone on basis of Sqlite3
WO2007049109A3 (en) Method and system for compression of logical data objects for storage
CN106294826A (en) A kind of company-data Query method in real time and system
CN104636242A (en) Method for automatically deleting repeated content in system logs on basis of Linux operating system
CN111444396B (en) Big data storage system
CN104778252A (en) Index storage method and index storage device
CN104317850A (en) Data processing method and device
WO2023277819A3 (en) Data processing method, system, device, computer program product, and storage function
CN106681659A (en) Data compression method and device
CN105159820A (en) Transmission method and device of system log data
CN103235754B (en) The treating method and apparatus of request in distributed file system
JP6213676B2 (en) Analysis device, analysis method, and analysis program
CN103236938A (en) Method and system for user action collection based on cache memory and asynchronous processing technology
CN103729269A (en) Cloud architecture-based network test data double-cache method
CN103207916A (en) Metadata processing method and device
CN111209608A (en) Big data storage system
CN106254806A (en) A kind of Video data guard method and device
WO2016091068A1 (en) Method and device for executing special instruction
US20150207898A1 (en) Systems and methods for statistical caching
CN103399939A (en) Correlation analysis method and system for audit of accounts and files
CN105224697A (en) Sort method with filtercondition and the device for performing described method
CN104486614A (en) MP4 (Mobile Pentium 4) video format corruption detection method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20160204

Address after: 200335 Shanghai city Changning District Admiralty Road No. 968 Building No. 16 10 floor

Applicant after: SHANGHAI XIECHENG BUSINESS CO., LTD.

Address before: 200335 Shanghai City, Changning District Fuquan Road No. 99, Ctrip network technology building

Applicant before: Ctrip computer technology (Shanghai) Co., Ltd.

GR01 Patent grant
GR01 Patent grant