CN115834575A - Log reporting method, system, equipment and computer readable storage medium - Google Patents
Log reporting method, system, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN115834575A CN115834575A CN202310172618.5A CN202310172618A CN115834575A CN 115834575 A CN115834575 A CN 115834575A CN 202310172618 A CN202310172618 A CN 202310172618A CN 115834575 A CN115834575 A CN 115834575A
- Authority
- CN
- China
- Prior art keywords
- log
- log file
- file
- processor
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000004590 computer program Methods 0.000 claims description 12
- 239000012634 fragment Substances 0.000 claims description 4
- 230000006837 decompression Effects 0.000 claims description 3
- 230000006870 function Effects 0.000 abstract description 5
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 14
- 230000004044 response Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000013467 fragmentation Methods 0.000 description 2
- 238000006062 fragmentation reaction Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000013024 troubleshooting Methods 0.000 description 1
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The application discloses a log reporting method, which belongs to the technical field of computers, and can obtain a plurality of logs by compressing a plurality of log data generated by a client into a log file and sending a request to a server once; meanwhile, the functions are separately processed by the two systems of uploading files and processing files, so that the two systems are independent in service and cannot influence each other, the bearing capacity of the whole system is increased, and the whole performance is improved. The application also provides a log reporting system, a log reporting device and a computer readable storage medium, which have the beneficial effects.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method, a system, a device, and a computer-readable storage medium for reporting logs.
Background
In the same time or in a very short time, a large number of requests arrive at the server, and each request needs the server to consume resources for processing and to make corresponding feedback. Because of the limited resources, it is not possible to process and satisfy these large numbers of requests simultaneously, which leads to a series of problems, collectively referred to as high concurrency.
In a high concurrency environment, the reporting performance of the log system is extremely high, if the response is not timely, the system is greatly burdened, but if a distributed cluster system is introduced, huge cost is increased. In the prior art, logs are generally reported through an http (Hyper Text Transfer Protocol) interface, however, the method has the following disadvantages: on one hand, each report needs to send a request to the server, so when a plurality of logs are obtained, the system is affected because the logs cannot be obtained in time; on the other hand, only one http interface is called, and the bearing capacity of the http interface is limited, so that the bearing capacity of the system is limited, and the overall performance is influenced. Therefore, it is necessary to provide a log reporting method to solve the problems of influence on the system and poor overall performance caused by delayed response in a high concurrency environment in the prior art.
Disclosure of Invention
The application aims to provide a log reporting method, a log reporting system, log reporting equipment and a computer readable storage medium, so that the influence on the system due to untimely response in a high concurrency environment is avoided, and the overall performance is improved.
In order to achieve the above object, the present application provides a log reporting method, including:
compressing a plurality of log data generated by a client to generate a log file;
uploading, by a first processor, the log file to a database;
when a request for acquiring the log file is received, acquiring the log file from the database through a second processor, and decompressing the log file;
and uploading the decompressed log file to a server.
Optionally, the compressing the plurality of log data generated by the client includes:
converting a plurality of log data generated by a client into a json format;
compressing the log data converted into json format;
correspondingly, after the decompressing the log file, the method further includes:
analyzing the decompressed log file into a json format;
correspondingly, the uploading the decompressed log file to a server includes:
uploading the log file analyzed into the json format to a server.
Optionally, the obtaining, by the second processor, the log file from the database and decompressing the log file includes:
and acquiring the log file from the database by adopting a spring-batch framework through a second processor, and decompressing the log file.
Optionally, the obtaining, by the second processor, the log file from the database by using a spring-batch framework, and decompressing the log file includes:
acquiring the log file from the database by adopting a spring-batch framework through a second processor, segmenting the log file, and decompressing the log file of each segment;
correspondingly, the uploading the decompressed log file to a server includes: and when the log file of each fragment is detected to be completely decompressed, uploading the decompressed log file to a server.
Optionally, after compressing the multiple log data generated by the client and generating the log file, the method further includes:
encrypting the log file;
correspondingly, before decompressing the log file, the method further includes:
and decrypting the log file.
Optionally, the parsing the decompressed log file into a json format includes:
and when the analysis fails, updating the data state to be json analysis failure so as to determine the reason of the problem according to the data state.
Optionally, the uploading, by the first processor, the log file to the database includes:
uploading the log file to a file system through a first processor, and generating a file path;
storing the file path to a database;
correspondingly, the obtaining, by the second processor, the log file from the database includes:
acquiring the file path from the database;
and acquiring the log file from the file system according to the file path.
In order to achieve the above object, the present application further provides a log reporting system, including:
the client storage module is used for compressing a plurality of log data generated by the client to generate a log file;
the data receiving module is used for uploading the log file to a database through the first processor;
the data processing module is used for acquiring the log file from the database through a second processor and decompressing the log file when a request for acquiring the log file is received;
and the file storage module is used for uploading the decompressed log file to a server.
In order to achieve the above object, the present application further provides a log reporting device, including:
a memory for storing a computer program;
the processor is configured to implement the steps of the log reporting method when executing the computer program, and the processor includes a first processor and a second processor.
In order to achieve the above object, the present application further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the steps of the log reporting method are implemented.
The log reporting method provided by the application comprises the following steps: compressing a plurality of log data generated by a client to generate a log file; uploading, by a first processor, the log file to a database; when a request for acquiring the log file is received, acquiring the log file from the database through a second processor, and decompressing the log file; and uploading the decompressed log file to a server.
Obviously, the multiple logs can be obtained by compressing multiple log data generated by the client into one log file and sending a request to the server once, and compared with the prior art that a request needs to be sent to the server once for each report, the method and the device can avoid the influence on the system due to untimely response in a high-concurrency environment; meanwhile, the functions are separately processed by the two systems of uploading files and processing files, so that the two systems are independent in service and cannot influence each other, the bearing capacity of the whole system is increased, and the whole performance is improved. The application also provides a log reporting system, a log reporting device and a computer readable storage medium, which have the beneficial effects.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only the embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a method for reporting a log according to an embodiment of the present application;
fig. 2 is a schematic flowchart of another log reporting method according to an embodiment of the present application;
fig. 3 is a specific structure of a log in a log reporting method according to an embodiment of the present application;
fig. 4 is a block diagram of a log reporting system according to an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a flowchart of a log reporting method according to an embodiment of the present application, where the method includes:
s101: and compressing a plurality of log data generated by the client to generate a log file.
The present embodiment does not limit the specific amount of log data, and may be multiple log data or all log data generated by the client. It should be noted that, a plurality of log data generated by the client are compressed into a log file, and a plurality of logs can be obtained by sending a request to the server once, so that the number of times of requests sent to the server can be effectively reduced; further, when all log data generated by the client is compressed into one log file, all logs can be acquired by sending a request to the server once. The embodiment does not limit the specific process of compressing the log data, and may be, for example, preprocessing a plurality of log data generated by the client; and compressing the preprocessed log data. To facilitate data transmission, the present embodiment may convert a plurality of log data generated by the client into json (JS Object Notation) format; compressing the log data converted into json format; correspondingly, after the log file is decompressed in step S103, the decompressed log file can be parsed into a json format; accordingly, step S104 may be uploading the log file parsed into json format to the server. Further, in order to troubleshoot the problem in the future, the present embodiment may update the data status to be json analysis failure when analysis fails, so as to determine the cause of the problem according to the data status.
The embodiment does not limit the subsequent operation of generating the log file, and for example, the log file may be encrypted; accordingly, before decompressing the log file in step S104, the log file can be decrypted.
Further, the log is reported through an http interface, the log cannot be uploaded for 100%, and in order to ensure that the log is not lost and can be recovered, the log file can be written into a local file of the client. The embodiment does not limit the specific storage format of the log, and for example, the log may be binary storage, and the log is divided into a header, a data bit, and a tail.
S102: uploading, by the first processor, the log file to a database.
The specific frequency of uploading the log file to the database is not limited in this embodiment, and for example, the log file may be uploaded to the database in real time by the first processor, or the log file may be uploaded to the database by the first processor when a preset condition is met.
Furthermore, because the file path is smaller than the data volume of the file, the occupied capacity in the database is small, and in order to reduce the occupied capacity of the log file in the database, the embodiment can upload the log file to the file system through the first processor and generate the file path; storing the file path to a database; correspondingly, in step S103, the log file is obtained from the database through the second processor, which may be a file path obtained from the database; and acquiring the log file from the file system according to the file path. The embodiment does not limit the specific type of the file system as long as the storage of the log file can be realized.
S103: and when a request for acquiring the log file is received, acquiring the log file from the database through the second processor, and decompressing the log file.
The embodiment does not limit the specific way of processing the log file, and for example, the second processor acquires the log file from the database by using a spring-batch (batch-processing framework) framework, and decompresses the log file. Further, in order to increase the program processing efficiency, in this embodiment, the second processor may acquire the log file from the database by using a spring-batch framework, perform fragmentation, and decompress the log file of each fragment; accordingly, step S104 may be uploading the decompressed log file to the server when it is detected that the decompression of the log file of each slice is completed.
It should be noted that, because the carrying capacity of the processors is limited, if the same processor is used to simultaneously execute the process of uploading the file and the process of processing the file, the overall performance is affected, and in the embodiment, the process of uploading the file by the first processor and the process of processing the file by the second processor ensure that the two system services are independent and do not affect each other, so that the carrying capacity of the overall system is increased, and the overall performance is improved.
S104: and uploading the decompressed log file to a server.
The present embodiment does not limit the specific type of the server, and the specific type of the server may be determined according to actual requirements.
Based on the embodiment, the method and the device have the advantages that the multiple logs generated by the client are compressed into one log file, and the multiple logs can be obtained by sending a request to the server once; meanwhile, the functions are separately processed by the file uploading system and the file processing system, so that the two systems are independent in service and cannot influence each other, the bearing capacity of the whole system is increased, and the whole performance is improved.
Referring to fig. 2 and fig. 3, fig. 2 is a schematic flow chart of a log reporting method provided in an embodiment of the present application, and fig. 3 is a specific structure of a log in the log reporting method provided in the embodiment of the present application, where the process is specifically as follows:
1. compressing a plurality of log data generated by a client to generate a log file, which specifically comprises the following steps:
(1) Referring to fig. 3, the log storage format: binary storage, which is divided into a head, a data bit and a tail;
(2) The head has 5 bytes, the first three bits are reserved bits, the last two bits are the length of data bits, and the supporting maximum length is 65535;
(3) Data bits, converting object data into json format, compressing the object data, then writing a binary string formed after encryption into a local file, wherein the maximum storage byte number of the data bits is 65535;
(4) Tail, terminator, 1 byte, value 1.
The above process is executed in the client storage module.
2. Uploading the log file to a database through a first processor, which comprises the following specific steps:
and uploading the log file to a file system, wherein the uploading needs to be authorized firstly and then uploaded, and after the uploading is finished, the file path is stored to a database.
The above process is performed at the data receiving module.
3. When a request for acquiring the log file is received, acquiring the log file from the database through the second processor, and decompressing the log file, which is specifically as follows:
(1) The method comprises the following steps that a spring-batch framework is used as a data processing module, a partition mode is used, data are taken out from a DB (data storage unit) and are fragmented, the program processing efficiency is improved, and the retry function of the framework can be triggered when a file fails to be downloaded, decrypted and decompressed;
(2) Reading out a file path from a database at regular time and analyzing;
(3) Reading the file according to the rule of the step 1, decompressing and decrypting the file;
(4) Analyzing the data into an agreed json data format, and updating the data state into a json analysis failure if the analysis fails;
(5) Failure occurs and the state is modified for future troubleshooting.
The above process is performed at the data processing module.
4. Uploading the decompressed log file to a server, which specifically comprises the following steps:
the parsed data of the contract is stored in an ES (elastic search server), and the data state is updated to be complete.
The above process is executed in the file storage module.
The following describes a log reporting system, a device and a computer readable storage medium provided in an embodiment of the present application, and the log reporting system, the device and the computer readable storage medium described below and the log reporting method described above may be referred to in a corresponding manner.
Referring to fig. 4, fig. 4 is a block diagram of a log reporting system according to an embodiment of the present disclosure, where the log reporting system includes:
a client storage module 100, configured to compress multiple log data generated by a client to generate a log file;
a data receiving module 200, configured to upload a log file to a database through a first processor;
the data processing module 300 is configured to, when receiving a request for obtaining a log file, obtain the log file from the database through the second processor, and decompress the log file;
and the file storage module 400 is configured to upload the decompressed log file to a server.
Based on the embodiment, the method and the device have the advantages that the multiple logs generated by the client are compressed into one log file, and the multiple logs can be obtained by sending a request to the server once; meanwhile, the functions are separately processed by the two systems of uploading files and processing files, so that the two systems are independent in service and cannot influence each other, the bearing capacity of the whole system is increased, and the whole performance is improved.
Based on the above embodiment, the client storage module 100 includes:
the data format conversion unit is used for converting the plurality of log data generated by the client into json format;
a compressed log data unit for compressing the log data converted into json format;
accordingly, the data processing module 300 further includes:
the analysis log file unit is used for analyzing the decompressed log file into a json format;
correspondingly, the file storage module 400 is specifically configured to upload the journal file parsed into the json format to the server.
Based on the foregoing embodiments, the data processing module 300 is specifically configured to, when receiving a request for obtaining a log file, obtain, by a second processor, the log file from the database by using a spring-batch framework, and decompress the log file.
Based on the foregoing embodiments, the data processing module 300 is specifically configured to, when receiving a request for obtaining a log file, obtain, by a second processor, the log file from the database by using a spring-batch framework, perform fragmentation, and decompress the log file of each fragment;
correspondingly, the file storage module 400 is specifically configured to, when it is detected that decompression of the log file of each segment is completed, upload the decompressed log file to the server.
Based on the foregoing embodiments, the client storage module further includes:
the encrypted log file unit is used for encrypting the log file;
accordingly, the data processing module 300 further includes:
and the decryption log file unit is used for decrypting the log file.
Based on the above embodiments, the data processing module 300 further includes:
and the data updating module is used for updating the data state to be json analysis failure when the analysis fails so as to determine the reason of the problem according to the data state.
Based on the above embodiments, the data receiving module 200 includes:
the file system uploading unit uploads the log file to a file system through a first processor and generates a file path;
the uploading database unit is used for storing the file path to a database;
accordingly, the data processing module 300 comprises:
the file path acquiring unit is used for acquiring a file path from a database;
and the log file acquiring unit is used for acquiring a log file from the file system according to the file path.
Based on the foregoing embodiment, the present application further provides a log reporting device, including: a memory and a processor, wherein the memory is used for storing a computer program; and the processor is used for realizing the steps of the log reporting method in each embodiment when executing the computer program. Of course, the log reporting device may further include various necessary network interfaces, power supplies, other components, and the like.
The present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the log reporting method in the foregoing embodiments are implemented. The storage medium may include: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, an optical disk, or other various media capable of storing program codes.
The principles and embodiments of the present application are described herein using specific examples, and in order to achieve the progressive relationship among the various examples, each example is described with emphasis on differences from other examples, and similar parts among the various examples may be referred to. For the system disclosed by the embodiment, reference is made to the corresponding method section. The above description of the embodiments is only intended to help understand the method of the present application and its core ideas. It will be apparent to those skilled in the art that various changes and modifications can be made in the present invention without departing from the principles of the invention, and these changes and modifications also fall within the scope of the claims of the present application.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a component of' 8230; \8230;" does not exclude the presence of additional identical elements in the process, method, article, or apparatus that comprises the element.
Claims (10)
1. A log reporting method is characterized by comprising the following steps:
compressing a plurality of log data generated by a client to generate a log file;
uploading, by a first processor, the log file to a database;
when a request for acquiring the log file is received, acquiring the log file from the database through a second processor, and decompressing the log file;
and uploading the decompressed log file to a server.
2. The log reporting method according to claim 1, wherein compressing the plurality of log data generated by the client comprises:
converting a plurality of log data generated by a client into a json format;
compressing the log data converted into json format;
correspondingly, after the decompressing the log file, the method further includes:
analyzing the decompressed log file into a json format;
correspondingly, the uploading the decompressed log file to a server includes:
uploading the log file analyzed into the json format to a server.
3. The method of claim 1, wherein the obtaining the log file from the database through the second processor and decompressing the log file comprises:
and acquiring the log file from the database by adopting a spring-batch framework through a second processor, and decompressing the log file.
4. The log reporting method according to claim 3, wherein the acquiring, by the second processor, the log file from the database by using a spring-batch framework and decompressing the log file comprises:
acquiring the log file from the database by adopting a spring-batch framework through a second processor, segmenting the log file, and decompressing the log file of each segment;
correspondingly, the uploading the decompressed log file to a server includes: and when the completion of the decompression of the log file of each fragment is detected, uploading the decompressed log file to a server.
5. The method according to claim 1, wherein the compressing the plurality of log data generated by the client to generate the log file further comprises:
encrypting the log file;
correspondingly, before decompressing the log file, the method further includes:
and decrypting the log file.
6. The log reporting method of claim 2, wherein the parsing the decompressed log file into a json format comprises:
and when the analysis fails, updating the data state to be json analysis failure so as to determine the reason of the problem according to the data state.
7. The log reporting method according to any one of claims 1 to 6, wherein the uploading the log file to the database by the first processor includes:
uploading the log file to a file system through a first processor, and generating a file path;
storing the file path to a database;
correspondingly, the obtaining, by the second processor, the log file from the database includes:
acquiring the file path from the database;
and acquiring the log file from the file system according to the file path.
8. A log reporting system, comprising: the system comprises a client storage module, a data receiving module, a data processing module and a file storage module;
the client storage module is used for compressing a plurality of log data generated by the client to generate a log file;
the data receiving module is used for uploading the log file to a database through a first processor;
the data processing module is used for acquiring the log file from the database through a second processor and decompressing the log file when a request for acquiring the log file is received;
and the file storage module is used for uploading the decompressed log file to a server.
9. A log reporting device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the log reporting method according to any one of claims 1 to 7 when executing the computer program, wherein the processor comprises a first processor and a second processor.
10. A computer-readable storage medium characterized by: the computer-readable storage medium has a computer program stored thereon, and when being executed by a processor, the computer program implements the steps of the log reporting method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310172618.5A CN115834575A (en) | 2023-02-28 | 2023-02-28 | Log reporting method, system, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310172618.5A CN115834575A (en) | 2023-02-28 | 2023-02-28 | Log reporting method, system, equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115834575A true CN115834575A (en) | 2023-03-21 |
Family
ID=85522308
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310172618.5A Pending CN115834575A (en) | 2023-02-28 | 2023-02-28 | Log reporting method, system, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115834575A (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090100242A1 (en) * | 2007-10-15 | 2009-04-16 | Mstar Semiconductor, Inc. | Data Processing Method for Use in Embedded System |
| US20110068957A1 (en) * | 2009-09-23 | 2011-03-24 | International Business Machines Corporation | Data compression system and associated methods |
| CN103617287A (en) * | 2013-12-12 | 2014-03-05 | 用友软件股份有限公司 | Log management method and device in distributed environment |
| CN103944744A (en) * | 2013-01-21 | 2014-07-23 | 博雅网络游戏开发（深圳）有限公司 | Method and system for log acquisition |
| CN104468222A (en) * | 2014-12-15 | 2015-03-25 | 北京奇虎科技有限公司 | Method, device and system for reporting log information |
| CN109542750A (en) * | 2018-11-26 | 2019-03-29 | 深圳天源迪科信息技术股份有限公司 | Distributed information log system |
| CN110209553A (en) * | 2019-06-11 | 2019-09-06 | 湖南快乐阳光互动娱乐传媒有限公司 | Data capture method and device |
| CN111886591A (en) * | 2019-09-12 | 2020-11-03 | 创新先进技术有限公司 | Log structure storage system |
| CN112087490A (en) * | 2020-08-07 | 2020-12-15 | 上海绊糖信息科技有限公司 | High-performance mobile terminal application software log collection system |
| CN112579321A (en) * | 2020-12-23 | 2021-03-30 | 京东数字科技控股股份有限公司 | Method, device and equipment for downloading service data |
| CN112953753A (en) * | 2019-12-24 | 2021-06-11 | 深圳市明源云科技有限公司 | Data acquisition method and device, terminal equipment and storage medium |
| CN114968953A (en) * | 2022-05-19 | 2022-08-30 | 招商银行股份有限公司 | Log storage and retrieval method, system, terminal equipment and medium |
| CN115086298A (en) * | 2022-05-30 | 2022-09-20 | 中银金融科技有限公司 | File transmission method and device |
-
2023
- 2023-02-28 CN CN202310172618.5A patent/CN115834575A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090100242A1 (en) * | 2007-10-15 | 2009-04-16 | Mstar Semiconductor, Inc. | Data Processing Method for Use in Embedded System |
| US20110068957A1 (en) * | 2009-09-23 | 2011-03-24 | International Business Machines Corporation | Data compression system and associated methods |
| CN103944744A (en) * | 2013-01-21 | 2014-07-23 | 博雅网络游戏开发（深圳）有限公司 | Method and system for log acquisition |
| CN103617287A (en) * | 2013-12-12 | 2014-03-05 | 用友软件股份有限公司 | Log management method and device in distributed environment |
| CN104468222A (en) * | 2014-12-15 | 2015-03-25 | 北京奇虎科技有限公司 | Method, device and system for reporting log information |
| CN109542750A (en) * | 2018-11-26 | 2019-03-29 | 深圳天源迪科信息技术股份有限公司 | Distributed information log system |
| CN110209553A (en) * | 2019-06-11 | 2019-09-06 | 湖南快乐阳光互动娱乐传媒有限公司 | Data capture method and device |
| CN111886591A (en) * | 2019-09-12 | 2020-11-03 | 创新先进技术有限公司 | Log structure storage system |
| CN112953753A (en) * | 2019-12-24 | 2021-06-11 | 深圳市明源云科技有限公司 | Data acquisition method and device, terminal equipment and storage medium |
| CN112087490A (en) * | 2020-08-07 | 2020-12-15 | 上海绊糖信息科技有限公司 | High-performance mobile terminal application software log collection system |
| CN112579321A (en) * | 2020-12-23 | 2021-03-30 | 京东数字科技控股股份有限公司 | Method, device and equipment for downloading service data |
| CN114968953A (en) * | 2022-05-19 | 2022-08-30 | 招商银行股份有限公司 | Log storage and retrieval method, system, terminal equipment and medium |
| CN115086298A (en) * | 2022-05-30 | 2022-09-20 | 中银金融科技有限公司 | File transmission method and device |
Non-Patent Citations (1)
| Title |
|---|
| 王家亮;赵海;李鹏;刘铮;: "Webit四核处理器的性能分析" * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7843823B2 (en) | Techniques for balancing throughput and compression in a network communication system | |
| US9735805B2 (en) | Encoder, decoder and method | |
| US5953503A (en) | Compression protocol with multiple preset dictionaries | |
| US9031997B2 (en) | Log file compression | |
| CN107395209B (en) | Data compression method, data decompression method and equipment thereof | |
| US10701150B2 (en) | Method and apparatus for storing network data | |
| US20130179413A1 (en) | Compressed Distributed Storage Systems And Methods For Providing Same | |
| WO2021068891A1 (en) | Method, system, electronic device, and storage medium for storing and collecting temperature data | |
| US10594790B2 (en) | Data compression in a dispersed storage network | |
| CN110851409A (en) | Log compression and decompression method, device and storage medium | |
| CN111708673A (en) | Log data compression method, device, equipment and storage medium | |
| US20170034303A1 (en) | Methods and apparatus to create and transmit a condensed logging data file | |
| CN111416992A (en) | File transcoding method and device | |
| EP2552075A2 (en) | Systems and methods of distributed file storage | |
| CN116567079A (en) | Data compression method and device | |
| CN114614829A (en) | Satellite data frame processing method and device, electronic equipment and readable storage medium | |
| CN112650755A (en) | Data storage method, method for querying data, database and readable medium | |
| CN115834575A (en) | Log reporting method, system, equipment and computer readable storage medium | |
| US10769016B2 (en) | Storing a plurality of correlated data in a dispersed storage network | |
| CN108897497B (en) | Centerless data management method and device | |
| CN113704206B (en) | Metadata processing method and device, electronic equipment and storage medium | |
| CN102891732A (en) | Data sending method and device and data receiving method and device | |
| US11734012B2 (en) | Systems and methods for efficient transfer of log data | |
| CN112291350A (en) | File transmission method, system, device and medium | |
| EP3961414A1 (en) | Method and apparatus for processing time records |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20230321 |