CN103944744A - Method and system for log acquisition - Google Patents
Method and system for log acquisition Download PDFInfo
- Publication number
- CN103944744A CN103944744A CN201310021720.1A CN201310021720A CN103944744A CN 103944744 A CN103944744 A CN 103944744A CN 201310021720 A CN201310021720 A CN 201310021720A CN 103944744 A CN103944744 A CN 103944744A
- Authority
- CN
- China
- Prior art keywords
- daily record
- record data
- file
- log
- compressed file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention provides a method and a system for log acquisition. The method comprises a step of acquiring log data through a UDP transmission mode, a step of writing the log data into a log file at a preset writing frequency, a step of packaging and compressing the log data to obtain a compressed file, and a step of transmitting the compressed file through a TCP transmission method. The method and the system for log acquisition acquire the log data through the UDP transmission mode, the log data is written into the log file at the preset frequency, the log file is packaged and compressed to form the compressed file, and then the compressed file is transmitted through the TCP transmission method. The method and the system acquire the log data in an asynchronous manner and process the log data in a distributed manner, so that system performances and storage efficiency are improved, and the read-write load of a disk is reduced by writing the data at the preset writing frequency.
Description
Technical field
The present invention relates to log store technology, particularly relate to log collection method and system.
Background technology
Daily record data is for the ease of business diagnosis and network analysis and the program behavior data that record, and these class data have the feature that data volume is large conventionally.Traditional log collection method is the database that in the time that daily record data produces, the daily record data of generation write direct.This log collection method easily brings performance pressure and storage pressure to system, thereby greatly affects the normal operation of system.
Summary of the invention
Based on this, be necessary easily to bring to system for existing log collection method the problem of performance pressure and storage pressure, a kind of log collection method that can improve systematic function and storage efficiency is provided.
In addition, be also necessary to provide a kind of Log Collect System that can improve systematic function and storage efficiency.
A kind of log collection method, comprises the steps:
Obtain daily record data by UDP transmission means;
By default write frequency, daily record data is write to journal file;
Journal file is packed to compress and obtain compressed file;
Forward compressed file by TCP transmission means.
A kind of Log Collect System, comprises UDP transfer server, and described UDP transfer server comprises:
Acquisition module, for obtaining daily record data by UDP transmission means;
Written document module, establishes frequency daily record data is write to journal file by writing in advance;
Packing compression module, for journal file is packed, compression obtains compressed file;
Forwarding module, for forwarding compressed file by TCP transmission means.
Above-mentioned log collection method and system, obtain daily record data by UDP transmission means, establish frequency daily record data is write to journal file by default writing, journal file is packed to compress and obtain compressed file, then forward compressed file by TCP transmission means, asynchronous collecting daily record data and distributed treatment daily record data, improved systematic function and storage efficiency, and alleviated the read-write load of disk by default write frequency data writing.
Brief description of the drawings
Fig. 1 is a kind of log collection method schematic flow sheet in an embodiment;
Fig. 2 is a kind of log collection method schematic flow sheet in another embodiment;
Fig. 3 is a kind of log collection method schematic flow sheet in another embodiment;
Fig. 4 is a kind of Log Collect System structural representation in an embodiment;
Fig. 5 is a kind of Log Collect System structural representation in another embodiment;
Fig. 6 is a kind of Log Collect System structural representation in another embodiment;
Fig. 7 is a kind of Log Collect System schematic diagram in an embodiment.
Embodiment
Below in conjunction with specific embodiment and accompanying drawing, the technical scheme of log collection method and system is described in detail, so that it is clearer.
As shown in Figure 1, in one embodiment, a kind of log collection method, comprises the steps:
Step S110, obtains daily record data by UDP transmission means.
In the present embodiment, UDP(User Datagram Protocol, User Datagram Protocol) transmission means refers to and uses the data transfer mode of udp protocol, UDP is OSI(Open System Interconnect, open system interconnection) a kind of towards disconnected transport layer protocol in reference model, provide towards the simple information of affairs and transmit service, the efficiency of transmission of obtaining daily record data by UDP transmission means is high, can mitigation system performance pressure.Concrete, can use socket(socket) create a UDP service processes, receive the daily record data sending by UDP transmission means.Daily record data is the data of records application program behavior, the daily record data obtaining can be temporarily stored in buffer memory, is convenient to read fast.In addition, if the daily record data receiving is through overcompression, need to first carry out decompress(ion) reduction.
Step S130, writes journal file by default write frequency by daily record data.
In the present embodiment, the daily record data obtaining is written in journal file by predeterminated frequency, for example, within every 20 seconds, create a journal file and the daily record data obtaining in this time period write in an orderly manner in the journal file of establishment, write with interval daily record data in journal file, can alleviate the read-write load of disk, write in an orderly manner daily record data and can ensure the logic of daily record data.The name of journal file can be to name according to document creation time and a random number, as 20121216151920.7387.log, wherein 20121216151920 is creation-times of journal file, comprises date Hour Minute Second, 7387 is the random numbers between 1 ~ 99999, log file extension.Such naming method can be avoided the repetition of filename and be convenient to file ordering.
Step S150, journal file is packed to compress obtains compressed file.
In the present embodiment, journal file packed and compressed to reduce bit number and the total amount of byte of journal file, thereby reduce file size, saving disk space.Compress mode can be zip, 7z, gz, tar or rar etc.The name of compressed file can be to name according to time and system information, if filename can be 20121216151801_601_192.168.100.101.zip, wherein 20121216151801 is date Hour Minute Seconds of current system time, the 601st, server numbering, 192.168.100.101 be server ip address, zip is the gz that adopts zip compress mode, can conveniently analyze compressed file source and compress mode by this file designation mode, and avoid file to bear the same name.
Concrete, can be by default packing frequency to the journal file processing of packing, make to include in compressed package multiple journal files, for example, can within 2 minutes, once pack and compress, the journal file packing generating within 2 minutes is compressed in to a compressed file the inside, can reduces like this utilization rate of processor, reduce the performance pressure of system.In addition, the journal file that packaged compression was processed can be deleted in time, be saved memory space.
Step S170, forwards compressed file by TCP transmission means.
In the present embodiment, TCP(Transmission Control Protocol, transmission control protocol) be a kind of connection-oriented, transport layer (Transport layer) communication protocol reliably with based on byte stream, send compressed file and can ensure accuracy and the reliability of file transfer by TCP transmission means.Concrete, can compressed file be forwarded to another server from book server according to the time sequencing in filename, carry out further arrangement and the storage of daily record.After definite compressed file forwards successfully, for example receive that compressed file successfully receives after mark, can delete the corresponding compressed file that success is transmitted, to save memory space.
Above-mentioned log collection method, obtain daily record data by UDP transmission means, by predeterminated frequency, daily record data is write to journal file, journal file is packed to compress and obtain compressed file, then forward compressed file by TCP transmission means, asynchronous collecting daily record data and distributed treatment daily record data, improved systematic function and storage efficiency, and alleviated the read-write load of disk by default write frequency data writing.
As shown in Figure 2, in one embodiment, before above-mentioned steps S110, also comprise the steps:
Step S210, the daily record data of acquisition applications program.
In the present embodiment, provide an interface function that sends daily record data for application program, when this function of application call, the daily record data that needs are recorded transmits with designated parameter, thereby collects the daily record data of application program.
Step S230, connects into a character string by the multiple fields in daily record data, with the daily record data of form format.
In the present embodiment, the daily record field in daily record data is divided into common field and extended field, and the number of common field is fixed, and extended field is to define in order to increase and decrease daily record data item flexibly, and the extension quantity of extended field is variable.For common field and extended field are connected into a complete character string, daily record data is formatd to processing.
Concrete, first carry out character replacement, "@1 $ " in daily record data and "@2 $ " are replaced with to null character (NUL), the stress of the English state in extension number " ` " is replaced with to "@2 $ ", by the comma of the English state in each field, " replace with "@1 $ ".Then the stress number " ` " of the English state of each extension of replacing is connected to form to new extended field, the comma by new extended field with the English state of common field of replacing, " connect into a character string, obtain the daily record data of format.Daily record data is formatd to processing, be convenient to the transmission of daily record data.
Step S250, compresses the daily record data of format.
This compress mode can be the data compression modes such as gz, the daily record data of format is compressed to reduce to bit number and the total amount of byte of daily record data, improves transmitting efficiency in the time sending daily record data.
Step S270, sends the daily record data after compression by UDP transmission means.
Owing to transmitting daily record data in local area network (LAN), can adopt UDP transmission means, UDP transmission means is towards disconnected transmission means, the data that TCP need to transmit are relatively less, simple and quick, can improve efficiency of transmission, mitigation system performance pressure.
As shown in Figure 3, in one embodiment, after above-mentioned steps S170, also comprise the steps:
Step S310, obtains and decompressing compressed file obtains journal file.
In the present embodiment, obtain the compressed file forwarding by TCP transmission means, can after a compressed file receives successfully, reply one and successfully identify to notify and successfully receive compressed file.The compressed file receiving according to the time sequencing decompress(ion) in compressed file name extracts and obtains journal file from compressed file.After decompress(ion) completes, the compressed file that decompress(ion) is crossed backups, and the compressed file backing up is deleted, to save memory space.
Step S330, reads journal file and obtains daily record data.
Read journal file by the time sequencing in daily record filename, read line by line log file contents and obtain daily record data.
Step S350, the anti-daily record data that formats obtains daily record field.
According to the anti-format of the format rule daily record data of step S230, obtain the daily record field in daily record data, this field comprises common field and extended field.
Step S370, writes log database by daily record field.
Analyze the daily record data in daily record field, take out the corresponding position of corresponding field write into Databasce.Daily record data write into Databasce is convenient to the retrieval of daily record and is checked.
As shown in Figure 4, in one embodiment, a kind of Log Collect System, comprises UDP transfer server 100, and this UDP transfer server 100 comprises acquisition module 110, written document module 130, packing compression module 150 and forwarding module 170.
Acquisition module 110, for obtaining daily record data by UDP transmission means.
In the present embodiment, UDP transmission means refers to the data transfer mode that uses udp protocol, UDP is a kind of towards disconnected transport layer protocol in OSI Reference Model, provide towards the simple information of affairs and transmit service, the efficiency of transmission of obtaining daily record data by UDP transmission means is high, can mitigation system performance pressure.Concrete, can create a UDP service processes with socket, receive the daily record data sending by UDP transmission means.Daily record data is the data of records application program behavior, the daily record data obtaining can be temporarily stored in buffer memory, is convenient to read fast.In addition, if the daily record data receiving is through overcompression, need to first carry out decompress(ion) reduction.
Written document module 130, for writing journal file by default write frequency by daily record data.
In the present embodiment, written document module 130 is written to the daily record of obtaining in file by predeterminated frequency, for example within every 20 seconds, create a file and the daily record data obtaining in this time period write in an orderly manner in the file of establishment, write with interval daily record data in file, can alleviate the read-write load of disk, write in an orderly manner daily record data and can ensure the logic of daily record data.The name of journal file can be to name according to document creation time and a random number, as 20121216151920.7387.log, wherein 20121216151920 is creation-times of journal file, comprises date Hour Minute Second, 7387 is the random numbers between 1 ~ 99999, log file extension.Such naming method can be avoided the repetition of filename and be convenient to file ordering.
Packing compression module 150, for journal file is packed, compression obtains compressed file.
In the present embodiment, packing compression module 150 is packed to journal file and is compressed to reduce bit number and the total amount of byte of journal file, thereby reduces file size, saves disk space.Compress mode can be zip, 7z, gz, tar or rar etc.The name of compressed file can be to name according to time and system information, if filename can be 20121216151801_601_192.168.100.101.zip, wherein 20121216151801 is date Hour Minute Seconds of current system time, the 601st, server numbering, 192.168.100.101 be server ip address, zip is the gz that adopts zip compress mode, can conveniently analyze compressed file source and compress mode by this file designation mode, and avoid file to bear the same name.
Concrete, packing compression module 150 can be by default packing frequency to the journal file processing of packing, make to include in compressed package multiple journal files, for example, can within 2 minutes, once pack and compress, the journal file packing generating within 2 minutes is compressed in to a compressed file the inside, can reduces like this utilization rate of processor, reduce the performance pressure of system.In addition, the journal file that packaged compression was processed can be deleted in time, be saved memory space.
Forwarding module 170, for forwarding compressed file by TCP transmission means.
In the present embodiment, TCP is a kind of connection-oriented, transport layer communication protocol reliably with based on byte stream, is sent compressed file and can be ensured accuracy and the reliability of file transfer by TCP transmission means.Concrete, can compressed file be forwarded to another server from book server according to the time sequencing in filename, carry out further arrangement and the storage of daily record.
In one embodiment, above-mentioned UDP transfer server 100 also comprises removing module 190, for after determining compressed file and forwarding successfully, deletes compressed file.After definite compressed file forwards successfully, for example receive that compressed file successfully receives after mark, can delete the corresponding compressed file that success is transmitted, to save memory space.
Above-mentioned Log Collect System, obtain daily record data by UDP transmission means, by predeterminated frequency, daily record data is write to journal file, journal file is packed to compress and obtain compressed file, then forward compressed file by TCP transmission means, asynchronous collecting daily record data and distributed treatment daily record data, improved systematic function and storage efficiency, and alleviated the read-write load of disk by default write frequency data writing.
As shown in Figure 5, in one embodiment, above-mentioned Log Collect System also comprises log data acquisition module 200, and this log data acquisition module 200 comprises: collecting unit 210, formatting unit 230, compression unit 250 and transmission unit 270.
Collecting unit 210, for the will data of acquisition applications program.
In the present embodiment, collecting unit 210 provides an interface function that sends daily record data for application program, and when this function of application call, the daily record data that needs are recorded transmits with designated parameter, thereby collects the daily record data of application program.
Formatting unit 230, for multiple fields of daily record data are connected into a character string, with the daily record data of form format.
In the present embodiment, the daily record field in daily record data is divided into common field and extended field, and the number of common field is fixed, and extended field is to define in order to increase and decrease daily record data item flexibly, and the extension quantity of extended field is variable.For common field and extended field are connected into a complete character string, daily record data is formatd to processing.
Concrete, first carry out character replacement, "@1 $ " in daily record data and "@2 $ " are replaced with to null character (NUL), the stress of the English state in extension number " ` " is replaced with to "@2 $ ", by the comma of the English state in each field, " replace with "@1 $ ".Then the stress number " ` " of the English state of each extension of replacing is connected to form to new extended field, the comma by new extended field with the English state of common field of replacing, " connect into a character string, obtain the daily record data of format.Daily record data is formatd to processing, be convenient to the transmission of daily record data.
Compression unit 250, for compressing the daily record data of format.This compress mode can be the data compression modes such as gz, the daily record data of format is compressed to reduce to bit number and the total amount of byte of daily record data, is to improve transmitting efficiency sending daily record data.
Transmission unit 270, for sending the daily record after compression by UDP transmission means.
In the present embodiment, owing to transmitting daily record data in local area network (LAN), can adopt UDP transmission means, UDP transmission means is towards disconnected transmission means, and the data that TCP need to transmit are relatively less, simple and quick, can improve efficiency of transmission, mitigation system performance pressure.
As shown in Figure 6, in one embodiment, above-mentioned Log Collect System also comprises daily record central server 300, and this daily record central server 300 comprises decompression module 310, read module 330, anti-formatting module 350 and writing module 370.
Decompression module 310, obtains journal file for obtaining also decompressing compressed file.
In the present embodiment, decompression module 310 is obtained the compressed file forwarding by TCP transmission means, can after a compressed file receives successfully, reply one and successfully identify to notify and successfully receive compressed file.The compressed file receiving according to the time sequencing decompress(ion) in compressed file name extracts and obtains journal file from compressed file.After decompress(ion) completes, the compressed file that decompress(ion) is crossed backups, and the compressed file backing up is deleted, to save memory space.
Read module 330, obtains daily record data for reading journal file.
In the present embodiment, read module 330 reads journal file by the time sequencing in daily record filename, reads line by line log file contents and obtains daily record data.
Anti-formatting unit 350, obtains daily record field for anti-format daily record data.
In the present embodiment, anti-formatting unit 350, according to the anti-format of the format rule daily record data of formatting unit 230, obtains the daily record field in daily record data, and this field comprises common field and extended field.
Writing unit 370, for writing log database by daily record field.
In the present embodiment, writing unit 370, by analyzing the daily record data in daily record field, takes out the corresponding position of corresponding field write into Databasce.Daily record data write into Databasce is convenient to the retrieval of daily record and is checked.
Elaborate above-mentioned log collection method and system below in conjunction with a specific embodiment, as shown in Figure 7, application program produces daily record data, transmits daily record data by the interface function that calls log data acquisition module 200.Log data acquisition module 200 formats the daily record data of collection compress, and adopts udp protocol that the daily record data after compression is packaged into UDP message bag and transmits, and sends to UDP transfer server 100.UDP transfer server 100 comprises acquisition module 110, written document module 130, packing compression module 150 and forwarding module 170, UDP transfer server 100 is as the terminal of daily record data, daily record data is further processed, to alleviate the systematic function pressure of application program and log data acquisition module 200, be convenient to the accurate transmission of daily record data simultaneously.UDP transfer server 100 adopts Transmission Control Protocol to carry out the transmission of compressed file with integrality and the accuracy of guarantee daily record data.Daily record central server 300 receives the compressed file of the daily record data that UDP transfer server 100 forwards, then compressed file is carried out to decompress(ion) reduction, read the daily record data in journal file, and carry out the anti-format of daily record data, obtain original daily record field, comprise common field and extended field, read daily record data corresponding stored in field in database, daily record data write into Databasce is convenient to the retrieval of daily record and is checked.
The above embodiment has only expressed several execution mode of the present invention, and it describes comparatively concrete and detailed, but can not therefore be interpreted as the restriction to the scope of the claims of the present invention.It should be pointed out that for the person of ordinary skill of the art, without departing from the inventive concept of the premise, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection range of patent of the present invention should be as the criterion with claims.
Claims (10)
1. a log collection method, comprises the steps:
Obtain daily record data by UDP transmission means;
By default write frequency, described daily record data is write to journal file;
Described journal file is packed to compress and obtain compressed file;
Forward described compressed file by TCP transmission means.
2. log collection method according to claim 1, is characterized in that, before the described step of obtaining daily record data by UDP transmission means, also comprises the steps:
The daily record data of acquisition applications program;
Multiple fields in daily record data are connected into a character string, with the daily record data of form format;
The daily record data of described format is compressed;
Send the daily record data after compression by UDP transmission means.
3. log collection method according to claim 2, is characterized in that, after the described step that forwards described compressed file by TCP transmission means, also comprises the steps:
Obtain and decompress(ion) described in compressed file obtain journal file;
Read described journal file and obtain daily record data;
The described daily record data of anti-format obtains daily record field;
Described daily record field is write to log database.
4. log collection method according to claim 1, is characterized in that, after the described step that forwards described compressed file by TCP transmission means, also comprises:
After determining described compressed file and forwarding successfully, delete described compressed file.
5. log collection method according to claim 1, is characterized in that, described the described journal file step that compression obtains compressed file of packing is specially:
By default packing frequency to the compression of packing of described journal file;
Described in deletion, beat the journal file of bag.
6. a Log Collect System, is characterized in that, comprises UDP transfer server, and described UDP transfer server comprises:
Acquisition module, for obtaining daily record data by UDP transmission means;
Written document module, writes journal file by default write frequency by described daily record data;
Packing compression module, for described journal file is packed, compression obtains compressed file;
Forwarding module, for forwarding described compressed file by TCP transmission means.
7. Log Collect System according to claim 6, is characterized in that, described system also comprises log data acquisition module:
Described log data acquisition module comprises:
Collecting unit, for the daily record data of acquisition applications program;
Formatting unit, for multiple fields of daily record data are connected into a character string, with the daily record data of form format;
Compression unit, for compressing the daily record data of described format;
Transmission unit, for sending the daily record data after described compression by UDP transmission means.
8. Log Collect System according to claim 7, is characterized in that, described system also comprises daily record central server, and described daily record central server comprises:
Decompression module, for obtain and decompress(ion) described in compressed file obtain journal file;
Read module, obtains daily record data for reading described journal file;
Anti-formatting module, obtains daily record field for the described daily record data of anti-format;
Writing module, for writing log database by described daily record field.
9. Log Collect System according to claim 6, is characterized in that, described UDP transfer server also comprises removing module, for after determining described compressed file and forwarding successfully, deletes described compressed file.
10. log collection method according to claim 6, is characterized in that, described packing compression module also for by default packing frequency to the compression of pack of described journal file, beaten the journal file wrapping described in deletion.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310021720.1A CN103944744B (en) | 2013-01-21 | 2013-01-21 | Log collection method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310021720.1A CN103944744B (en) | 2013-01-21 | 2013-01-21 | Log collection method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103944744A true CN103944744A (en) | 2014-07-23 |
| CN103944744B CN103944744B (en) | 2019-02-19 |
Family
ID=51192243
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310021720.1A Active CN103944744B (en) | 2013-01-21 | 2013-01-21 | Log collection method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103944744B (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105843869A (en) * | 2016-03-17 | 2016-08-10 | 金蝶软件（中国）有限公司 | Data transmission method, device and system |
| CN106789232A (en) * | 2016-12-16 | 2017-05-31 | 武汉奥浦信息技术有限公司 | A kind for the treatment of control system of efficient information flow |
| CN107609133A (en) * | 2017-09-18 | 2018-01-19 | 郑州云海信息技术有限公司 | Journal file dump method, device, equipment and its computer-readable recording medium |
| CN108664648A (en) * | 2018-05-17 | 2018-10-16 | 四川斐讯信息技术有限公司 | A kind of visual presentation method and system for detecting log collection stability |
| CN110308937A (en) * | 2019-04-28 | 2019-10-08 | 宁波三星医疗电气股份有限公司 | A method of hyper terminal serial ports in electric power acquisition terminal is opened based on USB flash disk |
| CN110378154A (en) * | 2019-07-24 | 2019-10-25 | 秒针信息技术有限公司 | A kind of method and device of file set completeness check |
| CN110825598A (en) * | 2019-09-23 | 2020-02-21 | 武汉智美互联科技有限公司 | Log real-time processing method and system |
| CN110995836A (en) * | 2019-11-29 | 2020-04-10 | 安徽江淮汽车集团股份有限公司 | Log management method, device, storage medium and device based on Internet of vehicles platform |
| CN112255942A (en) * | 2020-10-14 | 2021-01-22 | 江苏新安电器股份有限公司 | Data transmission method for test equipment |
| CN112765114A (en) * | 2021-01-21 | 2021-05-07 | 神州数码融信云技术服务有限公司 | Financial system log file processing method and system |
| CN114780353A (en) * | 2022-06-15 | 2022-07-22 | 统信软件技术有限公司 | File log monitoring method and system and computing device |
| CN115834575A (en) * | 2023-02-28 | 2023-03-21 | 新云网科技集团股份有限公司 | Log reporting method, system, equipment and computer readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101808121A (en) * | 2010-02-24 | 2010-08-18 | 深圳市五巨科技有限公司 | Method and device for writing server log of mobile terminal into database |
| CN101969386A (en) * | 2010-11-09 | 2011-02-09 | 道有道(北京)科技有限公司 | Log acquisition device and log acquisition method |
| CN102195795A (en) * | 2010-03-19 | 2011-09-21 | Tcl集团股份有限公司 | Intelligent district log system and log recording method thereof |
| CN102722584A (en) * | 2012-06-08 | 2012-10-10 | 北京天地云箱科技有限公司 | Data storage system and method |
| CN102780777A (en) * | 2012-07-19 | 2012-11-14 | 北京蓝汛通信技术有限责任公司 | Log collecting method and log collecting system |
-
2013
- 2013-01-21 CN CN201310021720.1A patent/CN103944744B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101808121A (en) * | 2010-02-24 | 2010-08-18 | 深圳市五巨科技有限公司 | Method and device for writing server log of mobile terminal into database |
| CN102195795A (en) * | 2010-03-19 | 2011-09-21 | Tcl集团股份有限公司 | Intelligent district log system and log recording method thereof |
| CN101969386A (en) * | 2010-11-09 | 2011-02-09 | 道有道(北京)科技有限公司 | Log acquisition device and log acquisition method |
| CN102722584A (en) * | 2012-06-08 | 2012-10-10 | 北京天地云箱科技有限公司 | Data storage system and method |
| CN102780777A (en) * | 2012-07-19 | 2012-11-14 | 北京蓝汛通信技术有限责任公司 | Log collecting method and log collecting system |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105843869A (en) * | 2016-03-17 | 2016-08-10 | 金蝶软件（中国）有限公司 | Data transmission method, device and system |
| CN106789232B (en) * | 2016-12-16 | 2019-12-06 | 武汉奥浦信息技术有限公司 | efficient information-flow processing control system |
| CN106789232A (en) * | 2016-12-16 | 2017-05-31 | 武汉奥浦信息技术有限公司 | A kind for the treatment of control system of efficient information flow |
| CN107609133A (en) * | 2017-09-18 | 2018-01-19 | 郑州云海信息技术有限公司 | Journal file dump method, device, equipment and its computer-readable recording medium |
| CN108664648A (en) * | 2018-05-17 | 2018-10-16 | 四川斐讯信息技术有限公司 | A kind of visual presentation method and system for detecting log collection stability |
| CN110308937A (en) * | 2019-04-28 | 2019-10-08 | 宁波三星医疗电气股份有限公司 | A method of hyper terminal serial ports in electric power acquisition terminal is opened based on USB flash disk |
| CN110308937B (en) * | 2019-04-28 | 2022-06-03 | 宁波三星医疗电气股份有限公司 | Method for opening super terminal serial port in power acquisition terminal based on USB flash disk |
| CN110378154A (en) * | 2019-07-24 | 2019-10-25 | 秒针信息技术有限公司 | A kind of method and device of file set completeness check |
| CN110378154B (en) * | 2019-07-24 | 2021-04-02 | 秒针信息技术有限公司 | File set integrity checking method and device |
| CN110825598A (en) * | 2019-09-23 | 2020-02-21 | 武汉智美互联科技有限公司 | Log real-time processing method and system |
| CN110995836A (en) * | 2019-11-29 | 2020-04-10 | 安徽江淮汽车集团股份有限公司 | Log management method, device, storage medium and device based on Internet of vehicles platform |
| CN112255942A (en) * | 2020-10-14 | 2021-01-22 | 江苏新安电器股份有限公司 | Data transmission method for test equipment |
| CN112765114A (en) * | 2021-01-21 | 2021-05-07 | 神州数码融信云技术服务有限公司 | Financial system log file processing method and system |
| CN114780353A (en) * | 2022-06-15 | 2022-07-22 | 统信软件技术有限公司 | File log monitoring method and system and computing device |
| CN115834575A (en) * | 2023-02-28 | 2023-03-21 | 新云网科技集团股份有限公司 | Log reporting method, system, equipment and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103944744B (en) | 2019-02-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103944744A (en) | Method and system for log acquisition | |
| CN102970158B (en) | Log storage and processing method and log server | |
| CN102906751B (en) | A kind of method of data storage, data query and device | |
| CN104462141B (en) | Method, system and the storage engines device of a kind of data storage and inquiry | |
| CN102508908B (en) | Method for acquiring subordinate financial business data and system for acquiring subordinate financial business data | |
| CN105512201A (en) | Data collection and processing method and device | |
| CN105824744A (en) | Real-time log collection and analysis method on basis of B2B (Business to Business) platform | |
| CN103118104B (en) | A kind of data restoration method and server based on version vector | |
| CN104090891A (en) | Method and device for data processing and server and system for data processing | |
| CN106991177B (en) | Lossless acquisition method and system for real-time logs in distributed environment | |
| CN106897159A (en) | A kind of system and method for gathering Data of Automatic Weather | |
| CN109145155A (en) | High-concurrency warehousing processing method for mass remote sensing image metadata | |
| CN112559463A (en) | Method and device for processing compressed file | |
| CN102497450A (en) | Two-stage-system-based distributed data compression processing method | |
| CN108090186A (en) | A kind of electric power data De-weight method on big data platform | |
| CN111831540A (en) | Debugging information processing method, processing device and storage medium | |
| CN102075572B (en) | Embedded type web server | |
| CN103020157A (en) | High-reliability real-time file generation method spanning physical isolation | |
| CN102999626B (en) | A kind of data compression/decompression compression apparatus and method, system | |
| CN110019347A (en) | A kind of data processing method, device and the terminal device of block chain | |
| CN1979475A (en) | Compressed file processing method | |
| CN107436848B (en) | Method and device for realizing conversion between user data and compressed data | |
| CN116170508A (en) | Data processing method, terminal, system, equipment, medium and product | |
| JP2002312250A (en) | Transmission system, device and method | |
| CN103716228A (en) | Mail transmission method, mail gateway and mail transmission system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |