CN101969386A - Log acquisition device and log acquisition method - Google Patents
Log acquisition device and log acquisition method Download PDFInfo
- Publication number
- CN101969386A CN101969386A CN 201010536426 CN201010536426A CN101969386A CN 101969386 A CN101969386 A CN 101969386A CN 201010536426 CN201010536426 CN 201010536426 CN 201010536426 A CN201010536426 A CN 201010536426A CN 101969386 A CN101969386 A CN 101969386A
- Authority
- CN
- China
- Prior art keywords
- log
- client
- server
- log information
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention relates to a log acquisition device and a log acquisition method. The device comprises at least one client for collecting logs and at least one server for recording the logs, wherein log information is transmitted between the client and the server through a network in real time. The method comprises that: the client generates the log information, writes the log information into a disk file of the client, reads the log information from the disk file of the client, and sends a connection request to the server; after receiving the request, the server establishes network connection with the client and receives the log information; the server sends the received log information to a server log writing module and a server log writing database module; the server log writing module writes the log information into the disk file of the server; and the server log writing database module writes the log information into the database. When the device and the method of the invention are used, the data analysis is more real-time, and the distributed acquisition of the logs is realized.
Description
Technical field
The present invention relates to the computer internet technical field, relate in particular to a kind of real-time acquisition device and method of distributed daily record.
Background technology
Present internet arena, more and more important to the analysis of user behavior, and the basis of user behavior analysis is user's a usage log.For a lot of distributed big flow products in the Internet, distribution along with server, the analysis of daily record becomes and more and more bothers, such as the log statistic of many service servers of front end, regular (per hour, every day) truncated log, then by FTP (File Transfer Protocol, file transfer protocol (FTP)) passes to and unify on the station server to handle, before the computing of some daily record, also need to consider the sequencing problem of daily record.
The backup mode of at present common a kind of daily record for example: the mode that many service servers will be by text according to the journal format that designs with log record in the journal file of this locality, by day or truncated log file by the hour.When morning, business load was low, the mode of journal file by ftp uploaded to concentrated log server, after treating that all application servers have been uploaded journal file, after the log server of concentrating merges all daily records, be written in the database, use for data analysis or data mining program.
Such daily record can be supported several the concurrent services to tens scales synchronously.When the server of managing reaches tens, and in the middle of being arranged, a large amount of servers has when reaching the standard grade/rolling off the production line change, the daily record of the concentrating extremely difficult management that regularly more seems synchronously, and daily record is synchronous owing to will avoid the peak on daytime, often need to carry out synchronously with the ebb period in morning, got off in 24 hours, the daily record of last G also is the very high operation of risk synchronously.And the daily record ordering union operation that becomes bottleneck also can hinder the cycle of other subsequent calculations.
Mainly there is following shortcoming in existing technical scheme:
1, the periodicity of log collection is oversize, in order to guarantee professional normal operation, generally all is one day time.
2, extensibility is relatively poor, for the collection of big more system journal with handle will be difficult more.
3, journal file is too big.Owing to generally use the mode log file of text at present, journal file is well compression not, needs a large amount of disk spaces.
4, the log analysis promptness is poor.Because the system that has need finish log analysis in the specific time, daily record is uploaded, merged to existing mode will take a large amount of time of log analysis, and the daily record amount is big more, and daily record is uploaded and time of merging will be long more, causes log analysis in time to finish.
5, maintainable poor.Professional journal format mode changes, and the analysis mode of daily record is changed thereupon, will be in the face of uncertain during system upgrade.
Therefore, need a kind of new log collection mode, the time of log collection is accomplished in real time, and improve the extensibility of system, save disk space simultaneously, reduce the time that daily record is uploaded and merged, guarantee the promptness of log analysis.
Summary of the invention
Technical problem to be solved by this invention provides a kind of distributed real-time log collection device, realizes the real-time collecting and the analysis in time of the distribution of daily record, and improves the extensibility of device, reduces journal file, and is convenient to the maintenance of daily record.
The technical scheme that the present invention solves the problems of the technologies described above is as follows: a kind of log collection device comprises that at least one client that is used for log collection and at least one are used for the server of log record; Carrying out real-time log information by network between the described client and server sends.
The invention has the beneficial effects as follows: real-time log information transmits, make log information not need regular collection, thereby can not upload, merge and cause the untimely of data analysis because of daily record concentrated, a plurality of client and servers carry out daily record by network and transmit, and have realized the distributed capture of daily record.
On the basis of technique scheme, the present invention can also do following improvement.
Further, described server is at least two, connects by chain structure between the server.
Chain structure in the above-mentioned further scheme is meant, described server can be connected and carry out real-time log information transmission simultaneously with another station server as the client that is used for log collection, thereby realize a kind of multilevel hierarchy of log collection, this chain structure can guarantee to increase at any time as required number of servers, favorable expandability guarantees the development that apparatus of the present invention can limit service.
Further, the form of described daily record adopts the protocol buffer form of google.
Protocol buffer is the form of a kind of exchanges data of google, and it is independent of language, is independent of platform.Google provides the realization of three kinds of language: java, C++ and python, each realizes all having comprised the compiler and the library file of corresponding language.Because it is protocol buffer is a kind of binary form, more many soon than using xml to carry out exchanges data.Can be used for data communication between the Distributed Application or the exchanges data under the isomerous environment to it.
Adopt the protocol buffer form of the google of above-mentioned further scheme, it is had a mind to effect and also is to have good maintainability, can not need to revise the parsing module of daily record because of the upgrading of system journal.
Further, described daily record is a binary format.
Adopt the beneficial effect of above-mentioned further scheme to be, adopt binary format, can effectively reduce the size (size of binary format journal file have only text about 20%) of journal file, for a large amount of disk spaces has been saved in the backup of daily record.
Further, described client comprises that client log logging modle and client log read sending module; Described client log logging modle is used for log information by minute, hour or day cut apart and record journal file for unit; Described client log reads sending module and is used for setting up the network connection with server, and reads the log information in the journal file and send it to described server.
Adopt the beneficial effect of above-mentioned further scheme to be, realized collection and the transmission of log information in client, by to the cutting apart of file, can guarantee that the volume of file is not too large, that improves daily record reads and writing speed the performance of assurance device.
Further, described client log reads sending module and comprises client log read module and client log sending module; Described client log read module is used for reading the log information of journal file and sends to described client log sending module; Described client log sending module is used for setting up the network connection and will sending to server from the log information that the client log read module receives with server; Described client log sending module has automatic reconnect function and does not have the automatic retransmitting function of response.
Adopt the beneficial effect of above-mentioned further scheme to be, guarantee the accuracy that log information sends.
Further, described server comprises sever log receiver module and sever log processing module; Described sever log receiver module is used for setting up the log information that network connects and the reception client sends and sending it to described sever log processing module with described client; The journal file neutralization that described sever log processing module is used for the log information that receives is analyzed, handled and is written to server end this locality is written to database.
Adopt the beneficial effect of above-mentioned further scheme to be, realized reception and the preservation of server end to log information, log information is saved in respectively in the journal file and database in, be used for backup and fault recovery on the one hand, provide data source for data analysis and data mining on the other hand.
Further, described sever log processing module comprises that sever log writing module and sever log write database module; Described sever log writing module is used for described log information is written to by asynchronous system the journal file of server end this locality; Described sever log writes database module and is used for described log information is write database, and carries out level fractionation and the vertical fractionation of log information in database.
Adopt the beneficial effect of above-mentioned further scheme to be, adopt asynchronous system to write journal file and compare the performance that has improved device with the method for synchronization, improved the daily record received quantity of sever log receiver module in the unit interval; Database is carried out the demand that level and the vertical fractionation system that makes have satisfied very big data volume.
The present invention also provides a kind of acquisition method of daily record, comprising:
Step 100, client generate log information and described log information are written in the disk file of client;
Step 200, read the log information in the client disk file, and send connection request to server;
After step 300, server are received connection request, set up network with client and be connected and receive log information;
The log information that receives is sent to the sever log writing module respectively for step 400, server and sever log writes database module;
Step 500, sever log writing module write the server disk file with described log information;
Step 600, sever log write database module described log information are write database.
Adopt the beneficial effect of said method to be: to realize collection and the preservation of log information from the client to the server.
Further, described step 100 comprises:
Adopt the beneficial effect of above-mentioned further scheme to be, elder generation in the log information formation, writes the operation that writes file that thread is finished daily record by daily record with log information recording then, thereby guarantees that log record does not influence the response speed of client application.
By apparatus and method provided by the invention, can realize the distributed capture of real-time log information, the autgmentability of device is strong, and journal file is little, and has good maintainability, can not make amendment to the daily record parsing because of system upgrade.In addition, the log collection mode adopts ICP/IP protocol, by client by socket (be also referred to as " socket ", application program usually by socket to the network request of sending or reply network requests) send log information to server, thereby guarantee the accuracy of log collection.In a word, apparatus and method of the present invention have solved the existing problem of existing Log backup mode.
Description of drawings
Fig. 1 is a log collection structure drawing of device of the present invention;
Fig. 2 is a log collection method flow diagram of the present invention;
Fig. 3 is the sub-process figure of step 100 in the log collection method of the present invention.
In the accompanying drawing, the list of parts of each label representative is as follows:
1, client, 2, server, 3, network, 11, the client log logging modle, 12, client log reads sending module, 121, client log read module, 122, client log sending module, 21, the sever log receiver module, 22, the sever log processing module, 221, sever log writing module, 222, sever log writes database module
Embodiment
Below in conjunction with accompanying drawing principle of the present invention and feature are described, institute gives an actual example and only is used to explain the present invention, is not to be used to limit scope of the present invention.
As shown in Figure 1, be apparatus structure schematic diagram of the present invention, comprise at least one client 1 and at least one server 2, described client 1 is used for the collection of daily record, described server 2 is used for the record of daily record, and client 1 and server 2 carry out the transmission of log information by network 3.Log collection mode among the present invention adopts ICP/IP protocol, utilizes socket to send log information to server 2 by client 1, and adopting ICP/IP protocol is in order to guarantee the accuracy of log collection.
Client log reads sending module 12 and has comprised client log read module 121 and client log sending module 122, and wherein client log read module 121 is responsible for reading the log information in the journal file and is sent to described client log sending module 122; Client log sending module 122 is responsible for setting up network with server end and is connected, and will send to server 2 from the log information that client log read module 121 receives.For the accuracy that guarantees that message sends, client log sending module 122 has that network disconnects automatic reconnect function and message does not have the automatic retransmitting function of response.
Among the present invention, server 2 includes sever log receiver module 21 and sever log processing module 22.Wherein, sever log receiver module 21 is responsible for monitoring network requests, receive the network requests of client 1, and foundation is connected with the network of client 1.The journal file neutralization that sever log processing module 22 is used for the log information that receives is analyzed, handled and is written to server end this locality is written to database.
Sever log processing module 22 comprises that sever log writing module 221 and sever log write database module 222.Wherein, the log information that sever log writing module 221 is responsible for the server end receiver module is received is written to by asynchronous mode in the journal file of server end this locality, to be used for backup and fault recovery.Sever log writes the log informations that database module 222 is responsible for sever log receiver module 21 is received and writes in the database, and finishes that the level of log information in database splits and the work of vertical fractionation.
Among the present invention, when the quantity of server 2 is two or two when above, connect by chain structure between the server 2, be that described server 2 can be connected and carry out real-time log information transmission simultaneously with another station server as another client that is used for log collection, thereby realize a kind of multilevel hierarchy of log collection, the development that the system that can guarantee so can limit service.Because along with the complexity of system increases gradually, the client-server logging mode of individual layer just possibly can't satisfy the requirement of system, adopt above-mentioned chain structure, make server 2 can be used as a node of log collection, to another connected server, be the upper level server, the transmission log information, thus allow system have better extensibility.
Log information in the present embodiment adopts binary format to preserve, and the size of journal file has only about 20% of text; The collection of daily record is real-time, thereby can not upload because of daily record concentrated, merge and cause the untimely of data analysis; In addition, journal format adopts the protocolbuffer form based on google, has good maintainability, can not need to revise the parsing module of daily record because of the upgrading of system journal.
As shown in Figure 2, the log collection method that device of the present invention adopted is:
Step 100, client generate log information and described log information are written in the disk file of client;
Step 200, read the log information in the client disk file, and send connection request to server;
After step 300, server are received connection request, set up network with client and be connected and receive log information;
The log information that receives is sent to the sever log writing module respectively for step 400, server and sever log writes database module;
Step 500, sever log writing module write the server disk file with described log information;
Step 600, sever log write database module described log information are write database.
Wherein, step 100 comprises:
By the technical program in real time, the extensibility of the whole application system that guarantees, can finish the expansion of system by the mode that increases common PC Server server, avoid the mode of disposal ability that can only be by improving Single-Server to improve the disposal ability of system, can effectively reduce professional server cost input.Simultaneously and since with the record of daily record and application carried out asynchronous separating treatment (application meeting commonly used at present directly with log record in database, may be because the service that influence application itself unusually of database.And described asynchronous separating treatment mode, different with mode commonly used at present, the daily record database that no longer writes direct, but write in the file as mentioned above, thereby avoided relevant problem, writing database is to be finished by the module of server end), avoid can't having improved the robustness of whole system for the user provides service because the log record influence is used; By adopting the mode log of binary system protocol buffer, effectively reduced the size of journal file, for a large amount of disk spaces has been saved in the backup of daily record.
The above only is preferred embodiment of the present invention, and is in order to restriction the present invention, within the spirit and principles in the present invention not all, any modification of being done, is equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. a log collection device is characterized in that: comprise that at least one client that is used for log collection and at least one are used for the server of log record; Carrying out real-time log information by network between the described client and server sends.
2. device according to claim 1 is characterized in that: described server is at least two, connects by chain structure between the server.
3. device according to claim 1 is characterized in that: the form of described daily record adopts the protocol buffer form of google.
4. device according to claim 1 is characterized in that: described daily record is a binary format.
5. according to each described device of claim 1 to 4, it is characterized in that: described client comprises that client log logging modle and client log read sending module; Described client log logging modle is used for log information by minute, hour or day cut apart and record journal file for unit; Described client log reads sending module and is used for setting up the network connection with server, and reads the log information in the journal file and send it to described server.
6. device according to claim 5 is characterized in that: described client log reads sending module and comprises client log read module and client log sending module; Described client log read module is used for reading the log information of journal file and sends to described client log sending module; Described client log sending module is used for setting up the network connection and will sending to server from the log information that the client log read module receives with server; Described client log sending module has automatic reconnect function and does not have the automatic retransmitting function of response.
7. according to each described device of claim 1 to 4, it is characterized in that: described server comprises sever log receiver module and sever log processing module; Described sever log receiver module is used for setting up the log information that network connects and the reception client sends and sending it to described sever log processing module with described client; The journal file neutralization that described sever log processing module is used for the log information that receives is analyzed, handled and is written to server end this locality is written to database.
8. device according to claim 7 is characterized in that: described sever log processing module comprises that sever log writing module and sever log write database module; Described sever log writing module is used for described log information is written to by asynchronous system the journal file of server end this locality; Described sever log writes database module and is used for described log information is write database, and carries out level fractionation and the vertical fractionation of log information in database.
9. log collection method comprises:
Step 100, client generate log information and described log information are written in the disk file of client;
Step 200, read the log information in the client disk file, and send connection request to server;
After step 300, server are received connection request, set up network with client and be connected and receive log information;
The log information that receives is sent to the sever log writing module respectively for step 400, server and sever log writes database module;
Step 500, sever log writing module write the server disk file with described log information;
Step 600, sever log write database module described log information are write database.
10. method according to claim 9 is characterized in that, described step 100 comprises:
Step 101, client generate log information, and log information is written in the message queue;
Step 102, the log information in the message queue is written to the client disk file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010536426 CN101969386A (en) | 2010-11-09 | 2010-11-09 | Log acquisition device and log acquisition method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010536426 CN101969386A (en) | 2010-11-09 | 2010-11-09 | Log acquisition device and log acquisition method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101969386A true CN101969386A (en) | 2011-02-09 |
Family
ID=43548492
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010536426 Pending CN101969386A (en) | 2010-11-09 | 2010-11-09 | Log acquisition device and log acquisition method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101969386A (en) |
Cited By (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102170494A (en) * | 2011-03-30 | 2011-08-31 | 深圳市五巨科技有限公司 | Method and system for recording operation process of mobile terminal as well as mobile terminal |
| CN102447633A (en) * | 2011-12-29 | 2012-05-09 | 北京亿赞普网络技术有限公司 | Log transmission method and system |
| CN102594598A (en) * | 2012-02-16 | 2012-07-18 | 浪潮(北京)电子信息产业有限公司 | Log management system and implementation method thereof |
| CN102681931A (en) * | 2012-05-15 | 2012-09-19 | 天津市天元新泰科技发展有限公司 | Realization method of log and abnormal probe |
| CN102780726A (en) * | 2011-05-13 | 2012-11-14 | 中兴通讯股份有限公司 | Log analysis method and log analysis system based on WEB platform |
| CN102981934A (en) * | 2012-12-21 | 2013-03-20 | 曙光信息产业(北京)有限公司 | Log transition method and log transition device |
| CN103176971A (en) * | 2011-12-20 | 2013-06-26 | 触动多媒体技术（上海）有限公司 | Remote log information analysis system |
| CN103281311A (en) * | 2013-05-12 | 2013-09-04 | 南京载玄信息科技有限公司 | Internet of Things protocol analysis method adopting Protobuf description |
| CN103309767A (en) * | 2012-03-08 | 2013-09-18 | 阿里巴巴集团控股有限公司 | Method and device for processing client log |
| CN103425750A (en) * | 2013-07-23 | 2013-12-04 | 国云科技股份有限公司 | Cross-platform and cross-application log collecting system and collecting managing method thereof |
| CN103605630A (en) * | 2013-11-28 | 2014-02-26 | 中标软件有限公司 | Virtual server system and data reading-writing method thereof |
| CN103778049A (en) * | 2012-10-19 | 2014-05-07 | 北京市三希电子科技开发公司 | Embedded system development log system |
| CN103944744A (en) * | 2013-01-21 | 2014-07-23 | 博雅网络游戏开发（深圳）有限公司 | Method and system for log acquisition |
| CN104050074A (en) * | 2013-03-12 | 2014-09-17 | 中国银联股份有限公司 | Method and device for asynchronously recording log in system |
| CN104580372A (en) * | 2014-12-12 | 2015-04-29 | 安徽富煌和利时科技股份有限公司 | Method for transmitting status files of electronic station board IPCs (Industrial Personal Computer) |
| CN104822156A (en) * | 2015-04-01 | 2015-08-05 | 中国联合网络通信集团有限公司 | User behavior analysis method and device |
| CN105224583A (en) * | 2014-07-03 | 2016-01-06 | 北京奇虎科技有限公司 | The method for cleaning of journal file and device |
| CN105229605A (en) * | 2012-11-26 | 2016-01-06 | 谷歌股份有限公司 | The concentrated distribution that application program is analyzed |
| CN105991319A (en) * | 2015-02-06 | 2016-10-05 | 杭州与盟医疗技术有限公司 | Medical equipment intelligent monitoring system based on network |
| CN106357454A (en) * | 2016-10-08 | 2017-01-25 | 武汉斗鱼网络科技有限公司 | Log system control device and method |
| CN106569934A (en) * | 2015-10-13 | 2017-04-19 | 阿里巴巴集团控股有限公司 | Application log display method and device |
| CN106649744A (en) * | 2016-12-26 | 2017-05-10 | 金蝶软件（中国）有限公司 | Log recording method and apparatus |
| CN106656619A (en) * | 2016-12-30 | 2017-05-10 | 郑州云海信息技术有限公司 | Linux log management system and method |
| CN106649729A (en) * | 2016-12-23 | 2017-05-10 | 深圳市金证科技股份有限公司 | Log running method and system, client and server |
| CN106713450A (en) * | 2016-12-21 | 2017-05-24 | 广州优视网络科技有限公司 | Downloading acceleration method and apparatus based on read-write separation mode |
| CN106790671A (en) * | 2017-01-24 | 2017-05-31 | 深圳市北斗智星勘测科技有限公司 | A kind of building structure deformation monitoring method, equipment and system |
| CN106897156A (en) * | 2016-12-28 | 2017-06-27 | 南京欣网互联信息技术有限公司 | The method that counting user behavior based on statistics platform forms daily record |
| CN107786641A (en) * | 2017-09-30 | 2018-03-09 | 南威软件股份有限公司 | A kind of acquisition method of distributed multi-system user user behaviors log |
| CN108121646A (en) * | 2017-12-26 | 2018-06-05 | 东软集团股份有限公司 | Journal file acquisition methods, device, computer and storage medium |
| CN108427625A (en) * | 2017-02-14 | 2018-08-21 | 北京国双科技有限公司 | Transmission, the method for record log, client, server end and system |
| CN109257230A (en) * | 2018-10-26 | 2019-01-22 | 武汉精鸿电子技术有限公司 | A kind of Log Administration System and method of semiconductor memory burn-in test |
| CN110781154A (en) * | 2018-07-11 | 2020-02-11 | 中兴通讯股份有限公司 | Log collection method, device, system and computer readable storage medium |
| CN111835562A (en) * | 2020-07-01 | 2020-10-27 | 北京爱笔科技有限公司 | Log uploading method, log query method and log query system |
| CN112181789A (en) * | 2020-08-31 | 2021-01-05 | 福州智象信息技术有限公司 | Equipment end log collection method based on AWS |
| CN112491659A (en) * | 2020-12-02 | 2021-03-12 | 广州品唯软件有限公司 | Flow playback test method and device, computer equipment and storage medium |
| CN115086296A (en) * | 2022-05-27 | 2022-09-20 | 阿里巴巴（中国）有限公司 | Log transmission system, log transmission method and related device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1394034A (en) * | 2001-06-21 | 2003-01-29 | 华为技术有限公司 | Journal management system of integrated network manager |
| CN1932812A (en) * | 2005-09-16 | 2007-03-21 | 腾讯科技（深圳）有限公司 | Method and apparatus for holding journal |
| CN101364891A (en) * | 2007-08-10 | 2009-02-11 | 中兴通讯股份有限公司 | System for collecting performance data by single point in distributed telecommunication network management and implementing method |
| CN101459557A (en) * | 2008-11-29 | 2009-06-17 | 成都市华为赛门铁克科技有限公司 | Secure logging centralized storage method and device |
-
2010
- 2010-11-09 CN CN 201010536426 patent/CN101969386A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1394034A (en) * | 2001-06-21 | 2003-01-29 | 华为技术有限公司 | Journal management system of integrated network manager |
| CN1932812A (en) * | 2005-09-16 | 2007-03-21 | 腾讯科技（深圳）有限公司 | Method and apparatus for holding journal |
| CN101364891A (en) * | 2007-08-10 | 2009-02-11 | 中兴通讯股份有限公司 | System for collecting performance data by single point in distributed telecommunication network management and implementing method |
| CN101459557A (en) * | 2008-11-29 | 2009-06-17 | 成都市华为赛门铁克科技有限公司 | Secure logging centralized storage method and device |
Cited By (52)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102170494A (en) * | 2011-03-30 | 2011-08-31 | 深圳市五巨科技有限公司 | Method and system for recording operation process of mobile terminal as well as mobile terminal |
| CN102780726A (en) * | 2011-05-13 | 2012-11-14 | 中兴通讯股份有限公司 | Log analysis method and log analysis system based on WEB platform |
| CN102780726B (en) * | 2011-05-13 | 2016-12-07 | 国网山东省电力公司蒙阴县供电公司 | A kind of log analysis method based on WEB platform and system |
| CN103176971A (en) * | 2011-12-20 | 2013-06-26 | 触动多媒体技术（上海）有限公司 | Remote log information analysis system |
| CN102447633A (en) * | 2011-12-29 | 2012-05-09 | 北京亿赞普网络技术有限公司 | Log transmission method and system |
| CN102594598A (en) * | 2012-02-16 | 2012-07-18 | 浪潮(北京)电子信息产业有限公司 | Log management system and implementation method thereof |
| CN103309767A (en) * | 2012-03-08 | 2013-09-18 | 阿里巴巴集团控股有限公司 | Method and device for processing client log |
| CN103309767B (en) * | 2012-03-08 | 2016-01-13 | 阿里巴巴集团控股有限公司 | A kind of client log disposal route and device |
| CN102681931A (en) * | 2012-05-15 | 2012-09-19 | 天津市天元新泰科技发展有限公司 | Realization method of log and abnormal probe |
| CN103778049A (en) * | 2012-10-19 | 2014-05-07 | 北京市三希电子科技开发公司 | Embedded system development log system |
| CN105229605B (en) * | 2012-11-26 | 2018-10-02 | 谷歌有限责任公司 | The concentration distribution of application program analysis |
| US10331539B2 (en) | 2012-11-26 | 2019-06-25 | Google Llc | Centralized dispatching of application analytics |
| CN105229605A (en) * | 2012-11-26 | 2016-01-06 | 谷歌股份有限公司 | The concentrated distribution that application program is analyzed |
| CN102981934A (en) * | 2012-12-21 | 2013-03-20 | 曙光信息产业(北京)有限公司 | Log transition method and log transition device |
| CN103944744B (en) * | 2013-01-21 | 2019-02-19 | 博雅网络游戏开发（深圳）有限公司 | Log collection method and system |
| CN103944744A (en) * | 2013-01-21 | 2014-07-23 | 博雅网络游戏开发（深圳）有限公司 | Method and system for log acquisition |
| CN104050074A (en) * | 2013-03-12 | 2014-09-17 | 中国银联股份有限公司 | Method and device for asynchronously recording log in system |
| CN103281311A (en) * | 2013-05-12 | 2013-09-04 | 南京载玄信息科技有限公司 | Internet of Things protocol analysis method adopting Protobuf description |
| CN103425750A (en) * | 2013-07-23 | 2013-12-04 | 国云科技股份有限公司 | Cross-platform and cross-application log collecting system and collecting managing method thereof |
| CN103605630A (en) * | 2013-11-28 | 2014-02-26 | 中标软件有限公司 | Virtual server system and data reading-writing method thereof |
| CN103605630B (en) * | 2013-11-28 | 2017-05-10 | 中标软件有限公司 | Virtual server system and data reading-writing method thereof |
| CN105224583B (en) * | 2014-07-03 | 2020-06-26 | 北京奇虎科技有限公司 | Method and device for cleaning log files |
| CN105224583A (en) * | 2014-07-03 | 2016-01-06 | 北京奇虎科技有限公司 | The method for cleaning of journal file and device |
| CN104580372A (en) * | 2014-12-12 | 2015-04-29 | 安徽富煌和利时科技股份有限公司 | Method for transmitting status files of electronic station board IPCs (Industrial Personal Computer) |
| CN105991319A (en) * | 2015-02-06 | 2016-10-05 | 杭州与盟医疗技术有限公司 | Medical equipment intelligent monitoring system based on network |
| CN104822156A (en) * | 2015-04-01 | 2015-08-05 | 中国联合网络通信集团有限公司 | User behavior analysis method and device |
| CN104822156B (en) * | 2015-04-01 | 2018-12-11 | 中国联合网络通信集团有限公司 | A kind of method and device of user behavior analysis |
| CN106569934A (en) * | 2015-10-13 | 2017-04-19 | 阿里巴巴集团控股有限公司 | Application log display method and device |
| CN106569934B (en) * | 2015-10-13 | 2019-06-18 | 阿里巴巴集团控股有限公司 | A kind of application journal displaying method and device |
| CN106357454B (en) * | 2016-10-08 | 2020-06-16 | 武汉斗鱼网络科技有限公司 | Log system control device and control method thereof |
| CN106357454A (en) * | 2016-10-08 | 2017-01-25 | 武汉斗鱼网络科技有限公司 | Log system control device and method |
| CN106713450A (en) * | 2016-12-21 | 2017-05-24 | 广州优视网络科技有限公司 | Downloading acceleration method and apparatus based on read-write separation mode |
| CN106649729A (en) * | 2016-12-23 | 2017-05-10 | 深圳市金证科技股份有限公司 | Log running method and system, client and server |
| CN106649744A (en) * | 2016-12-26 | 2017-05-10 | 金蝶软件（中国）有限公司 | Log recording method and apparatus |
| CN106649744B (en) * | 2016-12-26 | 2019-11-05 | 金蝶软件（中国）有限公司 | Log recording method and device |
| CN106897156A (en) * | 2016-12-28 | 2017-06-27 | 南京欣网互联信息技术有限公司 | The method that counting user behavior based on statistics platform forms daily record |
| CN106656619A (en) * | 2016-12-30 | 2017-05-10 | 郑州云海信息技术有限公司 | Linux log management system and method |
| CN106790671A (en) * | 2017-01-24 | 2017-05-31 | 深圳市北斗智星勘测科技有限公司 | A kind of building structure deformation monitoring method, equipment and system |
| CN106790671B (en) * | 2017-01-24 | 2019-12-10 | 深圳市北斗智星勘测科技有限公司 | Building structure deformation monitoring method, equipment and system |
| CN108427625A (en) * | 2017-02-14 | 2018-08-21 | 北京国双科技有限公司 | Transmission, the method for record log, client, server end and system |
| CN107786641A (en) * | 2017-09-30 | 2018-03-09 | 南威软件股份有限公司 | A kind of acquisition method of distributed multi-system user user behaviors log |
| CN108121646A (en) * | 2017-12-26 | 2018-06-05 | 东软集团股份有限公司 | Journal file acquisition methods, device, computer and storage medium |
| CN110781154A (en) * | 2018-07-11 | 2020-02-11 | 中兴通讯股份有限公司 | Log collection method, device, system and computer readable storage medium |
| CN109257230A (en) * | 2018-10-26 | 2019-01-22 | 武汉精鸿电子技术有限公司 | A kind of Log Administration System and method of semiconductor memory burn-in test |
| CN111835562A (en) * | 2020-07-01 | 2020-10-27 | 北京爱笔科技有限公司 | Log uploading method, log query method and log query system |
| CN111835562B (en) * | 2020-07-01 | 2023-10-17 | 北京爱笔科技有限公司 | Log uploading method, log inquiring method and system |
| CN112181789A (en) * | 2020-08-31 | 2021-01-05 | 福州智象信息技术有限公司 | Equipment end log collection method based on AWS |
| CN112181789B (en) * | 2020-08-31 | 2022-07-15 | 北京智象信息技术有限公司 | Equipment end log collection method based on AWS |
| CN112491659A (en) * | 2020-12-02 | 2021-03-12 | 广州品唯软件有限公司 | Flow playback test method and device, computer equipment and storage medium |
| CN112491659B (en) * | 2020-12-02 | 2022-07-01 | 广州品唯软件有限公司 | Flow playback test method and device, computer equipment and storage medium |
| CN115086296A (en) * | 2022-05-27 | 2022-09-20 | 阿里巴巴（中国）有限公司 | Log transmission system, log transmission method and related device |
| CN115086296B (en) * | 2022-05-27 | 2024-04-05 | 阿里巴巴（中国）有限公司 | Log transmission system, log transmission method and related device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101969386A (en) | Log acquisition device and log acquisition method | |
| CN111400326B (en) | Smart city data management system and method thereof | |
| CN102891873A (en) | Method for storing log data and log data storage system | |
| CN101594256A (en) | Disaster recovery method, device and system | |
| CN105138615A (en) | Method and system for building big data distributed log | |
| CN101344931A (en) | RFID integration machine | |
| CN112559475B (en) | Data real-time capturing and transmitting method and system | |
| CN103914485A (en) | System and method for remotely collecting, retrieving and displaying application system logs | |
| CN102480489A (en) | Logging method and device used in distributed environment | |
| CN111338893A (en) | Process log processing method and device, computer equipment and storage medium | |
| CN106095957A (en) | Cross-domain many wave files synchronous method of distributed file system and device | |
| CN111913933B (en) | Power grid historical data management method and system based on unified support platform | |
| CN108228755A (en) | The data of MySQL database based on daily record analytic technique to Hadoop platform synchronize clone method | |
| CN108762984A (en) | A kind of method and device of continuity data backup | |
| CN104268143A (en) | XML (extensible markup language) data processing method and device | |
| CN102916987A (en) | Data acquisition and management system based on cloud computing framework | |
| CN103701720A (en) | Communication method with Socket server and online transaction management system | |
| CN107357809A (en) | Magnanimity platform Hisoon real-time database metric data access system | |
| CN103297477B (en) | A kind of data acquisition reporting system and data processing method and proxy server | |
| CN103744901A (en) | Intelligent substation double-host history data synchronously-storing system and device | |
| CN202268912U (en) | Data management system based on cloud computation structure | |
| CN110417892B (en) | Message analysis-based data replication link optimization method and device | |
| EP2690560A2 (en) | Method of benchmarking the behaviour of a replacement information system with the old system | |
| CN111049898A (en) | Method and system for realizing cross-domain architecture of computing cluster resources | |
| CN105512829A (en) | Web service protocol-based card value multidimensional cost accumulation method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20110209 |