CN106027595A - Access log processing method and system for CDN node - Google Patents

Access log processing method and system for CDN node Download PDF

Info

Publication number
CN106027595A
CN106027595A CN201610262635.8A CN201610262635A CN106027595A CN 106027595 A CN106027595 A CN 106027595A CN 201610262635 A CN201610262635 A CN 201610262635A CN 106027595 A CN106027595 A CN 106027595A
Authority
CN
China
Prior art keywords
access log
log record
record
access
compression
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610262635.8A
Other languages
Chinese (zh)
Inventor
夏彦刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LeTV Holding Beijing Co Ltd
LeTV Cloud Computing Co Ltd
Original Assignee
LeTV Holding Beijing Co Ltd
LeTV Cloud Computing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LeTV Holding Beijing Co Ltd, LeTV Cloud Computing Co Ltd filed Critical LeTV Holding Beijing Co Ltd
Priority to CN201610262635.8A priority Critical patent/CN106027595A/en
Publication of CN106027595A publication Critical patent/CN106027595A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/568Storing data temporarily at an intermediate stage, e.g. caching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/1805Append-only file systems, e.g. using logs or journals to store data
    • G06F16/1815Journaling file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/955Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • G06F16/972Access to data in other repository systems, e.g. legacy data or dynamic Web page generation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention provides an access log processing method for a CDN node. The method comprises the following steps: responding to an access request, and generating an access log record; and uploading the access log record to an access log server, wherein the access log record is not stored in a local disk. The invention further discloses an access log processing system for the CDN node. By adopting the access log processing method and system for the CDN node provided by the invention, the generated access log record does not need to occupy the space of the local disk, and meanwhile, the response speed of a website and the operation efficiency of the system are improved; and a content distribution center only need to communicate with the access log server to analyze and inquire related access log record information, thereby reducing the access times of the CND node, relieving the pressure of the CND node, and meanwhile guaranteeing the timeliness of content distribution.

Description

Access log processing method and system for CDN node
Technical field
Disclosure embodiment relates to field of computer technology, particularly relates to a kind of for CDN node Access log processing method and system.
Background technology
CDN (Content Delivery Network, content distributing network) is a kind of by network Place on existing Internet basic one layer of intelligent virtual that node server is constituted everywhere Network.CDN can in real time according to network traffics and the connection of each CDN node, load state with And the request of user is re-directed to from user to the integrated information such as the distance of user and response time On near service node, its objective is to select the CDN node from user's relative close to user Send the content needed for user, alleviate the situation of network congestion, improve the response speed of website.
In prior art in technical scheme, the CDN node of the whole network is receiving the access request of user Time in addition to responding this access request, also this access request is carried out record with the form of daily record, with Go out in which this CDN node storage has according to the log analysis of CDN node in content distribution center Holding, (content of needs distribution is repeatedly access request to need to distribute which content for this node further Same content, but this CDN node is not cached with this is accessed for same content) etc..
But in the prior art, the CDN node of the whole network receives and responds the access request of user, And described access request is carried out record with the form of daily record, due to CDN node reception each second The quantity of access request is sizable, therefore it is necessary to the resource expending substantial amounts of CDN node is used With record access daily record, CDN node is caused calculating pressure;The access log record of described generation Be stored in local disk space, do not only take up local resource, and disc content is constantly stored in and Delete the generation causing disk fragments, and then affect running efficiency of system;This traditional method needs content Distribution Center constantly communicates with all nodes to access corresponding access log, and content distribution Communication quality between center and all of CDN node is difficult to ensure that again, in being the most also unfavorable for Hold Distribution Center timely in the whole network distribution carrying out content accurately and timely.
Summary of the invention
In order to need when solving content distribution center analysis inquiry user access logs information in prior art Constantly communicate the stress problems that CDN node is caused with CDN node, and user accesses day Will record is stored in local disk space and takies the caused system response time of disk internal memory and run effect The problem that rate is the highest, disclosure embodiment provides a kind of access log process side for CDN node Method, including:
Response access request, and generate access log record;
Upload described access log record to access log server, do not store described visit at local disk Ask log recording.
On the other hand, disclosure embodiment provides a kind of access log for CDN node to process system System, including:
Access log signal generating unit, is used for responding access request, and generates access log record;
Access log uploading unit, is used for uploading described access log record to access log server, Described access log record is not stored at local disk.
Disclosure embodiment takes by setting up access log between CDN node and content distribution center Business device is in order to store the access log record of user so that described access log record is without taking this locality Disk space, has saved system resource, improves the response speed of website and the operation effect of system simultaneously Rate;Content distribution center only need to communicate with access log server just can analyze inquiry user's access Log recording, it is to avoid because of communication quality the best can not in time for the situation of CDN node distribution content, Ensure that the accurate and effective of content distribution, described method decrease the access to CDN node simultaneously Number of times, slow down the pressure of CDN node.
Accompanying drawing explanation
In order to be illustrated more clearly that disclosure embodiment or technical scheme of the prior art, below will be to reality Execute the required accompanying drawing used in example or description of the prior art to be briefly described, it should be apparent that under, Accompanying drawing in the description of face is some embodiments of the disclosure, for those of ordinary skill in the art, On the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is illustrated that a kind of access log processing method for CDN node of disclosure embodiment Flow chart;
Fig. 2 is illustrated that the flow chart of a kind of preferred embodiment method of method shown in Fig. 1;
Fig. 3 is illustrated that the flow chart of the another kind of preferred embodiment method of method shown in Fig. 1;
Fig. 4 is illustrated that a kind of access log processing system for CDN node of disclosure embodiment Structural representation;
Fig. 5 is illustrated that the structural representation of a kind of preferred embodiment system of system shown in Fig. 3.
Fig. 6 is illustrated that the structural representation of a kind of subscriber equipment that disclosure embodiment provides.
Detailed description of the invention
For making the purpose of disclosure embodiment, technical scheme and advantage clearer, below in conjunction with this Accompanying drawing in open embodiment, clearly and completely retouches the technical scheme in disclosure embodiment State, it is clear that described embodiment is a part of embodiment of the disclosure rather than whole embodiments. Based on the embodiment in the disclosure, those of ordinary skill in the art are not making creative work premise Lower obtained every other embodiment, broadly falls into the scope of disclosure protection.
See Fig. 1 and be illustrated that a kind of at the access log of CDN node of disclosure embodiment The flow chart of reason method, including:
S110: response access request, and generate access log record;
S120: upload described access log record to access log server, does not stores at local disk Described access log record.
In disclosure embodiment, described access log record includes at least access information and the net of user Network information, the access information of described user includes at least the access time of user, accesses content, access The information such as type;The described network information includes at least the IP address of network, socket information, net The information such as network state (such as network error information).
In described implementation, described access log server can be a webserver, it is possible to Think a virtual server.
See the flow chart that Fig. 2 is illustrated that a kind of preferred embodiment method of method shown in Fig. 1, Including:
S110: response access request, and generate access log record;
S120 ': often generate an access log record, be not written into local disk and store, directly It is uploaded to access log server.
In disclosure embodiment, user often sends an access request, and CDN node just responds once institute State access request, and described access request is carried out record with daily record form.Described access log record It is not stored in local disk, but uses udp protocol to be directly uploaded to via described CDN node In access log server.
Further, described access log record is used by CDN node via after caching, compression Udp protocol is uploaded in described access log server.Wherein said access log record buffer memory is in generation In reason server (such as Nginx server).
It should be noted that described udp protocol provide insecure transmission service (be not required to The other side sets up connection, no matter how partner state directly transmits, and such as QQ, wechat), simply will Access log record sends, and does not ensures that they can arrive at (the not machine such as repeating transmission System, transmission speed is fast), therefore when using udp protocol transmission access log record, Yong Huying With program need to solve data-bag lost, repeat, sort, the problem such as mistake confirmation.
See the flow process that Fig. 3 is illustrated that the another kind of preferred embodiment method of method shown in Fig. 1 Figure, including:
S210: response access request, and generate access log record;
S220: cache described access log record, based on predetermined cache time and/or predetermined cache quantity The access log record of statistics after caching is compressed;
S230: upload the access log record after compression to access log server, empty and upload The caching that access log record after compression is relevant.
In disclosure embodiment, described access log record is saved by CDN via after caching, compression Point uses Transmission Control Protocol to be uploaded in described access log server, after uploading, empties and institute State the caching that access log record is relevant.
In a kind of embodiment, the described access log record to adding up after caching is compressed before Regularly (setpoint frequency is 3m/s) judges whether described access log record meets contractive condition, described Contractive condition includes predetermined cache time (uploading 1 time in such as 1 second) and/or predetermined cache quantity (ratio 1 time is uploaded) after often receiving 1000 access log records.If meeting contractive condition, then to slow After depositing, the access log record of statistics is compressed operation.Such as, system carries out timing and statistics simultaneously Access log record quantity operates, and carries out judging whether to meet contractive condition with the frequency of 3m/s, During the lazy weight 1000 of the access log record reaching 1 second when timing and counted on, for protecting The effectiveness that card daily record is uploaded, CDN node can be compressed the access log record counted on and upload institute State the access log record of compression;Access log that is same, that count on when timing not up to 1 second When record data have reached 1000, upload the situation of failure for avoiding accumulated document too much to cause, CDN node can compress counted on access log record upload operation.
Further, the described access log record to adding up after caching is compressed effectively saving The bandwidth of more than 50%, saves memory space, improves log recording transmission speed.
In another embodiment, about the execution of step S230, described CDN node uses TCP Agreement is uploaded described access log record and be there is feedback machine to access log server, described Transmission Control Protocol System, after the access log record after uploading compression to access log server, described CDN node The feedback information of access log server can be received, and operate accordingly according to feedback information, institute State embodiment to include:
Upload the access log record after described compression to after access log server, receive access log The feedback of server;
When described be fed back to receive successful time, empty relevant to the access log record after the compression uploaded Caching;
When described be fed back to reception failure time, again upload the access log record after compression to accessing day Will server.
Further, described CDN server can preset the access after again uploading described compression The threshold value (multipotency uploads 5 times) of log recording.When CDN server receives feedback letter When breath is for reception failure, first can compare the size of the most repeated number of times uploaded and default threshold value Relation, if CDN node has repeated the access journal record after sending described compression to described access The number of times of log server less than the threshold value again uploaded of described default, then allows CDN joint Point uploads the access log record after described compression again to access log server;Otherwise, then stop Upload operation, and empty the caching relevant to the access log record after the described compression uploading failure.
Further, the access log record uploading failure is resend can be prevented effectively from number According to loss situation;Meanwhile, it is set again uploading frequency threshold value, effectively prevent server Receive the user access information time delay inaccurate situation of long caused statistical information.
In another embodiment, the described access log processing method for CDN node can also be wrapped Including and described access log record is carried out classification process, described implementation includes:
Response access request, and generate access log record;
Cache described access log record, the access log record sort after caching is generated all kinds of access Log recording, based on predetermined cache time and/or predetermined cache quantity to sorted all kinds of visits after caching Ask that log recording is compressed;
Upload the extremely all kinds of access log servers of all kinds of access log records after compression, empty and upload Compression after the relevant caching of access log record.
In disclosure embodiment, described in be categorized as the business according to access log record and classify, institute Business of stating does not limits type, can be live, program request, it is also possible to be that third-party application is (as UC is clear Look at device, QQ) etc.;Correspondingly, the described access log server for storing all kinds of access log record Type is corresponding with described access log record type, can be live, program request, it is also possible to be third party Application etc..
In disclosure embodiment, upload described access log record to access log server in CDN node After, content distribution center can communicate with described access log server, analyzes inquiry described access day Will record, and determine that the whole network CDN node needs to store which file according to described access log information, with Meeting the access request of user, specifically embodiment includes:
The log information of storage in read access log server, respectively controls oneself analyzing the CDN node of the whole network Which content stored have, and needs further to distribute which content;
Content distribution instruction is issued to corresponding CDN node, with by scheduling according to described analysis result The heart obtains the content that can provide the accessed request corresponding to this CDN node.
Further, above-mentioned embodiment carries out classification process to described access log record, and deposits It is stored in the respective access log server corresponding with described classification, it is possible to facilitate content distribution center Have to analyze targetedly to inquire about in described access server and inquire about relevant content, in time to described analysis Reasonably distribute content for CDN node.
The method that the present embodiment is provided, sets up access log between CDN node and content distribution center Server is in order to store the access log record of user so that described access log record is without taking this locality Disk space, has saved system resource, improves the response speed of website and the operation effect of system simultaneously Rate;Content distribution center only need to communicate with access log server just can analyze inquiry user's access Log recording, it is to avoid because the best the caused content distribution center of communication quality can not be CDN in time The situation of node distribution content, described method decreases the access times to CDN node simultaneously, slows down The pressure of CDN node, it is ensured that the timely and effective property of content distribution.
Fig. 4 is illustrated that a kind of access log processing system for CDN node of disclosure embodiment Structural representation, including:
Access log signal generating unit, is used for responding access request, and generates access log record;
Access log uploading unit, is used for uploading described access log record to access log server, no Described access log record is stored at local disk.
In a kind of enforcement system, the access log uploading unit in described system is used for, and often generates a visit Ask log recording, be not written into local disk and store, be directly uploaded to access log server.
See Fig. 5 and be illustrated that the structural representation of a kind of preferred embodiment system shown in Fig. 3, described System also includes:
Access log arranges unit, for generating access log record in described access log signal generating unit Afterwards, cache described access log record, based on predetermined cache time and/or predetermined cache quantity to slow After depositing, the access log record of statistics is compressed;
Described access log uploading unit, the access log record after uploading compression is to access log Server, empties the caching relevant to the access log record after the compression uploaded.
In disclosure enforcement system, described access log arranges unit and is used for, as long as reaching predetermined cache Time and predetermined cache quantity one of them time, the access log record of statistics after caching is pressed Contracting.
In disclosure enforcement system, described access log uploading unit is used for:
Access log record after uploading compression, to after access log server, receives access log clothes The feedback of business device;
When described be fed back to receive successful time, empty relevant to the access log record after the compression uploaded Caching;
When described be fed back to reception failure time, again upload the access log record after compression to accessing day Will server.
In disclosure enforcement system, described access log uploading unit is additionally operable to again upload time when described When number exceedes predetermined threshold, stop uploading, empty relevant to the access log record after the compression uploaded Caching.
In a kind of enforcement system, described access log arranges unit for the access log note after caching All kinds of access log record is generated, based on predetermined cache time and/or predetermined cache quantity pair after record classification Described all kinds of access log record is compressed;
The described access log uploading unit all kinds of access log records after uploading compression are to all kinds of Access log server.
See the structural representation of a kind of subscriber equipment that Fig. 6 is illustrated that disclosure embodiment provides, Subscriber equipment is not implemented and limits by disclosure embodiment.As shown in Figure 6, this user sets For may include that
Processor (processor) 610, communication interface (Communications Interface) 620, Memorizer (memory) 630 and communication bus 640.
Processor 610, communication interface 620 and memorizer 630 complete phase by communication bus 640 Communication between Hu.
Communication interface 620, leading to for such as access log server and described content distribution center etc. Letter.
Processor 610, is used for the program that performs 631, specifically can perform in said method embodiment Correlation step.Specifically, program 631 can include that program code, described program code include calculating Machine operational order.Described processor 610 is probably a central processor CPU, or specific collection Become circuit ASIC (Application Specific Integrated Circuit), or be configured to reality Execute one or more integrated circuits of disclosure embodiment.
Memorizer 630, is used for program of depositing 631.Memorizer 630 may comprise high-speed RAM storage Device, it is also possible to also include nonvolatile memory (non-volatile memory), for example, at least one Individual access log record buffer memory memorizer.Program 631 specifically may be used for so that described subscriber equipment The 600 following operations of execution:
Access log generation step, for responding the access request of user, according to described access request, Generate access log record;
Access log uploading step, is used for uploading described access log record to access log server, Described access log record is not stored at local disk.
In program 631, a step implements the corresponding steps and list that may refer in above-described embodiment The description that China of unit is corresponding, is not repeated herein.Those skilled in the art it can be understood that arrive, For convenience and simplicity of description, the equipment of foregoing description and the specific works process of module, it is referred to Corresponding process in preceding method embodiment describes, and does not repeats them here.
The system that the present embodiment is provided, sets up access log between CDN node and content distribution center Server is in order to store the access log record of user so that described access log record is without taking this locality Disk space, has saved system resource, improves the response speed of website and the operation effect of system simultaneously Rate;Content distribution center only need to communicate with access log server just can analyze inquiry user's access Log recording, it is to avoid because the best the caused content distribution center of communication quality can not be CDN in time The situation of node distribution content, described method slow down the pressure of CDN node simultaneously, it is ensured that content The timely and effective property of distribution.
Device embodiment described above is only schematically, wherein said illustrates as separating component Unit can be or may not be physically separate, the parts shown as unit can be or Person may not be physical location, i.e. may be located at a place, or can also be distributed to multiple network On unit.Some or all of module therein can be selected according to the actual needs to realize the present embodiment The purpose of scheme.Those of ordinary skill in the art are not in the case of paying performing creative labour, the most permissible Understand and implement.
Through the above description of the embodiments, those skilled in the art is it can be understood that arrive each reality The mode of executing can add the mode of required general hardware platform by software and realize, naturally it is also possible to by firmly Part.Based on such understanding, the portion that prior art is contributed by technique scheme the most in other words Dividing and can embody with the form of software product, this computer software product can be stored in computer can Read in storage medium, such as ROM/RAM, magnetic disc, CD etc., including some instructions with so that one Computer equipment (can be personal computer, server, or the network equipment etc.) performs each to be implemented The method described in some part of example or embodiment.
Last it is noted that above example is only in order to illustrate the technical scheme of the disclosure, rather than to it Limit;Although the disclosure being described in detail with reference to previous embodiment, the ordinary skill of this area Personnel it is understood that the technical scheme described in foregoing embodiments still can be modified by it, or Person carries out equivalent to wherein portion of techniques feature;And these amendments or replacement, do not make corresponding skill The essence of art scheme departs from the spirit and scope of the disclosure each embodiment technical scheme.

Claims (14)

1. for an access log processing method for CDN node, including:
Response access request, and generate access log record;
Upload described access log record to access log server, do not store described visit at local disk Ask log recording.
Method the most according to claim 1, wherein, described in upload described access log record To access log server, do not store described access log record at local disk and include:
Often generate an access log record, be not written into local disk and store, be directly uploaded to visit Ask log server.
Method the most according to claim 1, wherein, after generating access log record, bag Include: cache described access log record, based on predetermined cache time and/or predetermined cache quantity to caching The access log record of rear statistics is compressed;
Upload described access log record to access log server, do not store described visit at local disk Ask that log recording includes:
Upload the access log record after compression to access log server, after the compression emptying and uploading The relevant caching of access log record.
Method the most according to claim 3, wherein, described based on the predetermined cache time and/or The access log record of statistics after caching is compressed including by predetermined cache quantity:
As long as reach predetermined cache time and predetermined cache quantity one of them time, to statistics after caching Access log record is compressed.
Method the most according to claim 3, wherein, described in upload the access log after compression Record, to access log server, empties the caching relevant to the access log record after the compression uploaded Including:
Access log record after uploading compression, to after access log server, receives access log clothes The feedback of business device;
When described be fed back to receive successful time, empty relevant to the access log record after the compression uploaded Caching;
When described be fed back to reception failure time, again upload the access log record after compression to accessing day Will server.
Method the most according to claim 5, wherein, when described number of times of again uploading exceedes pre- When determining threshold value, stop uploading, empty the caching relevant to the access log record after the compression uploaded.
7. according to the method according to any one of claim 3-6, wherein, statistics after described caching Access log is recorded as generating all kinds of access log record to after the access log record sort after caching;
Described based on predetermined cache time and/or predetermined cache quantity to the access log of statistics after caching Record is compressed including: based on predetermined cache time and/or predetermined cache quantity to classification after caching after All kinds of access log records be compressed;
Described upload compression after access log record include to access log server: after uploading compression All kinds of access log records to all kinds of access log servers.
8. for an access log processing system for CDN node, including:
Access log signal generating unit, is used for responding access request, and generates access log record;
Access log uploading unit, is used for uploading described access log record to access log server, Described access log record is not stored at local disk.
System the most according to claim 8, wherein, described access log uploading unit is used for:
Often generate an access log record, be not written into local disk and store, be directly uploaded to visit Ask log server.
System the most according to claim 8, wherein, described system also includes:
Access log arranges unit, for generating access log record in described access log signal generating unit Afterwards, cache described access log record, based on predetermined cache time and/or predetermined cache quantity to slow After depositing, the access log record of statistics is compressed;
Described access log uploading unit, the access log record after uploading compression is to access log Server, empties the caching relevant to the access log record after the compression uploaded.
11. systems according to claim 10, wherein, described access log arranges unit and uses In:
As long as reach predetermined cache time and predetermined cache quantity one of them time, to statistics after caching Access log record is compressed.
12. systems according to claim 10, wherein, described access log uploading unit is used In:
Access log record after uploading compression, to after access log server, receives access log clothes The feedback of business device;
When described be fed back to receive successful time, empty relevant to the access log record after the compression uploaded Caching;
When described be fed back to reception failure time, again upload the access log record after compression to accessing day Will server.
13. systems according to claim 12, wherein, described access log uploading unit is used In:
When described again upload number of times exceed predetermined threshold time, stop uploading, the compression emptying and uploading After the relevant caching of access log record.
14. according to the system according to any one of claim 10-13, wherein, and described access log Arrangement unit is used for: generate all kinds of access log record to after the access log record sort after caching, Based on predetermined cache time and/or predetermined cache quantity, described all kinds of access log records are compressed;
Described access log uploading unit is used for: upload all kinds of access log records after compression to all kinds of Access log server.
CN201610262635.8A 2016-04-25 2016-04-25 Access log processing method and system for CDN node Pending CN106027595A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610262635.8A CN106027595A (en) 2016-04-25 2016-04-25 Access log processing method and system for CDN node

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610262635.8A CN106027595A (en) 2016-04-25 2016-04-25 Access log processing method and system for CDN node

Publications (1)

Publication Number Publication Date
CN106027595A true CN106027595A (en) 2016-10-12

Family

ID=57081058

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610262635.8A Pending CN106027595A (en) 2016-04-25 2016-04-25 Access log processing method and system for CDN node

Country Status (1)

Country Link
CN (1) CN106027595A (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017157127A1 (en) * 2016-03-14 2017-09-21 华为技术有限公司 Access record passing back method, device and system
CN107277104A (en) * 2017-05-04 2017-10-20 上海斐讯数据通信技术有限公司 The processing method and wireless router of a kind of web page access data
CN107423411A (en) * 2017-07-28 2017-12-01 郑州云海信息技术有限公司 Journal displaying method and apparatus
CN107566480A (en) * 2017-08-30 2018-01-09 北京京东尚科信息技术有限公司 The user activity information acquisition method and device, storage medium of mobile terminal application
CN107766509A (en) * 2017-10-23 2018-03-06 北京京东尚科信息技术有限公司 A kind of method and apparatus of webpage static backup
CN108234233A (en) * 2016-12-22 2018-06-29 阿里巴巴集团控股有限公司 Log processing method and device
CN108804585A (en) * 2018-05-25 2018-11-13 网宿科技股份有限公司 A kind of data processing method and device in CDN system
CN110177024A (en) * 2019-05-06 2019-08-27 北京奇安信科技有限公司 Monitoring method and client, server-side, the system of hotspot device
CN110222084A (en) * 2019-05-06 2019-09-10 北京奇安信科技有限公司 The report method and device of hotspot device monitoring information, storage medium, terminal
CN110324366A (en) * 2018-03-28 2019-10-11 阿里巴巴集团控股有限公司 Data processing method, apparatus and system
CN110430083A (en) * 2019-08-15 2019-11-08 平安普惠企业管理有限公司 A kind of location processing method and server of agency's forwarding request
CN112131198A (en) * 2020-09-23 2020-12-25 北京奇艺世纪科技有限公司 Log analysis method and device and electronic equipment
CN113691681A (en) * 2021-08-20 2021-11-23 北京琥珀创想科技有限公司 Junk phone data processing method and system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1842021A (en) * 2005-03-28 2006-10-04 华为技术有限公司 Log information storage method
CN101958837A (en) * 2010-09-30 2011-01-26 北京世纪互联工程技术服务有限公司 Log processing system, log processing method, node server and center server
CN102053923A (en) * 2009-11-05 2011-05-11 北京金山软件有限公司 Storage method and storage device for logbook data
CN102385549A (en) * 2010-09-02 2012-03-21 北京无限立通通讯技术有限责任公司 Log processing system, log processing method and log storage sub-system
US20130246498A1 (en) * 2012-03-16 2013-09-19 Stephen Zucknovich Content distribution management system
CN105224256A (en) * 2015-10-13 2016-01-06 浪潮(北京)电子信息产业有限公司 A kind of storage system
CN105429784A (en) * 2015-10-30 2016-03-23 上海帝联信息科技股份有限公司 Central collection server, and method and system for log file processing
CN105429783A (en) * 2015-10-30 2016-03-23 上海帝联信息科技股份有限公司 Edge node server, log file processing method and log file processing system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1842021A (en) * 2005-03-28 2006-10-04 华为技术有限公司 Log information storage method
CN102053923A (en) * 2009-11-05 2011-05-11 北京金山软件有限公司 Storage method and storage device for logbook data
CN102385549A (en) * 2010-09-02 2012-03-21 北京无限立通通讯技术有限责任公司 Log processing system, log processing method and log storage sub-system
CN101958837A (en) * 2010-09-30 2011-01-26 北京世纪互联工程技术服务有限公司 Log processing system, log processing method, node server and center server
US20130246498A1 (en) * 2012-03-16 2013-09-19 Stephen Zucknovich Content distribution management system
CN105224256A (en) * 2015-10-13 2016-01-06 浪潮(北京)电子信息产业有限公司 A kind of storage system
CN105429784A (en) * 2015-10-30 2016-03-23 上海帝联信息科技股份有限公司 Central collection server, and method and system for log file processing
CN105429783A (en) * 2015-10-30 2016-03-23 上海帝联信息科技股份有限公司 Edge node server, log file processing method and log file processing system

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017157127A1 (en) * 2016-03-14 2017-09-21 华为技术有限公司 Access record passing back method, device and system
CN108234233A (en) * 2016-12-22 2018-06-29 阿里巴巴集团控股有限公司 Log processing method and device
CN108234233B (en) * 2016-12-22 2021-09-24 阿里巴巴集团控股有限公司 Log processing method and device
CN107277104A (en) * 2017-05-04 2017-10-20 上海斐讯数据通信技术有限公司 The processing method and wireless router of a kind of web page access data
CN107423411A (en) * 2017-07-28 2017-12-01 郑州云海信息技术有限公司 Journal displaying method and apparatus
CN107566480B (en) * 2017-08-30 2021-04-30 北京京东尚科信息技术有限公司 User activity information acquisition method and device for mobile terminal application and storage medium
CN107566480A (en) * 2017-08-30 2018-01-09 北京京东尚科信息技术有限公司 The user activity information acquisition method and device, storage medium of mobile terminal application
CN107766509A (en) * 2017-10-23 2018-03-06 北京京东尚科信息技术有限公司 A kind of method and apparatus of webpage static backup
CN110324366A (en) * 2018-03-28 2019-10-11 阿里巴巴集团控股有限公司 Data processing method, apparatus and system
CN108804585A (en) * 2018-05-25 2018-11-13 网宿科技股份有限公司 A kind of data processing method and device in CDN system
CN110222084A (en) * 2019-05-06 2019-09-10 北京奇安信科技有限公司 The report method and device of hotspot device monitoring information, storage medium, terminal
CN110177024A (en) * 2019-05-06 2019-08-27 北京奇安信科技有限公司 Monitoring method and client, server-side, the system of hotspot device
CN110177024B (en) * 2019-05-06 2021-10-01 奇安信科技集团股份有限公司 Monitoring method of hotspot equipment, client, server and system
CN110222084B (en) * 2019-05-06 2021-10-22 奇安信科技集团股份有限公司 Method and device for reporting monitoring information of hotspot equipment, storage medium and terminal
CN110430083A (en) * 2019-08-15 2019-11-08 平安普惠企业管理有限公司 A kind of location processing method and server of agency's forwarding request
CN110430083B (en) * 2019-08-15 2022-11-15 平安普惠企业管理有限公司 Positioning processing method for proxy forwarding request and server
CN112131198A (en) * 2020-09-23 2020-12-25 北京奇艺世纪科技有限公司 Log analysis method and device and electronic equipment
CN112131198B (en) * 2020-09-23 2024-06-07 北京奇艺世纪科技有限公司 Log analysis method and device and electronic equipment
CN113691681A (en) * 2021-08-20 2021-11-23 北京琥珀创想科技有限公司 Junk phone data processing method and system

Similar Documents

Publication Publication Date Title
CN106027595A (en) Access log processing method and system for CDN node
US10404556B2 (en) Methods and computer program products for correlation analysis of network traffic in a network device
US8589537B2 (en) Methods and computer program products for aggregating network application performance metrics by process pool
US10346367B1 (en) Load shedding techniques for distributed services with persistent client connections to ensure quality of service
US10263876B2 (en) Adaptive service timeouts
US10599529B2 (en) Instantiating data queues for management of remote data stores
CN105376270B (en) Method, device and system for improving uploading efficiency
CN104219230B (en) Identify method and the device of malicious websites
US10609206B1 (en) Auto-repairing mobile communication device data streaming architecture
CN114039875B (en) Data acquisition method, device and system based on eBPF technology
US11489780B1 (en) Traffic estimations for backbone networks
CN108415962A (en) A kind of cloud storage system
Moreno et al. Multi‐granular, multi‐purpose and multi‐Gb/s monitoring on off‐the‐shelf systems
CN114070755B (en) Virtual machine network flow determination method and device, electronic equipment and storage medium
CN114528231A (en) Data dynamic storage method and device, electronic equipment and storage medium
CN105184559B (en) A kind of payment system and method
CN109714208A (en) A kind of equipment is included in method, storage medium and the electronic equipment of network management
CN105468502A (en) Log collection method, device and system
CN105893150B (en) Interface calling frequency control method and device and interface calling request processing method and device
US20170223136A1 (en) Any Web Page Reporting and Capture
CN110990148A (en) Method, device and medium for optimizing storage performance
CN106302020B (en) Network bandwidth statistical method and device
Li et al. Characterizing service providers traffic of mobile internet services in cellular data network
CN112131198B (en) Log analysis method and device and electronic equipment
CN110222084B (en) Method and device for reporting monitoring information of hotspot equipment, storage medium and terminal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20161012

WD01 Invention patent application deemed withdrawn after publication