CN106027595A - Access log processing method and system for CDN node - Google Patents
Access log processing method and system for CDN node Download PDFInfo
- Publication number
- CN106027595A CN106027595A CN201610262635.8A CN201610262635A CN106027595A CN 106027595 A CN106027595 A CN 106027595A CN 201610262635 A CN201610262635 A CN 201610262635A CN 106027595 A CN106027595 A CN 106027595A
- Authority
- CN
- China
- Prior art keywords
- access log
- log record
- record
- access
- compression
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
- G06F16/972—Access to data in other repository systems, e.g. legacy data or dynamic Web page generation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides an access log processing method for a CDN node. The method comprises the following steps: responding to an access request, and generating an access log record; and uploading the access log record to an access log server, wherein the access log record is not stored in a local disk. The invention further discloses an access log processing system for the CDN node. By adopting the access log processing method and system for the CDN node provided by the invention, the generated access log record does not need to occupy the space of the local disk, and meanwhile, the response speed of a website and the operation efficiency of the system are improved; and a content distribution center only need to communicate with the access log server to analyze and inquire related access log record information, thereby reducing the access times of the CND node, relieving the pressure of the CND node, and meanwhile guaranteeing the timeliness of content distribution.
Description
Technical field
Disclosure embodiment relates to field of computer technology, particularly relates to a kind of for CDN node
Access log processing method and system.
Background technology
CDN (Content Delivery Network, content distributing network) is a kind of by network
Place on existing Internet basic one layer of intelligent virtual that node server is constituted everywhere
Network.CDN can in real time according to network traffics and the connection of each CDN node, load state with
And the request of user is re-directed to from user to the integrated information such as the distance of user and response time
On near service node, its objective is to select the CDN node from user's relative close to user
Send the content needed for user, alleviate the situation of network congestion, improve the response speed of website.
In prior art in technical scheme, the CDN node of the whole network is receiving the access request of user
Time in addition to responding this access request, also this access request is carried out record with the form of daily record, with
Go out in which this CDN node storage has according to the log analysis of CDN node in content distribution center
Holding, (content of needs distribution is repeatedly access request to need to distribute which content for this node further
Same content, but this CDN node is not cached with this is accessed for same content) etc..
But in the prior art, the CDN node of the whole network receives and responds the access request of user,
And described access request is carried out record with the form of daily record, due to CDN node reception each second
The quantity of access request is sizable, therefore it is necessary to the resource expending substantial amounts of CDN node is used
With record access daily record, CDN node is caused calculating pressure；The access log record of described generation
Be stored in local disk space, do not only take up local resource, and disc content is constantly stored in and
Delete the generation causing disk fragments, and then affect running efficiency of system；This traditional method needs content
Distribution Center constantly communicates with all nodes to access corresponding access log, and content distribution
Communication quality between center and all of CDN node is difficult to ensure that again, in being the most also unfavorable for
Hold Distribution Center timely in the whole network distribution carrying out content accurately and timely.
Summary of the invention
In order to need when solving content distribution center analysis inquiry user access logs information in prior art
Constantly communicate the stress problems that CDN node is caused with CDN node, and user accesses day
Will record is stored in local disk space and takies the caused system response time of disk internal memory and run effect
The problem that rate is the highest, disclosure embodiment provides a kind of access log process side for CDN node
Method, including:
Response access request, and generate access log record；
Upload described access log record to access log server, do not store described visit at local disk
Ask log recording.
On the other hand, disclosure embodiment provides a kind of access log for CDN node to process system
System, including:
Access log signal generating unit, is used for responding access request, and generates access log record；
Access log uploading unit, is used for uploading described access log record to access log server,
Described access log record is not stored at local disk.
Disclosure embodiment takes by setting up access log between CDN node and content distribution center
Business device is in order to store the access log record of user so that described access log record is without taking this locality
Disk space, has saved system resource, improves the response speed of website and the operation effect of system simultaneously
Rate；Content distribution center only need to communicate with access log server just can analyze inquiry user's access
Log recording, it is to avoid because of communication quality the best can not in time for the situation of CDN node distribution content,
Ensure that the accurate and effective of content distribution, described method decrease the access to CDN node simultaneously
Number of times, slow down the pressure of CDN node.
Accompanying drawing explanation
In order to be illustrated more clearly that disclosure embodiment or technical scheme of the prior art, below will be to reality
Execute the required accompanying drawing used in example or description of the prior art to be briefly described, it should be apparent that under,
Accompanying drawing in the description of face is some embodiments of the disclosure, for those of ordinary skill in the art,
On the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is illustrated that a kind of access log processing method for CDN node of disclosure embodiment
Flow chart；
Fig. 2 is illustrated that the flow chart of a kind of preferred embodiment method of method shown in Fig. 1；
Fig. 3 is illustrated that the flow chart of the another kind of preferred embodiment method of method shown in Fig. 1；
Fig. 4 is illustrated that a kind of access log processing system for CDN node of disclosure embodiment
Structural representation；
Fig. 5 is illustrated that the structural representation of a kind of preferred embodiment system of system shown in Fig. 3.
Fig. 6 is illustrated that the structural representation of a kind of subscriber equipment that disclosure embodiment provides.
Detailed description of the invention
For making the purpose of disclosure embodiment, technical scheme and advantage clearer, below in conjunction with this
Accompanying drawing in open embodiment, clearly and completely retouches the technical scheme in disclosure embodiment
State, it is clear that described embodiment is a part of embodiment of the disclosure rather than whole embodiments.
Based on the embodiment in the disclosure, those of ordinary skill in the art are not making creative work premise
Lower obtained every other embodiment, broadly falls into the scope of disclosure protection.
See Fig. 1 and be illustrated that a kind of at the access log of CDN node of disclosure embodiment
The flow chart of reason method, including:
S110: response access request, and generate access log record；
S120: upload described access log record to access log server, does not stores at local disk
Described access log record.
In disclosure embodiment, described access log record includes at least access information and the net of user
Network information, the access information of described user includes at least the access time of user, accesses content, access
The information such as type；The described network information includes at least the IP address of network, socket information, net
The information such as network state (such as network error information).
In described implementation, described access log server can be a webserver, it is possible to
Think a virtual server.
See the flow chart that Fig. 2 is illustrated that a kind of preferred embodiment method of method shown in Fig. 1,
Including:
S110: response access request, and generate access log record；
S120 ': often generate an access log record, be not written into local disk and store, directly
It is uploaded to access log server.
In disclosure embodiment, user often sends an access request, and CDN node just responds once institute
State access request, and described access request is carried out record with daily record form.Described access log record
It is not stored in local disk, but uses udp protocol to be directly uploaded to via described CDN node
In access log server.
Further, described access log record is used by CDN node via after caching, compression
Udp protocol is uploaded in described access log server.Wherein said access log record buffer memory is in generation
In reason server (such as Nginx server).
It should be noted that described udp protocol provide insecure transmission service (be not required to
The other side sets up connection, no matter how partner state directly transmits, and such as QQ, wechat), simply will
Access log record sends, and does not ensures that they can arrive at (the not machine such as repeating transmission
System, transmission speed is fast), therefore when using udp protocol transmission access log record, Yong Huying
With program need to solve data-bag lost, repeat, sort, the problem such as mistake confirmation.
See the flow process that Fig. 3 is illustrated that the another kind of preferred embodiment method of method shown in Fig. 1
Figure, including:
S210: response access request, and generate access log record；
S220: cache described access log record, based on predetermined cache time and/or predetermined cache quantity
The access log record of statistics after caching is compressed；
S230: upload the access log record after compression to access log server, empty and upload
The caching that access log record after compression is relevant.
In disclosure embodiment, described access log record is saved by CDN via after caching, compression
Point uses Transmission Control Protocol to be uploaded in described access log server, after uploading, empties and institute
State the caching that access log record is relevant.
In a kind of embodiment, the described access log record to adding up after caching is compressed before
Regularly (setpoint frequency is 3m/s) judges whether described access log record meets contractive condition, described
Contractive condition includes predetermined cache time (uploading 1 time in such as 1 second) and/or predetermined cache quantity (ratio
1 time is uploaded) after often receiving 1000 access log records.If meeting contractive condition, then to slow
After depositing, the access log record of statistics is compressed operation.Such as, system carries out timing and statistics simultaneously
Access log record quantity operates, and carries out judging whether to meet contractive condition with the frequency of 3m/s,
During the lazy weight 1000 of the access log record reaching 1 second when timing and counted on, for protecting
The effectiveness that card daily record is uploaded, CDN node can be compressed the access log record counted on and upload institute
State the access log record of compression；Access log that is same, that count on when timing not up to 1 second
When record data have reached 1000, upload the situation of failure for avoiding accumulated document too much to cause,
CDN node can compress counted on access log record upload operation.
Further, the described access log record to adding up after caching is compressed effectively saving
The bandwidth of more than 50%, saves memory space, improves log recording transmission speed.
In another embodiment, about the execution of step S230, described CDN node uses TCP
Agreement is uploaded described access log record and be there is feedback machine to access log server, described Transmission Control Protocol
System, after the access log record after uploading compression to access log server, described CDN node
The feedback information of access log server can be received, and operate accordingly according to feedback information, institute
State embodiment to include:
Upload the access log record after described compression to after access log server, receive access log
The feedback of server；
When described be fed back to receive successful time, empty relevant to the access log record after the compression uploaded
Caching；
When described be fed back to reception failure time, again upload the access log record after compression to accessing day
Will server.
Further, described CDN server can preset the access after again uploading described compression
The threshold value (multipotency uploads 5 times) of log recording.When CDN server receives feedback letter
When breath is for reception failure, first can compare the size of the most repeated number of times uploaded and default threshold value
Relation, if CDN node has repeated the access journal record after sending described compression to described access
The number of times of log server less than the threshold value again uploaded of described default, then allows CDN joint
Point uploads the access log record after described compression again to access log server；Otherwise, then stop
Upload operation, and empty the caching relevant to the access log record after the described compression uploading failure.
Further, the access log record uploading failure is resend can be prevented effectively from number
According to loss situation；Meanwhile, it is set again uploading frequency threshold value, effectively prevent server
Receive the user access information time delay inaccurate situation of long caused statistical information.
In another embodiment, the described access log processing method for CDN node can also be wrapped
Including and described access log record is carried out classification process, described implementation includes:
Response access request, and generate access log record；
Cache described access log record, the access log record sort after caching is generated all kinds of access
Log recording, based on predetermined cache time and/or predetermined cache quantity to sorted all kinds of visits after caching
Ask that log recording is compressed；
Upload the extremely all kinds of access log servers of all kinds of access log records after compression, empty and upload
Compression after the relevant caching of access log record.
In disclosure embodiment, described in be categorized as the business according to access log record and classify, institute
Business of stating does not limits type, can be live, program request, it is also possible to be that third-party application is (as UC is clear
Look at device, QQ) etc.；Correspondingly, the described access log server for storing all kinds of access log record
Type is corresponding with described access log record type, can be live, program request, it is also possible to be third party
Application etc..
In disclosure embodiment, upload described access log record to access log server in CDN node
After, content distribution center can communicate with described access log server, analyzes inquiry described access day
Will record, and determine that the whole network CDN node needs to store which file according to described access log information, with
Meeting the access request of user, specifically embodiment includes:
The log information of storage in read access log server, respectively controls oneself analyzing the CDN node of the whole network
Which content stored have, and needs further to distribute which content；
Content distribution instruction is issued to corresponding CDN node, with by scheduling according to described analysis result
The heart obtains the content that can provide the accessed request corresponding to this CDN node.
Further, above-mentioned embodiment carries out classification process to described access log record, and deposits
It is stored in the respective access log server corresponding with described classification, it is possible to facilitate content distribution center
Have to analyze targetedly to inquire about in described access server and inquire about relevant content, in time to described analysis
Reasonably distribute content for CDN node.
The method that the present embodiment is provided, sets up access log between CDN node and content distribution center
Server is in order to store the access log record of user so that described access log record is without taking this locality
Disk space, has saved system resource, improves the response speed of website and the operation effect of system simultaneously
Rate；Content distribution center only need to communicate with access log server just can analyze inquiry user's access
Log recording, it is to avoid because the best the caused content distribution center of communication quality can not be CDN in time
The situation of node distribution content, described method decreases the access times to CDN node simultaneously, slows down
The pressure of CDN node, it is ensured that the timely and effective property of content distribution.
Fig. 4 is illustrated that a kind of access log processing system for CDN node of disclosure embodiment
Structural representation, including:
Access log signal generating unit, is used for responding access request, and generates access log record；
Access log uploading unit, is used for uploading described access log record to access log server, no
Described access log record is stored at local disk.
In a kind of enforcement system, the access log uploading unit in described system is used for, and often generates a visit
Ask log recording, be not written into local disk and store, be directly uploaded to access log server.
See Fig. 5 and be illustrated that the structural representation of a kind of preferred embodiment system shown in Fig. 3, described
System also includes:
Access log arranges unit, for generating access log record in described access log signal generating unit
Afterwards, cache described access log record, based on predetermined cache time and/or predetermined cache quantity to slow
After depositing, the access log record of statistics is compressed；
Described access log uploading unit, the access log record after uploading compression is to access log
Server, empties the caching relevant to the access log record after the compression uploaded.
In disclosure enforcement system, described access log arranges unit and is used for, as long as reaching predetermined cache
Time and predetermined cache quantity one of them time, the access log record of statistics after caching is pressed
Contracting.
In disclosure enforcement system, described access log uploading unit is used for:
Access log record after uploading compression, to after access log server, receives access log clothes
The feedback of business device；
When described be fed back to receive successful time, empty relevant to the access log record after the compression uploaded
Caching；
When described be fed back to reception failure time, again upload the access log record after compression to accessing day
Will server.
In disclosure enforcement system, described access log uploading unit is additionally operable to again upload time when described
When number exceedes predetermined threshold, stop uploading, empty relevant to the access log record after the compression uploaded
Caching.
In a kind of enforcement system, described access log arranges unit for the access log note after caching
All kinds of access log record is generated, based on predetermined cache time and/or predetermined cache quantity pair after record classification
Described all kinds of access log record is compressed；
The described access log uploading unit all kinds of access log records after uploading compression are to all kinds of
Access log server.
See the structural representation of a kind of subscriber equipment that Fig. 6 is illustrated that disclosure embodiment provides,
Subscriber equipment is not implemented and limits by disclosure embodiment.As shown in Figure 6, this user sets
For may include that
Processor (processor) 610, communication interface (Communications Interface) 620,
Memorizer (memory) 630 and communication bus 640.
Processor 610, communication interface 620 and memorizer 630 complete phase by communication bus 640
Communication between Hu.
Communication interface 620, leading to for such as access log server and described content distribution center etc.
Letter.
Processor 610, is used for the program that performs 631, specifically can perform in said method embodiment
Correlation step.Specifically, program 631 can include that program code, described program code include calculating
Machine operational order.Described processor 610 is probably a central processor CPU, or specific collection
Become circuit ASIC (Application Specific Integrated Circuit), or be configured to reality
Execute one or more integrated circuits of disclosure embodiment.
Memorizer 630, is used for program of depositing 631.Memorizer 630 may comprise high-speed RAM storage
Device, it is also possible to also include nonvolatile memory (non-volatile memory), for example, at least one
Individual access log record buffer memory memorizer.Program 631 specifically may be used for so that described subscriber equipment
The 600 following operations of execution:
Access log generation step, for responding the access request of user, according to described access request,
Generate access log record；
Access log uploading step, is used for uploading described access log record to access log server,
Described access log record is not stored at local disk.
In program 631, a step implements the corresponding steps and list that may refer in above-described embodiment
The description that China of unit is corresponding, is not repeated herein.Those skilled in the art it can be understood that arrive,
For convenience and simplicity of description, the equipment of foregoing description and the specific works process of module, it is referred to
Corresponding process in preceding method embodiment describes, and does not repeats them here.
The system that the present embodiment is provided, sets up access log between CDN node and content distribution center
Server is in order to store the access log record of user so that described access log record is without taking this locality
Disk space, has saved system resource, improves the response speed of website and the operation effect of system simultaneously
Rate；Content distribution center only need to communicate with access log server just can analyze inquiry user's access
Log recording, it is to avoid because the best the caused content distribution center of communication quality can not be CDN in time
The situation of node distribution content, described method slow down the pressure of CDN node simultaneously, it is ensured that content
The timely and effective property of distribution.
Device embodiment described above is only schematically, wherein said illustrates as separating component
Unit can be or may not be physically separate, the parts shown as unit can be or
Person may not be physical location, i.e. may be located at a place, or can also be distributed to multiple network
On unit.Some or all of module therein can be selected according to the actual needs to realize the present embodiment
The purpose of scheme.Those of ordinary skill in the art are not in the case of paying performing creative labour, the most permissible
Understand and implement.
Through the above description of the embodiments, those skilled in the art is it can be understood that arrive each reality
The mode of executing can add the mode of required general hardware platform by software and realize, naturally it is also possible to by firmly
Part.Based on such understanding, the portion that prior art is contributed by technique scheme the most in other words
Dividing and can embody with the form of software product, this computer software product can be stored in computer can
Read in storage medium, such as ROM/RAM, magnetic disc, CD etc., including some instructions with so that one
Computer equipment (can be personal computer, server, or the network equipment etc.) performs each to be implemented
The method described in some part of example or embodiment.
Last it is noted that above example is only in order to illustrate the technical scheme of the disclosure, rather than to it
Limit；Although the disclosure being described in detail with reference to previous embodiment, the ordinary skill of this area
Personnel it is understood that the technical scheme described in foregoing embodiments still can be modified by it, or
Person carries out equivalent to wherein portion of techniques feature；And these amendments or replacement, do not make corresponding skill
The essence of art scheme departs from the spirit and scope of the disclosure each embodiment technical scheme.
Claims (14)
1. for an access log processing method for CDN node, including:
Response access request, and generate access log record；
Upload described access log record to access log server, do not store described visit at local disk
Ask log recording.
Method the most according to claim 1, wherein, described in upload described access log record
To access log server, do not store described access log record at local disk and include:
Often generate an access log record, be not written into local disk and store, be directly uploaded to visit
Ask log server.
Method the most according to claim 1, wherein, after generating access log record, bag
Include: cache described access log record, based on predetermined cache time and/or predetermined cache quantity to caching
The access log record of rear statistics is compressed；
Upload described access log record to access log server, do not store described visit at local disk
Ask that log recording includes:
Upload the access log record after compression to access log server, after the compression emptying and uploading
The relevant caching of access log record.
Method the most according to claim 3, wherein, described based on the predetermined cache time and/or
The access log record of statistics after caching is compressed including by predetermined cache quantity:
As long as reach predetermined cache time and predetermined cache quantity one of them time, to statistics after caching
Access log record is compressed.
Method the most according to claim 3, wherein, described in upload the access log after compression
Record, to access log server, empties the caching relevant to the access log record after the compression uploaded
Including:
Access log record after uploading compression, to after access log server, receives access log clothes
The feedback of business device；
When described be fed back to receive successful time, empty relevant to the access log record after the compression uploaded
Caching；
When described be fed back to reception failure time, again upload the access log record after compression to accessing day
Will server.
Method the most according to claim 5, wherein, when described number of times of again uploading exceedes pre-
When determining threshold value, stop uploading, empty the caching relevant to the access log record after the compression uploaded.
7. according to the method according to any one of claim 3-6, wherein, statistics after described caching
Access log is recorded as generating all kinds of access log record to after the access log record sort after caching；
Described based on predetermined cache time and/or predetermined cache quantity to the access log of statistics after caching
Record is compressed including: based on predetermined cache time and/or predetermined cache quantity to classification after caching after
All kinds of access log records be compressed；
Described upload compression after access log record include to access log server: after uploading compression
All kinds of access log records to all kinds of access log servers.
8. for an access log processing system for CDN node, including:
Access log signal generating unit, is used for responding access request, and generates access log record；
Access log uploading unit, is used for uploading described access log record to access log server,
Described access log record is not stored at local disk.
System the most according to claim 8, wherein, described access log uploading unit is used for:
Often generate an access log record, be not written into local disk and store, be directly uploaded to visit
Ask log server.
System the most according to claim 8, wherein, described system also includes:
Access log arranges unit, for generating access log record in described access log signal generating unit
Afterwards, cache described access log record, based on predetermined cache time and/or predetermined cache quantity to slow
After depositing, the access log record of statistics is compressed；
Described access log uploading unit, the access log record after uploading compression is to access log
Server, empties the caching relevant to the access log record after the compression uploaded.
11. systems according to claim 10, wherein, described access log arranges unit and uses
In:
As long as reach predetermined cache time and predetermined cache quantity one of them time, to statistics after caching
Access log record is compressed.
12. systems according to claim 10, wherein, described access log uploading unit is used
In:
Access log record after uploading compression, to after access log server, receives access log clothes
The feedback of business device；
When described be fed back to receive successful time, empty relevant to the access log record after the compression uploaded
Caching；
When described be fed back to reception failure time, again upload the access log record after compression to accessing day
Will server.
13. systems according to claim 12, wherein, described access log uploading unit is used
In:
When described again upload number of times exceed predetermined threshold time, stop uploading, the compression emptying and uploading
After the relevant caching of access log record.
14. according to the system according to any one of claim 10-13, wherein, and described access log
Arrangement unit is used for: generate all kinds of access log record to after the access log record sort after caching,
Based on predetermined cache time and/or predetermined cache quantity, described all kinds of access log records are compressed；
Described access log uploading unit is used for: upload all kinds of access log records after compression to all kinds of
Access log server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610262635.8A CN106027595A (en) | 2016-04-25 | 2016-04-25 | Access log processing method and system for CDN node |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610262635.8A CN106027595A (en) | 2016-04-25 | 2016-04-25 | Access log processing method and system for CDN node |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106027595A true CN106027595A (en) | 2016-10-12 |
Family
ID=57081058
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610262635.8A Pending CN106027595A (en) | 2016-04-25 | 2016-04-25 | Access log processing method and system for CDN node |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106027595A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017157127A1 (en) * | 2016-03-14 | 2017-09-21 | 华为技术有限公司 | Access record passing back method, device and system |
| CN107277104A (en) * | 2017-05-04 | 2017-10-20 | 上海斐讯数据通信技术有限公司 | The processing method and wireless router of a kind of web page access data |
| CN107423411A (en) * | 2017-07-28 | 2017-12-01 | 郑州云海信息技术有限公司 | Journal displaying method and apparatus |
| CN107566480A (en) * | 2017-08-30 | 2018-01-09 | 北京京东尚科信息技术有限公司 | The user activity information acquisition method and device, storage medium of mobile terminal application |
| CN107766509A (en) * | 2017-10-23 | 2018-03-06 | 北京京东尚科信息技术有限公司 | A kind of method and apparatus of webpage static backup |
| CN108234233A (en) * | 2016-12-22 | 2018-06-29 | 阿里巴巴集团控股有限公司 | Log processing method and device |
| CN108804585A (en) * | 2018-05-25 | 2018-11-13 | 网宿科技股份有限公司 | A kind of data processing method and device in CDN system |
| CN110177024A (en) * | 2019-05-06 | 2019-08-27 | 北京奇安信科技有限公司 | Monitoring method and client, server-side, the system of hotspot device |
| CN110222084A (en) * | 2019-05-06 | 2019-09-10 | 北京奇安信科技有限公司 | The report method and device of hotspot device monitoring information, storage medium, terminal |
| CN110324366A (en) * | 2018-03-28 | 2019-10-11 | 阿里巴巴集团控股有限公司 | Data processing method, apparatus and system |
| CN110430083A (en) * | 2019-08-15 | 2019-11-08 | 平安普惠企业管理有限公司 | A kind of location processing method and server of agency's forwarding request |
| CN112131198A (en) * | 2020-09-23 | 2020-12-25 | 北京奇艺世纪科技有限公司 | Log analysis method and device and electronic equipment |
| CN113691681A (en) * | 2021-08-20 | 2021-11-23 | 北京琥珀创想科技有限公司 | Junk phone data processing method and system |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1842021A (en) * | 2005-03-28 | 2006-10-04 | 华为技术有限公司 | Log information storage method |
| CN101958837A (en) * | 2010-09-30 | 2011-01-26 | 北京世纪互联工程技术服务有限公司 | Log processing system, log processing method, node server and center server |
| CN102053923A (en) * | 2009-11-05 | 2011-05-11 | 北京金山软件有限公司 | Storage method and storage device for logbook data |
| CN102385549A (en) * | 2010-09-02 | 2012-03-21 | 北京无限立通通讯技术有限责任公司 | Log processing system, log processing method and log storage sub-system |
| US20130246498A1 (en) * | 2012-03-16 | 2013-09-19 | Stephen Zucknovich | Content distribution management system |
| CN105224256A (en) * | 2015-10-13 | 2016-01-06 | 浪潮(北京)电子信息产业有限公司 | A kind of storage system |
| CN105429784A (en) * | 2015-10-30 | 2016-03-23 | 上海帝联信息科技股份有限公司 | Central collection server, and method and system for log file processing |
| CN105429783A (en) * | 2015-10-30 | 2016-03-23 | 上海帝联信息科技股份有限公司 | Edge node server, log file processing method and log file processing system |
-
2016
- 2016-04-25 CN CN201610262635.8A patent/CN106027595A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1842021A (en) * | 2005-03-28 | 2006-10-04 | 华为技术有限公司 | Log information storage method |
| CN102053923A (en) * | 2009-11-05 | 2011-05-11 | 北京金山软件有限公司 | Storage method and storage device for logbook data |
| CN102385549A (en) * | 2010-09-02 | 2012-03-21 | 北京无限立通通讯技术有限责任公司 | Log processing system, log processing method and log storage sub-system |
| CN101958837A (en) * | 2010-09-30 | 2011-01-26 | 北京世纪互联工程技术服务有限公司 | Log processing system, log processing method, node server and center server |
| US20130246498A1 (en) * | 2012-03-16 | 2013-09-19 | Stephen Zucknovich | Content distribution management system |
| CN105224256A (en) * | 2015-10-13 | 2016-01-06 | 浪潮(北京)电子信息产业有限公司 | A kind of storage system |
| CN105429784A (en) * | 2015-10-30 | 2016-03-23 | 上海帝联信息科技股份有限公司 | Central collection server, and method and system for log file processing |
| CN105429783A (en) * | 2015-10-30 | 2016-03-23 | 上海帝联信息科技股份有限公司 | Edge node server, log file processing method and log file processing system |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017157127A1 (en) * | 2016-03-14 | 2017-09-21 | 华为技术有限公司 | Access record passing back method, device and system |
| CN108234233A (en) * | 2016-12-22 | 2018-06-29 | 阿里巴巴集团控股有限公司 | Log processing method and device |
| CN108234233B (en) * | 2016-12-22 | 2021-09-24 | 阿里巴巴集团控股有限公司 | Log processing method and device |
| CN107277104A (en) * | 2017-05-04 | 2017-10-20 | 上海斐讯数据通信技术有限公司 | The processing method and wireless router of a kind of web page access data |
| CN107423411A (en) * | 2017-07-28 | 2017-12-01 | 郑州云海信息技术有限公司 | Journal displaying method and apparatus |
| CN107566480B (en) * | 2017-08-30 | 2021-04-30 | 北京京东尚科信息技术有限公司 | User activity information acquisition method and device for mobile terminal application and storage medium |
| CN107566480A (en) * | 2017-08-30 | 2018-01-09 | 北京京东尚科信息技术有限公司 | The user activity information acquisition method and device, storage medium of mobile terminal application |
| CN107766509A (en) * | 2017-10-23 | 2018-03-06 | 北京京东尚科信息技术有限公司 | A kind of method and apparatus of webpage static backup |
| CN110324366A (en) * | 2018-03-28 | 2019-10-11 | 阿里巴巴集团控股有限公司 | Data processing method, apparatus and system |
| CN108804585A (en) * | 2018-05-25 | 2018-11-13 | 网宿科技股份有限公司 | A kind of data processing method and device in CDN system |
| CN110222084A (en) * | 2019-05-06 | 2019-09-10 | 北京奇安信科技有限公司 | The report method and device of hotspot device monitoring information, storage medium, terminal |
| CN110177024A (en) * | 2019-05-06 | 2019-08-27 | 北京奇安信科技有限公司 | Monitoring method and client, server-side, the system of hotspot device |
| CN110177024B (en) * | 2019-05-06 | 2021-10-01 | 奇安信科技集团股份有限公司 | Monitoring method of hotspot equipment, client, server and system |
| CN110222084B (en) * | 2019-05-06 | 2021-10-22 | 奇安信科技集团股份有限公司 | Method and device for reporting monitoring information of hotspot equipment, storage medium and terminal |
| CN110430083A (en) * | 2019-08-15 | 2019-11-08 | 平安普惠企业管理有限公司 | A kind of location processing method and server of agency's forwarding request |
| CN110430083B (en) * | 2019-08-15 | 2022-11-15 | 平安普惠企业管理有限公司 | Positioning processing method for proxy forwarding request and server |
| CN112131198A (en) * | 2020-09-23 | 2020-12-25 | 北京奇艺世纪科技有限公司 | Log analysis method and device and electronic equipment |
| CN112131198B (en) * | 2020-09-23 | 2024-06-07 | 北京奇艺世纪科技有限公司 | Log analysis method and device and electronic equipment |
| CN113691681A (en) * | 2021-08-20 | 2021-11-23 | 北京琥珀创想科技有限公司 | Junk phone data processing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106027595A (en) | Access log processing method and system for CDN node | |
| US10404556B2 (en) | Methods and computer program products for correlation analysis of network traffic in a network device | |
| US8589537B2 (en) | Methods and computer program products for aggregating network application performance metrics by process pool | |
| US10346367B1 (en) | Load shedding techniques for distributed services with persistent client connections to ensure quality of service | |
| US10263876B2 (en) | Adaptive service timeouts | |
| US10599529B2 (en) | Instantiating data queues for management of remote data stores | |
| CN105376270B (en) | Method, device and system for improving uploading efficiency | |
| CN104219230B (en) | Identify method and the device of malicious websites | |
| US10609206B1 (en) | Auto-repairing mobile communication device data streaming architecture | |
| CN114039875B (en) | Data acquisition method, device and system based on eBPF technology | |
| US11489780B1 (en) | Traffic estimations for backbone networks | |
| CN108415962A (en) | A kind of cloud storage system | |
| Moreno et al. | Multi‐granular, multi‐purpose and multi‐Gb/s monitoring on off‐the‐shelf systems | |
| CN114070755B (en) | Virtual machine network flow determination method and device, electronic equipment and storage medium | |
| CN114528231A (en) | Data dynamic storage method and device, electronic equipment and storage medium | |
| CN105184559B (en) | A kind of payment system and method | |
| CN109714208A (en) | A kind of equipment is included in method, storage medium and the electronic equipment of network management | |
| CN105468502A (en) | Log collection method, device and system | |
| CN105893150B (en) | Interface calling frequency control method and device and interface calling request processing method and device | |
| US20170223136A1 (en) | Any Web Page Reporting and Capture | |
| CN110990148A (en) | Method, device and medium for optimizing storage performance | |
| CN106302020B (en) | Network bandwidth statistical method and device | |
| Li et al. | Characterizing service providers traffic of mobile internet services in cellular data network | |
| CN112131198B (en) | Log analysis method and device and electronic equipment | |
| CN110222084B (en) | Method and device for reporting monitoring information of hotspot equipment, storage medium and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20161012 |
|
| WD01 | Invention patent application deemed withdrawn after publication |