CN105868335A - Cache-data query synchronization method and system for CDN system - Google Patents
Cache-data query synchronization method and system for CDN system Download PDFInfo
- Publication number
- CN105868335A CN105868335A CN201610182679.XA CN201610182679A CN105868335A CN 105868335 A CN105868335 A CN 105868335A CN 201610182679 A CN201610182679 A CN 201610182679A CN 105868335 A CN105868335 A CN 105868335A
- Authority
- CN
- China
- Prior art keywords
- file
- hash
- blockette
- characteristic information
- array
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/1824—Distributed file systems implemented using Network-attached Storage [NAS] architecture
- G06F16/183—Provision of network file services by network file servers, e.g. by using NFS, CIFS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/178—Techniques for file synchronisation in file systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
Abstract
The invention discloses a cache-data query synchronization method for a CDN system. The cache-data query synchronization method includes the steps that characteristic information of files cached on CDN nodes is hashed multiple times to determine a first digit group; the to-be-set position in a first query array of a dispatching center is determined according to the first digit group, the determined to-be-set position is set, and a second query array is generated; characteristic information of a file in a source server is hashed multiple times to determine a second digit group; whether the position corresponding to the second digit group in the second query array is set or not is queried, and whether some file is cached on the CDN node or not is determined according to the query result. The invention further provides a cache-data query synchronization system for the CDN system. By means of the cache-data query synchronization method and system for the CDN system, the information amount of synchronization uploading of edge nodes is decreased, and the data querying speed of the dispatching center is increased.
Description
Technical field
The present invention relates to Internet technical field, particularly to a kind of data query cache synchronous method for CDN system and system.
Background technology
The full name of CDN is Content Delivery Network, i.e. content distributing network.Its objective is by increasing by one layer of new network architecture in existing Internet, the content of website is published to the network " edge " closest to user, make user can obtain required content nearby, solve Internet network congestion condition, improve user and access the response speed of website.
CDN technology is divided into dynamically to be accelerated and two kinds of technology of static acceleration, mostly commonly use at present is static acceleration, CDN node is i.e. disposed at the edge of network, when there being user to ask a certain service, CDN system is by scheduling, i.e. GSLB (Global Server Load Balance, GSLB) strategy directs the user to a fringe node of content that is nearest away from it and that be cached with user's request, and the content of caching is issued this user.This is accomplished by fringe node and synchronizes the information of all the elements that this node place caches to control centre, in case control centre is when receiving user to the access request of a certain service, the information of the cache contents that the fringe node stored by inquiry is synchronized is to determine the fringe node being cached with requested content accurately.
In prior art, fringe node synchronizes the method for this nodal cache content and is: store by the metadata of the All Files stored in fringe node is reached control centre nominally, to realize the information of fringe node cache file and the synchronization of control centre；The method whether being cached with a certain file in prior art in control centre's inquiry fringe node is: control centre is when receiving user access request, the fringe node of the request contrast control centre's storage according to user synchronizes the cache file information (the metadata title of file) of coming, to determine that user asks the fringe node at the file place accessed.
But, due to fringe node is numerous and at each fringe node the quantity of metadata of caching be also sizable (such as, video file is all presented in TS sheet), the most this traditional control centre that is uploaded to causes increasingly heavier pressure in the way of storage to control centre, and there is also owing to uploading file loss, the shortcoming causing synchronization failure in synchronizing process；In addition, owing to control centre storing the information of all of file of caching in all fringe nodes of the whole network with the form of the metadata title of file, therefore by traditional contrast one by one by the way of determine that the efficiency of the fringe node being cached with requested file is low-down, this also directly results in the time delay that user provides service, affect Consumer's Experience, be also to consume very much control centre's resource simultaneously.
Summary of the invention
The present invention provides a kind of data query cache synchronous method for CDN system and system, for solving containing much information and control centre's inquiry workload technical problem big, inefficient of fringe node synchronized upload in prior art.
According to an aspect of the invention, it is provided a kind of data query cache synchronous method for CDN system, including:
The characteristic information of the file being buffered in CDN node is carried out repeatedly Hash to determine the first blockette；
Determine that according to described first blockette the numerical digit to be put in the first inquiry array of control centre is put, to determined by numerical digit to be put put number, generate the second inquiry array；
The characteristic information of a certain file in described source server is carried out repeatedly Hash to determine the second blockette；
The position corresponding with the second blockette inquired about in described second inquiry array has been set to number the most, determines that described a certain file has been buffered in described CDN node according to Query Result.
According to another aspect of the present invention, it is provided that a kind of data query for CDN system synchronizes system, including:
First hash module, for carrying out repeatedly Hash to determine the first blockette to the characteristic information of the file being buffered in CDN node；
Second inquiry array generation module, the numerical digit to be put in the first inquiry array determining control centre according to described first blockette puts, to determined by numerical digit to be put put number, generate the second inquiry array；
Second hash module, for carrying out repeatedly Hash to determine the second blockette to the characteristic information of a certain file in described source server；
Inquiry determines module, has the most been set to number for inquiring about the position corresponding with the second blockette in described second inquiry array, has determined that described a certain file has been buffered in described CDN node according to Query Result.
The data query cache synchronous method for CDN system of the embodiment of the present invention and system, by the characteristic information of the file being buffered in CDN node is carried out repeatedly Hash to determine the first blockette, and determine that according to the first blockette the numerical digit to be put in the first inquiry array of control centre is put, determined by, numerical digit to be put puts number, generate the second inquiry array, thus only by uploading one group of numeral (the first blockette) with uniqueness determined by the characteristic information of the file of CDN node being carried out repeatedly Hash and be achieved that the synchronization of the information to cache file, decrease CDN node and upload synchrodata amount and workload；Meanwhile, also have only to be determined by inquire about the corresponding positions in array when control centre is inquired about and whether be set to number and can complete inquiry, so that inquiry also becomes quickness and high efficiency, improve the speed of the response to user access request, thus promote Consumer's Experience.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, in describing embodiment below, the required accompanying drawing used is briefly described, apparently, accompanying drawing in describing below is some embodiments of the present invention, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the flow chart of an embodiment of the data query cache synchronous method for CDN system of the present invention；
Fig. 2 is the flow chart of another embodiment of the data query cache synchronous method for CDN system of the present invention；
Fig. 3 is the flow chart of the another embodiment of the data query cache synchronous method for CDN system of the present invention；
Fig. 4 is the schematic diagram of an embodiment of the data query cache synchronization system for CDN system of the present invention；
Fig. 5 is the schematic diagram that the data query cache for CDN system in the present invention synchronizes an embodiment of system；
Fig. 6 is the schematic diagram that the data query cache for CDN system in the present invention synchronizes another embodiment of system；
Fig. 7 is the schematic diagram of the whole zero setting in all positions in bit array；
Fig. 8 be k when taking 3 para-position array put the schematic diagram of several embodiments；
Fig. 9 is the schematic diagram of the embodiment judging whether element be present in bit array.
Specific embodiment
For making the purpose of the embodiment of the present invention, technical scheme and advantage clearer, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is a part of embodiment of the present invention rather than whole embodiments.Based on the embodiment in the present invention, the every other embodiment that those of ordinary skill in the art are obtained under not making creative work premise, broadly fall into the scope of protection of the invention.
It should be noted that in the case of not conflicting, the embodiment in the application and the feature in embodiment can be mutually combined.
The present invention can be used in numerous general or special purpose computing system environment or configuration.Such as: personal computer, server computer, handheld device or portable set, laptop device, multicomputer system, system based on microprocessor, set top box, programmable consumer-elcetronics devices, network PC, minicomputer, mainframe computer, the distributed computing environment including any of the above system or equipment etc..
The present invention can be described in the general context of computer executable instructions, such as program module.Usually, program module includes performing particular task or realizing the routine of particular abstract data type, program, object, assembly, data structure etc..The present invention can also be put into practice in a distributed computing environment, in these distributed computing environment, the remote processing devices connected by communication network perform task.In a distributed computing environment, during program module may be located at the local and remote computer-readable storage medium including storage device.
Finally, it can further be stated that, in this article, the relational terms of such as first and second or the like is used merely to separate an entity or operation with another entity or operating space, and not necessarily requires or imply the relation or sequentially that there is any this reality between these entities or operation.And, term " includes ", " comprising ", not only includes those key elements, but also includes other key elements being not expressly set out, or also includes the key element intrinsic for this process, method, article or equipment.In the case of there is no more restriction, statement " including ... " key element limited, it is not excluded that there is also other identical element in including the process of described key element, method, article or equipment.
As it is shown in figure 1, the data query cache synchronous method for CDN system of one embodiment of the invention, including:
S11, characteristic information to the file being buffered in CDN node carry out repeatedly Hash to determine the first blockette；
S12, the numerical digit to be put determined according to the first blockette in the first inquiry array of control centre are put, to determined by numerical digit to be put put number, generate the second inquiry array；
S13, characteristic information to a certain file in source server carry out repeatedly Hash to determine the second blockette；
The position corresponding with the second blockette in S14, inquiry the second inquiry array has been set to number the most, determines that a certain file has been buffered in CDN node according to Query Result.
Source server in the present embodiment is any one source server in CDN the whole network, a certain file in source server is arbitrary file, actual of a certain file in source server mentioned here is the arbitrary file in CDN the whole network, and it is not intended to be limited to the file taking from source server, for example, it may be the access request from client requires to access a certain file.
The data query cache synchronous method for CDN system of the present embodiment, by the characteristic information of the file being buffered in CDN node is carried out repeatedly Hash to determine the first blockette, and determine that according to the first blockette the numerical digit to be put in the first inquiry array of control centre is put, determined by, numerical digit to be put puts number, generate the second inquiry array, thus only by uploading one group of numeral (the first blockette) with uniqueness determined by the characteristic information of the file of CDN node being carried out repeatedly Hash and be achieved that the synchronization of the information to cache file, decrease CDN node and upload synchrodata amount and workload；Simultaneously, owing to the information that synchronized also is to store with the form of digit order number in control centre, save memory space, and also have only to be determined by inquire about the corresponding positions in array when control centre is inquired about and whether be set to number and can complete inquiry, so that inquiry also becomes quickness and high efficiency, improve the speed of the response to user access request, thus promote Consumer's Experience.
As in figure 2 it is shown, be the flow chart of another embodiment of the present invention, in this embodiment, the characteristic information to the file being buffered in CDN node carries out repeatedly Hash to determine that the first blockette includes:
S21, determine the characteristic information of file；
S22, characteristic information carrying out repeatedly Hash, each Hash all generates a numeral；
S23, by generate all stored digital be the first blockette.
The present embodiment use hash algorithm the characteristic information of file carries out repeatedly Hash to be contained the first blockette of multiple numeral accordingly, for uniquely identifying this document, thus the data message of mark this document has been compressed to several numeral, greatly reduce the data volume that CDN node synchronizes to upload required for the fileinfo of local cache, and the reduction of the data volume owing to uploading, decrease the probability made mistakes in upload procedure (because it is inevitable the highest for the requirement of network environment to upload bigger file, upload less demanding to network environment of less file, therefore upload string number and be greatly reduced relative to the error probability uploading complete fileinfo).
Additionally, the number of times that the characteristic information of the file of be buffered in CDN node carries out Hash is at least 8 times, the blockette that the purpose of do so obtains after being to ensure the characteristic information of different files is carried out repeatedly Hash is different.nullThink，When the characteristic information of different files being carried out Hash (such as 3 times) of fewer number，Obtain only includes three digital blockettes，The probability that blockette that the blockette so obtained obtains with the characteristic information of other file carries out 3 Hash is identical is the biggest，So it is possible to there is the generation of the situation without inquiry in follow-up inquiry，Such as，Hash result to 3 times of A file and B file is all (4、9、13)，When certain nodal cache has A file and its characteristic information will carry out the result (4 of Hash、9、13) after synchronizing，If whether control centre's inquiry B file is buffered，The most at this moment owing to being also (4 to the 3 of the characteristic information of B file Hash result、9、13)，B file will be mistaken for and be buffered in some CDN node.
In order to further ensure that the characteristic information to file carries out the uniqueness of the blockette that Hash obtains, characteristic information uses the character string in the title of file or is the MD5 value of file, because the information of the MD5 value of the character string in the title of file and the file a certain file of a kind of unique mark, so it is carried out the probability that the blockette that Hash obtains comes across the characteristic information of other file identical the least, and then improve the accuracy of control centre's Query Result.
As it is shown on figure 3, be the flow chart of another embodiment of the present invention, in this embodiment, determine that according to the first blockette the numerical digit to be put in the first inquiry array of control centre is put, to determined by numerical digit to be put put number, generate the second inquiry array and include:
S31, the numeral read in described first blockette；
S32, to putting number with the corresponding position of described numeral read and obtain the second inquiry array in the first inquiry array.
For making the present embodiment clearer, illustrate in conjunction with the example below.
1) bit array (i.e., the first inquiry array):
Assuming that bit array uses the array of a m bit to preserve information, during original state, bit array is an array comprising m position, and each is all set to 0, and the element of the most whole array was both configured to for 0 (as shown in Figure 7).
2) k independent hash function (for repeatedly Hash)
In order to express S={x1,x2,…,xnThe set characteristic information of a file (each element be equivalent to) of such a n element, bit array uses k separate hash function (Hash Function), they respectively will set in each element be mapped to 1 ..., in the scope of m}.
When we are toward when increasing any one element x in bit array, we use k hash function that X carries out Hash to obtain k cryptographic Hash, then bit corresponding in array is set to 1.The position hash that i.e. i-th hash function mapsiX () will be set to 1 (1≤i≤k).Note, if a position is repeatedly set to 1, then only for the first time can work, after will there is no any effect several times.In fig. 8, k=3, and have two hash functions choose same position (from left side number the 5th, i.e. second " 1 " place).
3) judge whether element is present in bit array (that is, it is judged that whether some file is present in CDN node)
When judging whether element y belongs to this bit array, we have only to use k hash function to obtain k cryptographic Hash y, if all hashiY the position of () is all 1 (1≤i≤k), i.e. k position both is set to 1, so we are considered as y is the element (the most i.e. can determine that the file corresponding to element y is present in CDN node) in bit array, and being otherwise considered as y is not the element (the most i.e. can determine that in the no longer CDN node of the file corresponding to element y) in bit array.As it is shown in figure 9, y1It it not the most the element (because y1 has at has pointed to " 0 " position) in bit array.y2Or belong to this bit array.
Here the unit of m from n is different, m be bit be unit, n is then in units of element number the number of different element (say accurately be).The generally length of individual element all has a lot of bit.So making the characteristic information storing file in aforementioned manners is the most all to save on internal memory.
Method in above-described embodiment can be used in CDN server and CDN control centre.
The embodiment of the present invention can be passed through hardware processor (hardware processor) and realize related function module.
It should be noted that, for aforesaid each method embodiment, in order to be briefly described, therefore it is all expressed as a series of action and merges, but those skilled in the art should know, the present invention is not limited by described sequence of movement, because according to the present invention, some step can use other orders or carry out simultaneously.Secondly, those skilled in the art also should know, embodiment described in this description belongs to preferred embodiment, necessary to involved action and the module not necessarily present invention.
In the above-described embodiments, the description to each embodiment all emphasizes particularly on different fields, and does not has the part described in detail, may refer to the associated description of other embodiments in certain embodiment.
As shown in Figure 4, the data query for CDN system of one embodiment of the invention synchronizes the schematic diagram of system, including:
First hash module, for carrying out repeatedly Hash to determine the first blockette to the characteristic information of the file being buffered in CDN node；
Second inquiry array generation module, the numerical digit to be put in the first inquiry array determining control centre according to described first blockette puts, to determined by numerical digit to be put put number, generate the second inquiry array；
Second hash module, for carrying out repeatedly Hash to determine the second blockette to the characteristic information of a certain file in described source server；
Inquiry determines module, has the most been set to number for inquiring about the position corresponding with the second blockette in described second inquiry array, has determined that described a certain file has been buffered in described CDN node according to Query Result.
The data query cache for CDN system of the present embodiment synchronizes system, Hash is carried out repeatedly to determine the first blockette by the characteristic information of first hash module file to being buffered in CDN node, and the second inquiry array generation module determines that according to the first blockette the numerical digit to be put in the first inquiry array of control centre is put, determined by, numerical digit to be put puts number, generate the second inquiry array, thus only by uploading one group of numeral (the first blockette) with uniqueness determined by the characteristic information of the file of CDN node being carried out repeatedly Hash and be achieved that the synchronization of the information to cache file, decrease CDN node and upload synchrodata amount and workload；Simultaneously, owing to the information that synchronized also is to store with the form of digit order number in control centre, save memory space, and determine whether the corresponding positions that module also has only to when control centre is inquired about be determined by inquiry array is set to number and can complete inquiry by the second hash module and inquiry, so that inquiry also becomes quickness and high efficiency, improve the speed of the response to user access request, thus promote Consumer's Experience.
As it is shown in figure 5, the schematic diagram of one embodiment of the invention, wherein, the first hash module includes:
Characteristic information determines unit, for determining the characteristic information of described file；
Hash calculation unit, for described characteristic information is carried out repeatedly Hash, each Hash all generates a numeral；
First blockette signal generating unit, is the first blockette for all stored digital that will generate.
Characteristic information is the character string in the title of described file or the MD5 value for described file.
The number of times that the characteristic information of the file of be buffered in CDN node carries out Hash is at least 8 times.
The present embodiment use hash algorithm the characteristic information of file carries out repeatedly Hash to be contained the first blockette of multiple numeral accordingly, for uniquely identifying this document, thus the data message of mark this document has been compressed to several numeral, greatly reduce the data volume that CDN node synchronizes to upload required for the fileinfo of local cache, and the reduction of the data volume owing to uploading, decrease the probability made mistakes in upload procedure (because it is inevitable the highest for the requirement of network environment to upload bigger file, upload less demanding to network environment of less file, therefore upload string number and be greatly reduced relative to the error probability uploading complete fileinfo).
As shown in Figure 6, the schematic diagram of one embodiment of the invention, wherein the second inquiry array generation module includes:
Numeral reads unit, for reading the numeral in described first blockette；
Array signal generating unit, obtains described second inquiry array for the position corresponding with the described numeral read in described first inquiry array is put number.
System in above-described embodiment can be laid on CDN server and CDN control centre.
Embodiment of the method described above is only schematically, the wherein said unit illustrated as separating component can be or may not be physically separate, the parts shown as unit can be or may not be physical location, i.e. may be located at a place, or can also be distributed on multiple NE.Some or all of module therein can be selected according to the actual needs to realize the purpose of the present embodiment scheme.Those of ordinary skill in the art, in the case of not paying performing creative labour, are i.e. appreciated that and implement.
By the description of above embodiment, those skilled in the art is it can be understood that can add the mode of required general hardware platform by software to each embodiment and realize, naturally it is also possible to pass through hardware.Based on such understanding, the part that prior art is contributed by technique scheme the most in other words can embody with the form of software product, this computer software product can store in a computer-readable storage medium, such as ROM/RAM, magnetic disc, CD etc., including some instructions with so that a computer equipment (can be personal computer, server, or the network equipment etc.) perform the method described in some part of each embodiment or embodiment.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or computer program.Therefore, the form of the embodiment in terms of the present invention can use complete hardware embodiment, complete software implementation or combine software and hardware.And, the present invention can use the form at one or more upper computer programs implemented of computer-usable storage medium (including but not limited to disk memory and optical memory etc.) wherein including computer usable program code.
The present invention is to describe with reference to method, equipment (system) and the flow chart of computer program according to embodiments of the present invention and/or block diagram.It should be understood that can be by the flow process in each flow process in computer program instructions flowchart and/or block diagram and/or square frame and flow chart and/or block diagram and/or the combination of square frame.These computer program instructions can be provided to produce a machine to the processor of general purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device so that the instruction performed by the processor of computer or other programmable data processing device is produced for realizing the device of function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions may be alternatively stored in and can guide in the computer-readable memory that computer or other programmable data processing device work in a specific way, the instruction making to be stored in this computer-readable memory produces the manufacture including command device, and this command device realizes the function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame.These computer program instructions also can be loaded in computer or other programmable data processing device, make to perform sequence of operations step on computer or other programmable devices to produce computer implemented process, thus the instruction performed on computer or other programmable devices provides the step of the function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame for realization.
Last it is noted that above example is only in order to illustrate technical scheme, it is not intended to limit；Although the present invention being described in detail with reference to previous embodiment, it will be understood by those within the art that: the technical scheme described in foregoing embodiments still can be modified by it, or wherein portion of techniques feature is carried out equivalent；And these amendments or replacement, do not make the essence of appropriate technical solution depart from the spirit and scope of various embodiments of the present invention technical scheme.
Claims (10)
1. for a data query cache synchronous method for CDN system, including:
The characteristic information of the file being buffered in CDN node is carried out repeatedly Hash to determine the first blockette；
Determine that according to described first blockette the numerical digit to be put in the first inquiry array of control centre is put, right
Determined by numerical digit to be put put and carry out putting number, generate the second inquiry array；
The characteristic information of a certain file in described source server is carried out repeatedly Hash to determine the second numeral
Group；
The position corresponding with the second blockette inquired about in described second inquiry array has been set to number, root the most
Determine that described a certain file has been buffered in described CDN node according to Query Result.
Method the most according to claim 1, wherein, the described file to being buffered in CDN node
Characteristic information carry out repeatedly Hash to determine that the first blockette includes:
Determine the characteristic information of described file；
Described characteristic information carries out repeatedly Hash, and each Hash all generates a numeral；
It is the first blockette by all stored digital of generation.
Method the most according to claim 2, wherein, described determines tune according to described first blockette
Degree center first inquiry array in numerical digit to be put put, to determined by numerical digit to be put put number,
Generate the second inquiry array to include:
Read the numeral in described first blockette；
Number is put in the position corresponding with the described numeral read in described first inquiry array and obtains institute
State the second inquiry array.
4. according to the method described in any one of claim 1-3, wherein, described characteristic information is described literary composition
Character string in the title of part or be the MD5 value of described file.
5. according to the method described in any one of claim 1-3, wherein, to be buffered in CDN node
The characteristic information of file carry out the number of times of Hash and be at least 8 times.
6. the data query cache for CDN system synchronizes a system, including:
First hash module, for carrying out repeatedly Hash to the characteristic information of the file being buffered in CDN node
To determine the first blockette；
Second inquiry array generation module, for determining the first of control centre according to described first blockette
Numerical digit to be put in inquiry array is put, to determined by numerical digit to be put put number, generate the second inquiry
Array；
Second hash module, for carrying out repeatedly the characteristic information of a certain file in described source server
Hash is to determine the second blockette；
Inquiry determines module, for inquiring about the position corresponding with the second blockette in described second inquiry array
Put and be the most set to number, determine that described a certain file has been buffered in described CDN according to Query Result
Node.
System the most according to claim 6, wherein, described first hash module includes:
Characteristic information determines unit, for determining the characteristic information of described file；
Hash calculation unit, for described characteristic information is carried out repeatedly Hash, each Hash all generates one
Individual numeral；
First blockette signal generating unit, is the first blockette for all stored digital that will generate.
System the most according to claim 7, wherein, described second inquiry array generation module includes:
Numeral reads unit, for reading the numeral in described first blockette；
Array signal generating unit, for corresponding to the described numeral with reading in described first inquiry array
Position carry out putting number and obtain described second inquiry array.
9. according to the system described in any one of claim 6-8, wherein, described characteristic information is described literary composition
Character string in the title of part or be the MD5 value of described file.
10. according to the system described in any one of claim 6-8, wherein, to be buffered in CDN node
The characteristic information of file carry out the number of times of Hash and be at least 8 times.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610182679.XA CN105868335A (en) | 2016-03-28 | 2016-03-28 | Cache-data query synchronization method and system for CDN system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610182679.XA CN105868335A (en) | 2016-03-28 | 2016-03-28 | Cache-data query synchronization method and system for CDN system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105868335A true CN105868335A (en) | 2016-08-17 |
Family
ID=56624952
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610182679.XA Pending CN105868335A (en) | 2016-03-28 | 2016-03-28 | Cache-data query synchronization method and system for CDN system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105868335A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103888999A (en) * | 2012-12-19 | 2014-06-25 | 中国移动通信集团公司 | WebCache service and CDN service fusion method and device |
| CN104469392A (en) * | 2014-12-19 | 2015-03-25 | 北京奇艺世纪科技有限公司 | Video file storage method and device |
| US20150237159A1 (en) * | 2014-02-19 | 2015-08-20 | Level 3 Communications, Llc | Content delivery network architecture with edge proxy |
-
2016
- 2016-03-28 CN CN201610182679.XA patent/CN105868335A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103888999A (en) * | 2012-12-19 | 2014-06-25 | 中国移动通信集团公司 | WebCache service and CDN service fusion method and device |
| US20150237159A1 (en) * | 2014-02-19 | 2015-08-20 | Level 3 Communications, Llc | Content delivery network architecture with edge proxy |
| CN104469392A (en) * | 2014-12-19 | 2015-03-25 | 北京奇艺世纪科技有限公司 | Video file storage method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9740706B2 (en) | Management of intermediate data spills during the shuffle phase of a map-reduce job | |
| Zhao et al. | Dache: A data aware caching for big-data applications using the MapReduce framework | |
| US8442955B2 (en) | Virtual machine image co-migration | |
| US20200142860A1 (en) | Caseless file lookup in a distributed file system | |
| US20130318525A1 (en) | Locality-aware resource allocation for cloud computing | |
| US20090187588A1 (en) | Distributed indexing of file content | |
| CN104881466B (en) | The processing of data fragmentation and the delet method of garbage files and device | |
| US10909086B2 (en) | File lookup in a distributed file system | |
| US20130339605A1 (en) | Uniform storage collaboration and access | |
| US9348855B2 (en) | Supporting big data in enterprise content management systems | |
| CN111324606B (en) | Data slicing method and device | |
| CN110347651A (en) | Method of data synchronization, device, equipment and storage medium based on cloud storage | |
| US10417192B2 (en) | File classification in a distributed file system | |
| Elghamrawy et al. | A partitioning framework for Cassandra NoSQL database using Rendezvous hashing | |
| CN110427364A (en) | A kind of data processing method, device, electronic equipment and storage medium | |
| CN106354587A (en) | Mirror image server and method for exporting mirror image files of virtual machine | |
| CN110502472A (en) | A kind of the cloud storage optimization method and its system of large amount of small documents | |
| Cheng et al. | A Multi-dimensional Index Structure Based on Improved VA-file and CAN in the Cloud | |
| CN109669987A (en) | A kind of big data storage optimization method | |
| CN114730307A (en) | Intelligent data pool | |
| Serbanescu et al. | Architecture of distributed data aggregation service | |
| CN116842012A (en) | Method, device, equipment and storage medium for storing Redis cluster in fragments | |
| CN103108045A (en) | Web map service implementation method based on cloud framework | |
| CN105893468A (en) | Cache data synchronization method system for CDN system | |
| CN105868335A (en) | Cache-data query synchronization method and system for CDN system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160817 |
|
| WD01 | Invention patent application deemed withdrawn after publication |