CN105893468A - Cache data synchronization method system for CDN system - Google Patents
Cache data synchronization method system for CDN system Download PDFInfo
- Publication number
- CN105893468A CN105893468A CN201610184232.6A CN201610184232A CN105893468A CN 105893468 A CN105893468 A CN 105893468A CN 201610184232 A CN201610184232 A CN 201610184232A CN 105893468 A CN105893468 A CN 105893468A
- Authority
- CN
- China
- Prior art keywords
- file
- hash
- characteristic information
- blockette
- cdn
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/178—Techniques for file synchronisation in file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention discloses a cache data synchronization method for a CDN system. The method comprises: performing multiple times of hashing on feature information of a file cached at a CDN node so as to determine a first digital set; and uploading the first digital set to a scheduling center to modify a query array in the scheduling center, wherein the query array is used by the scheduling center to perform a file cache result query. The present invention further provides a cache data synchronization system for the CDN system. The method and system disclosed by the present invention reduce the amount of information synchronously uploaded by edge nodes, speed up the data query performed by the scheduling center, and relieves the storage pressure of the scheduling center.
Description
Technical field
The present invention relates to Internet technical field, particularly to a kind of data cached synchronous method for CDN system and system.
Background technology
The full name of CDN is Content Delivery Network, i.e. content distributing network.Its objective is by increasing by one layer of new network architecture in existing Internet, the content of website is published to the network " edge " closest to user, make user can obtain required content nearby, solve Internet network congestion condition, improve user and access the response speed of website.
CDN technology is divided into dynamically to be accelerated and two kinds of technology of static acceleration, mostly commonly use at present is static acceleration, CDN node is i.e. disposed at the edge of network, when there being user to ask a certain service, CDN system is by scheduling, i.e. GSLB (Global Server Load Balance, GSLB) strategy directs the user to a fringe node of content that is nearest away from it and that be cached with user's request, and the content of caching is issued this user.This is accomplished by fringe node and synchronizes the information of all the elements that this node place caches to control centre, in case control centre is when receiving user to the access request of a certain service, the information of the cache contents that the fringe node stored by inquiry is synchronized is to determine the fringe node being cached with requested content accurately.
In prior art, fringe node synchronizes the method for this nodal cache content and is: store by the metadata of the All Files stored in fringe node is reached control centre nominally, to realize the information of fringe node cache file and the synchronization of control centre;The method whether being cached with a certain file in prior art in control centre's inquiry fringe node is: control centre is when receiving user access request, the fringe node of the request contrast control centre's storage according to user synchronizes the cache file information (the metadata title of file) of coming, to determine that user asks the fringe node at the file place accessed.
But, due to fringe node is numerous and at each fringe node the quantity of metadata of caching be also sizable (such as, video file is all presented in TS sheet), the most this traditional control centre that is uploaded to causes increasingly heavier pressure in the way of storage to control centre, and there is also owing to uploading file loss, the shortcoming causing synchronization failure in synchronizing process;In addition, owing to control centre storing the information of all of file of caching in all fringe nodes of the whole network with the form of the metadata title of file, therefore by traditional contrast one by one by the way of determine that the efficiency of the fringe node being cached with requested file is low-down, this also directly results in the time delay that user provides service, affect Consumer's Experience, be also to consume very much control centre's resource simultaneously.
Summary of the invention
The present invention provides a kind of data cached synchronous method for CDN system and system, for solving containing much information and control centre's inquiry workload technical problem big, inefficient of fringe node synchronized upload in prior art.
According to an aspect of the invention, it is provided a kind of data cached synchronous method for CDN system, including:
The characteristic information of the file being buffered in CDN node is carried out repeatedly Hash to determine the first blockette;
Uploading described first blockette to control centre to revise the inquiry array in described control centre, wherein said inquiry array carries out file cache result queries for control centre.
According to another aspect of the present invention, it is provided that a kind of data cached synchronization system for CDN system, including:
First hash module, for carrying out repeatedly Hash to determine the first blockette to the characteristic information of the file being buffered in CDN node;
Transmission module in data, for uploading described first blockette to control centre to revise the inquiry array in described control centre, wherein said inquiry array carries out file cache result queries for control centre.
The data cached synchronous method for CDN system of the embodiment of the present invention and system, by the characteristic information of the file being buffered in CDN node is carried out repeatedly Hash to determine the first blockette, and it is uploaded to control centre for storing the characteristic information of the file in CDN node, thus only by uploading one group of numeral (the first blockette) with uniqueness determined by the characteristic information of the file of CDN node being carried out repeatedly Hash and be achieved that the synchronization of the information to cache file, decrease CDN node and upload synchrodata amount and workload;Meanwhile, the storage pressure of control centre is alleviated so that inquiry also becomes quickness and high efficiency, improves the speed of the response to user access request, thus promotes Consumer's Experience.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, in describing embodiment below, the required accompanying drawing used is briefly described, apparently, accompanying drawing in describing below is some embodiments of the present invention, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the flow chart of an embodiment of the data cached synchronous method for CDN system of the present invention;
Fig. 2 is the flow chart of another embodiment of the data cached synchronous method for CDN system of the present invention;
Fig. 3 is the schematic diagram of an embodiment of the data cached synchronization system for CDN system of the present invention;
Fig. 4 is the schematic diagram of another embodiment of the data cached synchronization system for CDN system of the present invention;
Fig. 5 is the schematic diagram of the whole zero setting in all positions in bit array;
Fig. 6 be k when taking 3 para-position array put the schematic diagram of several embodiments;
Fig. 7 is the schematic diagram of the embodiment judging whether element be present in bit array.
Specific embodiment
For making the purpose of the embodiment of the present invention, technical scheme and advantage clearer, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is a part of embodiment of the present invention rather than whole embodiments.Based on the embodiment in the present invention, the every other embodiment that those of ordinary skill in the art are obtained under not making creative work premise, broadly fall into the scope of protection of the invention.
It should be noted that in the case of not conflicting, the embodiment in the application and the feature in embodiment can be mutually combined.
The present invention can be used in numerous general or special purpose computing system environment or configuration.Such as: personal computer, server computer, handheld device or portable set, laptop device, multicomputer system, system based on microprocessor, set top box, programmable consumer-elcetronics devices, network PC, minicomputer, mainframe computer, the distributed computing environment including any of the above system or equipment etc..
The present invention can be described in the general context of computer executable instructions, such as program module.Usually, program module includes performing particular task or realizing the routine of particular abstract data type, program, object, assembly, data structure etc..The present invention can also be put into practice in a distributed computing environment, in these distributed computing environment, the remote processing devices connected by communication network perform task.In a distributed computing environment, during program module may be located at the local and remote computer-readable storage medium including storage device.
Finally, it can further be stated that, in this article, the relational terms of such as first and second or the like is used merely to separate an entity or operation with another entity or operating space, and not necessarily requires or imply the relation or sequentially that there is any this reality between these entities or operation.And, term " includes ", " comprising ", not only includes those key elements, but also includes other key elements being not expressly set out, or also includes the key element intrinsic for this process, method, article or equipment.In the case of there is no more restriction, statement " including ... " key element limited, it is not excluded that there is also other identical element in including the process of described key element, method, article or equipment.
As it is shown in figure 1, the data cached synchronous method for CDN system of one embodiment of the invention, including:
S11, characteristic information to the file being buffered in CDN node carry out repeatedly Hash to determine the first blockette;
S12, uploading described first blockette to control centre to revise the inquiry array in described control centre, wherein said inquiry array carries out file cache result queries for control centre.
The data query cache synchronous method for CDN system of the present embodiment, by the characteristic information of the file being buffered in CDN node is carried out repeatedly Hash to determine the first blockette, thus only by uploading one group of numeral (the first blockette) with uniqueness determined by the characteristic information of the file of CDN node being carried out repeatedly Hash and be achieved that the synchronization of the information to cache file, decrease CDN node and upload synchrodata amount and workload;Simultaneously, save the memory space of control centre, and also have only to be determined by inquire about the corresponding positions in array when control centre is inquired about and whether be set to number and can complete inquiry, so that inquiry also becomes quickness and high efficiency, improve the speed of the response to user access request, thus promote Consumer's Experience.
The first blockette of uploading in above-described embodiment includes to control centre with the inquiry array in amendment control centre, reads the numeral in the first blockette;
Number is put in the position corresponding with the numeral read in inquiry array and obtains new inquiry array.
The characteristic information of file to be checked is carried out repeatedly Hash to determine the second blockette;
The position corresponding with the second blockette inquired about in described new inquiry array has been set to number the most, determines that file to be checked has been buffered in CDN node according to Query Result.
File to be checked in the present embodiment can be from the access request of client and requires to access a certain file.
As in figure 2 it is shown, be the flow chart of another embodiment of the present invention, in this embodiment, the characteristic information to the file being buffered in CDN node carries out repeatedly Hash to determine that the first blockette includes:
S21, determine the characteristic information of file;
S22, characteristic information carrying out repeatedly Hash, each Hash all generates a numeral;
S23, by generate all stored digital be the first blockette.
The present embodiment use hash algorithm the characteristic information of file carries out repeatedly Hash to be contained the first blockette of multiple numeral accordingly, for uniquely identifying this document, thus the data message of mark this document has been compressed to several numeral, greatly reduce the data volume that CDN node synchronizes to upload required for the fileinfo of local cache, and the reduction of the data volume owing to uploading, decrease the probability made mistakes in upload procedure (because it is inevitable the highest for the requirement of network environment to upload bigger file, upload less demanding to network environment of less file, therefore upload string number and be greatly reduced relative to the error probability uploading complete fileinfo).
Additionally, the number of times that the characteristic information of the file of be buffered in CDN node carries out Hash is at least 8 times, the blockette that the purpose of do so obtains after being to ensure the characteristic information of different files is carried out repeatedly Hash is different.nullThink,When the characteristic information of different files being carried out Hash (such as 3 times) of fewer number,Obtain only includes three digital blockettes,The probability that blockette that the blockette so obtained obtains with the characteristic information of other file carries out 3 Hash is identical is the biggest,So it is possible to there is the generation of the situation without inquiry in follow-up inquiry,Such as,Hash result to 3 times of A file and B file is all (4、9、13),When certain nodal cache has A file and its characteristic information will carry out the result (4 of Hash、9、13) after synchronizing,If whether control centre's inquiry B file is buffered,The most at this moment owing to being also (4 to the 3 of the characteristic information of B file Hash result、9、13),B file will be mistaken for and be buffered in some CDN node.
In order to further ensure that the characteristic information to file carries out the uniqueness of the blockette that Hash obtains, characteristic information uses the character string in the title of file or is the MD5 value of file, because the information of the MD5 value of the character string in the title of file and the file a certain file of a kind of unique mark, so it is carried out the probability that the blockette that Hash obtains comes across the characteristic information of other file identical the least, and then improve the accuracy of control centre's Query Result.
The numerical digit to be put in the first inquiry array determining control centre of the first blockette in above-described embodiment is put, to determined by numerical digit to be put put number, generate the second inquiry array, specifically include:
Read the numeral in described first blockette;
Number is put in the position corresponding with the described numeral read in first inquiry array and obtains the second inquiry array.
For making the present embodiment clearer, illustrate in conjunction with the example below.
1) bit array (i.e., the first inquiry array):
Assuming that bit array uses the array of a m bit to preserve information, during original state, bit array is an array comprising m position, and each is all set to 0, and the element of the most whole array was both configured to for 0 (as shown in Figure 5).
2) k independent hash function (for repeatedly Hash)
In order to express S={x1,x2,…,xnThe set characteristic information of a file (each element be equivalent to) of such a n element, bit array uses k separate hash function (Hash Function), they respectively will set in each element be mapped to 1 ..., in the scope of m}.
When we are toward when increasing any one element x in bit array, we use k hash function that X carries out Hash to obtain k cryptographic Hash, then bit corresponding in array is set to 1.The position hash that i.e. i-th hash function mapsiX () will be set to 1 (1≤i≤k).Note, if a position is repeatedly set to 1, then only for the first time can work, after will there is no any effect several times.In figure 6, k=3, and have two hash functions choose same position (from left side number the 5th, i.e. second " 1 " place).
3) judge whether element is present in bit array (that is, it is judged that whether some file is present in CDN node)
When judging whether element y belongs to this bit array, we have only to use k hash function to obtain k cryptographic Hash y, if all hashiY the position of () is all 1 (1≤i≤k), i.e. k position both is set to 1, so we are considered as y is the element (the most i.e. can determine that the file corresponding to element y is present in CDN node) in bit array, and being otherwise considered as y is not the element (the most i.e. can determine that in the no longer CDN node of the file corresponding to element y) in bit array.As it is shown in fig. 7, y1It it not the most the element (because y1 has at has pointed to " 0 " position) in bit array.y2Or belong to this bit array.
Here the unit of m from n is different, m be bit be unit, n is then in units of element number the number of different element (say accurately be).The generally length of individual element all has a lot of bit.So making the characteristic information storing file in aforementioned manners is the most all to save on internal memory.
Method in above-described embodiment can be used in CDN server and CDN control centre.
The embodiment of the present invention can be passed through hardware processor (hardware processor) and realize related function module.
It should be noted that, for aforesaid each method embodiment, in order to be briefly described, therefore it is all expressed as a series of action and merges, but those skilled in the art should know, the present invention is not limited by described sequence of movement, because according to the present invention, some step can use other orders or carry out simultaneously.Secondly, those skilled in the art also should know, embodiment described in this description belongs to preferred embodiment, necessary to involved action and the module not necessarily present invention.
In the above-described embodiments, the description to each embodiment all emphasizes particularly on different fields, and does not has the part described in detail, may refer to the associated description of other embodiments in certain embodiment.
As it is shown on figure 3, the schematic diagram of the data cached synchronization system for CDN system of one embodiment of the invention, including:
First hash module, for carrying out repeatedly Hash to determine the first blockette to the characteristic information of the file being buffered in CDN node;
Transmission module in data, for uploading described first blockette to control centre to revise the inquiry array in described control centre, wherein said inquiry array carries out file cache result queries for control centre.
The data cached synchronization system for CDN system of the present embodiment, Hash is carried out repeatedly to determine the first blockette by the characteristic information of first hash module file to being buffered in CDN node, and by transmission module in data, described first blockette is uploaded to control centre put for the numerical digit to be put in the first inquiry array determining control centre, determined by, numerical digit to be put puts number, generate the second inquiry array, thus only by uploading one group of numeral (the first blockette) with uniqueness determined by the characteristic information of the file of CDN node being carried out repeatedly Hash and be achieved that the synchronization of the information to cache file, decrease CDN node and upload synchrodata amount and workload;Simultaneously, owing to the information that synchronized also is to store with the form of digit order number in control centre, save memory space, and determine whether the corresponding positions that module also has only to when control centre is inquired about be determined by inquiry array is set to number and can complete inquiry by the second hash module and inquiry, so that inquiry also becomes quickness and high efficiency, improve the speed of the response to user access request, thus promote Consumer's Experience.
As shown in Figure 4, the schematic diagram of one embodiment of the invention, wherein, the first hash module includes:
Characteristic information determines unit, for determining the characteristic information of described file;
Hash calculation unit, for described characteristic information is carried out repeatedly Hash, each Hash all generates a numeral;
First blockette signal generating unit, is the first blockette for all stored digital that will generate.
Characteristic information is the character string in the title of described file or the MD5 value for described file.
The number of times that the characteristic information of the file of be buffered in CDN node carries out Hash is at least 8 times.
The present embodiment use hash algorithm the characteristic information of file carries out repeatedly Hash to be contained the first blockette of multiple numeral accordingly, for uniquely identifying this document, thus the data message of mark this document has been compressed to several numeral, greatly reduce the data volume that CDN node synchronizes to upload required for the fileinfo of local cache, and the reduction of the data volume owing to uploading, decrease the probability made mistakes in upload procedure (because it is inevitable the highest for the requirement of network environment to upload bigger file, upload less demanding to network environment of less file, therefore upload string number and be greatly reduced relative to the error probability uploading complete fileinfo).
System in above-described embodiment can be laid on CDN server and CDN control centre.
Embodiment of the method described above is only schematically, the wherein said unit illustrated as separating component can be or may not be physically separate, the parts shown as unit can be or may not be physical location, i.e. may be located at a place, or can also be distributed on multiple NE.Some or all of module therein can be selected according to the actual needs to realize the purpose of the present embodiment scheme.Those of ordinary skill in the art, in the case of not paying performing creative labour, are i.e. appreciated that and implement.
By the description of above embodiment, those skilled in the art is it can be understood that can add the mode of required general hardware platform by software to each embodiment and realize, naturally it is also possible to pass through hardware.Based on such understanding, the part that prior art is contributed by technique scheme the most in other words can embody with the form of software product, this computer software product can store in a computer-readable storage medium, such as ROM/RAM, magnetic disc, CD etc., including some instructions with so that a computer equipment (can be personal computer, server, or the network equipment etc.) perform the method described in some part of each embodiment or embodiment.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or computer program.Therefore, the form of the embodiment in terms of the present invention can use complete hardware embodiment, complete software implementation or combine software and hardware.And, the present invention can use the form at one or more upper computer programs implemented of computer-usable storage medium (including but not limited to disk memory and optical memory etc.) wherein including computer usable program code.
The present invention is to describe with reference to method, equipment (system) and the flow chart of computer program according to embodiments of the present invention and/or block diagram.It should be understood that can be by the flow process in each flow process in computer program instructions flowchart and/or block diagram and/or square frame and flow chart and/or block diagram and/or the combination of square frame.These computer program instructions can be provided to produce a machine to the processor of general purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device so that the instruction performed by the processor of computer or other programmable data processing device is produced for realizing the device of function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions may be alternatively stored in and can guide in the computer-readable memory that computer or other programmable data processing device work in a specific way, the instruction making to be stored in this computer-readable memory produces the manufacture including command device, and this command device realizes the function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame.These computer program instructions also can be loaded in computer or other programmable data processing device, make to perform sequence of operations step on computer or other programmable devices to produce computer implemented process, thus the instruction performed on computer or other programmable devices provides the step of the function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame for realization.
Last it is noted that above example is only in order to illustrate technical scheme, it is not intended to limit;Although the present invention being described in detail with reference to previous embodiment, it will be understood by those within the art that: the technical scheme described in foregoing embodiments still can be modified by it, or wherein portion of techniques feature is carried out equivalent;And these amendments or replacement, do not make the essence of appropriate technical solution depart from the spirit and scope of various embodiments of the present invention technical scheme.
Claims (8)
1. for a data cached synchronous method for CDN system, including:
The characteristic information of the file being buffered in CDN node is carried out repeatedly Hash to determine the first blockette;
Upload described first blockette to control centre to revise the inquiry array in described control centre, its
Described in inquire about array and carry out file cache result queries for control centre.
Method the most according to claim 1, wherein, the described file to being buffered in CDN node
Characteristic information carry out repeatedly Hash to determine that the first blockette includes:
Determine the characteristic information of described file;
Described characteristic information carries out repeatedly Hash, and each Hash all generates a numeral;
It is the first blockette by all stored digital of generation.
Method the most according to claim 1 and 2, wherein, described characteristic information is described file
Character string in title or be the MD5 value of described file.
Method the most according to claim 1 and 2, wherein, the literary composition to be buffered in CDN node
The characteristic information of part carries out the number of times of Hash and is at least 8 times.
5. for a data cached synchronization system for CDN system, including:
First hash module, for carrying out repeatedly Hash to the characteristic information of the file being buffered in CDN node
To determine the first blockette;
Transmission module in data, is used for uploading described first blockette to control centre to revise in described scheduling
Inquiry array in the heart, wherein said inquiry array carries out file cache result queries for control centre.
Method the most according to claim 6, wherein, described first hash module includes:
Characteristic information determines unit, for determining the characteristic information of described file;
Hash calculation unit, for how described characteristic information is carried out repeatedly Hash, each Hash all generates
One numeral;
First blockette signal generating unit, is the first blockette for all stored digital that will generate.
7. according to the system described in claim 5 or 6, wherein, described characteristic information is described file
Character string in title or be the MD5 value of described file.
8. according to the system described in claim 5 or 6, wherein, the literary composition to be buffered in CDN node
The characteristic information of part carries out the number of times of Hash and is at least 8 times.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610184232.6A CN105893468A (en) | 2016-03-28 | 2016-03-28 | Cache data synchronization method system for CDN system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610184232.6A CN105893468A (en) | 2016-03-28 | 2016-03-28 | Cache data synchronization method system for CDN system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN105893468A true CN105893468A (en) | 2016-08-24 |
Family
ID=57014439
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610184232.6A Pending CN105893468A (en) | 2016-03-28 | 2016-03-28 | Cache data synchronization method system for CDN system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105893468A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112291356A (en) * | 2020-11-02 | 2021-01-29 | 大连理工大学 | Self-verification variable name distributed storage method based on CNFS protocol |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102143212A (en) * | 2010-12-31 | 2011-08-03 | 华为技术有限公司 | Cache sharing method and device for content delivery network |
CN103888999A (en) * | 2012-12-19 | 2014-06-25 | 中国移动通信集团公司 | WebCache service and CDN service fusion method and device |
CN104933054A (en) * | 2014-03-18 | 2015-09-23 | 上海帝联信息科技股份有限公司 | Uniform resource locator (URL) storage method and device of cache resource file, and cache server |
-
2016
- 2016-03-28 CN CN201610184232.6A patent/CN105893468A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102143212A (en) * | 2010-12-31 | 2011-08-03 | 华为技术有限公司 | Cache sharing method and device for content delivery network |
CN103888999A (en) * | 2012-12-19 | 2014-06-25 | 中国移动通信集团公司 | WebCache service and CDN service fusion method and device |
CN104933054A (en) * | 2014-03-18 | 2015-09-23 | 上海帝联信息科技股份有限公司 | Uniform resource locator (URL) storage method and device of cache resource file, and cache server |
Non-Patent Citations (1)
Title |
---|
张永 等: "基于词频差异特征选取的Context Graph算法改进", 《计算机工程与应用》 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112291356A (en) * | 2020-11-02 | 2021-01-29 | 大连理工大学 | Self-verification variable name distributed storage method based on CNFS protocol |
CN112291356B (en) * | 2020-11-02 | 2022-01-04 | 大连理工大学 | Self-verification variable name distributed storage method based on CNFS protocol |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9740706B2 (en) | Management of intermediate data spills during the shuffle phase of a map-reduce job | |
Dong et al. | An optimized approach for storing and accessing small files on cloud storage | |
US10275489B1 (en) | Binary encoding-based optimizations at datastore accelerators | |
US8972986B2 (en) | Locality-aware resource allocation for cloud computing | |
US8442955B2 (en) | Virtual machine image co-migration | |
US8224804B2 (en) | Indexing of partitioned external data sources | |
US10909086B2 (en) | File lookup in a distributed file system | |
CN103581331B (en) | The online moving method of virtual machine and system | |
US9218136B2 (en) | Cloud scale directory services | |
US9348855B2 (en) | Supporting big data in enterprise content management systems | |
CN111324606B (en) | Data slicing method and device | |
CN102567312A (en) | Machine translation method based on distributive parallel computation framework | |
CN110347651A (en) | Method of data synchronization, device, equipment and storage medium based on cloud storage | |
CN109726004A (en) | A kind of data processing method and device | |
Elghamrawy et al. | A partitioning framework for Cassandra NoSQL database using Rendezvous hashing | |
CN106570113A (en) | Cloud storage method and system for mass vector slice data | |
US20090327303A1 (en) | Intelligent allocation of file server resources | |
US9760577B2 (en) | Write-behind caching in distributed file systems | |
US11157456B2 (en) | Replication of data in a distributed file system using an arbiter | |
CN110502472A (en) | A kind of the cloud storage optimization method and its system of large amount of small documents | |
CN109669987A (en) | A kind of big data storage optimization method | |
CN105893468A (en) | Cache data synchronization method system for CDN system | |
CN103108045A (en) | Web map service implementation method based on cloud framework | |
US9229659B2 (en) | Identifying and accessing reference data in an in-memory data grid | |
CN116842012A (en) | Method, device, equipment and storage medium for storing Redis cluster in fragments |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160824 |
|
WD01 | Invention patent application deemed withdrawn after publication |