CN103678523A - Distributed cache data access method and device - Google Patents
Distributed cache data access method and device Download PDFInfo
- Publication number
- CN103678523A CN103678523A CN201310624964.9A CN201310624964A CN103678523A CN 103678523 A CN103678523 A CN 103678523A CN 201310624964 A CN201310624964 A CN 201310624964A CN 103678523 A CN103678523 A CN 103678523A
- Authority
- CN
- China
- Prior art keywords
- server
- data block
- target data
- block index
- access
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0877—Cache access modes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/1824—Distributed file systems implemented using Network-attached Storage [NAS] architecture
- G06F16/1827—Management specifically adapted to NAS
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
An embodiment of the invention provides a distributed cache data access method and device. According to the method, a first server receives a first access request sent by a user, and the first access request carries a target data block index to be accessed; the first server determines a first hash value of the target data block index and determines a second server of storing the target data block index according to correspondence between the set hash value and the servers; the first server transmits a second access request carrying the target data block index to the second server, so that the second server queries a third server which caches corresponding data blocks of the target data block index, according to the correspondence between the set data block index and the servers; the first server receives access response transmitted by the second server, and the access response carries query results of the third server querying the cached target data blocks. Through the application of the distributed cache data access method and device, data access efficiency of clustered file systems is improved and the performances of the clustered file systems are improved.
Description
Technical field
The embodiment of the present invention relates to computer information technology field, relates in particular to a kind of distributed cache cache data access method and device.
Background technology
Along with the sharply expansion of every profession and trade data storage requirement and scale, the application of cluster storage system is also more and more extensive.Cluster network extra storage NAS(Network Attached Storage) system, as one of its Typical Representative, provides high-performance, large capacity, the high data access service of expanding to user.
In cluster NAS, conventionally by a server, preserve and manage the cache information in whole cluster NAS, in cluster NAS, any station server receives the cache information of the data that all can need to read or write to this cache management server queries after read request or write request.Yet, can cause like this inefficiency of cache management servers process access, thereby affect the performance of whole cluster file system.
Summary of the invention
The embodiment of the present invention provides a kind of distributed cache cache data access method and device, has improved the data access efficiency of cluster file system, improves the performance of cluster file system.
Embodiment of the present invention first aspect provides a kind of distributed cache cache data access method, comprising:
First server receives the first request of access that user sends, and carries the target data block index of access in described the first request of access;
Described first server is determined the first cryptographic hash that described target data block index is corresponding, and according to the cryptographic hash of setting and the corresponding relation of server, determines the second server of the described target data block index of storage that described the first cryptographic hash is corresponding;
Described first server sends the second request of access to described second server, in described the second request of access, carry described target data block index, so that described second server is according to the data block index of setting and the corresponding relation of server, the 3rd server of target data block index corresponding data piece described in query caching;
Described first server receives the access response that described second server sends, and carries the Query Result of the 3rd server of target data block described in query caching in described access response.
In the possible embodiment of the first of first aspect, described Query Result is the sign of described the 3rd server, after described first server receives the access response of described second server transmission, also comprise: described first server sends the 3rd request of access according to the sign of described the 3rd server to described the 3rd server, in described the 3rd request of access, carry described target data block index, so that described the 3rd server is accessed the described data block that described target data block index is corresponding in local cache cache, so that described the 3rd server returns to described target data block, or,
Described Query Result is used to indicate the 3rd server that does not have the data block that target data block index is corresponding described in buffer memory in cluster service system, after described first server receives the access response of described second server transmission, also comprise: described first server sends the 4th request of access to the rear end disk array in described cluster service system, in described the 4th request of access, carry described target data block index, so that described rear end disk array is accessed data block corresponding to described target data block index, so that described the 3rd server returns to described target data block.
In conjunction with the possible embodiment of the first of first aspect or first aspect, in the possible implementation of the second of first aspect, if the request of described the first request of access for data block corresponding to described target data block index write, described first server, by after data-block cache corresponding to described target data block index is in local cache, also comprises:
Described first server, according to described the first request of access, is rewritten as target data block by data block corresponding to described target data block index in local cache;
Described first server sends the second update request to described second server, described the second update request is used to indicate described first server, in local cache, data block corresponding to described target data block index is rewritten as to target data block, so that described second server upgrades the corresponding relation of described data block index and server;
Described first server sends Indication message to described second server, and described Indication message is used to indicate data block corresponding to described target data block index that described second server is notified described the 3rd server to delete to store in local cache.
In conjunction with the first of first aspect or any the possible embodiment in the second, in the third possible embodiment of first aspect, described target data block also comprises after returning to described first server:
Described first server by data-block cache corresponding to described target data block index in local cache, described first server sends the first update request to described second server, described the first update request be used to indicate described first server by data-block cache corresponding to described target data block index in local cache, so that described second server upgrades the corresponding relation of described data block index and server.
Embodiment of the present invention second aspect provides a kind of distributed cache cache data access method, comprising:
Second server receives the second request of access that first server sends, and in described the second request of access, carries target data block index;
Described second server is according to the data block index of setting and the corresponding relation of server, the 3rd server of target data block index corresponding data piece described in query caching;
Described second server sends access response to described first server, carries the Query Result of described the 3rd server of target data block described in query caching in described access response.
In the possible embodiment of the first of second aspect, described second server sends described access response to described first server, carries the Query Result of described the 3rd server of target data block described in query caching in described access response, comprising:
Described Query Result is used to indicate the sign of described the 3rd server of the data block that in cluster service system, described in buffer memory, target data block index is corresponding; Or,
Described Query Result is used to indicate the 3rd server that does not have the data block that target data block index is corresponding described in buffer memory in cluster service system.
In conjunction with the possible embodiment of the first of second aspect or second aspect, in the possible implementation of the second of second aspect, if the request of described the first request of access for data block corresponding to described target data block index write also comprises:
Described second server is after described first server sends access response, described second server receives the Indication message that described first server sends, and described Indication message is used to indicate data block corresponding to described target data block index that described second server is notified described the 3rd server to delete to store in local cache;
Described second server receives the first update request that described first server sends, described the first update request be used to indicate described first server by data-block cache corresponding to described target data block index in local cache, so that described second server upgrades the corresponding relation of described data block index and server.
The embodiment of the present invention third aspect provides a kind of distributed cache cache data access method, comprising:
The 3rd server receives the 3rd request of access that first server sends, and in described the 3rd request of access, carries target data block index;
Described the 3rd server is accessed the described data block that described target data block index is corresponding in local cache cache;
Described the 3rd server sends data block corresponding to described target data block index to described first server;
Fourth aspect present invention provides a kind of distributed cache cache DAA, comprising:
The first receiver module, the first request of access of sending for receiving user, carries the target data block index of access in described the first request of access;
Determination module, for determining the first cryptographic hash corresponding to described target data block index, and according to the cryptographic hash of setting and the corresponding relation of server, determines the second server of the described target data block index of storage that described the first cryptographic hash is corresponding;
The first sending module, for sending the second request of access to described second server, in described the second request of access, carry described target data block index, so that described second server is according to the data block index of setting and the corresponding relation of server, the 3rd server of target data block index corresponding data piece described in query caching;
The second receiver module, the access response sending for receiving described second server, carries the Query Result of the 3rd server of target data block described in query caching in described access response.
In the possible embodiment of the first of fourth aspect, the second sending module, being used for is the sign of described the 3rd server at described Query Result, after receiving the access response of described second server transmission, according to the sign of described the 3rd server, to described the 3rd server, send the 3rd request of access, in described the 3rd request of access, carry described target data block index, so that described the 3rd server is accessed the described data block that described target data block index is corresponding in local cache cache, so that described the 3rd server returns to described target data block, or,
For described Query Result, be used to indicate the 3rd server that cluster service system does not exist the data block that target data block index is corresponding described in buffer memory, after receiving the access response of described second server transmission, also comprise: the rear end disk array in described cluster service system sends the 4th request of access, in described the 4th request of access, carry described target data block index, so that described rear end disk array is accessed data block corresponding to described target data block index, so that described the 3rd server returns to described target data block.
In conjunction with the possible embodiment of the first of fourth aspect or fourth aspect, in the possible implementation of the second of fourth aspect, if the request of described the first request of access for data block corresponding to described target data block index write, by after data-block cache corresponding to described target data block index is in local cache, described the second receiver module also for:
According to described the first request of access, in local cache, data block corresponding to described target data block index is rewritten as to target data block;
To described second server, send the second update request, described the second update request is used to indicate described first server, in local cache, data block corresponding to described target data block index is rewritten as to target data block, so that described second server upgrades the corresponding relation of described data block index and server;
To described second server, send Indication message, described Indication message is used to indicate data block corresponding to described target data block index that described second server is notified described the 3rd server to delete to store in local cache.
In conjunction with any possible embodiment in first or the second of fourth aspect, in the third possible embodiment of fourth aspect, also comprise processing module:
For by data-block cache corresponding to described target data block index at local cache, to described second server, send the first update request, described the first update request is used to indicate data-block cache corresponding to described target data block index in local cache, so that described second server upgrades the corresponding relation of described data block index and server.
Fifth aspect present invention provides a kind of distributed cache cache DAA, comprising:
Receiver module, the second request of access sending for receiving first server, carries target data block index in described the second request of access;
Enquiry module, for according to the data block index of setting and the corresponding relation of server, the 3rd server of target data block index corresponding data piece described in query caching;
Sending module, for sending access response to described first server, carries the Query Result of described the 3rd server of target data block described in query caching in described access response.
In the possible embodiment of the first aspect the 5th, describedly to described first server, send described access response, in described access response, carry the Query Result of described the 3rd server of target data block described in query caching, comprising:
Described Query Result is used to indicate the sign of described the 3rd server of the data block that in cluster service system, described in buffer memory, target data block index is corresponding; Or,
Described Query Result is used to indicate the 3rd server that does not have the data block that target data block index is corresponding described in buffer memory in cluster service system.
In conjunction with the possible embodiment of the first of the 5th aspect or the 5th aspect, in the possible implementation of the second aspect the 5th, also comprise processing module:
For after described first server sends access response, receive the Indication message that described first server sends, described Indication message is for notifying described the 3rd server to delete data block corresponding to described target data block index that local cache stores;
The first update request sending for receiving described first server, described the first update request be used to indicate described first server by data-block cache corresponding to described target data block index in local cache, so that described processing module is upgraded the corresponding relation of described data block index and server.
Sixth aspect present invention provides a kind of distributed cache cache DAA, comprising:
Receiver module, the 3rd request of access sending for receiving first server, carries target data block index in described the 3rd request of access;
Processing module, for accessing the described data block that described target data block index is corresponding at local cache cache;
Sending module, for sending data block corresponding to described target data block index to described first server.
Embodiment of the present invention distributed cache cache data access method and device, by data block index distributed caching in each server of group system, and by data block distributed storage in each server of group system, after receiving user's request of access, first according to data block index calculation cryptographic hash, according to cryptographic hash and server corresponding relation, determine the server of storing data block index, to this server request, obtain again the server identification of caching data block, the server of storage data block index can find according to the corresponding relation of data block index and server the server identification of caching data block, thereby can the operation of executing data block access.Improve the data access efficiency of cluster file system, improved the performance of cluster file system.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, by the accompanying drawing of required use in embodiment or description of the Prior Art being done to one, introduce simply below, apparently, accompanying drawing in the following describes is some embodiments of the present invention, for those of ordinary skills, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Figure 1 shows that the networking layout structure schematic diagram of cluster NAS system;
Fig. 2 is distributed cache cache data access method embodiment provided by the invention mono-process flow diagram;
Fig. 3 is the process flow diagram of distributed cache cache data access method embodiment bis-provided by the invention
Fig. 4 is the process flow diagram of distributed cache cache data access method embodiment tri-provided by the invention;
Fig. 5 is the schematic diagram of distributed cache cache data access method embodiment tetra-provided by the invention;
Fig. 6 is the schematic diagram of distributed cache cache data access method embodiment five provided by the invention;
Fig. 7 is the schematic diagram of distributed cache cache data access method embodiment six provided by the invention;
Fig. 8 is the schematic diagram of distributed cache cache data access method embodiment seven provided by the invention;
Fig. 9 is the schematic diagram of distributed cache cache DAA embodiment mono-provided by the invention;
Figure 10 is the schematic diagram of distributed cache cache DAA embodiment bis-provided by the invention;
Figure 11 is the schematic diagram of distributed cache cache DAA embodiment tri-provided by the invention;
Embodiment
For making object, technical scheme and the advantage of the embodiment of the present invention clearer, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is the present invention's part embodiment, rather than whole embodiment.Embodiment based in the present invention, those of ordinary skills, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.
The networking layout structure schematic diagram that Figure 1 shows that cluster NAS system, cluster NAS system has operating system and the cluster file system of oneself, and by network file, shares agreement the access services of file data is provided to user.As shown in Figure 1, operating system, cluster file system, network file share agreement as running software on each server head of cluster NAS system.Wherein cluster file system has been responsible for Organization layout and the Access Management Access of the file data of whole cluster NAS system.
Fig. 2 is distributed cache cache data access method embodiment provided by the invention mono-process flow diagram; Concrete flow process is as follows:
S101: first server receives the first request of access that user sends, and carries the target data block index of access in the first request of access;
User sends the first request of access to first server, the first request of access is to read data block request corresponding to described target data block index, or be the request that data block corresponding to target data block index write, in cluster file system, each data block has the unique data block index in this system, such as, can be disk offset address or the logical address of target data block.
S102: first server is determined the first cryptographic hash that target data block index is corresponding, and according to the cryptographic hash of setting and the corresponding relation of server, determine the second server of the storage target data block index that the first cryptographic hash is corresponding;
During user's access file system data, to first server, send the first request of access, first server can utilize target data block index to search in local cache, checks whether buffer memory in cache of target data.If exist, direct data block corresponding to access destination data block index in local cache of first server.If buffer memory in local cache, does not utilize target data block index value to do a Hash (hash) computing, obtain the hash value that target database index is corresponding, this hash value can be the numerical value of 10; Then utilize this hash value to go to search hash value to the corresponding relation of server, find the server of management objectives data-block cache information, namely second server.Wherein, the cryptographic hash of setting and the corresponding relation of server can be the corresponding relations of cryptographic hash and server ID.
S103: first server sends the second request of access to second server, in the second request of access, carry target data block index, so that second server is according to the data block index of setting and the corresponding relation of server, the 3rd server of query caching target data block index corresponding data piece;
Wherein, second server is for storing the server of target data block index, and the second request of access that first server sends to second server is for the ID of the 3rd server of query caching target data block.Second server can be searched according to the data block index of setting and the corresponding relation of server.
It should be noted that, second server and the 3rd server can be same servers, can be also different servers.
S104: first server receives the access response that second server sends, carries the Query Result of the 3rd server of target data block described in query caching in access response.
If inquiring in system, second server there is the 3rd server that is cached with target data block, Query Result is the sign of the 3rd server, after first server receives the access response of second server transmission, first server sends the 3rd request of access according to the sign of the 3rd server to the 3rd server, in the 3rd request of access, carry described target data block index, so that the 3rd server data block corresponding to access destination data block index in local cache, and to first server return data, process first server the most at last target data returns to user.Above-mentioned access can be to read the data block that target data block index is corresponding, can be also data block corresponding to target data block index carried out to write operation.
If second server inquires and does not have the 3rd server that is cached with target data block in system, in the result indication cluster service system of inquiry, there is not the 3rd server of the data block that target data block index is corresponding described in buffer memory, after first server receives the access response of second server transmission, first server sends the 4th request of access to the rear end disk array in cluster service system, in the 4th request of access, carry target data block index, so that rear end disk array is accessed data block corresponding to described target data block index.
In the present embodiment, for each query manipulation in embodiment illustrated in fig. 1, be elaborated.
Wherein, in S102, first first server can utilize target data block index value to carry out a hash computing, obtains a hash value; Then utilize this hash value to remove to search the corresponding relation of hash value and server, this corresponding relation can adopt mapping table form as shown in table 1 below, can find corresponding server ID according to this table 1, on this server, preserve and manage the cache information of this data block.
| Hash value | Server ID |
| X1 | 1 |
| X2 | 1 |
| X3 | 2 |
| X4 | 2 |
| … | … |
| Xn | N |
The mapping table of table 1 hash value and server ID
The corresponding relation of hash value and server, above-mentioned table 1 can be kept in each server of cluster file system, and the content of preserving on each server is all identical.Above-mentioned corresponding relation can build when cluster file system is set up, and when the server number of cluster file system changes, this corresponding relation on each server also can dynamically be adjusted.The cache information of the data block of whole cluster file system is distributed in whole cluster and manages, and each data block can find unique server to manage.
According to above-mentioned steps, utilize hash value to inquire corresponding server, namely second server.After inquiring the management server second server of target data block, first server sends request of access to second server, the 3rd server of query caching data, according to step S103, wherein the mapping relations of target data block index value and caching server can adopt and represent as the form of following table 2, the ID that can obtain caching server by inquiry, wherein the caching server of buffer memory target data block can be one or more.
The 3rd server mappings relation of target data block and buffer memory target data block is as follows:
| Target data block index value | Caching server ID |
| XXXX1 | 1、2、3 |
| XXXX2 | 2 |
| XXXX3 | 3 |
| … | ? |
| XXXXn | 2、N |
Table 2 target data block index value and caching server ID mapping table
If a target data block is only by a server buffer, a corresponding caching server only, in upper table 2, only has a corresponding server ID, if target data block by a plurality of users when different server is accessed, these data may be buffered in a plurality of servers, corresponding caching server corresponding to target data block can have a plurality of, i.e. corresponding a plurality of server ID in upper table 2.
By above-mentioned Query Result, first server sends request of access to the 3rd server, and the 3rd server need to be accessed corresponding target data block in local cache, and returns to first server.After receiving the target data block returning, first server also needs to manage the data buffer storage information on book server, when a target data block is buffered in the data cache of book server, first server need to increase in this locality a management item, show this data block buffer memory on book server, and No. ID of the server of this data block of record management.After data are eliminated by local cache, delete corresponding local cache management information.
Be that each server needs to manage local cache information, for example, can safeguard that one as the data buffer storage local management information table of table 3.
| Target data block index value | The server ID of data block ownership cache manager |
| XXXX1 | 1 |
| XXXX2 | 1 |
| XXXX3 | 3 |
| XXXX4 | 2 |
| … | … |
| XXXXn | N |
Table 3 target data block local cache management information table
When if user accesses a certain target data block to certain first server in system, first can in this local management information table, inquire about, if inquire the relevant information of this target data block, show these data buffer memory available on book server, directly in local data cache, obtain corresponding data and offer user's access.
If do not inquire in local management information table, need to initiate inquiry to the server of this target data block of management.If inquire the cache information of target data block on the server of management objectives data block, directly according to cache information, to the server of this target data block of buffer memory, send data access request, obtain target data block, and more this data block of new management management information and the cache cache information of home server; If the server of management objectives data block does not inquire the cache management information of target data block yet, first server is read in data from disk array, and increase management item in local management information table, and send synchronization message to the server of this target data block of management, upgrade its cache management information.
The distributed cache Cache data access method that the present embodiment provides, by data block index distributed caching in each server of group system, and by data block distributed storage in each server of group system, after receiving user's request of access, first according to data block index calculation cryptographic hash, according to cryptographic hash and server corresponding relation, determine the server of storing data block index, to this server request, obtain again the server identification of caching data block, the server of storage data block index can find according to the corresponding relation of data block index and server the server identification of caching data block, thereby can the operation of executing data block access.Improve the data access efficiency of cluster file system, improved the performance of cluster file system.
Fig. 3 is the process flow diagram of distributed cache cache data access method embodiment bis-provided by the invention.Concrete step is as follows:
S201: second server receives the second request of access that first server sends, and carries target data block index in the second request of access;
Wherein, first server receives the first request of access of user, request access target data block, according to target data block index calculation, go out corresponding hash value, inquire the second server of management objectives data block storage information, send the second request of access, in the second request of access that second server receives, carry target data block index.
S202: second server is according to the data block index of setting and the corresponding relation of server, the 3rd server of query caching target data block index corresponding data piece;
It should be noted that, second server and the 3rd server can be same servers, can be also different servers.
S203: second server sends access response to first server, carries the Query Result of the 3rd server of query caching target data block in access response.
If inquiring in system, second server there is the 3rd server that is cached with target data block, Query Result is the sign of the 3rd server, if second server inquires and do not have the 3rd server that is cached with target data block in system, in the result of inquiry indication cluster service system, there is not the 3rd server of the data block that target data block index is corresponding described in buffer memory.
On basis embodiment illustrated in fig. 2, the main operation of the second server that the present embodiment provides, is elaborated to the concrete query manipulation shown in Fig. 3.
First server is utilized target data block index calculation hash value, searches corresponding with it server, and this corresponding relation can pass through mapping table, or database form represents.
Second server receives after the second request of access of first server, according to step S202, and wherein target data block index and cache database, namely the corresponding relation of the 3rd server can represent by form, as shown in Figure 2 the method in embodiment.
Wherein, if the first request of access is write data requests, second server also needs to receive the Indication message that first server sends, Indication message is used to indicate data block corresponding to target data block index that second server is notified the 3rd server to delete to store in local cache, and second server receives the first update request that first server sends, indication first server by data-block cache corresponding to described target data block index in local cache, so that the second server corresponding relation of new data block index and server more.
The distributed cache cache data access method that the present embodiment provides, corresponding with the method that Fig. 2 of the present invention provides, by data block index distributed caching in each server of group system, and by data block distributed storage in each server of group system, after receiving user's request of access, first according to data block index calculation cryptographic hash, according to cryptographic hash and server corresponding relation, determine the server of storing data block index, to this server request, obtain again the server identification of caching data block, the server of storage data block index can find according to the corresponding relation of data block index and server the server identification of caching data block, thereby can the operation of executing data block access.Improve the data access efficiency of cluster file system, improved the performance of cluster file system.
Fig. 4 is the process flow diagram of distributed cache cache data access method embodiment tri-provided by the invention.Concrete step is as follows:
S301: the 3rd server receives the 3rd request of access that first server sends, and carries target data block index in the 3rd request of access;
S302: the 3rd server is data block corresponding to access destination data block index in local cache; The 3rd server is according to index value access destination data block in local cache of the target data block receiving.
S303: the 3rd server sends data block corresponding to target data block index to first server.
If the first request of access is request that data block corresponding to target data block index write, and Query Result is the sign of the 3rd server, also comprises:
The 3rd server receives the notice of second server, and the data block corresponding to target data block index of storing in local cache deleted in indication.
Optionally, also comprise: the 3rd server receives cluster service system server number change Indication message; The 3rd server is stored to the data block of buffer memory in local cache in the disk array of rear end; The 3rd server, according to cluster service system server number change Indication message, upgrades the corresponding relation of cryptographic hash and server.
The distributed cache cache data access method that the present embodiment provides, with Fig. 2 of the present invention, the method that Fig. 3 provides is corresponding, by data block index distributed caching in each server of group system, and by data block distributed storage in each server of group system, after receiving user's request of access, first according to data block index calculation cryptographic hash, according to cryptographic hash and server corresponding relation, determine the server of storing data block index, to this server request, obtain again the server identification of caching data block, the server of storage data block index can find according to the corresponding relation of data block index and server the server identification of caching data block, thereby can the operation of executing data block access.Improve the data access efficiency of cluster file system, improved the performance of cluster file system.
Fig. 5 is the schematic diagram of distributed cache cache data access method embodiment tetra-provided by the invention.On basis embodiment illustrated in fig. 3, the first request of access that the present embodiment provides user to send to first server is read request, and corresponding target data block is buffered under the enforcement scene in the cache of other servers, the embodiment of distributed cache cache data access method.Concrete steps are as follows:
401: user sends the first request of access to first server, in this first request of access, carry the target data block index reading;
402: first server is calculated the first cryptographic hash that this target data block is corresponding, by according to the cryptographic hash of setting and the corresponding relation of server, determine the second server of the storage target data block index that this first cryptographic hash is corresponding;
403: first server sends the second request of access to second server, this second request of access is carried target data block index;
404: second server is according to the data block index of setting and the corresponding relation of server, the 3rd server of this target data block index correspondence target data block of query caching.
Optionally, second server is also cached with target data block in can increasing first server in the management information (table 2 in example embodiment as shown in Figure 3) of this target data;
405: second server is to first server backward reference response, the sign of carrying the 3rd server of buffer memory target data block in this access response;
406: first server sends read data request to the 3rd server;
Three server lookups in 407: the are buffered in local cache to target data block;
Within 408: the, three servers read the target data block that this target data block index is corresponding in local cache;
Within 409: the, three servers return to first server by target data block corresponding to target data block index.
410: the management information of this target data block that first server has increased a local cache;
411: first server by data buffer storage in first server data cache;
412: first server returns to user by target data block corresponding to target data block index.
The distributed cache Cache data access method that the present embodiment provides, data are when other server buffer, after receiving user's request of access, calculate cryptographic hash, according to cryptographic hash and server corresponding relation, determine the second server of storage data block index, then to the 3rd server identification of second server acquisition request caching data block, then obtain target data block to the 3rd server, improve the data access efficiency of cluster file system, improved the performance of cluster file system.
Fig. 6 is the schematic diagram of distributed cache cache data access method embodiment five provided by the invention, on basis embodiment illustrated in fig. 3, the first request of access that the present embodiment provides user to send to first server is read request, and corresponding target data block is on each server all under the enforcement scene without buffer memory, the embodiment of distributed cache cache data access method.Concrete steps are as follows:
501: user sends the first request of access to first server, in this first request of access, carry the target data block index that will read;
502: first server is calculated the first cryptographic hash that this target data block is corresponding, according to the corresponding relation of the fixed cryptographic hash of equipment and server, determine the second server of the storage target data block index that this first cryptographic hash is corresponding;
503: first server sends the second request of access to second server, in this second request of access, carry target data block index;
504: second server, according to the data block index of setting and the corresponding relation of server, does not inquire the 3rd server of the corresponding target data block of this target data block index of buffer memory;
Second server is cached with this target data block in can increasing first server in the management information (table 2 in example embodiment as shown in Figure 3) of this target data;
505: second server is to first server backward reference response, and indication is without the cache information of this target data block;
506: first server is at rear end disk array reading out data, and be buffered in the cache of first server;
507: the management information of this target data block that first server has increased a local cache;
508: first server returns to user by data block corresponding to target data block index.
The distributed cache Cache data access method that the present embodiment provides, data are not when arbitrary server buffer, second server increases the management information that target data is buffered in first server, first server returns to user from rear end disk access target data block, has improved the data access efficiency of cluster file system.
Fig. 7 is the schematic diagram of distributed cache cache data access method embodiment six provided by the invention.On basis embodiment illustrated in fig. 3, the first request of access that the present embodiment provides user to send to first server is write request, and be under the enforcement scene of new writen data, when data are newly write, because equal buffer memory target data not on each server, first server is directly added local cache target data block management information, first server sends the first update request to second server, the first update request indication first server by data-block cache corresponding to target data block index in local cache, so that the second server corresponding relation of new data block index and server more, concrete steps are as follows:
601: user sends the first request of access to first server, this first request of access is write request, carries target data block index and target data block;
602: according to the embodiment described in Fig. 3, in inquiry system, equal this target data block of buffer memory not of each server, is new writen data request;
603: first server is the management server to target data block by target data block search index, it is second server, send the first update request, inform that second server target data block is buffered in first server, so that second server new administration information more;
604: the management information of this target data block that first server has increased local cache;
605 first servers inform that user runs succeeded.
The distributed cache Cache data access method that the present embodiment provides, newly write target data block, second server increases the management information that target data is buffered in first server, and first server increases local cache, reduce data cached complexity, avoid Single Point of Faliure.
Fig. 8 is the process flow diagram of distributed cache cache data access method embodiment seven provided by the invention.On basis embodiment illustrated in fig. 3, the first request of access that the present embodiment provides user to send to first server is write request, and write under the enforcement scene of (modification is write) for revising the covering of legacy data, covering is write flow process and has in fact been covered and read flow process, before writing data, reality is read in old data block, so necessarily have the management information of this data block in first server.When data block writes first server cache, first server is to the management server of this data block, be that second server device sends Indication message, data block corresponding to target data block index that the 3rd server of indicating second server notice to be cached with this data block is deleted local cache.First server also needs to send the second update request to second server, in indication first server cache, data block corresponding to target data block index is rewritten as to target data block, so that the second server corresponding relation of new data block index and server more.Concrete steps are as follows:
701: user sends the first request of access to first server, this first request of access is write request, carries target data block index and target data block;
702: according to the index value of target data block, inquire in local cache and have buffer memory, for covering, write data, it is consistent that reading out data is caught up with the process that reads shown in Fig. 4 of stating;
703: first server by target data block search index to the management server of target data block, i.e. second server, transmission the second update request, informs that second server target data block revises, so that second server new administration information more;
704: second server device sends Indication message, data block corresponding to target data block index that the 3rd server of indicating second server notice to be cached with this data block is deleted local cache;
705: the management information of this target data block that first server has increased local cache;
706: first server informs that user runs succeeded.
Wherein, when data-block cache need to be eliminated from first server cache, can delete the local management information of this data block, first server can be notified second server simultaneously, makes its more new administration information.
The distributed cache Cache data access method that the present embodiment provides, target data block is write in covering, second server increases the management information that target data is buffered in first server, and notify the 3rd server to delete data block corresponding to target data block index, first server is upgraded local cache, reduce data cached complexity, avoid Single Point of Faliure, improve access efficiency.
Further, except the read-write operation of data block in above-mentioned each embodiment, number of servers changes, and can cause hash value to change to the mapping table of server ID, thereby have influence on the management server of data.Server count changes to be divided into and increases and reduce, and processing procedure is all identical:
First server receives cluster service system server number change Indication message; First server is stored to the data block of buffer memory in local cache in the disk array of rear end; First server, according to cluster service system server number change Indication message, is upgraded the corresponding relation of cryptographic hash and server.
The distributed cache cache data access method proposing in the present embodiment, by data block index distributed caching in each server of group system, and by data block distributed storage in each server of group system, and the dynamic change of back-level server quantity, improve the data access efficiency of cluster file system, improved the performance of cluster file system.
Fig. 9 is distributed cache cache DAA embodiment provided by the invention mono-schematic diagram, comprising:
The first receiver module 91, the first request of access of sending for receiving user, carries the target data block index of access in the first request of access;
The first sending module 93, for sending the second request of access to second server, in the second request of access, carry target data block index, so that second server is according to the data block index of setting and the corresponding relation of server, the 3rd server of query caching target data block index corresponding data piece;
The second receiver module 94, for receiving the access response of second server transmission, carries the Query Result of the 3rd server of query caching target data block in access response.
Optionally, before determining the first cryptographic hash that target data block index is corresponding, determination module 92 also for:
In local data block cache information, search and whether have target data block index;
If exist, data block corresponding to access destination data block index in local cache cache.
Optionally, also comprise:
The second sending module 95, being used for is the sign of the 3rd server at Query Result, after receiving the access response of second server transmission, according to the sign of the 3rd server, to the 3rd server, send the 3rd request of access, in the 3rd request of access, carry target data block index, so that the 3rd server data block corresponding to access destination data block index in local cache cache; Or,
For Query Result, be used to indicate the 3rd server that cluster service system does not exist the data block that buffer memory target data block index is corresponding, after receiving the access response of second server transmission, also comprise: the rear end disk array in cluster service system sends the 4th request of access, in the 4th request of access, carry target data block index, so that data block corresponding to rear end disk array access destination data block index.
Optionally, comprising:
The first request of access is to read the data block request that target data block index is corresponding, or the request for data block corresponding to target data block index write.
Optionally, according to the sign of the 3rd server after the 3rd server sends the 3rd request of access, the second sending module 95 also for:
Receive data block corresponding to target data block index that the 3rd server returns;
The data block that target data block index is corresponding returns to user.
Optionally, also comprise:
Optionally, after the rear end disk array in cluster service system sends the 4th request of access, the second sending module 95 also for:
Receive data block corresponding to target data block index that rear end disk array returns;
The data block that target data block is corresponding returns to user.
Optionally, processing module 96 also for: after receiving the data block that target data block index that rear end disk array returns is corresponding, data-block cache corresponding to target data block index, in local cache, and is added into target data block index in the local data block cache information of first server.
Optionally, if the first request of access is request that data block corresponding to target data block index write, by after data-block cache corresponding to target data block index is in local cache, processing module 96 also for:
According to the first request of access, in local cache, data block corresponding to target data block index is rewritten as to target data block.
Optionally, if the first request of access is request that data block corresponding to target data block index write, and Query Result is the sign of the 3rd server, after receiving the access response that second server sends, the second receiver module 94 also for:
To second server, send Indication message, Indication message is used to indicate data block corresponding to target data block index that second server is notified the 3rd server to delete to store in local cache.
Optionally, after data-block cache corresponding to target data block index is in local cache, processing module 96 also for:
To second server, send the first update request, the first update request be used to indicate first server by data-block cache corresponding to target data block index in local cache, so that the second server corresponding relation of new data block index and server more.
Optionally, according to the first request of access, after data block corresponding to target data block index being rewritten as to target data block in local cache, processing module 96 also for:
To second server, send the second update request, the second update request is used to indicate first server, in local cache, data block corresponding to target data block index is rewritten as to target data block, so that the second server corresponding relation of new data block index and server more.
Optionally, processing module 96 also for:
Receive cluster service system server number change Indication message;
The data block of buffer memory in local cache is stored in the disk array of rear end;
According to cluster service system server number change Indication message, upgrade the corresponding relation of cryptographic hash and server.
The distributed cache cache management devices that the present embodiment provides, corresponding with the method that Fig. 1-Fig. 8 of the present invention provides, for the technical scheme shown in execution graph 1-Fig. 8, method, principle and technique effect can, referring to embodiment of the method, repeat no more herein.
Figure 10 is distributed cache cache DAA embodiment provided by the invention bis-schematic diagram, comprising:
Receiver module 101, the second request of access sending for receiving first server, carries target data block index in the second request of access;
Enquiry module 102, for according to the data block index of setting and the corresponding relation of server, the 3rd server of query caching target data block index corresponding data piece;
Sending module 103, for sending access response to first server, carries the Query Result of the 3rd server of query caching target data block in access response.
Optionally, to first server, send access response, in access response, carry the Query Result of the 3rd server of query caching target data block, comprising:
Query Result is used to indicate the sign of the 3rd server of the data block that in cluster service system, buffer memory target data block index is corresponding; Or,
Query Result is used to indicate the 3rd server that does not have the data block that buffer memory target data block index is corresponding in cluster service system.
Optionally, also comprise:
Processing module 104, if the request for the first request of access for data block corresponding to target data block index write, after first server sends access response, receive the Indication message that first server sends, Indication message is used to indicate data block corresponding to target data block index that second server is notified the 3rd server to delete to store in local cache.
Optionally, processing module 104 also for:
Receive the first update request that first server sends, the first update request be used to indicate first server by data-block cache corresponding to target data block index in local cache, so that the second server corresponding relation of new data block index and server more.
Optionally, processing module 104 also for:
Receive cluster service system server number change Indication message;
The data block of buffer memory in local cache is stored in the disk array of rear end;
According to cluster service system server number change Indication message, upgrade the corresponding relation of cryptographic hash and server.
The distributed cache cache management devices that the present embodiment provides, corresponding with the method that Fig. 1-Fig. 8 of the present invention provides, for the technical scheme shown in execution graph 1-Fig. 8, method, principle and technique effect can, referring to embodiment of the method, repeat no more herein.
Figure 11 is distributed cache cache DAA embodiment provided by the invention tri-schematic diagram, comprising:
Sending module 113, for sending data block corresponding to target data block index to first server.
Optionally, if the first request of access is request that data block corresponding to target data block index write, and Query Result is the sign of the 3rd server, receiver module 131 also for:
The notice that receives second server is deleted the data block corresponding to target data block index of storing in local cache.
Optionally, processing module 112 also for:
Receive cluster service system server number change Indication message;
The data block of buffer memory in local cache is stored in the disk array of rear end;
According to cluster service system server number change Indication message, upgrade the corresponding relation of cryptographic hash and server.
The distributed cache cache management devices that the present embodiment provides, corresponding with the method that Fig. 1-Fig. 8 of the present invention provides, for the technical scheme shown in execution graph 1-Fig. 8, method, principle and technique effect can, referring to embodiment of the method, repeat no more herein.
One of ordinary skill in the art will appreciate that: all or part of step that realizes above-mentioned each embodiment of the method can complete by the relevant hardware of programmed instruction.Aforesaid program can be stored in a computer read/write memory medium.This program, when carrying out, is carried out the step that comprises above-mentioned each embodiment of the method; And aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CDs.
Finally it should be noted that: each embodiment, only in order to technical scheme of the present invention to be described, is not intended to limit above; Although the present invention is had been described in detail with reference to aforementioned each embodiment, those of ordinary skill in the art is to be understood that: its technical scheme that still can record aforementioned each embodiment is modified, or some or all of technical characterictic is wherein equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution depart from the scope of various embodiments of the present invention technical scheme.
Claims (16)
1. a distributed cache cache data access method, is characterized in that, comprising:
First server receives the first request of access that user sends, and carries the target data block index of access in described the first request of access;
Described first server is determined the first cryptographic hash that described target data block index is corresponding, and according to the cryptographic hash of setting and the corresponding relation of server, determines the second server of the described target data block index of storage that described the first cryptographic hash is corresponding;
Described first server sends the second request of access to described second server, in described the second request of access, carry described target data block index, so that described second server is according to the data block index of setting and the corresponding relation of server, the 3rd server of target data block index corresponding data piece described in query caching;
Described first server receives the access response that described second server sends, and carries the Query Result of the 3rd server of target data block described in query caching in described access response.
2. method according to claim 1, it is characterized in that, described Query Result is the sign of described the 3rd server, after described first server receives the access response of described second server transmission, also comprise: described first server sends the 3rd request of access according to the sign of described the 3rd server to described the 3rd server, in described the 3rd request of access, carry described target data block index, so that described the 3rd server is accessed the described data block that described target data block index is corresponding in local cache cache, so that described the 3rd server returns to described target data block, or,
Described Query Result is used to indicate the 3rd server that does not have the data block that target data block index is corresponding described in buffer memory in cluster service system, after described first server receives the access response of described second server transmission, also comprise: described first server sends the 4th request of access to the rear end disk array in described cluster service system, in described the 4th request of access, carry described target data block index, so that described rear end disk array is accessed data block corresponding to described target data block index, so that described the 3rd server returns to described target data block.
3. method according to claim 1 and 2, it is characterized in that, if the request of described the first request of access for data block corresponding to described target data block index write, described first server, by after data-block cache corresponding to described target data block index is in local cache, also comprises:
Described first server, according to described the first request of access, is rewritten as target data block by data block corresponding to described target data block index in local cache;
Described first server sends the second update request to described second server, described the second update request is used to indicate described first server, in local cache, data block corresponding to described target data block index is rewritten as to target data block, so that described second server upgrades the corresponding relation of described data block index and server;
Described first server sends Indication message to described second server, and described Indication message is used to indicate data block corresponding to described target data block index that described second server is notified described the 3rd server to delete to store in local cache.
4. according to the method in claim 2 or 3, it is characterized in that, described target data block also comprises after returning to described first server:
Described first server by data-block cache corresponding to described target data block index in local cache, described first server sends the first update request to described second server, described the first update request be used to indicate described first server by data-block cache corresponding to described target data block index in local cache, so that described second server upgrades the corresponding relation of described data block index and server.
5. a distributed cache cache data access method, is characterized in that, comprising:
Second server receives the second request of access that first server sends, and in described the second request of access, carries target data block index;
Described second server is according to the data block index of setting and the corresponding relation of server, the 3rd server of target data block index corresponding data piece described in query caching;
Described second server sends access response to described first server, carries the Query Result of described the 3rd server of target data block described in query caching in described access response.
6. method according to claim 5, is characterized in that, described second server sends described access response to described first server, carries the Query Result of described the 3rd server of target data block described in query caching in described access response, comprising:
Described Query Result is used to indicate the sign of described the 3rd server of the data block that in cluster service system, described in buffer memory, target data block index is corresponding; Or,
Described Query Result is used to indicate the 3rd server that does not have the data block that target data block index is corresponding described in buffer memory in cluster service system.
7. according to the method described in claim 5 or 6, it is characterized in that, if the request of described the first request of access for data block corresponding to described target data block index write also comprises:
Described second server is after described first server sends access response, described second server receives the Indication message that described first server sends, and described Indication message is used to indicate data block corresponding to described target data block index that described second server is notified described the 3rd server to delete to store in local cache;
Described second server receives the first update request that described first server sends, described the first update request be used to indicate described first server by data-block cache corresponding to described target data block index in local cache, so that described second server upgrades the corresponding relation of described data block index and server.
8. a distributed cache cache data access method, is characterized in that, comprising:
The 3rd server receives the 3rd request of access that first server sends, and in described the 3rd request of access, carries target data block index;
Described the 3rd server is accessed the described data block that described target data block index is corresponding in local cache cache;
Described the 3rd server sends data block corresponding to described target data block index to described first server.
9. a distributed cache cache DAA, is characterized in that, comprising:
The first receiver module, the first request of access of sending for receiving user, carries the target data block index of access in described the first request of access;
Determination module, for determining the first cryptographic hash corresponding to described target data block index, and according to the cryptographic hash of setting and the corresponding relation of server, determines the second server of the described target data block index of storage that described the first cryptographic hash is corresponding;
The first sending module, for sending the second request of access to described second server, in described the second request of access, carry described target data block index, so that described second server is according to the data block index of setting and the corresponding relation of server, the 3rd server of target data block index corresponding data piece described in query caching;
The second receiver module, the access response sending for receiving described second server, carries the Query Result of the 3rd server of target data block described in query caching in described access response.
10. device according to claim 9, is characterized in that, also comprises:
The second sending module, being used for is the sign of described the 3rd server at described Query Result, after receiving the access response of described second server transmission, according to the sign of described the 3rd server, to described the 3rd server, send the 3rd request of access, in described the 3rd request of access, carry described target data block index, so that described the 3rd server is accessed the described data block that described target data block index is corresponding in local cache cache, so that described the 3rd server returns to described target data block; Or,
For described Query Result, be used to indicate the 3rd server that cluster service system does not exist the data block that target data block index is corresponding described in buffer memory, after receiving the access response of described second server transmission, also comprise: the rear end disk array in described cluster service system sends the 4th request of access, in described the 4th request of access, carry described target data block index, so that described rear end disk array is accessed data block corresponding to described target data block index, so that described the 3rd server returns to described target data block.
11. according to the device described in claim 9 or 10, it is characterized in that, if the request of described the first request of access for data block corresponding to described target data block index write, by after data-block cache corresponding to described target data block index is in local cache, described the second receiver module also for:
According to described the first request of access, in local cache, data block corresponding to described target data block index is rewritten as to target data block;
To described second server, send the second update request, described the second update request is used to indicate described first server, in local cache, data block corresponding to described target data block index is rewritten as to target data block, so that described second server upgrades the corresponding relation of described data block index and server;
To described second server, send Indication message, described Indication message is used to indicate data block corresponding to described target data block index that described second server is notified described the 3rd server to delete to store in local cache.
12. according to the device described in claim 10 or 11, it is characterized in that, also comprises processing module:
For by data-block cache corresponding to described target data block index at local cache, to described second server, send the first update request, described the first update request is used to indicate data-block cache corresponding to described target data block index in local cache, so that described second server upgrades the corresponding relation of described data block index and server.
13. 1 kinds of distributed cache cache DAAs, is characterized in that, comprising:
Receiver module, the second request of access sending for receiving first server, carries target data block index in described the second request of access;
Enquiry module, for according to the data block index of setting and the corresponding relation of server, the 3rd server of target data block index corresponding data piece described in query caching;
Sending module, for sending access response to described first server, carries the Query Result of described the 3rd server of target data block described in query caching in described access response.
14. devices according to claim 13, is characterized in that, describedly to described first server, send described access response, carry the Query Result of described the 3rd server of target data block described in query caching in described access response, comprising:
Described Query Result is used to indicate the sign of described the 3rd server of the data block that in cluster service system, described in buffer memory, target data block index is corresponding; Or,
Described Query Result is used to indicate the 3rd server that does not have the data block that target data block index is corresponding described in buffer memory in cluster service system.
15. according to the device described in claim 13 or 14, it is characterized in that, also comprises processing module:
For after described first server sends access response, receive the Indication message that described first server sends, described Indication message is for notifying described the 3rd server to delete data block corresponding to described target data block index that local cache stores;
The first update request sending for receiving described first server, described the first update request be used to indicate described first server by data-block cache corresponding to described target data block index in local cache, so that described processing module is upgraded the corresponding relation of described data block index and server.
16. 1 kinds of distributed cache cache DAAs, is characterized in that, comprising:
Receiver module, the 3rd request of access sending for receiving first server, carries target data block index in described the 3rd request of access;
Processing module, for accessing the described data block that described target data block index is corresponding at local cache cache;
Sending module, for sending data block corresponding to described target data block index to described first server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310624964.9A CN103678523B (en) | 2013-11-28 | 2013-11-28 | Distributed cache cache data access methods and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310624964.9A CN103678523B (en) | 2013-11-28 | 2013-11-28 | Distributed cache cache data access methods and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103678523A true CN103678523A (en) | 2014-03-26 |
| CN103678523B CN103678523B (en) | 2018-03-09 |
Family
ID=50316068
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310624964.9A Active CN103678523B (en) | 2013-11-28 | 2013-11-28 | Distributed cache cache data access methods and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103678523B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104202375A (en) * | 2014-08-22 | 2014-12-10 | 广州华多网络科技有限公司 | Method and system for synchronous data |
| CN105512053A (en) * | 2015-12-07 | 2016-04-20 | 中南大学 | Mirror caching method for mobile transparent computing system server terminal multi-user access |
| CN105787124A (en) * | 2016-03-28 | 2016-07-20 | 中国建设银行股份有限公司 | Data processing method and device applied to databases as well as data storage system |
| CN106506704A (en) * | 2016-12-29 | 2017-03-15 | 北京奇艺世纪科技有限公司 | A kind of buffering updating method and device |
| WO2017049764A1 (en) * | 2015-09-24 | 2017-03-30 | 北京百度网讯科技有限公司 | Method for reading and writing data and distributed storage system |
| CN106649141A (en) * | 2016-11-02 | 2017-05-10 | 郑州云海信息技术有限公司 | Storage interaction device and storage system based on ceph |
| CN106713250A (en) * | 2015-11-18 | 2017-05-24 | 杭州华为数字技术有限公司 | Data access method and device based on distributed system |
| CN107025289A (en) * | 2017-04-14 | 2017-08-08 | 腾讯科技（深圳）有限公司 | The method and relevant device of a kind of data processing |
| CN107633016A (en) * | 2017-08-23 | 2018-01-26 | 阿里巴巴集团控股有限公司 | Data processing method and device and electronic equipment |
| CN108566421A (en) * | 2018-03-29 | 2018-09-21 | 四川斐讯信息技术有限公司 | A kind of network type location mode and system based on Network Attached Storage |
| CN110413918A (en) * | 2019-08-01 | 2019-11-05 | 腾讯科技（深圳）有限公司 | Data transmission method for uplink, device, equipment and storage medium |
| EP3386168A4 (en) * | 2015-12-03 | 2019-11-27 | Hangzhou Hikvision Digital Technology Co., Ltd. | Data cloud storage system, client terminal, storage server and application method |
| CN111931000A (en) * | 2020-08-12 | 2020-11-13 | 武汉兆图科技有限公司 | Large-scale vector field oriented data processing method |
| CN112650694A (en) * | 2019-10-12 | 2021-04-13 | 北京达佳互联信息技术有限公司 | Data reading method and device, cache proxy server and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101867607A (en) * | 2010-05-21 | 2010-10-20 | 北京无限立通通讯技术有限责任公司 | Distributed data access method, device and system |
| CN102325098A (en) * | 2011-09-15 | 2012-01-18 | 北京神州泰岳软件股份有限公司 | Group information acquisition method and system |
| CN102333130A (en) * | 2011-10-31 | 2012-01-25 | 北京蓝汛通信技术有限责任公司 | Method and system for accessing cache server and intelligent cache scheduler |
| CN102929958A (en) * | 2012-10-10 | 2013-02-13 | 无锡江南计算技术研究所 | Metadata processing method, agenting and forwarding equipment, server and computing system |
| EP2562991A1 (en) * | 2011-01-13 | 2013-02-27 | Huawei Technologies Co., Ltd. | Data prefetching method, node and system for distributed hash table dht memory system |
| CN103390061A (en) * | 2013-07-31 | 2013-11-13 | 浙江大学 | Multi-level cache-based sea spatio-temporal data accessing method taking user as center |
-
2013
- 2013-11-28 CN CN201310624964.9A patent/CN103678523B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101867607A (en) * | 2010-05-21 | 2010-10-20 | 北京无限立通通讯技术有限责任公司 | Distributed data access method, device and system |
| EP2562991A1 (en) * | 2011-01-13 | 2013-02-27 | Huawei Technologies Co., Ltd. | Data prefetching method, node and system for distributed hash table dht memory system |
| CN102325098A (en) * | 2011-09-15 | 2012-01-18 | 北京神州泰岳软件股份有限公司 | Group information acquisition method and system |
| CN102333130A (en) * | 2011-10-31 | 2012-01-25 | 北京蓝汛通信技术有限责任公司 | Method and system for accessing cache server and intelligent cache scheduler |
| CN102929958A (en) * | 2012-10-10 | 2013-02-13 | 无锡江南计算技术研究所 | Metadata processing method, agenting and forwarding equipment, server and computing system |
| CN103390061A (en) * | 2013-07-31 | 2013-11-13 | 浙江大学 | Multi-level cache-based sea spatio-temporal data accessing method taking user as center |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104202375A (en) * | 2014-08-22 | 2014-12-10 | 广州华多网络科技有限公司 | Method and system for synchronous data |
| CN104202375B (en) * | 2014-08-22 | 2017-10-24 | 广州华多网络科技有限公司 | The method and system of synchrodata |
| WO2017049764A1 (en) * | 2015-09-24 | 2017-03-30 | 北京百度网讯科技有限公司 | Method for reading and writing data and distributed storage system |
| US11537659B2 (en) | 2015-09-24 | 2022-12-27 | Beijing Baidu Netcom Science And Technology Co., Ltd. | Method for reading and writing data and distributed storage system |
| CN106713250A (en) * | 2015-11-18 | 2017-05-24 | 杭州华为数字技术有限公司 | Data access method and device based on distributed system |
| CN106713250B (en) * | 2015-11-18 | 2019-08-20 | 杭州华为数字技术有限公司 | Data access method and device based on distributed system |
| US10623516B2 (en) | 2015-12-03 | 2020-04-14 | Hangzhou Hikvision Digital Technology Co., Ltd. | Data cloud storage system, client terminal, storage server and application method |
| EP3386168A4 (en) * | 2015-12-03 | 2019-11-27 | Hangzhou Hikvision Digital Technology Co., Ltd. | Data cloud storage system, client terminal, storage server and application method |
| CN105512053B (en) * | 2015-12-07 | 2017-06-16 | 中南大学 | The mirror cache method of mobile transparent computing system server end multi-user access |
| CN105512053A (en) * | 2015-12-07 | 2016-04-20 | 中南大学 | Mirror caching method for mobile transparent computing system server terminal multi-user access |
| CN105787124A (en) * | 2016-03-28 | 2016-07-20 | 中国建设银行股份有限公司 | Data processing method and device applied to databases as well as data storage system |
| CN106649141A (en) * | 2016-11-02 | 2017-05-10 | 郑州云海信息技术有限公司 | Storage interaction device and storage system based on ceph |
| CN106649141B (en) * | 2016-11-02 | 2019-10-18 | 郑州云海信息技术有限公司 | A kind of storage interactive device and storage system based on ceph |
| CN106506704A (en) * | 2016-12-29 | 2017-03-15 | 北京奇艺世纪科技有限公司 | A kind of buffering updating method and device |
| CN107025289B (en) * | 2017-04-14 | 2018-12-11 | 腾讯科技（深圳）有限公司 | A kind of method and relevant device of data processing |
| CN107025289A (en) * | 2017-04-14 | 2017-08-08 | 腾讯科技（深圳）有限公司 | The method and relevant device of a kind of data processing |
| CN107633016A (en) * | 2017-08-23 | 2018-01-26 | 阿里巴巴集团控股有限公司 | Data processing method and device and electronic equipment |
| CN107633016B (en) * | 2017-08-23 | 2020-11-24 | 创新先进技术有限公司 | Data processing method and device and electronic equipment |
| CN108566421A (en) * | 2018-03-29 | 2018-09-21 | 四川斐讯信息技术有限公司 | A kind of network type location mode and system based on Network Attached Storage |
| CN108566421B (en) * | 2018-03-29 | 2021-06-04 | 浙江华网俊业科技有限公司 | Network type distribution method and system based on network attached storage |
| CN110413918A (en) * | 2019-08-01 | 2019-11-05 | 腾讯科技（深圳）有限公司 | Data transmission method for uplink, device, equipment and storage medium |
| CN110413918B (en) * | 2019-08-01 | 2023-09-22 | 腾讯科技（深圳）有限公司 | Data transmission method, device, equipment and storage medium |
| CN112650694A (en) * | 2019-10-12 | 2021-04-13 | 北京达佳互联信息技术有限公司 | Data reading method and device, cache proxy server and storage medium |
| CN112650694B (en) * | 2019-10-12 | 2024-01-12 | 北京达佳互联信息技术有限公司 | Data reading method and device, cache proxy server and storage medium |
| CN111931000A (en) * | 2020-08-12 | 2020-11-13 | 武汉兆图科技有限公司 | Large-scale vector field oriented data processing method |
| CN111931000B (en) * | 2020-08-12 | 2023-12-19 | 武汉兆图科技有限公司 | Large-scale vector field data processing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103678523B (en) | 2018-03-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103678523A (en) | Distributed cache data access method and device | |
| JP4372671B2 (en) | Method and apparatus for generating content address indicating data unit written in storage system in close proximity in time | |
| US8799409B2 (en) | Server side data cache system | |
| CN104395904A (en) | Efficient data object storage and retrieval | |
| KR20170068564A (en) | Data processing method, apparatus and system | |
| CN102694828B (en) | A kind of method of distributed cache system data access and device | |
| WO2014110266A1 (en) | Optimizing snapshot lookups | |
| CN108363641B (en) | Main and standby machine data transmission method, control node and database system | |
| CN103853714A (en) | Data processing method and device | |
| CN105635196A (en) | Method and system of file data obtaining, and application server | |
| CN105159845A (en) | Memory reading method | |
| US20090157694A1 (en) | Method and system for managing file metadata transparent about address changes of data servers and movements of their disks | |
| US7509473B2 (en) | Segmented storage system mapping | |
| CN111803917A (en) | Resource processing method and device | |
| US10327133B2 (en) | Making subscriber data addressable as a device in a mobile data network | |
| CN109844723A (en) | The method and system of master control foundation is carried out using the statistical information based on service | |
| JPH04313126A (en) | File input/output system for decentralized file system | |
| US11016688B1 (en) | Real-time localized data access in a distributed data storage system | |
| CN103491124A (en) | Method for processing multimedia message data and distributed cache system | |
| US20060282434A1 (en) | Access to fragmented database system | |
| CN107066206B (en) | Storage control method and system for distributed physical disk | |
| CN107168645B (en) | Storage control method and system of distributed system | |
| CN113853778A (en) | Cloning method and device of file system | |
| CN116010677B (en) | Spatial index method and device and electronic equipment thereof | |
| CN115437579B (en) | Metadata management method and device, computer equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |