CN101867607A - Distributed data access method, device and system - Google Patents
Distributed data access method, device and system Download PDFInfo
- Publication number
- CN101867607A CN101867607A CN201010187047A CN201010187047A CN101867607A CN 101867607 A CN101867607 A CN 101867607A CN 201010187047 A CN201010187047 A CN 201010187047A CN 201010187047 A CN201010187047 A CN 201010187047A CN 101867607 A CN101867607 A CN 101867607A
- Authority
- CN
- China
- Prior art keywords
- data
- caching server
- access
- needs
- access data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a distributed data access method, a device and a system. The method comprises the following steps: receiving a data access request of users; determining a buffer storage server required by data access; obtaining the data results from the determined buffer storage server; and displaying the results of the data access for the users. The invention solves the problem of visit pressure caused during the visit of a center server by terminal users, and improves the usability of the distributed buffer storage system.
Description
Technical field
The present invention relates to the data service technical field, particularly a kind of distributed data buffer memory access method, Apparatus and system.
Background technology
Along with the development of software engineering and the recommendation that company information is built in recent years, present application system institute data to be processed are more and more huger, and the number of users that serve also continues to increase, and the requirement of service quality (Qos) is also more and more higher.Along with the increase of data volume and increasing of number of users, will cause the overall performance of storage system to descend, for addressing this problem, and designed the distributed caching system, this distributed caching system generally all adopts internal memory as the physical medium of preserving data, with be kept in the past data in the system such as database in buffer memory, preserve simultaneously a, thereby avoided directly the entire system performance that operation caused of systems such as database is descended.
At present, in order to improve the performance of distributed caching system, usually adopt Hash (HASH), set (B-Tree) algorithm as the data retrieval algorithm, perhaps be stored in searching algorithm on that station server, to reach availability and the reliability that improves the distributed caching system by the central server locator data.But, when utilizing HASH, when data volume can cause the space waste after a little while as the data retrieval algorithm, this is because the value space of key is unfixing, in order to reach higher search efficient, needs to use the array space bigger, can cause the space waste when data volume is few, its availability is low.When utilizing B-Tree as the data retrieval algorithm, its retrieval rate does not have the HASH algorithm fast, and its availability is lower.
Searching algorithm is called searching algorithm commonly used at present on that station server and utilization is stored in by the central server locator data, detailed process is: set up a central server, at first, this central server of the application server access of client, the data of query caching are kept on that caching server, central server is informed this application server with the caching server of the described data of buffer memory, then, this application server visits again corresponding caching server, to obtain described data in buffer.
But along with the increase of data volume and increasing of number of users, because the terminal use needs visit central server earlier when visit, the pressure of central server can become the new performance bottleneck of system along with the increase of visit capacity.In addition, if when there is Single Point of Faliure in central server, will have influence on the availability of whole system.
Summary of the invention
The embodiment of the invention provides a kind of distributed data access method, Apparatus and system, the visit stress problems that causes during with solution end-user access central server, the availability of raising distributed caching system.
For solving the problems of the technologies described above, the invention provides a kind of distributed data access method, described method comprises:
Receiving the user needs the request of access data;
Determine the described caching server that needs access data;
From described definite caching server, obtain the result of the described data of access;
Result to the described data of described user's display access.
Optionally, describedly determine that the described caching server of access data that needs comprises: utilize Hash HASH algorithm or summary MD5 algorithm from the caching server group, to determine the described caching server that needs access data.
Optionally, the described HASH of utilization algorithm definite described caching server of access data that needs from the caching server group specifically comprises:
The described sign of access data that needs is carried out Hash calculation, obtain corresponding cryptographic Hash;
With described cryptographic Hash and default array delivery, and with the result of the delivery index as query caching server group;
Get the described caching server group of inquiry according to described index, obtain the described caching server that needs access data;
The described MD5 of utilization algorithm determines that from the caching server group the described caching server of access data that needs specifically comprises:
The described sign of access data that needs is carried out digest calculations, obtain corresponding cryptographic Hash;
With described cryptographic Hash and default array delivery, and with the result of the delivery index as query caching server group;
Get the described caching server group of inquiry according to described index, obtain the described caching server that needs access data.
Optionally, the described result who obtains the described data of access from described definite caching server specifically comprises:
Send the described request that needs access data to described caching server;
Described caching server carries out linear Hash calculation to the described access data that needs, and determines the described particular location space that needs access data, and finishes the accessing operation that needs access data to described;
The response of described caching server feedback access data.
Accordingly, the present invention also provides a kind of access device of distributed data, and described device comprises:
Receiving element is used to receive the request that the user needs access data;
Determining unit is used for determining the described caching server that needs access data;
Acquiring unit is used for obtaining from described definite caching server the result of the described data of access;
Display unit is used for the result to the described data of described user's display access.
Optionally, described determining unit comprises:
The Hash determining unit is used for determining the described caching server that needs access data by Hash HASH algorithm from the caching server group; And/or
The summary determining unit is used for determining the described caching server that needs access data by summary MD5 algorithm from the caching server group.
Optionally, described Hash determining unit comprises:
The Hash calculation unit is used for the described sign of access data that needs is carried out Hash calculation, obtains corresponding cryptographic Hash;
The first delivery unit is used for described cryptographic Hash and default array delivery, and with the result of the delivery index as query caching server group;
First query unit is used for getting the described caching server group of inquiry according to described index, obtains the described caching server that needs access data;
Described summary determining unit comprises:
The digest calculations unit is used for the described sign of access data that needs is carried out digest calculations, obtains corresponding cryptographic Hash;
The second delivery unit is used for described cryptographic Hash and default array delivery, and with the result of the delivery index as query caching server group;
Second query unit is used for inquiry and gets the described caching server group of inquiry according to described index, obtains the described caching server that needs access data.
Optionally, described acquiring unit comprises:
Transmitting element is used for sending the described request that needs access data to described caching server;
Receiving element is used to receive the response that described caching server sends the described data of access.
Optionally, described device is integrated in the application server of client, or independent part is deployed in client.
Accordingly, the present invention also provides a kind of distributed data caching system, and described system comprises: be integrated with application server and a plurality of caching server of the access device of distributed data, wherein,
The described application server that is integrated with the access device of distributed data, be used to receive the request that the user needs access data, determine the described caching server that needs access data, and send the request of the described data of access, and receive the response that described definite caching server sends the described data of access to described definite caching server;
Described caching server, be used to receive the request of the described data of access that described application server sends, and the described access data that needs carried out linear Hash calculation, determine the described particular location space that needs access data, and after described data are carried out accessing operation, to the response of the described data of described application server feedback access.
As shown from the above technical solution, in the embodiment of the invention, need not to locate central server, when the application server of client receives the request of user access data, this application server carries out Hash calculation, determine the caching server of these data of access, and carry out data interaction with described definite caching server, obtain the result of the described data of access, thereby realized that the terminal use is when carrying out data access, do not need to determine the caching server of the described data of access, thereby reduced, improved the availability of distributed cache server because end-user access is excessive to the pressure that central server causes by central server.
Further, described caching server by Hash calculation, obtains the locational space of these data of storage in the caching server when the request of the access data that receives the application server transmission, and finish accessing operation to described data, improved the availability of distributed cache server.
Description of drawings
Fig. 1 is the flow chart of the method for a kind of distributed data access provided by the invention;
Fig. 2 is the particular flow sheet of the method for a kind of distributed data access provided by the invention;
Fig. 3 is the structural representation of the access device of a kind of distributed data provided by the invention;
Fig. 4 is the structural representation of the access device of another kind of distributed data provided by the invention;
Fig. 5 is the structural representation of a kind of distributed caching provided by the invention system;
Fig. 6 is the structural representation of the application example of a kind of distributed caching provided by the invention system.
Embodiment
In order to make those skilled in the art person understand the scheme of the embodiment of the invention better, the embodiment of the invention is described in further detail below in conjunction with drawings and embodiments.
See also Fig. 1, be the flow chart of the method for a kind of distributed data access provided by the invention; In this embodiment, what distributed caching was preserved all is＜key value〉key-value pair, described method comprises:
Step 101: receive the request that the user needs access data;
Such as, when the user need inquire about the phone of certain company, need on terminal, import the information such as title of the said firm, the application server of terminal receives the information of the described Business Name of inquiry of this user's input.The process of this inquiry company telephone number is exactly the process of fetching data, and the process of its deposit data is similar with the process of fetching data, and does not repeat them here.
Step 102: determine the described caching server that needs access data;
Wherein, the mode of determining can comprise: Hash HASH algorithm or summary MD5 algorithm, promptly utilize Hash HASH algorithm or summary MD5 algorithm to determine the described caching server that needs access data from the caching server group.
On the basis of step 101, application server is when receiving the information of the described Business Name of described inquiry, if to utilize the HASH algorithm is example, specifically comprise: application server carries out Hash calculation to the described sign of access data that needs, and obtains corresponding cryptographic Hash; With described cryptographic Hash and default array delivery, and with the result of the delivery index as query caching server group; Get the described caching server group of inquiry according to described index, obtain the described caching server that needs access data.
If to utilize the MD5 algorithm is example, specifically comprise: application server carries out digest calculations to the described sign of access data that needs, and obtains corresponding cryptographic Hash; With described cryptographic Hash and default array delivery, and with the result of the delivery index as query caching server group; Get the described caching server group of inquiry according to described index, obtain the described caching server that needs access data.
Step 103: the result who from described definite caching server, obtains the described data of access;
Wherein, the described result who obtains the described data of access can comprise: application server sends the described request that needs access data to described caching server; Described caching server carries out linear Hash calculation to the described access data that needs, and determines the described particular location space that needs access data, and finishes the accessing operation that needs access data to described; Described caching server is to the response of application server feedback access data.
Step 104: to the result of the described data of described user's display access.
That is to say that application server is shown to the user with the result of the described data of access when receiving the response of the described data of access that caching server sends.Such as, the result of the described data that application server receives then can be shown to the client by the display of terminal for the telephone number of certain company.The process of this inquiry company phone is exactly the process of fetching data, and the process of its deposit data is similar with the process of fetching data, and specifically sees for details above-mentioned.
In the embodiment of the invention, need not to locate central server, when receiving the request of user access data, the application server of this terminal carries out phase I HASH and calculates, promptly determine the caching server of these data of access, and carry out data interaction, thereby realized that the terminal use is not by central server the time with described definite caching server, also can carry out data interaction, reduce because end-user access is excessive to the pressure that central server causes with caching server.That is to say, in the present embodiment, visit for terminal data, (promptly a piece of data does not go up at a plurality of caching servers (being cache node) and preserves to the dependence of central server, the positioning action of central server has been distributed to the data use side, reduced pressure, thereby improved the availability of distributed caching system central server.
Further since with a storage on a plurality of caching servers, have the horizontal extension ability for the storing process of data.
Also see also Fig. 2, be the particular flow sheet of the method for a kind of distributed data access provided by the invention, described method comprises:
Step 201: the application server of terminal receives the request of the user access data of this terminal;
In this embodiment, deposit data can be to inquire about any data that are stored in advance on the caching server according to user's needs; In like manner, deposit data can be according to user's request, with storage to caching server.For the user, fetch data and store data, role's difference of just serving as, such as, when looking into data, the role that the user serves as is for using the user, when deposit data, the role that the user serves as is keeper etc., but is not limited to this, also can use the user be divided into different grades, the founder can allow the high user of grade carry out the access etc. of data.
Step 202: application server is determined the caching server of the described data of access by Hash HASH algorithm (being the phase I Hash calculation); But being not limited to described Hash HASH algorithm, also can be summary MD5 algorithm or consistency hash algorithm (Consistent Hashing), certainly, can also be other algorithm, and present embodiment does not limit.
Present embodiment is an example with the HASH algorithm, promptly the application server of this terminal is finished the positioning action to the caching server of the described data of access, such as, the sign (or keyword) of the described data of access is carried out delivery (MOD) operation, and with the result of delivery index as query caching server group, get the described caching server group of inquiry according to described index, obtain the described caching server that needs access data.
Step 203: application server sends the request of the described data of access to the described caching server that inquires; Promptly visit described caching server;
Step 204: caching server is determined the locational space of the described data of access by hash algorithm (second stage Hash calculation), and described data are carried out accessing operation;
That is to say, the second stage Hash calculation that described caching server is finished, mainly be to finish the retrieving that needs the data of access to described, promptly this needs the locational space of the data of access, such as: big array of linear HASH algorithm definition, then the described data (being key assignments key) of access that need are carried out delivery (MOD), and with the result of delivery array index as the described data of access (can be different data), and the storage that will need access is in the array index of correspondence, perhaps from the array index of described correspondence, read described data, thereby finish needing the read-write operation of access data.The implementation of the HASH algorithm in the present embodiment, present embodiment is as example, but is not limited to this.
Wherein, in the present embodiment, caching server carries out accessing operation to described data, is example to fetch data below, specifically comprises:
Judge whether there are described data in the described locational space,, then read described data if exist; And comprise described data in the response of in following step 205, feeding back; If there is no, judge then whether described data exist in the backup server, if then visit described backup server, and from described backup server, read described data, and comprise described data in the response of in following step 205, feeding back.
Step 205: caching server is to the response of the described data of application server feedback access of terminal;
Wherein, for fetching data, comprise the data that the user need inquire about in the described response; For deposit data, comprise success or the failure information of storing described data in the described response.
Step 206: after the application server of described terminal receives described response, described response is shown to the user by this terminal.
In this embodiment, the distributed implementation method of HASH algorithm data in two stages is exactly: each caching server is preserved a part of data of terminal applies system, the data distributed and saved that all of application system need be preserved can be moved the buffer memory service of a plurality of caching server storages on the station terminal server in each caching server.The sign of all buffer memory services deposits an array in, retrieves the buffer memory service by the index that buffer memory is identified in the array.
Wherein, the process that data deposit in the caching server is: according to the sign (key assignments) of data, calculate a HASH value, such as modulo operation (MOD), and the number of elements of cryptographic Hash and array carried out delivery, the result of delivery is as the index of caching server, thereby finds the target cache server, data deposited in the target cache server then; In like manner, determine during data retrieval that the step of target cache server and the step that data deposit caching server in are similar, specifically see for details above-mentionedly, do not repeat them here.
In this embodiment, with the process of data multi-point backup be: each buffer memory service all exists in the caching server of a backup, all backup caching servers constitute a distributed backup caching system, when data deposit in the distributed buffer system, also deposit the backup caching system that distributes simultaneously in.When certain cache invalidation in the distributed caching system, can directly be substituted into the backup buffer memory of correspondence in the caching system, so just realized high availability.
The embodiment of the invention proposes the scheme of a kind of two stage HASH calculating and data multi-point backup, be that terminal does not need through the visit central server, just can navigate to the storage of searching or storing on that caching server, thereby solved the high available of distributed caching system, high reliability also has horizontal expansion capacity.
Implementation procedure based on said method, the present invention also provides a kind of access device of distributed data, its structural representation sees Fig. 3 for details, described device comprises: receiving element 31, determining unit 32, acquiring unit 33 and display unit 34, wherein, receiving element 31 is used to receive the request that the user needs access data; Determining unit 32 is used for the caching server that needs access data of determining that described receiving element 31 receives; Acquiring unit 33 is used for obtaining from the caching servers that described determining unit 32 is determined the result of the described data of access; Display unit 34 is used for showing to described user the result of the described data of access that described acquiring unit 33 obtains.
Optionally, described determining unit 32 comprises: Hash determining unit 321 and/or summary determining unit 322, its concrete structural representation sees Fig. 4 for details, summary determining unit 322 among the figure is connected with the receiving element with dashed lines, wherein, described Hash determining unit 321 is used for determining the described caching server that needs access data by Hash HASH algorithm from the caching server group; Described summary determining unit 322 is used for determining the described caching server that needs access data by summary MD5 algorithm from the caching server group.
Optionally, described acquiring unit 33 comprises: transmitting element 331 and receiving element 332, its concrete structural representation sees Fig. 4 for details, is the another kind of structural representation of described device.Described transmitting element 331 is used for sending the described request that needs access data to described caching server; Described receiving element 332 is used for receiving the response that described caching server sends the described data of access after transmitting element sends the described request that needs access data.
Wherein, described Hash determining unit comprises: Hash calculation unit, the first delivery unit, first query unit.Described Hash calculation unit is used for the described sign of access data that needs is carried out Hash calculation, obtains corresponding cryptographic Hash; The described first delivery unit is used for described cryptographic Hash and default array delivery, and with the result of the delivery index as query caching server group; Described first query unit is used for getting the described caching server group of inquiry according to described index, obtains the described caching server that needs access data.
Described summary determining unit comprises: digest calculations unit, the second delivery unit, second query unit.Described digest calculations unit is used for the described sign of access data that needs is carried out digest calculations, obtains corresponding cryptographic Hash; The described second delivery unit is used for described cryptographic Hash and default array delivery, and with the result of the delivery index as query caching server group; Second query unit is used for inquiry and gets the described caching server group of inquiry according to described index, obtains the described caching server that needs access data.
Optionally, described device can be integrated in the application server of client, also can independent part be deployed in client.Present embodiment does not limit.
In the embodiment of the invention, need not to locate central server, in phase I HASH, carry out the caching server location, not to the dependence of central server, the central server positioning action has been distributed in the application server of data consumer's end, has reduced when a plurality of end-user access pressure central server.Improved the availability of distributed caching system.
Corresponding, the present invention is real also to provide a kind of distributed caching system, and its structural representation sees Fig. 5 for details, described system comprises: be integrated with application server 51 and a plurality of caching server 52 of the access device of distributed data, wherein, described application service is the application server of terminal, wherein
The described application server 51 that is integrated with the access device of distributed data, be used to receive the request that the user needs access data, determine the described caching server that needs access data, and send the request of the described data of access, and receive the response that described definite caching server sends the described data of access to described definite caching server;
Described a plurality of caching server 52, be used to receive the request of the described data of access that described application server sends, and the described access data that needs carried out linear Hash calculation, determine the described particular location space that needs access data, and after described data are carried out accessing operation, to the response of the described data of described application server feedback access.
Wherein, the unit that the access device of described distributed data specifically comprises sees the foregoing description for details, does not repeat them here.
Understanding for the ease of those skilled in the art, also see also Fig. 6, the structural representation of the application example of a kind of distributed caching system that provides for the embodiment of the invention, as shown in the figure, described system comprises: application server 61, the first caching servers (being the distributed caching node, down together) 62 and second caching server 63 that comprises terminal, present embodiment is an example with two distributed cache servers, but is not limited to this.In this embodiment, store a plurality of buffer memory services in each distributed cache server, i.e. key-value pair among the figure.
Described application server 61 is when the request of the access data that receives user's input, finish positioning action by phase I HASH algorithm to caching server, be specially: the Hash calculation of the described sign that needs access data being carried out the phase I, obtain corresponding cryptographic Hash, and with described cryptographic Hash and default array delivery, and with the result of delivery index (such as the index of second caching server) as query caching server group, afterwards, described second caching server 63 of described application server 61 visits, promptly send the request of access data to described second caching server 63, described second caching server 63 is when the request that receives described access data, finish retrieval by second stage HASH algorithm to data, promptly calculate the locational space of the described data of described access, its computational process sees for details above-mentioned, then, with described storage in described locational space, perhaps, from described locational space, read described data, afterwards, second caching server 63 is to the response of the described data of application server 61 feedback accesses, described application server 61 is after receiving described response, and the display by terminal shows described response.
Such as, user A thinks to provide on the internet the company of a Yellow Page, so that other users search the contact method of mechanisms such as some company, restaurant.User A can be organization names, with and contact method form key-value pair＜title, contact method, then these data are kept in the distributed caching system.
Afterwards, user B is to the telephone number of searching certain restaurant, at this moment, user B inquires about the request of the telephone number in this restaurant as long as import this on terminal computer, the application server of terminal computer is when receiving described request, navigate to the caching server of the telephone number in this restaurant of storage by the phase I hash algorithm, this application server sends the request of the contact method that obtains this restaurant to described caching server, this caching server carries out the Hash calculation of Section Point, retrieve the particular location space of the contact method in this restaurant of storage, and from this locational space, read the contact method in this restaurant, then, the contact method in this restaurant is sent to application server, and the contact method in this restaurant that this application server will receive is shown to user B by display.
By the foregoing description as can be known, the embodiment of the invention need not to locate central server, on the application server of terminal, can carry out the phase I Hash calculation, navigate to the caching server of access data, its concrete position fixing process does not rely on central server, be about to the central server positioning action and be distributed to the data use side, thereby the pressure that central server has been caused when having reduced terminal access has improved the availability of distributed caching system.
Also need to prove, in this article, relational terms such as first and second grades only is used for an entity or operation are made a distinction with another entity or operation, and not necessarily requires or hint and have the relation of any this reality or in proper order between these entities or the operation.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thereby make and comprise that process, method, article or the equipment of a series of key elements not only comprise those key elements, but also comprise other key elements of clearly not listing, or also be included as this process, method, article or equipment intrinsic key element.Do not having under the situation of more restrictions, the key element that limits by statement " comprising ... ", and be not precluded within process, method, article or the equipment that comprises described key element and also have other identical element.
Through the above description of the embodiments, those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential general hardware platform, can certainly pass through hardware, but the former is better execution mode under a lot of situation.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words can embody with the form of software product, this computer software product can be stored in the storage medium, as ROM/RAM, magnetic disc, CD etc., comprise that some instructions are with so that a computer equipment (can be a personal computer, server, the perhaps network equipment etc.) carry out the described method of some part of each embodiment of the present invention or embodiment.
The above only is a preferred implementation of the present invention; should be pointed out that for those skilled in the art, under the prerequisite that does not break away from the principle of the invention; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.
Claims (10)
1. the access method of a distributed data is characterized in that, comprising:
Receiving the user needs the request of access data;
Determine the described caching server that needs access data;
From described definite caching server, obtain the result of the described data of access;
Result to the described data of described user's display access.
2. method according to claim 1 is characterized in that, described definite described caching server of access data that needs comprises: utilize Hash HASH algorithm or summary MD5 algorithm to determine the described caching server that needs access data from the caching server group.
3. method according to claim 2 is characterized in that, the described HASH of utilization algorithm determines that from the caching server group the described caching server of access data that needs specifically comprises:
The described sign of access data that needs is carried out Hash calculation, obtain corresponding cryptographic Hash;
With described cryptographic Hash and default array delivery, and with the result of the delivery index as query caching server group;
Get the described caching server group of inquiry according to described index, obtain the described caching server that needs access data;
The described MD5 of utilization algorithm determines that from the caching server group the described caching server of access data that needs specifically comprises:
The described sign of access data that needs is carried out digest calculations, obtain corresponding cryptographic Hash;
With described cryptographic Hash and default array delivery, and with the result of the delivery index as query caching server group;
Get the described caching server group of inquiry according to described index, obtain the described caching server that needs access data.
4. according to each described method of claim 1 to 3, it is characterized in that the described result who obtains the described data of access from described definite caching server specifically comprises:
Send the described request that needs access data to described caching server;
Described caching server carries out linear Hash calculation to the described access data that needs, and determines the described particular location space that needs access data, and finishes the accessing operation that needs access data to described;
The response of described caching server feedback access data.
5. the access device of a distributed data is characterized in that, comprising:
Receiving element is used to receive the request that the user needs access data;
Determining unit is used for determining the described caching server that needs access data;
Acquiring unit is used for obtaining from described definite caching server the result of the described data of access;
Display unit is used for the result to the described data of described user's display access.
6. device according to claim 5 is characterized in that, described determining unit comprises:
The Hash determining unit is used for determining the described caching server that needs access data by Hash HASH algorithm from the caching server group; And/or
The summary determining unit is used for determining the described caching server that needs access data by summary MD5 algorithm from the caching server group.
7. device according to claim 6 is characterized in that,
Described Hash determining unit comprises:
The Hash calculation unit is used for the described sign of access data that needs is carried out Hash calculation, obtains corresponding cryptographic Hash;
The first delivery unit is used for described cryptographic Hash and default array delivery, and with the result of the delivery index as query caching server group;
First query unit is used for getting the described caching server group of inquiry according to described index, obtains the described caching server that needs access data;
Described summary determining unit comprises:
The digest calculations unit is used for the described sign of access data that needs is carried out digest calculations, obtains corresponding cryptographic Hash;
The second delivery unit is used for described cryptographic Hash and default array delivery, and with the result of the delivery index as query caching server group;
Second query unit is used for inquiry and gets the described caching server group of inquiry according to described index, obtains the described caching server that needs access data.
8. according to each described device of claim 5 to 7, it is characterized in that described acquiring unit comprises:
Transmitting element is used for sending the described request that needs access data to described caching server;
Receiving element is used to receive the response that described caching server sends the described data of access.
9. according to each described device of claim 5 to 7, it is characterized in that described device is integrated in the application server of client, or independent part is deployed in client.
10. a distributed data caching system is characterized in that, comprising: be integrated with application server and a plurality of caching server of the access device of distributed data, wherein,
The described application server that is integrated with the access device of distributed data, be used to receive the request that the user needs access data, determine the described caching server that needs access data, and send the request of the described data of access, and receive the response that described definite caching server sends the described data of access to described definite caching server;
Described caching server, be used to receive the request of the described data of access that described application server sends, and the described access data that needs carried out linear Hash calculation, determine the described particular location space that needs access data, and after described data are carried out accessing operation, to the response of the described data of described application server feedback access.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010187047A CN101867607A (en) | 2010-05-21 | 2010-05-21 | Distributed data access method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010187047A CN101867607A (en) | 2010-05-21 | 2010-05-21 | Distributed data access method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101867607A true CN101867607A (en) | 2010-10-20 |
Family
ID=42959169
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010187047A Pending CN101867607A (en) | 2010-05-21 | 2010-05-21 | Distributed data access method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101867607A (en) |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102012931A (en) * | 2010-12-01 | 2011-04-13 | 北京瑞信在线系统技术有限公司 | Filter cache method and device, and cache system |
| CN102694828A (en) * | 2011-03-23 | 2012-09-26 | 中兴通讯股份有限公司 | Method and apparatus for data access in distributed caching system |
| CN102790784A (en) * | 2011-05-18 | 2012-11-21 | 阿里巴巴集团控股有限公司 | Distributed cache method and system and cache analyzing method and analyzing system |
| CN103412827A (en) * | 2013-08-05 | 2013-11-27 | 广州唯品会信息科技有限公司 | Picture caching method and picture caching system |
| CN103544149A (en) * | 2012-07-09 | 2014-01-29 | 百度在线网络技术（北京）有限公司 | Method and system for accessing image and image server |
| CN103678523A (en) * | 2013-11-28 | 2014-03-26 | 华为技术有限公司 | Distributed cache data access method and device |
| CN103716341A (en) * | 2012-09-28 | 2014-04-09 | 联想(北京)有限公司 | Information processing method, electronic devices and service platform |
| CN103744880A (en) * | 2013-12-20 | 2014-04-23 | 浪潮(北京)电子信息产业有限公司 | DNA data managing method and system based on cloud computing |
| CN103823807A (en) * | 2012-11-16 | 2014-05-28 | 深圳市腾讯计算机系统有限公司 | Data de-duplication method, device and system |
| CN103944972A (en) * | 2014-04-02 | 2014-07-23 | 深圳市中博科创信息技术有限公司 | Method and gateway for uploading and downloading data |
| CN104052824A (en) * | 2014-07-04 | 2014-09-17 | 哈尔滨工业大学深圳研究生院 | Distributed cache method and system |
| CN104077397A (en) * | 2014-07-01 | 2014-10-01 | 成都康赛信息技术有限公司 | Response method for distributed big data classification retrieval webpage |
| CN104113566A (en) * | 2013-04-18 | 2014-10-22 | 深圳市蓝韵网络有限公司 | Medical image cloud storage implementing method |
| CN104408073A (en) * | 2014-10-31 | 2015-03-11 | 广州华多网络科技有限公司 | Data operation method and device |
| CN105141672A (en) * | 2015-08-03 | 2015-12-09 | 广州神马移动信息科技有限公司 | Method, device and system for data storage |
| CN105260136A (en) * | 2015-09-24 | 2016-01-20 | 北京百度网讯科技有限公司 | Data read-write method and distributed storage system |
| CN105577806A (en) * | 2015-12-30 | 2016-05-11 | Tcl集团股份有限公司 | Distributed cache method and system |
| CN105607594A (en) * | 2015-12-25 | 2016-05-25 | 福州福群电子科技有限公司 | Method for searching equipment in server memory based on smart home |
| US9380127B2 (en) | 2011-05-18 | 2016-06-28 | Alibaba Group Holding Limited | Distributed caching and cache analysis |
| CN105787124A (en) * | 2016-03-28 | 2016-07-20 | 中国建设银行股份有限公司 | Data processing method and device applied to databases as well as data storage system |
| CN107463598A (en) * | 2017-06-09 | 2017-12-12 | 中国邮政储蓄银行股份有限公司 | Distributed cache system |
| CN107733952A (en) * | 2016-08-12 | 2018-02-23 | 中国电信股份有限公司 | For providing the methods, devices and systems of differentiation buffer service |
| CN108804447A (en) * | 2017-04-28 | 2018-11-13 | 北京京东尚科信息技术有限公司 | Utilize the method and system of cache responses request of data |
| CN109274593A (en) * | 2018-08-31 | 2019-01-25 | 新华三信息安全技术有限公司 | A kind of information storage means and device |
| CN112486956A (en) * | 2020-12-10 | 2021-03-12 | 北京字节跳动网络技术有限公司 | Data access method and device and electronic equipment |
| CN112597198A (en) * | 2020-12-18 | 2021-04-02 | 北京达佳互联信息技术有限公司 | User data query method and device, server and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101051958A (en) * | 2007-05-11 | 2007-10-10 | 北京工业大学 | Extracting method for behaviour analysis parameter of network behaviour |
| CN101184086A (en) * | 2006-11-16 | 2008-05-21 | 达诺媒体有限公司 | Systems and methods for distributed digital rights management |
| CN101374119A (en) * | 2007-08-25 | 2009-02-25 | 鲁海宁 | Method and system for providing information service as well as method for identifying resource |
| CN101630303A (en) * | 2009-08-24 | 2010-01-20 | 成都市华为赛门铁克科技有限公司 | Request message processing method, device and multi-processor memory system |
-
2010
- 2010-05-21 CN CN201010187047A patent/CN101867607A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101184086A (en) * | 2006-11-16 | 2008-05-21 | 达诺媒体有限公司 | Systems and methods for distributed digital rights management |
| CN101051958A (en) * | 2007-05-11 | 2007-10-10 | 北京工业大学 | Extracting method for behaviour analysis parameter of network behaviour |
| CN101374119A (en) * | 2007-08-25 | 2009-02-25 | 鲁海宁 | Method and system for providing information service as well as method for identifying resource |
| CN101630303A (en) * | 2009-08-24 | 2010-01-20 | 成都市华为赛门铁克科技有限公司 | Request message processing method, device and multi-processor memory system |
Cited By (39)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102012931A (en) * | 2010-12-01 | 2011-04-13 | 北京瑞信在线系统技术有限公司 | Filter cache method and device, and cache system |
| CN102694828A (en) * | 2011-03-23 | 2012-09-26 | 中兴通讯股份有限公司 | Method and apparatus for data access in distributed caching system |
| CN102694828B (en) * | 2011-03-23 | 2016-03-30 | 中兴通讯股份有限公司 | A kind of method of distributed cache system data access and device |
| US9380127B2 (en) | 2011-05-18 | 2016-06-28 | Alibaba Group Holding Limited | Distributed caching and cache analysis |
| CN102790784A (en) * | 2011-05-18 | 2012-11-21 | 阿里巴巴集团控股有限公司 | Distributed cache method and system and cache analyzing method and analyzing system |
| CN103544149A (en) * | 2012-07-09 | 2014-01-29 | 百度在线网络技术（北京）有限公司 | Method and system for accessing image and image server |
| CN103544149B (en) * | 2012-07-09 | 2018-07-13 | 百度在线网络技术（北京）有限公司 | A kind of method, system and picture servers accessing picture |
| CN103716341A (en) * | 2012-09-28 | 2014-04-09 | 联想(北京)有限公司 | Information processing method, electronic devices and service platform |
| CN103823807A (en) * | 2012-11-16 | 2014-05-28 | 深圳市腾讯计算机系统有限公司 | Data de-duplication method, device and system |
| CN103823807B (en) * | 2012-11-16 | 2018-06-15 | 深圳市腾讯计算机系统有限公司 | A kind of method, apparatus and system for removing repeated data |
| CN104113566B (en) * | 2013-04-18 | 2019-05-21 | 蓝网科技股份有限公司 | A kind of implementation method of the cloud storage of medical imaging |
| CN104113566A (en) * | 2013-04-18 | 2014-10-22 | 深圳市蓝韵网络有限公司 | Medical image cloud storage implementing method |
| CN103412827B (en) * | 2013-08-05 | 2016-12-28 | 广州唯品会信息科技有限公司 | Image cache method and system |
| CN103412827A (en) * | 2013-08-05 | 2013-11-27 | 广州唯品会信息科技有限公司 | Picture caching method and picture caching system |
| CN103678523A (en) * | 2013-11-28 | 2014-03-26 | 华为技术有限公司 | Distributed cache data access method and device |
| CN103678523B (en) * | 2013-11-28 | 2018-03-09 | 华为技术有限公司 | Distributed cache cache data access methods and device |
| CN103744880A (en) * | 2013-12-20 | 2014-04-23 | 浪潮(北京)电子信息产业有限公司 | DNA data managing method and system based on cloud computing |
| CN103944972A (en) * | 2014-04-02 | 2014-07-23 | 深圳市中博科创信息技术有限公司 | Method and gateway for uploading and downloading data |
| CN104077397A (en) * | 2014-07-01 | 2014-10-01 | 成都康赛信息技术有限公司 | Response method for distributed big data classification retrieval webpage |
| CN104052824A (en) * | 2014-07-04 | 2014-09-17 | 哈尔滨工业大学深圳研究生院 | Distributed cache method and system |
| CN104052824B (en) * | 2014-07-04 | 2017-06-23 | 哈尔滨工业大学深圳研究生院 | Distributed caching method and system |
| CN104408073B (en) * | 2014-10-31 | 2017-10-20 | 广州华多网络科技有限公司 | Data manipulation method and device |
| CN104408073A (en) * | 2014-10-31 | 2015-03-11 | 广州华多网络科技有限公司 | Data operation method and device |
| CN105141672A (en) * | 2015-08-03 | 2015-12-09 | 广州神马移动信息科技有限公司 | Method, device and system for data storage |
| CN105260136B (en) * | 2015-09-24 | 2019-04-05 | 北京百度网讯科技有限公司 | Data read-write method and distributed memory system |
| WO2017049764A1 (en) * | 2015-09-24 | 2017-03-30 | 北京百度网讯科技有限公司 | Method for reading and writing data and distributed storage system |
| US11537659B2 (en) | 2015-09-24 | 2022-12-27 | Beijing Baidu Netcom Science And Technology Co., Ltd. | Method for reading and writing data and distributed storage system |
| CN105260136A (en) * | 2015-09-24 | 2016-01-20 | 北京百度网讯科技有限公司 | Data read-write method and distributed storage system |
| CN105607594A (en) * | 2015-12-25 | 2016-05-25 | 福州福群电子科技有限公司 | Method for searching equipment in server memory based on smart home |
| CN105577806A (en) * | 2015-12-30 | 2016-05-11 | Tcl集团股份有限公司 | Distributed cache method and system |
| CN105577806B (en) * | 2015-12-30 | 2019-11-12 | Tcl集团股份有限公司 | A kind of distributed caching method and system |
| CN105787124A (en) * | 2016-03-28 | 2016-07-20 | 中国建设银行股份有限公司 | Data processing method and device applied to databases as well as data storage system |
| CN107733952A (en) * | 2016-08-12 | 2018-02-23 | 中国电信股份有限公司 | For providing the methods, devices and systems of differentiation buffer service |
| CN108804447A (en) * | 2017-04-28 | 2018-11-13 | 北京京东尚科信息技术有限公司 | Utilize the method and system of cache responses request of data |
| CN108804447B (en) * | 2017-04-28 | 2021-05-25 | 北京京东尚科信息技术有限公司 | Method and system for responding to data request by using cache |
| CN107463598A (en) * | 2017-06-09 | 2017-12-12 | 中国邮政储蓄银行股份有限公司 | Distributed cache system |
| CN109274593A (en) * | 2018-08-31 | 2019-01-25 | 新华三信息安全技术有限公司 | A kind of information storage means and device |
| CN112486956A (en) * | 2020-12-10 | 2021-03-12 | 北京字节跳动网络技术有限公司 | Data access method and device and electronic equipment |
| CN112597198A (en) * | 2020-12-18 | 2021-04-02 | 北京达佳互联信息技术有限公司 | User data query method and device, server and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101867607A (en) | Distributed data access method, device and system | |
| US8849838B2 (en) | Bloom filter for storing file access history | |
| US11301446B1 (en) | System and method for interacting with a plurality of data sources | |
| CN102542052B (en) | Priority hash index | |
| KR101475964B1 (en) | In-memory caching of shared customizable multi-tenant data | |
| US9386117B2 (en) | Server side data cache system | |
| US8782075B2 (en) | Query handling in databases with replicated data | |
| CN104317926B (en) | The data storage and query method and corresponding device and system of a kind of persistence | |
| US9183267B2 (en) | Linked databases | |
| US20100306234A1 (en) | Cache synchronization | |
| US11216516B2 (en) | Method and system for scalable search using microservice and cloud based search with records indexes | |
| CN102375853A (en) | Distributed database system, method for building index therein and query method | |
| CN105159845A (en) | Memory reading method | |
| US20070156655A1 (en) | Method of retrieving data from a data repository, and software and apparatus relating thereto | |
| CN107103014A (en) | The replay method of history pushed information, device and system | |
| CN108694188B (en) | Index data updating method and related device | |
| CN110399348A (en) | File deletes method, apparatus, system and computer readable storage medium again | |
| CN109521962A (en) | A kind of metadata query method, apparatus, equipment and computer readable storage medium | |
| US20150242413A1 (en) | Indexing data updates associated with an electronic catalog system | |
| CN114490527B (en) | Metadata retrieval method, system, terminal and storage medium | |
| CN109254981B (en) | Data management method and device of distributed cache system | |
| CN105005567A (en) | Interest point query method and system | |
| JP5163171B2 (en) | Cache system and server | |
| CN108804502A (en) | Big data inquiry system, method, computer equipment and storage medium | |
| CN103136294A (en) | File operating method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20101020 |