CN102117309A - Data caching system and data query method - Google Patents
Data caching system and data query method Download PDFInfo
- Publication number
- CN102117309A CN102117309A CN 201010042712 CN201010042712A CN102117309A CN 102117309 A CN102117309 A CN 102117309A CN 201010042712 CN201010042712 CN 201010042712 CN 201010042712 A CN201010042712 A CN 201010042712A CN 102117309 A CN102117309 A CN 102117309A
- Authority
- CN
- China
- Prior art keywords
- data
- caching server
- caching
- index
- search
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention relates to the cache technique, and provides a data caching system and a data query method, in order to overcome the disadvantages that the existing Memcached system does not support multi-index and the like. The data caching system comprises a cache proxy, and at least one cache server in communication connection with the cache proxy, wherein the cache proxy is used for receiving a query quest and carrying out hash calculation, and sending the query quest to the corresponding cache server; and the cache server is used for extracting the search field and the search keyword contained in the query quest, searching the corresponding index table in an index region of a cache table of the search field stored in a shared memory, searching the corresponding index in the index table according to the search keyword, searching the corresponding data record in a data region in the cache table according to the index, and returning to the searched data record through the cache proxy. The invention also provides a data query method. The technical scheme provided by the invention is helpful in improving the overall reliability and the security of the data caching system.
Description
Technical field
The present invention relates to caching technology, more particularly, relate to a kind of data buffering system and data enquire method.
Background technology
For alleviating the visit pressure of database server, most of application servers all are provided with data buffering system.The effect of this data buffering system is to store the often data of visit of user temporarily.Thus, when the user visits the data of having carried out interim storage once more, just can directly return this data, and need not from database server, to obtain again these data, reduce the burden of database server thus.
A kind of network data caching system the most commonly used at present is the Memcached system.The Memcached system is a kind of distributed memory caching system, and it adopts Client/Server (client/server) structure, communicates based on socket.The employing of Memcached system (key, value) mode is carried out the buffer memory of data, does not have the notion of logical table, and all data are all shared same storage space.The Memcached system uses proceeding internal memory to come the data of memory buffers, thus, when the critical processes of Memcached system takes place to cause the Memcached system to be restarted unusually, will lose by the data of Memcached system cache.In addition, Memcached does not have the notion of tables of data, and all data cached shared same storage spaces lack division in logic, are not easy to the management and the use of data.In addition, the Memcached system does not support many index, therefore if wish for same data recording a plurality of index to be set, then needs to prepare a plurality of copies for this data recording, and waste of storage space is serious.And the Memcached system do not possess data backup mechanism, and reliability is not high.
Therefore, need a kind of data buffering system, can effectively overcome the above-mentioned defective that existing Memcached system exists.
Summary of the invention
The technical problem to be solved in the present invention is, does not support defectives such as many index at existing Memcached system, and a kind of data buffering system and data enquire method are provided.
The technical solution adopted for the present invention to solve the technical problems is:
Construct a kind of data buffering system, comprise caching agent and at least one caching server that communicates to connect with caching agent;
Described caching agent is used to receive query requests and carries out hash based on this query requests and calculate, and then this query requests is mail to the caching server that hash result of calculation is pointed to;
The caching server that receives described query requests is used for extracting search field and the search key that described query requests comprises, at first search corresponding concordance list in the index area of the cache table of in shared drive, storing according to this search field, in this concordance list, search corresponding index according to search key then, in the data field of cache table, search corresponding data recording according to this index again, return the data recording that finds by caching agent then.
In data buffering system provided by the invention, each caching server and database server communicate to connect, the caching server that receives described query requests is used for when not finding described index, obtain the data recording of the pairing request inquiry of described query requests and generate corresponding index from database server for it, then the data recording obtained and the index of generation are added to respectively in described concordance list and the data field, return this data recording by described caching agent again.
In data buffering system provided by the invention, described caching agent is used for when judging that caching server that described hash result of calculation is pointed to is unavailable, sends searching request with caching server that this unavailable caching server matches mutually based on described query requests in described at least one caching server;
Store the copy of the cache table of this unavailable caching server in the shared drive of the caching server that matches mutually with described unavailable caching server; The caching server that receives this searching request is used for extracting search field and the search key that described searching request comprises, at first search corresponding concordance list in the index area of the described copy of in shared drive, storing according to this search field, in this concordance list, search corresponding index according to search key then, in the data field of described copy, search corresponding data recording according to this index at last, return the data recording that finds by caching agent then.
In data buffering system provided by the invention, each caching server is used for reading the configuration file of the XML form of storage when starting, and generates described cache table according to this configuration file.
In data buffering system provided by the invention, each caching server is used for based on LRU mode or TIMEOUT mode self cache table being carried out the data replacement operation.
The present invention also provides a kind of data enquire method, comprising:
Transmit step, comprise that caching agent receives query requests and carries out hash calculating based on this query requests, mails to this query requests the caching server that hash result of calculation is pointed to then;
Finding step, comprise that the caching server that receives described query requests extracts search field and the search key that comprises in the described query requests, at first search corresponding concordance list in the index area of the cache table of in shared drive, storing according to this search field, in this concordance list, search corresponding index according to search key then, in the data field of cache table, search corresponding data recording according to this index again, return the data recording that finds by caching agent then.
In data enquire method provided by the invention, described finding step comprises that also the caching server that receives described query requests is not when finding described data recording, obtain the data recording of the pairing request inquiry of described query requests and generate corresponding index from database server for it, then the data recording obtained and the index of generation are added to respectively in described concordance list and the data field, return this data recording by described caching agent again.
In data enquire method provided by the invention, described forwarding step also comprises, described caching agent is when the caching server of judging described hash result of calculation sensing is unavailable, in described at least one caching server, send searching request based on described query requests with caching server that this unavailable caching server matches mutually, wherein, store the copy of the cache table of this unavailable caching server in the shared drive of the caching server that matches mutually with described unavailable caching server;
Described finding step also comprises, the caching server that receives this searching request extracts search field and the search key that comprises in the described searching request, at first search corresponding concordance list in the index area of the described copy of in shared drive, storing according to this search field, in this concordance list, search corresponding index according to search key then, in the data field of described copy, search corresponding data recording according to this index at last, return the data recording that finds by caching agent then.
In data enquire method provided by the invention, described method also comprises initialization step, comprises that each caching server reads the configuration file of the XML form of storage when starting, and generates described cache table according to this configuration file.
In data enquire method provided by the invention, described method also comprises step of updating, comprises that each caching server carries out the data replacement operation based on LRU mode or TIMEOUT mode to self cache table.
Implement technical scheme of the present invention, have following beneficial effect: in data buffering system provided by the invention and data enquire method, each caching server is stored in data cached form with cache table in the shared drive.Thus, when the critical processes of caching system takes place to cause process to be restarted unusually, be stored in data cached still available in the shared drive.In addition, cache table is divided into index area and data field in logic, conveniently carries out the management and the use of data.Simultaneously, store a plurality of concordance lists in the index area, just can realize thus same data recording being inquired about by multiple index.At last, technical scheme provided by the invention helps to improve the reliability and the security of entire system for cache table provides real-time Hot Spare mechanism.
Description of drawings
The invention will be further described below in conjunction with drawings and Examples, in the accompanying drawing:
Fig. 1 is the logical organization synoptic diagram according to the network environment of a preferred embodiment of the present invention;
Fig. 2 is the synoptic diagram according in the shared drive of a preferred embodiment of the present invention data distributed architecture;
Fig. 3 is the process flow diagram according to the data enquire method of a preferred embodiment of the present invention.
Embodiment
In order to make purpose of the present invention, technical scheme and advantage clearer,, the present invention is further elaborated below in conjunction with drawings and Examples.Should be appreciated that specific embodiment described herein only in order to explanation the present invention, and be not used in qualification the present invention.
The invention provides a kind of data buffering system and data enquire method, each caching server is stored in data cached form with cache table in the shared drive.Thus, when the critical processes of caching system takes place to cause process to be restarted unusually, be stored in data cached still available in the shared drive.In addition, cache table is divided into index area and data field in logic, conveniently carries out the management and the use of data.Simultaneously, store a plurality of concordance lists in the index area, just can realize thus same data recording being inquired about by multiple index.At last, technical scheme provided by the invention helps to improve the reliability and the security of entire system for cache table provides real-time Hot Spare mechanism.Below just come technical scheme of the present invention is described in detail with specific embodiment in conjunction with the accompanying drawings.
Fig. 1 is the logical organization synoptic diagram according to the network environment 100 of a preferred embodiment of the present invention.As shown in Figure 1, wherein show client 102, caching agent 104, a plurality of caching server 106～110, database server 112 and internet 114.Client 102 communicates to connect by internet 114 and caching agent 104, and a plurality of caching servers 106～110 communicate to connect respectively at caching agent 104, and all are connected to database server 112.Wherein, caching agent 104 and a plurality of caching server 106～110 common composition data caching systems.
Caching agent 104 is used for the socket connection pool to each caching server is managed.
In technical scheme provided by the invention, caching agent 104 reads the configuration file of XML form when starting, wherein specify the connection performance that has between caching agent 104 and a plurality of caching server 106～110 and each caching server and the database server 112.Caching agent 104 by this configuration file management its with a plurality of caching servers 106～110 between be connected.
An example of configuration file is as follows:
<？xml?version＝″1.0″？>
<DBProxy>
<Options>
<ConnTimeOut>1</ConnTimeOut>
<Prefetch>100</Prefetch>
<ConnectFailNum>5</ConnectFailNum>
<ConnectCheckInterval>60</ConnectCheckInterval>
<QueueSize>2097152</QueueSize>
</Options>
<DistributedCache>
<ConnectData?ID＝″1″>
<DNS>192.168.0.1:26005</DNS>
<User>misc</User>
<Passwd>misc</Passwd>
<MaxConns>5</MaxConns>
<MinConns>1</MinConns>
<Backup>0</Backup>
<MaxIdleTime>300</MaxIdleTime>
</ConnectData>
<ConnectData?ID＝″2″>
<DNS>192.168.0.2:26005</DNS>
<User>misc</User>
<Passwd>misc</Passwd>
<MaxConns>5</MaxConns>
<MinConns>1</MinConns>
<Backup>0</Backup>
<MaxIdleTime>300</MaxIdleTime>
</ConnectData>
</DistributedCache>
<Oracle>
<ConnectData?ID＝″1″>
<MaxConns>10</MaxConns>
<MinConns>1</MinConns>
<MaxIdleTime>300</MaxIdleTime>
</ConnectData>
</Oracle>
</DBProxy>
Connection pool has the characteristic of dynamic retractility, can carry out the number of connection increase and decrease automatically according to the situation of each connection.
Connection pool dynamic retractility management process is as follows:
Caching agent 104 is according to the connection example of configuration file initial creation to each caching server.In each connects example, according to minimum number of connection, be created to the initial connection of corresponding caching server, put into connection pool and be connected formation with the free time;
When receiving query requests, to the corresponding cache server, this is to realize by the connection example that query requests is hashed to this caching server correspondence to caching agent 104 with this query requests hash (content of relevant hash calculating will be described in detail hereinafter).The connection example obtains idle a connection for this inquiry use from team's head of idle queues.Do not have idle connection available if idle queues is current, judge then whether the current connection number of connection pool reaches the maximum number of connections of configuration.If reach maximum number of connections, then connect to block in the formation and wait for that connecting formation up to the free time has idle the connection to put into, or specifies time-out time to arrive in the free time.If do not reach maximum number of connections, connection pool is put in a then newly-built connection, and chooses this newly-built connection this inquiry use altogether.
For the connection of choosing, from free time connection formation, delete, join and using the connection formation.
Caching agent 104 comes the forwarding inquiries request according to the connection of choosing.Behind this sign off, (promptly receive the data recording that caching server returns), this is connected from deleting with connecting the formation, and join idle connection formation team head.
When caching agent 104 initial starts are created to the connection example of each caching server, can create a formation for each connection example and detect thread, this thread is periodically carried out following function: the connection chain line state detects: carry out the Link State detection for each connection that the free time connects in the formation.Failure arrives certain number of times if Link State detects continuously, then closes this connection, from discharging connection pool and idle the connection the formation.The idle connection discharges: if current connection pool connects the minimum number of connection of number greater than configuration, then connect the formation tail of the queue and choose idle a connection from the free time, if last visit time that this free time connects and current time in system are at interval greater than the maximum idle time that disposes, then close this connection, and be connected the formation its deletion with idle from connection pool.
Client 102 is used for sending query requests by internet 114 to caching agent 104.
Caching agent 104 is used to receive the query requests that client 102 sends and carries out hash based on this query requests and calculate, and then this query requests is mail to the caching server that hash result of calculation is pointed to.
In the specific implementation process, caching agent 104 can adopt Hash remainder algorithm to carry out above-mentioned hash and calculate, and the implementation of this Hash remainder algorithm is as follows:
S1, the key value in the query requests is carried out CRC32 calculate;
S2, to the result of calculation among the step S1, be that radix carries out complementation with the number of the caching server of current data caching system configuration, obtain remainder;
S3, the order that sets in advance according to the remainder of trying to achieve among the step S2 and for each caching server, selected corresponding cache server is born executing the task of this query requests.
The caching server (such as but not limited to caching server 106～110) of the query requests that reception caching agent 104 is transmitted extracts search field and the search key that comprises in the query requests, at first search corresponding concordance list in the index area of the cache table of in shared drive, storing according to this search field, in this concordance list, search corresponding index according to search key then, in the data field of cache table, search corresponding data recording according to this index at last, return the data recording that finds by caching agent 104 then.
In technical scheme provided by the invention, the form of data cached employing cache table is stored in the shared drive.Thus, when the critical processes of data buffering system provided by the invention takes place to cause process to be restarted unusually, be stored in data cached still available in the shared drive.Do not restart the data cached situation of losing that causes adopting the proceeding internal memory storage and process can not occur.
In the specific implementation process, cache table further is divided into index area and data field.Store at least one concordance list in the index area.Every corresponding index type of concordance list, a field or a plurality of field of data recording in each index type corresponding data district.This shows that technical scheme provided by the invention can be set up a plurality of index to the data record, and data recording need not according to the quantity of index the data record to be carried out duplicating of equal number of times.For example, if data recording is a bibliography information, every bibliography information comprises a plurality of fields such as title, publishing house, classifying content.Can be that data recording makes up a concordance list then according to each field.To make up three above concordance lists for data recording thus.
In the specific implementation process, also can one metadata table be set to cache table, be used for the structure of cache table is described.Thus, just can when receiving query requests, at first carry out the legitimacy verification to query requests according to this metadata table.Record in the metadata table for example, the index area in the cache table comprise three concordance lists that title, publishing house, these three fields of classifying content of comprising according to every data recording make up.In this case, if the indication of the query requests received search the publication date for * * * bibliography, then because cache table is not provided with index according to the publication date, and cause this query requests illegal, thereby refusal is carried out this query requests.
In the specific implementation process, the distributed architecture of every data as shown in Figure 2 in the shared drive.
Fig. 2 is the synoptic diagram according in the shared drive of a preferred embodiment of the present invention data distributed architecture.As shown in Figure 2, store metadata table and cache table in the shared drive.And cache table further comprises index area and data field.About the content of metadata table, cache table, index area and data field is described in detail at preamble, therefore repeat no more herein.
In the specific implementation process, each caching server reads the configuration file of XML (Extensible Markup Language, the extend markup language) form of storage when starting, and according to this configuration file generator tables of data and cache table.Can be in configuration file each generic attribute of each tables of data in the specific data caching system, as contents such as list structure, table index, the strategy that skips, host's main frames.In the specific implementation process, the example of configuration file is as follows:
<？xml?version＝″1.0″encoding＝″utf-8″？>
<daf>
<define>
<table name＝″v_supersp″ type＝″cache″ storage＝″3″
maxrecnum＝″48000″initload＝″2″>
<column?type＝″string″>icpcode</column>
<column?type＝″string″>icpid</column>
<column?type＝″string″>icptypeid</column>
<column?type＝″string″>supericpcode</column>
<column?type＝″string″>icpstatus</column>
<index?name＝″idx_icpcode″type＝″hash″flag＝″1″>
<column_name>icpcode</column_name>
</index>
<index?name＝″idx_supericpcode″type＝″hash″flag＝″0″>
<column_name>supericpcode</column_name>
</index>
<aging>none</aging>
</table>
<table name＝″v_subscriber″ type＝″cache″ storage＝″2600″
maxrecnum＝″4050000″initload＝″0″>
<column?type＝″string″>status</column>
<column?type＝″string″>mid</column>
<column?type＝″string″>subsid</column>
<index?name＝″idx_subsid″type＝″hash″flag＝″0″>
<column_name>subsid</column_name>
</index>
<aging>lru</aging>
</table>
</define>
<deploy>
<machine?name＝″zj_svr01″ip＝″192.168.0.1″>
<table_name>v_supersp</table_name>
</machine>
<machine?name＝″zj_svr02″ip＝″192.168.0.2″>
<table_name>v_subscriber</table_name>
</machine>
</deploy>
Simultaneously, also define the creation method that metadata table is arranged in the configuration file.For the data recording that need to be configured to original upload in the cache table, in the configuration file except the creation method of index of definition district and data field, also definable reads table record as data recording and for it generates index to constitute concordance list in the corresponding tables from database server after data buffering system starts, and is loaded into then in data field and the index area.Load operation can be synchronous or asynchronous system, depends on the concrete configuration of each tables of data.
As indicated above, by lists such as metadata table, concordance list and tables of data are set, can realize optimum management to the data record.
As indicated above, each caching server (such as but not limited to caching server 106～110) communicates to connect with database server 112.The caching server that receives query requests is used for when not finding corresponding index, obtaining query requests from database server 112 asks the data recording of inquiring about and is the corresponding index of its generation, then the data recording obtained and the index of generation are added to respectively in concordance list and the data field, return this data recording by caching agent 104 again.
In addition, caching agent 104 is used for when judging that caching server that hash result of calculation is pointed to is unavailable, sends searching request with caching server that this unavailable caching server matches mutually based on query requests in other caching servers;
Store the copy of the cache table of this unavailable caching server in the shared drive of the caching server that matches mutually with unavailable caching server; The caching server that receives this searching request is used for extracting search field and the search key that searching request comprises, at first search corresponding concordance list in the index area of the described copy of in shared drive, storing according to this search field, in this concordance list, search corresponding index according to search key then, in the data field of described copy, search corresponding data recording according to this index at last, return the data recording that finds by caching agent then.Be not difficult to find out that so technical scheme provided by the invention provides Hot Spare mechanism, thereby effectively improve the reliability of data buffering system.
In the specific implementation process,, can in its configuration file, specify caching server with its pairing for each caching server.
In the specific implementation process, the backup procedure that caching server (inserts, revises or deletion) when carrying out Data Update is as follows:
Request first for affairs, caching agent 104 is after receiving the Data Update request (affairs are asked first) that client 102 is sent, this update request is carried out hash to be calculated, with the connection example of selected corresponding caching server, on this connection example, choose a connection and carry out the Data Update operation; After Data Update finishes, if this connections exemplary configuration backup connection example (promptly this caching server disposes the caching server of pairing), then this Data Update request of buffer memory on the operation history chained list of above-mentioned connection correspondence, return this operating result to client, return the connection ID of this operation simultaneously;
The intermediate request of affairs, caching agent 104 receives the Data Update request (affairs intermediate request) that client 102 is sent, and wherein comprises the connection ID of operation last time.104 pairs of these update requests of caching agent are carried out hash calculating, with the connection example of selected corresponding caching server, carry out Data Update behaviour by the connection pointed of above-mentioned connection ID then on the connection example.After Data Update finishes, if this connections exemplary configuration backup connect example, then this Data Update request of buffer memory on the operation history chained list in the connection is returned this operating result to client.
For the ending request of affairs, caching agent 104 receives the Data Update request (the affairs ending request is for submitting to or rollback) that client 102 is sent, and wherein comprises the connection ID of operation last time.104 pairs of these update requests of caching agent are carried out hash and are calculated, connection example with selected corresponding caching server, on the connection example, carry out data then and submit to or rolling back action, return this operating result to client then by the connection pointed of above-mentioned connection ID.If this connections exemplary configuration backup connection example, and this is operating as rolling back action, then deletes all Data Update requests of buffer memory on the operation history chained list of this connection; If this connections exemplary configuration backup connect example, and this is submit operation, then presses the operation history chained list extraction Data Update request of cache-time order from this connection, and is inserted into the backup request buffer queue of this connection example.The backup thread of this connection example reads all Data Update requests of these affairs from the backup request buffer queue, initiate the Data Update request to the backed-up instance of this connection example.
From above backup policy as can be seen, at the backup of Data Update request, caching agent 104 has adopted the strategy of " first row cache, concentrate submit to ", directly abandons for the request of rollback, can not produce backup operation; For the request of submitting to, in backup, adopt asynchronous system simultaneously, compare with not adopting backup policy on the performance, have only minimum performance loss.
In technical scheme provided by the invention, each caching server is used for based on LRU mode or TIMEOUT mode self cache table being carried out the data replacement operation.
The data replacement operation of carrying out that each caching server carried out can be LRU data scrubbing or the cleaning of TimeOut stale data.Each caching server is that LRU strategy and TimeOut strategy are safeguarded a doubly linked list respectively, and each node data pointer to member of chained list points in the cache table memory address of data recording in the data field.
LRU skips strategy according to access time of each data recording in the data field in cache table order, and all data recording are conspired to create chained list, and the data recording of up-to-date visit is moved to the chained list head.Caching server is to have disposed the cache table startup LRU cleaning thread that LRU skips tactful.This thread periodic scan cache table, cache table the utilization rate of shared drive is arrived set in advance in limited time, this thread is cleared up to the data recording of head of the queue scanning direction predetermined number from the chained list tail of the queue, and clears up the index of these data recording.TimeOut skips strategy according to the insertion sequence of each data recording in the data field in the cache table, and all data recording are conspired to create chained list, and the new data recording of inserting is positioned at the chained list tail of the queue.Simultaneously, write down the time-out time of corresponding data record on the chained list node.Caching server is to have disposed the cache table startup TimeOut cleaning thread that TimeOut skips tactful, this thread periodically travels through chained list, the data recording of this traversal predetermined number, overtime moment of this each data recording that traverses and system current time are compared, if the overtime moment surpasses system's current time, then clear up this data recording and corresponding index record.The request of data thread can be remembered the position of each traversal, and scan period next time arrives, and thread can be from back, the position continuation scanning of traversal last time.After scanning tail of the queue, restart scanning from head of the queue.
The present invention also provides a kind of data enquire method, below just be described in greater detail in conjunction with Fig. 3.
Fig. 3 is the process flow diagram according to the data enquire method 300 of a preferred embodiment of the present invention.As shown in Figure 3, method 300 starts from step 302.
Subsequently, at next step 304, caching agent receives query requests and carries out hash based on this query requests and calculate, and then this query requests is mail to the caching server that hash result of calculation is pointed to.
Subsequently, at next step 306, the caching server that receives described query requests extracts search field and the search key that comprises in the described query requests.
Subsequently, at next step 308, search corresponding concordance list in the index area of the cache table of in shared drive, storing according to this search field.
Subsequently, at next step 310, in this concordance list, search corresponding index according to search key.
Subsequently, at next step 312, in the data field of cache table, search corresponding data recording according to this index.
Subsequently, at next step 314, return the data recording that finds by caching agent.
At last, method 300 ends at step 316.
In said method 300, step 304 can reduce the forwarding step, and step 306～314 can reduce finding step.
In the specific implementation process, finding step comprises that also the caching server that receives query requests is not when finding described index, obtain the data recording of the pairing request inquiry of described query requests and generate corresponding index from database server for it, then the data recording obtained and the index of generation are added to respectively in described concordance list and the data field, return this data recording by described caching agent again.
In the specific implementation process, transmitting step also comprises, described caching agent is when the caching server of judging described hash result of calculation sensing is unavailable, in described at least one caching server, send searching request based on described query requests with caching server that this unavailable caching server matches mutually, wherein, store the copy of the cache table of this unavailable caching server in the shared drive of the caching server that matches mutually with described unavailable caching server; In this case, finding step also comprises, the caching server that receives this searching request extracts search field and the search key that comprises in the described searching request, at first search corresponding concordance list in the index area of the described copy of in shared drive, storing according to this search field, in this concordance list, search corresponding index according to search key then, in the data field of described copy, search corresponding data recording according to this index at last, return the data recording that finds by caching agent then.
In the specific implementation process, method 300 also comprises initialization step, comprises that each caching server reads the configuration file of the XML form of storage when starting, and generates described cache table according to this configuration file.
In the specific implementation process, method 300 also comprises step of updating, comprises that each caching server carries out the data replacement operation based on LRU mode or TIMEOUT mode to self cache table.
The above only is preferred embodiment of the present invention, not in order to restriction the present invention, all any modifications of being done within the spirit and principles in the present invention, is equal to and replaces and improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. a data buffering system is characterized in that, comprises caching agent and at least one caching server that communicates to connect with caching agent;
Described caching agent is used to receive query requests and carries out hash based on this query requests and calculate, and then this query requests is mail to the caching server that hash result of calculation is pointed to;
The caching server that receives described query requests is used for extracting search field and the search key that described query requests comprises, at first search corresponding concordance list in the index area of the cache table of in shared drive, storing according to this search field, in this concordance list, search corresponding index according to search key then, in the data field of cache table, search corresponding data recording according to this index again, return the data recording that finds by caching agent then.
2. data buffering system according to claim 1, it is characterized in that, each caching server and database server communicate to connect, the caching server that receives described query requests is used for when not finding described index, obtain the data recording of the pairing request inquiry of described query requests and generate corresponding index from database server for it, then the data recording obtained and the index of generation are added to respectively in described concordance list and the data field, return this data recording by described caching agent again.
3. data buffering system according to claim 1, it is characterized in that, described caching agent is used for when judging that caching server that described hash result of calculation is pointed to is unavailable, sends searching request with caching server that this unavailable caching server matches mutually based on described query requests in described at least one caching server;
Store the copy of the cache table of this unavailable caching server in the shared drive of the caching server that matches mutually with described unavailable caching server; The caching server that receives this searching request is used for extracting search field and the search key that described searching request comprises, at first search corresponding concordance list in the index area of the described copy of in shared drive, storing according to this search field, in this concordance list, search corresponding index according to search key then, in the data field of described copy, search corresponding data recording according to this index at last, return the data recording that finds by caching agent then.
4. data buffering system according to claim 3 is characterized in that, each caching server is used for reading the configuration file of the XML form of storage when starting, and generates described cache table according to this configuration file.
5. data buffering system according to claim 4 is characterized in that, each caching server is used for based on LRU mode or TIMEOUT mode self cache table being carried out the data replacement operation.
6. a data enquire method is characterized in that, comprising:
Transmit step, comprise that caching agent receives query requests and carries out hash calculating based on this query requests, mails to this query requests the caching server that hash result of calculation is pointed to then;
Finding step, comprise that the caching server that receives described query requests extracts search field and the search key that comprises in the described query requests, at first search corresponding concordance list in the index area of the cache table of in shared drive, storing according to this search field, in this concordance list, search corresponding index according to search key then, in the data field of cache table, search corresponding data recording according to this index again, return the data recording that finds by caching agent then.
7. data enquire method according to claim 6, it is characterized in that, described finding step comprises that also the caching server that receives described query requests is not when finding described index, obtain the data recording of the pairing request inquiry of described query requests and generate corresponding index from database server for it, then the data recording obtained and the index of generation are added to respectively in described concordance list and the data field, return this data recording by described caching agent again.
8. data enquire method according to claim 7, it is characterized in that, described forwarding step also comprises, described caching agent is when the caching server of judging described hash result of calculation sensing is unavailable, in described at least one caching server, send searching request based on described query requests with caching server that this unavailable caching server matches mutually, wherein, store the copy of the cache table of this unavailable caching server in the shared drive of the caching server that matches mutually with described unavailable caching server;
Described finding step also comprises, the caching server that receives this searching request extracts search field and the search key that comprises in the described searching request, at first search corresponding concordance list in the index area of the described copy of in shared drive, storing according to this search field, in this concordance list, search corresponding index according to search key then, in the data field of described copy, search corresponding data recording according to this index at last, return the data recording that finds by caching agent then.
9. data enquire method according to claim 8 is characterized in that described method also comprises initialization step, comprises that each caching server reads the configuration file of the XML form of storage when starting, and generates described cache table according to this configuration file.
10. data enquire method according to claim 9 is characterized in that described method also comprises step of updating, comprises that each caching server carries out the data replacement operation based on LRU mode or TIMEOUT mode to self cache table.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010042712 CN102117309B (en) | 2010-01-06 | 2010-01-06 | Data caching system and data query method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010042712 CN102117309B (en) | 2010-01-06 | 2010-01-06 | Data caching system and data query method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102117309A true CN102117309A (en) | 2011-07-06 |
| CN102117309B CN102117309B (en) | 2013-04-17 |
Family
ID=44216083
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010042712 Expired - Fee Related CN102117309B (en) | 2010-01-06 | 2010-01-06 | Data caching system and data query method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102117309B (en) |
Cited By (55)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102710774A (en) * | 2012-06-04 | 2012-10-03 | 深圳市宏电技术股份有限公司 | Method and system for data transmission |
| CN102710790A (en) * | 2012-06-20 | 2012-10-03 | 深圳市远行科技有限公司 | Memcached implementation method and system based on metadata management |
| CN102968507A (en) * | 2012-12-14 | 2013-03-13 | 中国银行股份有限公司 | Cache table based data query method |
| CN103019964A (en) * | 2012-12-24 | 2013-04-03 | 北京搜狐新媒体信息技术有限公司 | Cache data access method and data cache system |
| CN103067293A (en) * | 2012-12-31 | 2013-04-24 | 北京京东世纪贸易有限公司 | Method and system for multiplex and connection management of a load balancer |
| CN103136278A (en) * | 2011-12-05 | 2013-06-05 | 腾讯科技（深圳）有限公司 | Data reading method and data reading device |
| CN103309873A (en) * | 2012-03-09 | 2013-09-18 | 阿里巴巴集团控股有限公司 | Method and device for processing data, and system |
| CN103390061A (en) * | 2013-07-31 | 2013-11-13 | 浙江大学 | Multi-level cache-based sea spatio-temporal data accessing method taking user as center |
| CN103475690A (en) * | 2013-06-17 | 2013-12-25 | 携程计算机技术（上海）有限公司 | Memcached instance configuration method and Memcached instance configuration system |
| CN103678172A (en) * | 2013-12-25 | 2014-03-26 | Tcl集团股份有限公司 | Local data cache management method and device |
| CN104067279A (en) * | 2012-03-30 | 2014-09-24 | 惠普发展公司，有限责任合伙企业 | Authorization cache |
| CN104216901A (en) * | 2013-05-31 | 2014-12-17 | 北京新媒传信科技有限公司 | Information searching method and system |
| CN104765652A (en) * | 2014-01-08 | 2015-07-08 | 中国移动通信集团浙江有限公司 | Data backup and data recovery method and device |
| CN104951403A (en) * | 2015-07-06 | 2015-09-30 | 中国科学技术大学 | Low-overhead and error-free cold and hot data recognition method |
| CN105022743A (en) * | 2014-04-24 | 2015-11-04 | 中兴通讯股份有限公司 | Index management method and index management device |
| CN105427057A (en) * | 2015-12-22 | 2016-03-23 | 黑龙江盛世达仁科技开发有限责任公司 | System and method for assistance in water saving and grain increase |
| CN105512053A (en) * | 2015-12-07 | 2016-04-20 | 中南大学 | Mirror caching method for mobile transparent computing system server terminal multi-user access |
| CN105589890A (en) * | 2014-11-05 | 2016-05-18 | 中国银联股份有限公司 | Memory sharing frame system |
| CN105786909A (en) * | 2014-12-25 | 2016-07-20 | 北京东方通科技股份有限公司 | Message queue backlog load self-adaptive application triggering method and system |
| CN105912675A (en) * | 2016-04-13 | 2016-08-31 | 中国科学院计算技术研究所 | Batch delete/query method and apparatus for merging small files |
| CN106294607A (en) * | 2016-07-29 | 2017-01-04 | 北京奇虎科技有限公司 | Data cached update method and updating device |
| CN106372254A (en) * | 2016-09-28 | 2017-02-01 | 广州华多网络科技有限公司 | Business data processing method and device, and terminal |
| CN106557562A (en) * | 2016-11-14 | 2017-04-05 | 天津南大通用数据技术股份有限公司 | A kind of querying method and device of unit database data |
| CN106557503A (en) * | 2015-09-28 | 2017-04-05 | 杭州海康威视数字技术股份有限公司 | A kind of method and system of image retrieval |
| CN106777085A (en) * | 2016-12-13 | 2017-05-31 | 东软集团股份有限公司 | A kind of data processing method, device and data query system |
| CN103559300B (en) * | 2013-11-13 | 2017-06-13 | 曙光信息产业(北京)有限公司 | The querying method and inquiry unit of data |
| CN106998366A (en) * | 2017-05-23 | 2017-08-01 | 上海斐讯数据通信技术有限公司 | A kind of cloud controller load-balancing method and its device, a kind of cloud controller |
| CN107133300A (en) * | 2017-04-27 | 2017-09-05 | 福建中金在线信息科技有限公司 | A kind of data query method and device |
| CN107346307A (en) * | 2016-05-04 | 2017-11-14 | 北京京东尚科信息技术有限公司 | Distributed cache system and method |
| CN107483604A (en) * | 2017-08-29 | 2017-12-15 | 武汉斗鱼网络科技有限公司 | The method and apparatus that Nginx RTMP dynamics update DNS cache |
| CN107943718A (en) * | 2017-12-07 | 2018-04-20 | 网宿科技股份有限公司 | A kind of method and apparatus for clearing up cache file |
| CN108268476A (en) * | 2016-12-30 | 2018-07-10 | 北京国双科技有限公司 | Data query method and device |
| CN108604278A (en) * | 2015-10-23 | 2018-09-28 | 甲骨文国际公司 | Self-described configuration with the support to shared data table |
| CN108614826A (en) * | 2016-12-12 | 2018-10-02 | 中国移动通信集团公司 | A kind of data query method and device |
| CN108763458A (en) * | 2018-05-28 | 2018-11-06 | 腾讯科技（深圳）有限公司 | Content characteristic querying method, device, computer equipment and storage medium |
| CN108780458A (en) * | 2017-12-08 | 2018-11-09 | 深圳市大疆创新科技有限公司 | A kind of page cache processing method, device and server |
| CN108810041A (en) * | 2017-04-27 | 2018-11-13 | 华为技术有限公司 | A kind of data write-in of distributed cache system and expansion method, device |
| CN109358805A (en) * | 2018-09-03 | 2019-02-19 | 中新网络信息安全股份有限公司 | A kind of data cache method |
| CN109376020A (en) * | 2018-09-18 | 2019-02-22 | 中国银行股份有限公司 | Data processing method, device and the storage medium multi-tiling chain interaction and given |
| CN109412846A (en) * | 2018-10-11 | 2019-03-01 | 杭州迪普科技股份有限公司 | A kind of configuration rollback method and device |
| CN110019259A (en) * | 2017-09-26 | 2019-07-16 | 亿阳信通股份有限公司 | Data-updating method, device and the storage medium of distributed index service-Engine |
| CN110716960A (en) * | 2019-10-22 | 2020-01-21 | 北京锐安科技有限公司 | Database query method, device, equipment and storage medium |
| CN110795457A (en) * | 2019-09-24 | 2020-02-14 | 苏宁云计算有限公司 | Data caching processing method and device, computer equipment and storage medium |
| CN110955688A (en) * | 2019-12-23 | 2020-04-03 | 北京奇艺世纪科技有限公司 | Proxy server, data query method and device, electronic equipment and storage medium |
| CN110990734A (en) * | 2019-11-11 | 2020-04-10 | 苏宁云计算有限公司 | Construction method of cache structure |
| CN111651631A (en) * | 2020-04-28 | 2020-09-11 | 长沙证通云计算有限公司 | High-concurrency video data processing method, electronic equipment, storage medium and system |
| CN112016693A (en) * | 2019-05-30 | 2020-12-01 | 中兴通讯股份有限公司 | Machine learning engine implementation method and device, terminal equipment and storage medium |
| CN112035485A (en) * | 2020-09-03 | 2020-12-04 | 徐州金蝶软件有限公司 | Method and system for realizing efficient query of credit information data based on distributed architecture |
| CN112100446A (en) * | 2019-06-18 | 2020-12-18 | 上海赜睿信息科技有限公司 | Search method, readable storage medium and electronic device |
| CN112187908A (en) * | 2020-09-23 | 2021-01-05 | 易小博(武汉)科技有限公司 | Data processing method, system and interface service platform |
| CN113420052A (en) * | 2021-07-08 | 2021-09-21 | 上海浦东发展银行股份有限公司 | Multi-level distributed cache system and method |
| CN113779028A (en) * | 2021-08-31 | 2021-12-10 | 珠海市新德汇信息技术有限公司 | Storage method, query method, electronic device and storage medium fusing primary key index genes |
| WO2022105574A1 (en) * | 2020-11-20 | 2022-05-27 | 北京沃东天骏信息技术有限公司 | Information transmission method, system, and apparatus |
| CN115203204A (en) * | 2022-07-13 | 2022-10-18 | 国电南京自动化股份有限公司 | High-capacity decoupling flexible master station system and control method |
| CN112100446B (en) * | 2019-06-18 | 2024-05-14 | 上海赜睿信息科技有限公司 | Search method, readable storage medium, and electronic device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7577960B2 (en) * | 2003-06-19 | 2009-08-18 | Microsoft Corporation | System and method for managing cached objects using notifications bonds |
| CN100530186C (en) * | 2006-12-26 | 2009-08-19 | 腾讯科技（深圳）有限公司 | Method and system for processing buffer |
| CN100472539C (en) * | 2007-04-17 | 2009-03-25 | 南京中兴软创科技有限责任公司 | Database access interface method based on caching technology |
-
2010
- 2010-01-06 CN CN 201010042712 patent/CN102117309B/en not_active Expired - Fee Related
Cited By (84)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103136278A (en) * | 2011-12-05 | 2013-06-05 | 腾讯科技（深圳）有限公司 | Data reading method and data reading device |
| CN103136278B (en) * | 2011-12-05 | 2016-10-05 | 腾讯科技（深圳）有限公司 | A kind of method and device reading data |
| CN103309873B (en) * | 2012-03-09 | 2018-06-12 | 阿里巴巴集团控股有限公司 | The processing method of data, apparatus and system |
| CN103309873A (en) * | 2012-03-09 | 2013-09-18 | 阿里巴巴集团控股有限公司 | Method and device for processing data, and system |
| US9514290B2 (en) | 2012-03-30 | 2016-12-06 | Hewlett Packard Enterprise Development Lp | Authorization cache |
| CN104067279A (en) * | 2012-03-30 | 2014-09-24 | 惠普发展公司，有限责任合伙企业 | Authorization cache |
| CN102710774A (en) * | 2012-06-04 | 2012-10-03 | 深圳市宏电技术股份有限公司 | Method and system for data transmission |
| CN102710774B (en) * | 2012-06-04 | 2014-12-17 | 深圳市宏电技术股份有限公司 | Method and system for data transmission |
| CN102710790B (en) * | 2012-06-20 | 2015-06-10 | 深圳市远行科技有限公司 | Memcached implementation method and system based on metadata management |
| CN102710790A (en) * | 2012-06-20 | 2012-10-03 | 深圳市远行科技有限公司 | Memcached implementation method and system based on metadata management |
| CN102968507A (en) * | 2012-12-14 | 2013-03-13 | 中国银行股份有限公司 | Cache table based data query method |
| CN103019964A (en) * | 2012-12-24 | 2013-04-03 | 北京搜狐新媒体信息技术有限公司 | Cache data access method and data cache system |
| CN103019964B (en) * | 2012-12-24 | 2016-01-27 | 北京搜狐新媒体信息技术有限公司 | A kind of cache data access method and data buffering system |
| CN103067293A (en) * | 2012-12-31 | 2013-04-24 | 北京京东世纪贸易有限公司 | Method and system for multiplex and connection management of a load balancer |
| CN103067293B (en) * | 2012-12-31 | 2017-03-22 | 北京京东世纪贸易有限公司 | Method and system for multiplex and connection management of a load balancer |
| CN104216901A (en) * | 2013-05-31 | 2014-12-17 | 北京新媒传信科技有限公司 | Information searching method and system |
| CN104216901B (en) * | 2013-05-31 | 2017-12-05 | 北京新媒传信科技有限公司 | The method and system of information search |
| CN103475690B (en) * | 2013-06-17 | 2016-06-08 | 上海携程商务有限公司 | Memcached node configuration method and device |
| CN103475690A (en) * | 2013-06-17 | 2013-12-25 | 携程计算机技术（上海）有限公司 | Memcached instance configuration method and Memcached instance configuration system |
| CN103390061A (en) * | 2013-07-31 | 2013-11-13 | 浙江大学 | Multi-level cache-based sea spatio-temporal data accessing method taking user as center |
| CN103390061B (en) * | 2013-07-31 | 2016-12-28 | 浙江大学 | Customer-centric and spatio-temporal data accessing method based on multi-level buffer |
| CN103559300B (en) * | 2013-11-13 | 2017-06-13 | 曙光信息产业(北京)有限公司 | The querying method and inquiry unit of data |
| CN103678172A (en) * | 2013-12-25 | 2014-03-26 | Tcl集团股份有限公司 | Local data cache management method and device |
| CN103678172B (en) * | 2013-12-25 | 2017-05-03 | Tcl集团股份有限公司 | Local data cache management method and device |
| CN104765652A (en) * | 2014-01-08 | 2015-07-08 | 中国移动通信集团浙江有限公司 | Data backup and data recovery method and device |
| CN105022743A (en) * | 2014-04-24 | 2015-11-04 | 中兴通讯股份有限公司 | Index management method and index management device |
| CN105589890A (en) * | 2014-11-05 | 2016-05-18 | 中国银联股份有限公司 | Memory sharing frame system |
| CN105589890B (en) * | 2014-11-05 | 2019-06-14 | 中国银联股份有限公司 | Memory sharing frame system |
| CN105786909A (en) * | 2014-12-25 | 2016-07-20 | 北京东方通科技股份有限公司 | Message queue backlog load self-adaptive application triggering method and system |
| CN104951403B (en) * | 2015-07-06 | 2018-01-30 | 中国科学技术大学 | A kind of cold and hot data identification method of low overhead and zero defect |
| CN104951403A (en) * | 2015-07-06 | 2015-09-30 | 中国科学技术大学 | Low-overhead and error-free cold and hot data recognition method |
| CN106557503A (en) * | 2015-09-28 | 2017-04-05 | 杭州海康威视数字技术股份有限公司 | A kind of method and system of image retrieval |
| CN108604278A (en) * | 2015-10-23 | 2018-09-28 | 甲骨文国际公司 | Self-described configuration with the support to shared data table |
| CN105512053B (en) * | 2015-12-07 | 2017-06-16 | 中南大学 | The mirror cache method of mobile transparent computing system server end multi-user access |
| CN105512053A (en) * | 2015-12-07 | 2016-04-20 | 中南大学 | Mirror caching method for mobile transparent computing system server terminal multi-user access |
| CN105427057A (en) * | 2015-12-22 | 2016-03-23 | 黑龙江盛世达仁科技开发有限责任公司 | System and method for assistance in water saving and grain increase |
| CN105912675A (en) * | 2016-04-13 | 2016-08-31 | 中国科学院计算技术研究所 | Batch delete/query method and apparatus for merging small files |
| CN105912675B (en) * | 2016-04-13 | 2019-06-18 | 中国科学院计算技术研究所 | A kind of batch deletion/querying method and device merged for small documents |
| CN107346307A (en) * | 2016-05-04 | 2017-11-14 | 北京京东尚科信息技术有限公司 | Distributed cache system and method |
| CN106294607A (en) * | 2016-07-29 | 2017-01-04 | 北京奇虎科技有限公司 | Data cached update method and updating device |
| CN106372254B (en) * | 2016-09-28 | 2022-04-29 | 广州华多网络科技有限公司 | Method, device and terminal for processing service data |
| CN106372254A (en) * | 2016-09-28 | 2017-02-01 | 广州华多网络科技有限公司 | Business data processing method and device, and terminal |
| CN106557562A (en) * | 2016-11-14 | 2017-04-05 | 天津南大通用数据技术股份有限公司 | A kind of querying method and device of unit database data |
| CN108614826A (en) * | 2016-12-12 | 2018-10-02 | 中国移动通信集团公司 | A kind of data query method and device |
| CN106777085A (en) * | 2016-12-13 | 2017-05-31 | 东软集团股份有限公司 | A kind of data processing method, device and data query system |
| CN108268476A (en) * | 2016-12-30 | 2018-07-10 | 北京国双科技有限公司 | Data query method and device |
| CN108268476B (en) * | 2016-12-30 | 2021-11-30 | 北京国双科技有限公司 | Data query method and device |
| CN107133300A (en) * | 2017-04-27 | 2017-09-05 | 福建中金在线信息科技有限公司 | A kind of data query method and device |
| CN108810041B (en) * | 2017-04-27 | 2021-03-05 | 华为技术有限公司 | Data writing and capacity expansion method and device for distributed cache system |
| CN108810041A (en) * | 2017-04-27 | 2018-11-13 | 华为技术有限公司 | A kind of data write-in of distributed cache system and expansion method, device |
| CN106998366B (en) * | 2017-05-23 | 2020-12-22 | 金华市智甄通信设备有限公司 | Cloud controller load balancing method and device and cloud controller |
| CN106998366A (en) * | 2017-05-23 | 2017-08-01 | 上海斐讯数据通信技术有限公司 | A kind of cloud controller load-balancing method and its device, a kind of cloud controller |
| CN107483604B (en) * | 2017-08-29 | 2020-12-15 | 武汉斗鱼网络科技有限公司 | Method and device for dynamically updating DNS cache by Nginx-RTMP |
| CN107483604A (en) * | 2017-08-29 | 2017-12-15 | 武汉斗鱼网络科技有限公司 | The method and apparatus that Nginx RTMP dynamics update DNS cache |
| CN110019259B (en) * | 2017-09-26 | 2023-09-22 | 亿阳信通股份有限公司 | Data updating method, device and storage medium of distributed index service engine |
| CN110019259A (en) * | 2017-09-26 | 2019-07-16 | 亿阳信通股份有限公司 | Data-updating method, device and the storage medium of distributed index service-Engine |
| CN107943718A (en) * | 2017-12-07 | 2018-04-20 | 网宿科技股份有限公司 | A kind of method and apparatus for clearing up cache file |
| CN107943718B (en) * | 2017-12-07 | 2021-09-14 | 网宿科技股份有限公司 | Method and device for cleaning cache file |
| CN108780458A (en) * | 2017-12-08 | 2018-11-09 | 深圳市大疆创新科技有限公司 | A kind of page cache processing method, device and server |
| CN108763458A (en) * | 2018-05-28 | 2018-11-06 | 腾讯科技（深圳）有限公司 | Content characteristic querying method, device, computer equipment and storage medium |
| CN108763458B (en) * | 2018-05-28 | 2023-06-16 | 腾讯科技（深圳）有限公司 | Content characteristic query method, device, computer equipment and storage medium |
| CN109358805A (en) * | 2018-09-03 | 2019-02-19 | 中新网络信息安全股份有限公司 | A kind of data cache method |
| CN109376020A (en) * | 2018-09-18 | 2019-02-22 | 中国银行股份有限公司 | Data processing method, device and the storage medium multi-tiling chain interaction and given |
| CN109412846B (en) * | 2018-10-11 | 2021-08-24 | 杭州迪普科技股份有限公司 | Configuration rollback method and device |
| CN109412846A (en) * | 2018-10-11 | 2019-03-01 | 杭州迪普科技股份有限公司 | A kind of configuration rollback method and device |
| CN112016693A (en) * | 2019-05-30 | 2020-12-01 | 中兴通讯股份有限公司 | Machine learning engine implementation method and device, terminal equipment and storage medium |
| CN112016693B (en) * | 2019-05-30 | 2021-06-04 | 中兴通讯股份有限公司 | Machine learning engine implementation method and device, terminal equipment and storage medium |
| CN112100446B (en) * | 2019-06-18 | 2024-05-14 | 上海赜睿信息科技有限公司 | Search method, readable storage medium, and electronic device |
| CN112100446A (en) * | 2019-06-18 | 2020-12-18 | 上海赜睿信息科技有限公司 | Search method, readable storage medium and electronic device |
| CN110795457A (en) * | 2019-09-24 | 2020-02-14 | 苏宁云计算有限公司 | Data caching processing method and device, computer equipment and storage medium |
| CN110716960A (en) * | 2019-10-22 | 2020-01-21 | 北京锐安科技有限公司 | Database query method, device, equipment and storage medium |
| CN110990734A (en) * | 2019-11-11 | 2020-04-10 | 苏宁云计算有限公司 | Construction method of cache structure |
| CN110955688A (en) * | 2019-12-23 | 2020-04-03 | 北京奇艺世纪科技有限公司 | Proxy server, data query method and device, electronic equipment and storage medium |
| CN111651631A (en) * | 2020-04-28 | 2020-09-11 | 长沙证通云计算有限公司 | High-concurrency video data processing method, electronic equipment, storage medium and system |
| CN111651631B (en) * | 2020-04-28 | 2023-11-28 | 长沙证通云计算有限公司 | High concurrency video data processing method, electronic equipment, storage medium and system |
| CN112035485B (en) * | 2020-09-03 | 2023-09-26 | 江苏新蝶数字科技有限公司 | Method and system for realizing efficient query of credit information data based on distributed architecture |
| CN112035485A (en) * | 2020-09-03 | 2020-12-04 | 徐州金蝶软件有限公司 | Method and system for realizing efficient query of credit information data based on distributed architecture |
| CN112187908A (en) * | 2020-09-23 | 2021-01-05 | 易小博(武汉)科技有限公司 | Data processing method, system and interface service platform |
| WO2022105574A1 (en) * | 2020-11-20 | 2022-05-27 | 北京沃东天骏信息技术有限公司 | Information transmission method, system, and apparatus |
| CN113420052B (en) * | 2021-07-08 | 2023-02-17 | 上海浦东发展银行股份有限公司 | Multi-level distributed cache system and method |
| CN113420052A (en) * | 2021-07-08 | 2021-09-21 | 上海浦东发展银行股份有限公司 | Multi-level distributed cache system and method |
| CN113779028A (en) * | 2021-08-31 | 2021-12-10 | 珠海市新德汇信息技术有限公司 | Storage method, query method, electronic device and storage medium fusing primary key index genes |
| CN115203204A (en) * | 2022-07-13 | 2022-10-18 | 国电南京自动化股份有限公司 | High-capacity decoupling flexible master station system and control method |
| CN115203204B (en) * | 2022-07-13 | 2023-07-04 | 国电南京自动化股份有限公司 | High-capacity decoupling flexible master station system and control method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102117309B (en) | 2013-04-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102117309B (en) | Data caching system and data query method | |
| US7440977B2 (en) | Recovery method using extendible hashing-based cluster logs in shared-nothing spatial database cluster | |
| US9575826B2 (en) | Two level addressing in storage clusters | |
| US6675214B2 (en) | Method and apparatus for efficient storage and retrieval of objects in and from an object storage device | |
| US6507847B1 (en) | History database structure for Usenet | |
| CN102122285B (en) | Data cache system and data inquiry method | |
| CN102411598B (en) | Method and system for realizing data consistency | |
| WO2016177283A1 (en) | Cache directory refreshing method and device | |
| US20090210429A1 (en) | System and method for asynchronous update of indexes in a distributed database | |
| WO2012139328A1 (en) | Cache server system and application method thereof, cache client, and cache server | |
| CN105426321A (en) | RDMA friendly caching method using remote position information | |
| CN100458776C (en) | Network cache management system and method | |
| CN113377868B (en) | Offline storage system based on distributed KV database | |
| CN102012933A (en) | Distributed file system and method for storing data and providing services by utilizing same | |
| CN113836162A (en) | Method and device for service decoupling and automatic updating of multi-level cache | |
| CN101377788A (en) | Method and system of caching management in cluster file system | |
| KR20210082481A (en) | Database management service providing system | |
| CN105930519A (en) | Globally shared read caching method based on cluster file system | |
| CN114338725B (en) | Distributed storage scheduling method for improving upper limit of large-scale cluster rendering | |
| US7058773B1 (en) | System and method for managing data in a distributed system | |
| US20030115202A1 (en) | System and method for processing a request using multiple database units | |
| CN110109956B (en) | Method and terminal for preventing cache from penetrating | |
| CN116257521B (en) | KV storage method based on FPGA | |
| CN104821907A (en) | Email processing method | |
| CN116049320B (en) | Distributed database design method and system based on localized access |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130417 Termination date: 20140106 |