CN104317926B - The data storage and query method and corresponding device and system of a kind of persistence - Google Patents
The data storage and query method and corresponding device and system of a kind of persistence Download PDFInfo
- Publication number
- CN104317926B CN104317926B CN201410601861.5A CN201410601861A CN104317926B CN 104317926 B CN104317926 B CN 104317926B CN 201410601861 A CN201410601861 A CN 201410601861A CN 104317926 B CN104317926 B CN 104317926B
- Authority
- CN
- China
- Prior art keywords
- data
- write
- key
- file system
- distributed file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of data storage and query method of persistence and corresponding device and system, wherein, the date storage method of persistence includes：The data storage operations request of application program transmission is received, the data that match will be asked to write with the data storage operations and cached, and establishment can identify at least one key file of the data in distributed file system；Cache client obtains at least one key value of energy mark data from the key files；According at least one key value of the acquisition, the data matched with the key values are searched in the buffer；The data matched with the key values found in the buffer are write in distributed file system, and delete the key values in key files corresponding with the data of said write distributed file system.
Description
Technical field
The present invention relates to database purchase inquiring technology field, and in particular to a kind of data storage and query side of persistence
Method and corresponding device and system.
Background technology
Although existing distributed cache system supports distributed deployment, Fig. 1, internal single buffer service may refer to
The data stored on device node do not have redundancy, if the caching server nodes break down application program can be caused not look into
Data are ask, and then cause service disconnection or mistake.
At present, solving the persistence scheme of this problem mainly has snapshot and AOF (append only file, an increasing text
Part) mode, and the internal storage data of caching server is completely write into disk once every time using the mode of snapshot, it is not to increase
That measures updates the data, if the data volume in internal memory is very big, and data write operation is very more, will necessarily cause substantial amounts of disk I/
O operation and have a strong impact on performance；In addition, the mode of snapshot be according to certain time interval by internal memory data write disk
In, so if unexpected exception occurs in caching server, the data after all modifications after last time snapshot will be lost.
AOF modes are that every order will add log files, and it is excessive to may result in data volume, when caching system weight
Loading data can be very slow when opening recovery data, such as, tens G data may need a few houres to have loaded, this consumption
When be not that therefore disk file reading speed is slow, but because all orders read will be in caching server internal memory again
Perform one time；Further, since every order will write log files, the readwrite performance of caching can also decline.
Using the persistence mode of snapshot or AOF, have the shortcomings that common：
First, caching persistence causes system unstable or collapsed using Buffer IO, so-called Buffer IO refer to
Cache write-in to persistence file and read operation can all use the Page Cache of physical memory, and most of data base sets
System can use Direct IO to bypass this layer of Page Cache and voluntarily safeguard the Cache of a data, and lasting when what is cached
Change file excessive (especially snapshot document), and when being written and read to it, the data in disk file can all be loaded into physics
As one layer Cache of the operating system to this document in internal memory, and the data managed in this layer of Cache data and cache
Really repeat storage, although kernel can do Page Cache Weeding when physical memory is nervous, but kernel very may be used
Can think that certain block Page Cache are more important, and allow caching process to start Swap, this be system will start occur it is unstable or
Person is collapsed；
Second, the data of persistence, which need caching server node to restart, could load recovery, therefore, in caching server
Service can not be provided during nodes break down, cause service disconnection or mistake；
Third, service end disk easily runs into bottleneck：Data are uniformly stored on service end disk, multiple different clients
When data access request is initiated in end simultaneously, service end disk easily reaches bottleneck, influences performance；
Fourth, caching server is unable to dynamic expansion：Data can only be stored under the catalogue of buffer service end, when storage is empty
Between not enough extension when need to stop service, behind extension storage space, be again started up memory space, the process of extension needs to stop upper strata
Application system.
The content of the invention
The technical problems to be solved by the invention are to provide the data storage and query method of persistence a kind of and corresponding
Device and system, can realize efficient reading and writing data, and complete data backup.
According to the one side of the invention provided there is provided a kind of date storage method of persistence, including：
Receive the data storage operations request that application program is sent, the data that will be matched with data storage operations request
Write-in caching, and establishment can identify at least one key file of the data in distributed file system；
Cache client obtains at least one key value of energy mark data from the key files；
According at least one key value of the acquisition, the data matched with the key values are searched in the buffer；
By in the data write-in distributed file system for being matched with the key values of finding in the buffer, and delete with
Key values in the corresponding key files of data of said write distributed file system.
According to another aspect of the present invention there is provided a kind of data storage device of persistence, including：
First Data write. module, the data storage operations request for receiving application program transmission, will be with the data
The data write-in caching of operation requests matching is stored, and establishment can identify at least the one of the data in distributed file system
Individual key files；
Data Identification acquisition module, for call cache client obtained from the key files can mark data to
A few key value；
Data search module, at least one key value according to the acquisition, is searched and the key values in the buffer
The data of matching；
Second Data write. module, is distributed for the data matched with the key values found in the buffer to be write
In formula file system, and delete the key values in key files corresponding with the data of said write distributed file system.
According to another aspect of the invention there is provided a kind of data query method of persistence, including：
Data storage is completed beforehand through the date storage method of persistence；
The data query operation request that application program is sent is received, searches asked with the data query operation in the buffer
The data of matching；
If successful inquiring, the data of the matching inquired are returned into the application program；If inquiry failure, dividing
The data of match query in cloth file system；
In the case of the data that matching is inquired in distributed file system, the data of the matching inquired are returned
To application program and write caching.
According to it is still another aspect of the present invention to provide a kind of data query system of persistence, including：
Beforehand through the data storage device of persistence, the storage of data, and the data query system of the persistence are completed
System also includes：First data inquiry module, the data query operation for receiving application program transmission, is searched and institute from caching
State the data of data query operation request matching；
Second data inquiry module, for ought not inquire the number matched with data query operation request in the buffer
According to when, the data of match query in distributed file system；
3rd Data write. module, for when inquiring the data of matching in distributed file system, will inquire
The data of matching return to application program and write caching.
The date storage method and device for a kind of persistence that the present invention is provided, according to the data storage operations of application program
Request, writes data into caching first, while the key files of these data can be identified by being created in distributed file system, delays
Depositing client continual can obtain key files from distributed file system and obtain key values therein, according to acquisition
Key values, inquire about the data matched with the key values in the buffer, will finally search successful data write-in distributed file system
In, and delete the key values in key files corresponding with the data write.The method provided by the present invention, can complete data
Backup, ensure the safety and reliability of data, the characteristics of using distributed file system data storage, data are stored in
On the different memory nodes of distributed file system, memory space can be with dynamic retractility；In addition, caching and distributed field system
Data in system are consistent in real time, and the inconsistency or data of data will not be caused because of the difference of data backup time
Lose.
A kind of data query method and system for persistence that the present invention is provided, the data for being firstly received application program are looked into
Operation requests are ask, acquiescence searches the data of matching from caching, if successful inquiring, the data of matching are returned to application program,
If inquiry failure, searches the data of matching from distributed file system, in the case of searching successfully, successful by searching
Data return to application program and write caching.Data in caching are backuped to distributed text by the method provided by the present invention
In part system, if caching server end is broken down, distributed file system can provide service at once, will not cause application
The problem of program is unable to queried access, will not also cause the terminal of business.
Brief description of the drawings
Fig. 1 is the network architecture diagram of the distributed deployment of prior art；
Fig. 2 is a kind of date storage method flow chart of persistence of the embodiment of the present invention one；
Fig. 3 is the integrated stand composition between the modules that use in the embodiment of the present invention one；
The particular flow sheet that Fig. 4 is handled for the data insertion operation in the embodiment of the present invention one；
Fig. 5 is a kind of data storage device schematic diagram of persistence of the embodiment of the present invention two；
Fig. 6 is a kind of data query method flow diagram of persistence of the embodiment of the present invention three；
The particular flow sheet that Fig. 7 is handled for the data query operation in the embodiment of the present invention three；
Fig. 8 is a kind of data query system schematic diagram of persistence of the embodiment of the present invention four.
Embodiment
The principle and feature of the present invention are described below in conjunction with accompanying drawing, the given examples are served only to explain the present invention, and
It is non-to be used to limit the scope of the present invention.
Embodiment one, a kind of date storage method of persistence.Enter with reference to Fig. 2-Fig. 4 methods provided the present invention
Row is described in detail.
In Fig. 2, S201, the data storage operations request for receiving application program transmission will be with data storage operations requests
The data write-in caching matched somebody with somebody, and establishment can identify at least one key file of the data in distributed file system.
Specifically, Fig. 3 be the present embodiment between application program, database, caching, distributed file system, key files
Data transfer connection figure.
When the data storage operations request that database client receives application client transmission (is referred to as number
Asked according to insertion operation), may refer to Fig. 4, will in database client with application program send data operation request in
The data write-in caching matched somebody with somebody.When the data in database client are successfully written caching, database client is to application program
The successful information of data write-in caching is sent, and the data that can identify these write-in cachings are created in distributed file system
Data record in key files, this document energy unique identification data.Wherein, one key of each data record correspondence in data
File, using the key values (i.e. key value) of the data record as filename, file content is sky；When in database client
During all data or partial data write-in cache failures, the data for writing cache failure are directly write into distributed file system
In, and create in distributed file system with without the corresponding key files of data write in distributed file system.
It should be noted that the database in the present embodiment is non-relational database, i.e. NoSQL databases.
S202, cache client obtain at least one key value of energy mark data from key files.
Specifically, created in distributed file system after key files, cache client can be obtained in real time not to be write point
The corresponding key files of data in cloth file system, and from the key files of acquisition obtain can unique identification data key
Value.Wherein, key is used to indicate that the data record in data, and the data record not write in distributed file system may
Have a plurality of, therefore the corresponding key values that cache client is obtained herein may have multiple.
S203, at least one key value according to acquisition, search the data matched with the key values in the buffer.
Specifically, because the key values that are obtained from distributed file system are the number that does not write in distributed file system
According to corresponding key values, therefore these corresponding data of key values should generally exist in the buffer.It therefore, it can according to acquisition
These key values, search the data matched with these key values in the buffer.
S204, the data for being matched with the key values of finding in the buffer are write in distributed file system, and deleted
Except the key values in key files corresponding with the data of the write-in distributed file system.
Specifically, above-mentioned steps search data corresponding with these key values in the buffer according to the key values of acquisition, slow
Deposit searching data it is successful in the case of, these successful data of lookup are write in distributed file system, and is deleted with writing
Enter the key values in the corresponding key files of these data of distributed file system, so as to the inquiry of cache client subsequently, only
Want cache client to inquire the key values in key files, show that these corresponding data of key values do not write distributed field system
In system.In the buffer in the case of searching data failure, the information of searching data failure can be sent to application by cache client
Program, request applications resend data storage operations and asked to database client, and the data for searching failure are write
Caching.
Embodiment two, a kind of data storage device of persistence.The device that the present invention is provided is carried out with reference to Fig. 5 detailed
Describe in detail bright.
In Fig. 5, the device that the present invention is provided includes the first Data write. module 501, Data Identification acquisition module 502, number
According to searching modul 503, the second Data write. module 504 and the first request module 505.
Wherein, the first Data write. module 501 is mainly used in receiving the data storage operations request that application program is sent, will
Ask the data matched to write with data storage operations to cache, and establishment can identify the data extremely in distributed file system
A few key file.
Specifically, when the data storage operations request that database client receives application client transmission (also may be used
To be referred to as data discrepancy operation requests), the number that the first Data write. module 501 will be sent in database client with application program
Caching is write according to the data matched in operation requests.When the data in database client are successfully written caching, database visitor
Family end sends data write-in to application program and caches successful information, and creates in distributed file system and can identify these and write
Enter the data record in the key files of the data of caching, this document energy unique identification data.Wherein, each data in data
Record one key file of correspondence, using the key values (i.e. key value) of the data record as filename, file content is sky；Work as number
During according to all data in the client of storehouse or partial data write-in cache failure, the first Data write. module 501 directly will write-in
In the data write-in distributed file system of cache failure, and created and the distributed text of no write-in in distributed file system
The corresponding key files of data in part system.
It should be noted that non-relational database, i.e. NoSQL databases during database in the present embodiment.
Data Identification acquisition module 502 is mainly used in calling cache client to obtain energy mark data from key files
At least one key value.
Specifically, being created in distributed file system after key files, the Data Identification in cache client is arranged at
Acquisition module 502 can obtain the corresponding key files of the data not write in distributed file system in real time, and from the key of acquisition
The key values of energy unique identification data are obtained in file.Wherein, key values are used to indicate that the data record in data, do not write
Data record in distributed file system may have a plurality of, therefore the corresponding key values that cache client is obtained herein may
Have multiple.
Data search module 503 is mainly used at least one the key value obtained according to Data Identification acquisition module 502,
The data matched with the key values are searched in caching.
Specifically, because the key values that are obtained from distributed file system are the number that does not write in distributed file system
According to corresponding key values, these corresponding data of key values should generally exist in the buffer.Therefore, data search module 503 can
With these key values according to acquisition, the data matched with these key values are searched in the buffer.
Second Data write. module 504 be mainly used in the buffer finding data search module 503 with key values
In the data write-in distributed file system matched somebody with somebody, and delete key files corresponding with the data of the write-in distributed file system
In key values.
First request module 505 is mainly used in when data search module 503 does not find what is matched with key values in the buffer
During data, failure information will be searched and be sent to application program, request applications send data to database client again and deposited
Operation requests are stored up, the data for searching failure are write and cached.
Specifically, the key values that data search module 503 is obtained according to Data Identification acquisition module 502 are searched in the buffer
Data corresponding with these key values, data search module 503 is in the case of searching data is successful in the buffer, and the second data are write
Enter module 504 to write these lookup successful data in distributed file system, and delete and write-in distributed file system
The corresponding key files of these data in key values, so as to the inquiry of cache client subsequently, as long as cache client is inquired about
To the key values in key files, show that these corresponding data of key values are not write in distributed file system.Data search module
503 in the buffer searching data failure in the case of, the first request module 505 can by searching data failure information be sent to should
With program, request applications send data storage operations request to database client again, the data for searching failure are write
Enter caching.
Embodiment three, a kind of data query method of persistence.The method provided with reference to Fig. 6 and Fig. 7 the present invention
It is described in detail.
In Fig. 6, S601, beforehand through persistence date storage method complete data storage.
Specifically, the present embodiment completes data using the date storage method of the persistence in foregoing embodiment one first
Storage, related technical characteristic may refer to a kind of detailed description of embodiment, is not repeated.
S602, the data query operation request for receiving application program transmission, being searched from caching please with data query operation
Seek the data of matching.
Specifically, referring to Fig. 7, when the data query operation that database client receives application client transmission please
When asking, give tacit consent to and the data that the data query operation request sent with application program is matched are searched first from caching.
If the data of the matching of inquiry are returned to the application program by S603, successful inquiring；If inquiry failure,
The data of match query from distributed file system.
Specifically, in the case of searching data are successful from caching when above-mentioned steps, successful data will be searched and returned to
Application client；If being searched and data from distributed file system in the case of searching data failure in the buffer
The data of inquiry operation request matching.
S604, in distributed file system inquire about data it is successful in the case of, by the data of successful inquiring return to should
With program and write caching.
Specifically, when searching the data matched with data query operation request from distributed file system, searching
In the case of successfully, successful data feedback will be searched to application client and the successful data write-in of these lookups is slow
Deposit.Search failure in the case of, from distributed file system read key files and judge in key files whether there is with
The key values of the Data Matching of failure are searched, if in the presence of to application program transmission request, request applications are again to data
Storehouse client sends data storage operations request, and the data for searching failure are re-write into caching；If being not present in key files
With the key for the Data Matching for searching failure, then null is returned to, terminate flow.
Example IV, a kind of data query system of persistence.The system that the present invention is provided is carried out with reference to Fig. 8 detailed
Describe in detail bright.
In Fig. 8, the system that the present invention is provided includes the data storage device 801 of persistence, the first data inquiry module
802nd, the second data inquiry module 803, the 3rd Data write. module 804 and the second request module 805.
Wherein, the storage device 801 of persistence is mainly used in using the data storage device of the persistence in embodiment two,
Complete the storage of data.
Specifically, the data storage device 801 of the persistence in the present embodiment first uses the persistence in embodiment two
Data storage device completes the storage of data, and related technical characteristic may refer to a kind of detailed description of embodiment, herein not
Repeat explanation.
First data inquiry module 802 is mainly used in receiving the data query operation request that application program is sent, in caching
The data that middle lookup is matched with data query operation request.
Specifically, when database client receives the data query operation request of application client transmission, the
One data inquiry module 802 is given tacit consent to searches the number that the data query operation request sent with application program is matched first from caching
According to.
Second data inquiry module 803 is mainly used in when the first data inquiry module 802 inquires about failure in the buffer,
The data of match query in distributed file system.
Specifically, when the searching data successes in the buffer of the first data inquiry module 802, successful data will be searched and returned
Back to application client；In the buffer in the case of searching data failure, the second data inquiry module 803 is in distributed text
The data matched with data query operation request are searched in part system.
3rd Data write. module 804 is mainly used in when the second data inquiry module 803 is looked into distributed file system
When asking data success, the data of successful inquiring are returned into application program and caching is write.
Second request module 805 is mainly used in when the second data inquiry module 803 inquires about number in distributed file system
According to being unsuccessfully, the key Files in distributed file system are read, and judge whether the Data Matching with inquiry failure
Key values；If in the presence of, to application requests again will search failure data write cache.
Asked specifically, being searched when the second data inquiry module 803 from distributed file system with data query operation
During the data of matching, in the case of searching successfully, the 3rd Data write. module 804 will search successful data feedback to application
Programmatic client simultaneously caches the successful data write-in of these lookups.In the case where searching failure, the second request module 805 is read
Take the key files in distributed file system and judge to whether there is the key of the Data Matching with searching failure in key files
Value, if in the presence of to application program transmission request, request applications send data storage to database client again please
Ask, the data for searching failure are re-write into caching；If the key of the Data Matching with searching failure is not present in key files
Value, then return to null, terminates flow.
The date storage method and device for a kind of persistence that the present invention is provided, using distributed file system in caching
Data backed up, and realize caching with distributed file system in data mutual backup, ensured data
Safety and reliability；The characteristics of using distributed file system data storage, data are stored in distributed file system
On different memory nodes, memory space can be with dynamic retractility；In addition, caching is protected in real time with the data in distributed file system
Hold consistent, the inconsistency of data or the loss of data will not be caused because of the difference of data backup time.
The data query method and system for a kind of persistence that the present invention is provided, when the data for receiving application program transmission
Inquiry operation is asked, and searches the data of matching from caching first, if failure is searched in the buffer, then from distributed field system
Search the data of matching in system, so broken down when abnormal or caching occurs for the inquiry operation on caching, it is possible to from point
Inquired about in cloth file system, it is ensured that the failure of buffer service will not cause service disconnection, namely ensure that the safety of system
Property and high availability.
The foregoing is only presently preferred embodiments of the present invention, be not intended to limit the invention, it is all the present invention spirit and
Within principle, any modification, equivalent substitution and improvements made etc. should be included in the scope of the protection.
Claims (10)
1. a kind of date storage method of persistence, it is characterised in that including：
Step S201, the data storage operations request for receiving application program transmission, will be matched with data storage operations request
Data write-in caching, and in distributed file system create can identify at least one key file of the data；
Step S202, cache client obtain at least one key value of energy mark data from the key files；
Step S203, at least one key value according to the acquisition, search the data matched with the key values in the buffer；
Step S204, the data for being matched with the key values of finding in the buffer are write in distributed file system, and deleted
Except the key values in key files corresponding with the data of said write distributed file system.
2. date storage method as claimed in claim 1, it is characterised in that the step S201 includes：
In the case of data write-in cache failure, the data of said write cache failure are write direct into distributed document
In system.
3. date storage method as claimed in claim 2, it is characterised in that the step S202 includes：
Cache client is obtained from key files without the corresponding key values of data in write-in distributed file system in real time.
4. date storage method as claimed in claim 1, it is characterised in that also include after execution step S203：
If not finding the data matched with the key values in the buffer, failure information will be searched and be sent to application program, please
Ask application program to send data storage operations request to database client again, the data for searching failure are write and cached.
5. a kind of data storage device of persistence, it is characterised in that including：
First Data write. module, the data storage operations request for receiving application program transmission, will be with the data storage
The data write-in caching of operation requests matching, and establishment can identify at least one of the data in distributed file system
Key files；
Data Identification acquisition module, for calling cache client to obtain at least the one of energy mark data from the key files
Individual key values；
Data search module, at least one key value according to the acquisition, searches matched with the key values in the buffer
Data；
Second Data write. module, for the data matched with the key values found in the buffer to be write into distributed text
In part system, and delete the key values in key files corresponding with the data of said write distributed file system.
6. data storage device as claimed in claim 5, it is characterised in that also include：
First request module, if for not finding the data matched with the key values in the buffer, failure information hair will be searched
Application program is given, request applications send data storage operations request to database client again, will search failure
Data write-in caching.
7. a kind of data query method of persistence, it is characterised in that including：
Step S601, the date storage method completion data storage beforehand through the persistence described in claim any one of 1-4；
Step S602, the data query operation request for receiving application program transmission, search grasped with the data query in the buffer
Make the data of request matching；
If the data of the matching inquired are returned to the application program by step S603, successful inquiring；If inquiry failure,
Then in distributed file system match query data；
Step S604, inquire in distributed file system the data of matching in the case of, by the number of the matching inquired
According to returning to application program and write caching.
8. data query method as claimed in claim 7, it is characterised in that also include after the execution step S603：
In the case of the data for not finding matching in distributed file system, the key texts in distributed file system are read
Part, and judge whether the key values with the Data Matching；
If in the presence of, to application requests again will search failure data write cache.
9. a kind of data query system of persistence, it is characterised in that beforehand through holding described in any one of claim 5 to 6
The data storage device changed long, completes the storage of data, and the data query system of the persistence also includes：
First data inquiry module, the data query operation for receiving application program transmission, is searched and the number from caching
It is investigated that asking the data of operation requests matching；
Second data inquiry module, for ought not inquire the data matched with data query operation request in the buffer
When, the data of match query in distributed file system；
3rd Data write. module, for when inquiring the data of matching in distributed file system, by inquired
The data matched somebody with somebody return to application program and write caching.
10. data query system as claimed in claim 9, it is characterised in that also include：
Second request module, for when not inquiring the data of matching in distributed file system, reading distributed document
Key files in system, and judge whether the key values with the Data Matching；If in the presence of to application requests weight
New write the data for searching failure caches.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410601861.5A CN104317926B (en) | 2014-10-31 | 2014-10-31 | The data storage and query method and corresponding device and system of a kind of persistence |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410601861.5A CN104317926B (en) | 2014-10-31 | 2014-10-31 | The data storage and query method and corresponding device and system of a kind of persistence |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104317926A CN104317926A (en) | 2015-01-28 |
| CN104317926B true CN104317926B (en) | 2017-10-17 |
Family
ID=52373158
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410601861.5A Active CN104317926B (en) | 2014-10-31 | 2014-10-31 | The data storage and query method and corresponding device and system of a kind of persistence |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104317926B (en) |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106294190B (en) * | 2015-05-25 | 2020-10-16 | 中兴通讯股份有限公司 | Storage space management method and device |
| CN106557278A (en) * | 2015-09-30 | 2017-04-05 | 腾讯科技（深圳）有限公司 | A kind of method of data cached persistence |
| CN105516284B (en) * | 2015-12-01 | 2019-05-03 | 深圳市华讯方舟软件技术有限公司 | A kind of method and apparatus of Cluster Database distributed storage |
| CN106021335A (en) * | 2016-05-06 | 2016-10-12 | 北京奇虎科技有限公司 | A database accessing method and device |
| CN108073355B (en) * | 2016-11-15 | 2020-03-17 | 杭州海康威视数字技术股份有限公司 | Data storage and deletion method and device |
| CN106657356A (en) * | 2016-12-29 | 2017-05-10 | 郑州云海信息技术有限公司 | Data writing method and device for cloud storage system, and cloud storage system |
| CN107094178B (en) * | 2017-05-11 | 2019-06-18 | 广东网金控股股份有限公司 | A kind of Internet data transmission method, apparatus and server terminal |
| CN108021688B (en) * | 2017-12-15 | 2019-05-21 | 北京明朝万达科技股份有限公司 | A kind of data processing method and device |
| CN109299035B (en) * | 2018-07-04 | 2021-10-15 | 中通服建设有限公司 | CHR file management method, system and computer readable storage medium |
| CN109189759B (en) * | 2018-08-01 | 2021-11-19 | 华为技术有限公司 | Data reading method, data query method, device and equipment in KV storage system |
| CN109753592A (en) * | 2018-12-22 | 2019-05-14 | 汤新红 | A kind of information flow storage system and its storage method based on big data |
| CN110413613B (en) * | 2019-07-09 | 2023-01-17 | 创新先进技术有限公司 | Writing and reading method, device and equipment for large data volume data |
| CN110908809A (en) * | 2019-10-28 | 2020-03-24 | 苏宁云计算有限公司 | Query service calling method and device |
| CN113297203B (en) * | 2020-07-15 | 2024-07-02 | 阿里巴巴集团控股有限公司 | Data query and write method and device, computer storage medium and electronic equipment |
| CN111966751B (en) * | 2020-08-14 | 2022-07-08 | 苏州浪潮智能科技有限公司 | Distributed object storage metadata storage method and system, and reading method and system |
| CN112632098A (en) * | 2020-12-18 | 2021-04-09 | 平安普惠企业管理有限公司 | Dynamic generation method of structured query statement and related equipment |
| CN112597354A (en) * | 2020-12-22 | 2021-04-02 | 贝壳技术有限公司 | Method, device, system and storage medium for providing configuration parameters |
| CN114584576B (en) * | 2022-03-04 | 2024-07-19 | 拉扎斯网络科技（上海）有限公司 | Data storage method, apparatus, device, storage medium and computer program product |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101510209A (en) * | 2009-03-30 | 2009-08-19 | 北京金山软件有限公司 | Method, system and server for implementing real time search |
| CN102014153A (en) * | 2010-10-19 | 2011-04-13 | 浪潮(北京)电子信息产业有限公司 | Data storage system and method thereof |
| CN103577551A (en) * | 2013-10-16 | 2014-02-12 | 青岛海信传媒网络技术有限公司 | Method and device for submitting data to database in batch |
-
2014
- 2014-10-31 CN CN201410601861.5A patent/CN104317926B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101510209A (en) * | 2009-03-30 | 2009-08-19 | 北京金山软件有限公司 | Method, system and server for implementing real time search |
| CN102014153A (en) * | 2010-10-19 | 2011-04-13 | 浪潮(北京)电子信息产业有限公司 | Data storage system and method thereof |
| CN103577551A (en) * | 2013-10-16 | 2014-02-12 | 青岛海信传媒网络技术有限公司 | Method and device for submitting data to database in batch |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104317926A (en) | 2015-01-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104317926B (en) | The data storage and query method and corresponding device and system of a kind of persistence | |
| US8214334B2 (en) | Systems and methods for distributed system scanning | |
| US8762353B2 (en) | Elimination of duplicate objects in storage clusters | |
| US9715507B2 (en) | Techniques for reconciling metadata and data in a cloud storage system without service interruption | |
| US10769177B1 (en) | Virtual file structure for data storage system | |
| US9684702B2 (en) | Database redistribution utilizing virtual partitions | |
| US9547706B2 (en) | Using colocation hints to facilitate accessing a distributed data storage system | |
| US10970257B2 (en) | Replicating file systems via cloud storage | |
| CN106874383A (en) | A kind of decoupling location mode of metadata of distributed type file system | |
| CN105138571B (en) | Distributed file system and method for storing massive small files | |
| US11176110B2 (en) | Data updating method and device for a distributed database system | |
| CN105718455A (en) | Data query method and apparatus | |
| CN101867607A (en) | Distributed data access method, device and system | |
| CN104020961A (en) | Distributed data storage method, device and system | |
| US11526465B2 (en) | Generating hash trees for database schemas | |
| WO2012083754A1 (en) | Method and device for processing dirty data | |
| CN105447166A (en) | Keyword based information search method and system | |
| CN106776795B (en) | Data writing method and device based on Hbase database | |
| US11683161B2 (en) | Managing encryption keys under group-level encryption | |
| CN108900337B (en) | Fault recovery method, server, client and system for metadata service | |
| CN111143366B (en) | High-efficiency storage method for massive large object data | |
| US10303680B2 (en) | Data processing apparatus and data processing method | |
| KR100739141B1 (en) | Data update method | |
| KR101755276B1 (en) | SYSTEM AND METHOD MANAGING TRANSACTION BASED ON NoSQL | |
| CN114911806A (en) | Method and related device for updating data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |