CN104317926A - Persistent data storage method, persistent data query method, persistent data storage device and persistent data query system - Google Patents
Persistent data storage method, persistent data query method, persistent data storage device and persistent data query system Download PDFInfo
- Publication number
- CN104317926A CN104317926A CN201410601861.5A CN201410601861A CN104317926A CN 104317926 A CN104317926 A CN 104317926A CN 201410601861 A CN201410601861 A CN 201410601861A CN 104317926 A CN104317926 A CN 104317926A
- Authority
- CN
- China
- Prior art keywords
- data
- write
- file system
- distributed file
- key
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a persistent data storage method, a persistent data query method, a persistent data storage device and a persistent data query system. The persistent data storage method includes: receiving a data storage operation request sent by an application program, writing data matched with the data storage operation request into cache and creating at least one key file capable of identifying the data in a distributed file system; enabling a cache client to obtain at least one key value capable of identifying the data in the key files; searching data matched with the key values in the cache according to the obtained key values; writing the data matched with the key values and searched from the cache into the distributed file system, and deleting the key values, corresponding to the data written into the distributed file system, in the key files.
Description
Technical field
The present invention relates to database purchase inquiring technology field, be specifically related to a kind of data storage and query method of persistence and the device of correspondence and system.
Background technology
Although existing distributed cache system supports distributed deployment, can see Fig. 1, but the data that inner single caching server node stores do not have redundancy, if this caching server nodes break down, can cause application program cannot data query, and then cause service disconnection or mistake.
At present, the persistence scheme addressed this problem mainly contains snapshot and AOF (append only file, only increase file) mode, and use the mode of snapshot each all by complete for the internal storage data of caching server write disk once, it is not the more new data of increment, if the data volume in internal memory is very large, and data write operation is very many, a large amount of magnetic disc i/o operations will inevitably be caused and have a strong impact on performance; In addition, the mode of snapshot is according to certain time interval by the data write disk in internal memory, if therefore caching server appearance surprisingly extremely, will lose the data after all modifications after last snapshot.
AOF mode is that every bar order all will add log file, data volume may be caused excessive, loading data when caching system is restarted and recovered data can be slowly, such as, the data of tens G may need several hours ability to load, this is consuming time is not that therefore disk file reading speed is slow, but because all orders of reading all will re-execute one time in caching server internal memory; In addition, because every bar order all will write log file, the readwrite performance of buffer memory also can decline to some extent.
Use the persistence mode of snapshot or AOF, there is common shortcoming:
One, buffer memory persistence uses Buffer IO to cause system instability or collapse, so-called Buffer IO refers to that buffer memory all can use the Page Cache of physical memory to the write of persistence file and read operation, and most of Database Systems can use Direct IO to walk around the Cache that this layer of Page Cache also safeguards data voluntarily, and work as the persistence file excessive (especially snapshot document) of buffer memory, and when it is read and write, data in disk file all can be loaded in physical memory as one deck Cache of operating system to this file, and the data managed in the data of this layer of Cache and cache actual be repeated storage, although kernel can do the Weeding of Page Cache when physical memory is nervous, but kernel probably thinks that certain block Page Cache is more important, and allow buffer memory process start Swap, this is that system will start to occur unstable or collapse,
Its two, the data of persistence need caching server node to restart could load recovery, therefore, cannot provide service, cause service disconnection or mistake when caching server nodes break down;
Its three, service end disk easily runs into bottleneck: data unified are stored on service end disk, and when multiple different clients initiates data access request simultaneously, service end disk easily reaches bottleneck, affects performance;
Its four, caching server can not dynamic expansion: under data can only be stored in buffer service end catalogue, need stop service, behind extension storage space, again start storage space when insufficient memory is expanded, and the process need of expansion stops upper layer application system.
Summary of the invention
Technical matters to be solved by this invention is to provide a kind of data storage and query method of persistence and the device of correspondence and system, can realize efficient reading and writing data, and complete data backup.
According to an aspect provided by the invention, provide a kind of date storage method of persistence, comprising:
Receive the data storage operations request that application program sends, the data of mating with described data storage operations request are write buffer memory, and in distributed file system, create at least one key file that can identify described data;
Cache client obtains at least one key value of energy identification data from described key file;
According at least one key value of described acquisition, search the data of mating with described key value in the buffer;
The data of mating with described key value found in the buffer are write in distributed file system, and deletes the key value in the key file corresponding with the data of said write distributed file system.
According to another aspect of the present invention, provide a kind of data storage device of persistence, comprising:
The data of mating with described data storage operations request for receiving the data storage operations request that application program sends, are write buffer memory, and in distributed file system, create at least one key file that can identify described data by the first Data write. module;
Data Identification acquisition module, obtains at least one key value of energy identification data from described key file for calling cache client;
Data search module, at least one the key value according to described acquisition, searches the data of mating with described key value in the buffer;
Second Data write. module, for the data of mating with described key value found in the buffer being write in distributed file system, and deletes the key value in the key file corresponding with the data of said write distributed file system.
According to another aspect of the invention, provide a kind of data enquire method of persistence, comprising:
Complete data by the date storage method of persistence in advance to store;
Receive the data query operation request that application program sends, search the data of mating with described data query operation request in the buffer;
If successful inquiring, then the data of the coupling inquired are returned to described application program; If inquire about unsuccessfully, then the data of match query in distributed file system;
When inquiring the data of coupling in distributed file system, by the coupling inquired data return to application program and write buffer memory.
According to another aspect of the present invention, provide a kind of data query system of persistence, comprising:
In advance by the data storage device of persistence, complete the storage of data, and the data query system of described persistence also comprises: the first data inquiry module, for receiving the data query operation that application program sends, from buffer memory, search the data of mating with described data query operation request;
Second data inquiry module, for when not inquiring the data of mating with described data query operation request in the buffer, the data of match query in distributed file system;
The data of the coupling inquired, for when inquiring the data of coupling in distributed file system, being returned to application program and writing buffer memory by the 3rd Data write. module.
The date storage method of a kind of persistence provided by the invention and device, according to the data storage operations request of application program, first data are write buffer memory, in distributed file system, create the key file that can identify these data simultaneously, cache client continually can obtain key file and obtain key value wherein from distributed file system, according to the key value obtained, inquire about the data of mating with this key value in the buffer, finally will search in successful data write distributed file system, and delete the key value in the key file corresponding with the data of write.By method provided by the invention, the backup of data can be completed, ensure the safety and reliability of data, adopt distributed file system to store the feature of data, data are stored on the different memory node of distributed file system, and storage space can dynamic retractility; In addition, the data in buffer memory and distributed file system are consistent in real time, can not cause the inconsistency of data or the loss of data because of the difference of data backup time.
The data enquire method of a kind of persistence provided by the invention and system, first the data query operation request of application program is received, acquiescence searches the data of coupling from buffer memory, if successful inquiring, then return the data of coupling to application program, if inquire about unsuccessfully, then from distributed file system, search the data of coupling, searching in successful situation, successful data will searched and return application program and write buffer memory.By method provided by the invention, data in buffer memory backuped in distributed file system, if caching server end breaks down, then distributed file system can provide service at once, can not cause application program can not the problem of queried access, also can not cause the terminal of business.
Accompanying drawing explanation
Fig. 1 is the network architecture diagram of the distributed deployment of prior art;
Fig. 2 is the date storage method process flow diagram of a kind of persistence of the embodiment of the present invention one;
Fig. 3 is the integrated stand composition between the modules that uses in the embodiment of the present invention one;
Fig. 4 is the particular flow sheet of the data insertion operation process in the embodiment of the present invention one;
Fig. 5 is the data storage device schematic diagram of a kind of persistence of the embodiment of the present invention two;
Fig. 6 is the data enquire method process flow diagram of a kind of persistence of the embodiment of the present invention three;
Fig. 7 is the particular flow sheet of the data query operation process in the embodiment of the present invention three;
Fig. 8 is the data query system schematic diagram of a kind of persistence of the embodiment of the present invention four.
Embodiment
Be described principle of the present invention and feature below in conjunction with accompanying drawing, example, only for explaining the present invention, is not intended to limit scope of the present invention.
The date storage method of embodiment one, a kind of persistence.Below in conjunction with Fig. 2-Fig. 4, method provided by the invention is described in detail.
In Fig. 2, the data of mating with data storage operations request are write buffer memory, and in distributed file system, create at least one key file that can identify these data by the data storage operations request that S201, reception application program send.
Concrete, Fig. 3 is the data transmission connection layout between application program in the present embodiment, database, buffer memory, distributed file system, key file.
When database client receives the data storage operations request (also can be called data insertion operation request) of application client transmission, see Fig. 4, the data of mating in the data operation request sent with application program in database client can be write buffer memory.When the data in database client successfully write buffer memory, database client sends the successful information of data write buffer memory to application program, and in distributed file system, create the key file of the data that can identify these write buffer memorys, the data record in this file energy unique identification data.Wherein, the corresponding key file of each data record in data, using the key value (i.e. key value) of this data record as filename, file content is empty; When all data in database client or partial data write cache failure, directly by the data write distributed file system of write cache failure, and create the key file corresponding with the data do not write in distributed file system in distributed file system.
It should be noted that, non-relational database, i.e. NoSQL database during database in the present embodiment.
S202, cache client obtain at least one key value of energy identification data from key file.
Concrete, create key file in distributed file system after, cache client can not write key file corresponding to data in distributed file system by Real-time Obtaining, and obtain from the key file obtained can the key value of unique identification data.Wherein, key is used to represent the data record in data, and the data record do not write in distributed file system may have many, and the key value of correspondence that therefore cache client obtains herein may have multiple.
S203, according to obtain at least one key value, search the data of mating with this key value in the buffer.
Concrete, because the key value obtained from distributed file system is key values corresponding to the data do not write in distributed file system, therefore the data of these key values correspondences should exist usually in the buffer.Therefore, according to these key values obtained, the data of mating with these key values can be searched in the buffer.
S204, the data of mating with described key value found in the buffer to be write in distributed file system, and delete the key value in the key file corresponding with the data of this write distributed file system.
Concrete, above-mentioned steps searches the data corresponding with these key values in the buffer according to the key value obtained, under searching the successful situation of data in the buffer, these are searched in successful data write distributed file system, and the key value of deleting in the key file corresponding with these data of write distributed file system, so that the inquiry that cache client is follow-up, as long as cache client inquires the key value in key file, show that the data of these key values correspondences do not write in distributed file system.When searching data failure in the buffer, the information of searching data failure can be sent to application program by cache client, and request applications resends data storage operations request to database client, will search the data write buffer memory of failure.
The data storage device of embodiment two, a kind of persistence.Below in conjunction with Fig. 5, device provided by the invention is described in detail.
In Fig. 5, device provided by the invention comprises the first Data write. module 501, Data Identification acquisition module 502, data search module 503, second Data write. module 504 and the first request module 505.
Wherein, first Data write. module 501 is mainly used in the data storage operations request receiving application program transmission, the data of mating with data storage operations request are write buffer memory, and in distributed file system, creates at least one key file that can identify these data.
Concrete, when database client receives the data storage operations request (also can be called data discrepancy operation requests) of application client transmission, the data of mating in the data operation request sent with application program in database client are write buffer memory by the first Data write. module 501.When the data in database client successfully write buffer memory, database client sends the successful information of data write buffer memory to application program, and in distributed file system, create the key file of the data that can identify these write buffer memorys, the data record in this file energy unique identification data.Wherein, the corresponding key file of each data record in data, using the key value (i.e. key value) of this data record as filename, file content is empty; When all data in database client or partial data write cache failure, first Data write. module 501 directly by the data write distributed file system of write cache failure, and creates the key file corresponding with the data do not write in distributed file system in distributed file system.
It should be noted that, non-relational database, i.e. NoSQL database during database in the present embodiment.
Data Identification acquisition module 502 is mainly used in calling at least one key value that cache client obtains energy identification data from key file.
Concrete, create key file in distributed file system after, be arranged at Data Identification acquisition module 502 in cache client and can not write key file corresponding to data in distributed file system by Real-time Obtaining, and obtain from the key file obtained can the key value of unique identification data.Wherein, key value is used to represent the data record in data, and the data record do not write in distributed file system may have many, and the key value of correspondence that therefore cache client obtains herein may have multiple.
Data search module 503 is mainly used at least one the key value obtained according to Data Identification acquisition module 502, searches the data of mating with this key value in the buffer.
Concrete, because the key value obtained from distributed file system is key values corresponding to the data do not write in distributed file system, the data of these key values correspondences should exist usually in the buffer.Therefore, data search module 503 according to these key values obtained, can search the data of mating with these key values in the buffer.
The data of mating with key value that second Data write. module 504 is mainly used in data search module 503 to find in the buffer write in distributed file system, and delete the key value in the key file corresponding with the data of this write distributed file system.
First request module 505 is mainly used in when data search module 503 does not find the data of mating with key value in the buffer, failure information will be searched and send to application program, request applications sends data storage operations request to database client again, will search the data write buffer memory of failure.
Concrete, the key value that data search module 503 obtains according to Data Identification acquisition module 502 searches the data corresponding with these key values in the buffer, under data search module 503 searches the successful situation of data in the buffer, these search in successful data write distributed file system by the second Data write. module 504, and the key value of deleting in the key file corresponding with these data of write distributed file system, so that the inquiry that cache client is follow-up, as long as cache client inquires the key value in key file, show that the data of these key values correspondences do not write in distributed file system.When data search module 503 searches data failure in the buffer, the information of searching data failure can be sent to application program by the first request module 505, request applications sends data storage operations request to database client again, will search the data write buffer memory of failure.
The data enquire method of embodiment three, a kind of persistence.Below in conjunction with Fig. 6 and Fig. 7, method provided by the invention is described in detail.
In Fig. 6, S601, completed the storage of data in advance by the date storage method of persistence.
Concrete, first the present embodiment adopts the date storage method of the persistence in aforesaid embodiment one to complete the storage of data, and relevant technical characteristic see a kind of detailed description of embodiment, can not be repeated.
The data query operation request that S602, reception application program send, searches the data of mating with data query operation request from buffer memory.
Concrete, see Fig. 7, when database client receives the data query operation request that application client sends, first acquiescence searches the data that the data query operation request that sends with application program is mated from buffer memory.
If S603 successful inquiring, then the data of the coupling of inquiry are returned to described application program; If inquire about unsuccessfully, then the data of match query from distributed file system.
Concrete, under above-mentioned steps searches the successful situation of data from buffer memory, successful data will be searched and return to application client; If when searching data failure in the buffer, then from distributed file system, search the data of mating with data query operation request.
S604, in the successful situation of data query, the data of successful inquiring are returned to application program and writes buffer memory in distributed file system.
Concrete, when searching the data of mating with data query operation request from distributed file system, searching in successful situation, successful data feedback will searched and search successful data write buffer memory to application client and by these.When searching failure, from distributed file system, read key file and judge in key file, whether to there is the key value with the Data Matching of searching failure, if exist, then send request to application program, request applications sends data storage operations request to database client again, and the data of searching failure are re-write buffer memory; If there is not the key with the Data Matching of searching failure in key file, then return null, process ends.
The data query system of embodiment four, a kind of persistence.Below in conjunction with Fig. 8, system provided by the invention is described in detail.
In Fig. 8, system provided by the invention comprises data storage device 801, first data inquiry module 802, second data inquiry module 803, the 3rd Data write. module 804 and second request module 805 of persistence.
Wherein, the memory storage 801 of persistence is mainly used in the data storage device of the persistence adopted in embodiment two, completes the storage of data.
Concrete, the data storage device 801 of the persistence in the present embodiment first adopts the data storage device of the persistence in embodiment two to complete the storage of data, and relevant technical characteristic see a kind of detailed description of embodiment, can not be repeated.
First data inquiry module 802 is mainly used in the data query operation request receiving application program transmission, searches the data of mating with data query operation request in the buffer.
Concrete, when database client receives the data query operation request that application client sends, the first data inquiry module 802 gives tacit consent to the data of first searching the data query operation request that sends with application program and mating from buffer memory.
Second data inquiry module 803 is mainly used in when the first data inquiry module 802 is inquired about unsuccessfully in the buffer, the data of match query in distributed file system.
Concrete, when the first data inquiry module 802 searches data success in the buffer, successful data will be searched and return to application client; When searching data failure in the buffer, the second data inquiry module 803 searches the data of mating with data query operation request in distributed file system.
3rd Data write. module 804 is mainly used in when the data of successful inquiring during data query success, are returned to application program and write buffer memory by the second data inquiry module 803 in distributed file system.
Second request module 805 is mainly used in when the second data inquiry module 803 data query in distributed file system unsuccessfully, reads the key File in distributed file system, and judges whether the key value that there is the Data Matching failed with inquiry; If exist, then again the data write buffer memory of failure will be searched to application requests.
Concrete, when the second data inquiry module 803 searches the data of mating with data query operation request from distributed file system, searching in successful situation, the 3rd Data write. module 804 will be searched successful data feedback and search successful data write buffer memory to application client and by these.When searching failure, second request module 805 reads the key file in distributed file system and judges whether there is the key value with the Data Matching of searching failure in key file, if exist, then send request to application program, request applications sends data storage request to database client again, and the data of searching failure are re-write buffer memory; If there is not the key value with the Data Matching of searching failure in key file, then return null, process ends.
The date storage method of a kind of persistence provided by the invention and device, distributed file system is adopted to back up the data in buffer memory, and achieve the mutual backup of the data in buffer memory and distributed file system, ensure the safety and reliability of data; Adopt distributed file system to store the feature of data, data are stored on the different memory node of distributed file system, and storage space can dynamic retractility; In addition, the data in buffer memory and distributed file system are consistent in real time, can not cause the inconsistency of data or the loss of data because of the difference of data backup time.
The data enquire method of a kind of persistence provided by the invention and system; when receiving the data query operation request of application program transmission; first from buffer memory, search the data of coupling; if search unsuccessfully in the buffer; the data of coupling are searched again from distributed file system; like this when the query manipulation generation exception on buffer memory or buffer memory break down; just can inquire about from distributed file system; ensure that the fault of buffer service can not cause service disconnection, also namely ensure that security and the high availability of system.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. a date storage method for persistence, is characterized in that, comprising:
The data of mating with described data storage operations request are write buffer memory, and in distributed file system, create at least one key file that can identify described data by the data storage operations request that step S201, reception application program send;
Step S202, cache client obtain at least one key value of energy identification data from described key file;
Step S203, at least one key value according to described acquisition, search the data of mating with described key value in the buffer;
Step S204, the data of mating with described key value found in the buffer to be write in distributed file system, and delete the key value in the key file corresponding with the data of said write distributed file system.
2. date storage method as claimed in claim 1, it is characterized in that, described step S201 comprises:
When described data write cache failure, the data of said write cache failure are write direct in distributed file system.
3. date storage method as claimed in claim 2, it is characterized in that, described step S202 comprises:
Cache client obtains key value corresponding to the data do not write in distributed file system in real time from key file.
4. date storage method as claimed in claim 1, is characterized in that, also comprises after performing step S203:
If do not find the data of mating with described key value in the buffer, then will search failure information and send to application program, request applications sends data storage operations request to database client again, will search the data write buffer memory of failure.
5. a data storage device for persistence, is characterized in that, comprising:
The data of mating with described data storage operations request for receiving the data storage operations request that application program sends, are write buffer memory, and in distributed file system, create at least one key file that can identify described data by the first Data write. module;
Data Identification acquisition module, obtains at least one key value of energy identification data from described key file for calling cache client;
Data search module, at least one the key value according to described acquisition, searches the data of mating with described key value in the buffer;
Second Data write. module, for the data of mating with described key value found in the buffer being write in distributed file system, and deletes the key value in the key file corresponding with the data of said write distributed file system.
6. data storage device as claimed in claim 5, is characterized in that, also comprise:
First request module, if for not finding the data of mating with described key value in the buffer, to search failure information and send to application program, request applications sends data storage operations request to database client again, will search the data write buffer memory of failure.
7. a data enquire method for persistence, is characterized in that, comprising:
Step S601, in advance by the date storage method of the persistence described in any one of claim 1-4 complete data store;
The data query operation request that step S602, reception application program send, searches the data of mating with described data query operation request in the buffer;
If step S603 successful inquiring, then the data of the coupling inquired are returned to described application program; If inquire about unsuccessfully, then the data of match query in distributed file system;
Step S604, when inquiring the data of coupling in distributed file system, by the coupling inquired data return to application program and write buffer memory.
8. data enquire method as claimed in claim 7, is characterized in that, also comprise after described execution step S603:
When not finding the data of coupling in distributed file system, read the key file in distributed file system, and judge whether to there is the key value with described Data Matching;
If exist, then again the data write buffer memory of failure will be searched to application requests.
9. a data query system for persistence, is characterized in that, in advance by the data storage device of the persistence described in any one of claim 5 to 6, complete the storage of data, and the data query system of described persistence also comprises:
First data inquiry module, for receiving the data query operation that application program sends, searches the data of mating with described data query operation request from buffer memory;
Second data inquiry module, for when not inquiring the data of mating with described data query operation request in the buffer, the data of match query in distributed file system;
The data of the coupling inquired, for when inquiring the data of coupling in distributed file system, being returned to application program and writing buffer memory by the 3rd Data write. module.
10. data query system as claimed in claim 9, is characterized in that, also comprise:
Second request module, for when not inquiring the data of coupling in distributed file system, reads the key file in distributed file system, and judges whether to there is the key value with described Data Matching; If exist, then again the data write buffer memory of failure will be searched to application requests.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410601861.5A CN104317926B (en) | 2014-10-31 | 2014-10-31 | The data storage and query method and corresponding device and system of a kind of persistence |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410601861.5A CN104317926B (en) | 2014-10-31 | 2014-10-31 | The data storage and query method and corresponding device and system of a kind of persistence |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104317926A true CN104317926A (en) | 2015-01-28 |
| CN104317926B CN104317926B (en) | 2017-10-17 |
Family
ID=52373158
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410601861.5A Active CN104317926B (en) | 2014-10-31 | 2014-10-31 | The data storage and query method and corresponding device and system of a kind of persistence |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104317926B (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105516284A (en) * | 2015-12-01 | 2016-04-20 | 深圳市华讯方舟软件技术有限公司 | Clustered database distributed storage method and device |
| CN106021335A (en) * | 2016-05-06 | 2016-10-12 | 北京奇虎科技有限公司 | A database accessing method and device |
| WO2016187974A1 (en) * | 2015-05-25 | 2016-12-01 | 中兴通讯股份有限公司 | Storage space management method and apparatus |
| CN106557278A (en) * | 2015-09-30 | 2017-04-05 | 腾讯科技（深圳）有限公司 | A kind of method of data cached persistence |
| CN106657356A (en) * | 2016-12-29 | 2017-05-10 | 郑州云海信息技术有限公司 | Data writing method and device for cloud storage system, and cloud storage system |
| CN107094178A (en) * | 2017-05-11 | 2017-08-25 | 广东网金控股股份有限公司 | A kind of Internet data transmission method, device and server terminal |
| CN108021688A (en) * | 2017-12-15 | 2018-05-11 | 北京明朝万达科技股份有限公司 | A kind of data processing method and device |
| CN108073355A (en) * | 2016-11-15 | 2018-05-25 | 杭州海康威视数字技术股份有限公司 | A kind of data storage and delet method and device |
| CN109189759A (en) * | 2018-08-01 | 2019-01-11 | 华为技术有限公司 | Method for reading data, data query method, device and equipment in KV storage system |
| CN109299035A (en) * | 2018-07-04 | 2019-02-01 | 中通服建设有限公司 | A kind of CHR file management method, system and computer readable storage medium |
| CN109753592A (en) * | 2018-12-22 | 2019-05-14 | 汤新红 | A kind of information flow storage system and its storage method based on big data |
| CN110413613A (en) * | 2019-07-09 | 2019-11-05 | 阿里巴巴集团控股有限公司 | Write-in, read method, device and the equipment of Volume data |
| CN110908809A (en) * | 2019-10-28 | 2020-03-24 | 苏宁云计算有限公司 | Query service calling method and device |
| CN111966751A (en) * | 2020-08-14 | 2020-11-20 | 苏州浪潮智能科技有限公司 | Distributed object storage metadata storage method and system, and reading method and system |
| CN112597354A (en) * | 2020-12-22 | 2021-04-02 | 贝壳技术有限公司 | Method, device, system and storage medium for providing configuration parameters |
| CN112632098A (en) * | 2020-12-18 | 2021-04-09 | 平安普惠企业管理有限公司 | Dynamic generation method of structured query statement and related equipment |
| CN113297203A (en) * | 2020-07-15 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Data query and write-in method and device, computer storage medium and electronic equipment |
| CN114584576A (en) * | 2022-03-04 | 2022-06-03 | 拉扎斯网络科技（上海）有限公司 | Data storage method, device, equipment, storage medium and computer program product |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101510209A (en) * | 2009-03-30 | 2009-08-19 | 北京金山软件有限公司 | Method, system and server for implementing real time search |
| CN102014153A (en) * | 2010-10-19 | 2011-04-13 | 浪潮(北京)电子信息产业有限公司 | Data storage system and method thereof |
| CN103577551A (en) * | 2013-10-16 | 2014-02-12 | 青岛海信传媒网络技术有限公司 | Method and device for submitting data to database in batch |
-
2014
- 2014-10-31 CN CN201410601861.5A patent/CN104317926B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101510209A (en) * | 2009-03-30 | 2009-08-19 | 北京金山软件有限公司 | Method, system and server for implementing real time search |
| CN102014153A (en) * | 2010-10-19 | 2011-04-13 | 浪潮(北京)电子信息产业有限公司 | Data storage system and method thereof |
| CN103577551A (en) * | 2013-10-16 | 2014-02-12 | 青岛海信传媒网络技术有限公司 | Method and device for submitting data to database in batch |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016187974A1 (en) * | 2015-05-25 | 2016-12-01 | 中兴通讯股份有限公司 | Storage space management method and apparatus |
| CN106557278A (en) * | 2015-09-30 | 2017-04-05 | 腾讯科技（深圳）有限公司 | A kind of method of data cached persistence |
| CN105516284B (en) * | 2015-12-01 | 2019-05-03 | 深圳市华讯方舟软件技术有限公司 | A kind of method and apparatus of Cluster Database distributed storage |
| WO2017092384A1 (en) * | 2015-12-01 | 2017-06-08 | 深圳市华讯方舟软件技术有限公司 | Clustered database distributed storage method and device |
| CN105516284A (en) * | 2015-12-01 | 2016-04-20 | 深圳市华讯方舟软件技术有限公司 | Clustered database distributed storage method and device |
| CN106021335A (en) * | 2016-05-06 | 2016-10-12 | 北京奇虎科技有限公司 | A database accessing method and device |
| WO2017190580A1 (en) * | 2016-05-06 | 2017-11-09 | 北京奇虎科技有限公司 | Method and device for accessing database |
| CN108073355B (en) * | 2016-11-15 | 2020-03-17 | 杭州海康威视数字技术股份有限公司 | Data storage and deletion method and device |
| CN108073355A (en) * | 2016-11-15 | 2018-05-25 | 杭州海康威视数字技术股份有限公司 | A kind of data storage and delet method and device |
| CN106657356A (en) * | 2016-12-29 | 2017-05-10 | 郑州云海信息技术有限公司 | Data writing method and device for cloud storage system, and cloud storage system |
| CN107094178A (en) * | 2017-05-11 | 2017-08-25 | 广东网金控股股份有限公司 | A kind of Internet data transmission method, device and server terminal |
| CN107094178B (en) * | 2017-05-11 | 2019-06-18 | 广东网金控股股份有限公司 | A kind of Internet data transmission method, apparatus and server terminal |
| CN108021688A (en) * | 2017-12-15 | 2018-05-11 | 北京明朝万达科技股份有限公司 | A kind of data processing method and device |
| CN108021688B (en) * | 2017-12-15 | 2019-05-21 | 北京明朝万达科技股份有限公司 | A kind of data processing method and device |
| CN109299035A (en) * | 2018-07-04 | 2019-02-01 | 中通服建设有限公司 | A kind of CHR file management method, system and computer readable storage medium |
| CN109189759A (en) * | 2018-08-01 | 2019-01-11 | 华为技术有限公司 | Method for reading data, data query method, device and equipment in KV storage system |
| CN109189759B (en) * | 2018-08-01 | 2021-11-19 | 华为技术有限公司 | Data reading method, data query method, device and equipment in KV storage system |
| CN109753592A (en) * | 2018-12-22 | 2019-05-14 | 汤新红 | A kind of information flow storage system and its storage method based on big data |
| CN110413613A (en) * | 2019-07-09 | 2019-11-05 | 阿里巴巴集团控股有限公司 | Write-in, read method, device and the equipment of Volume data |
| CN110413613B (en) * | 2019-07-09 | 2023-01-17 | 创新先进技术有限公司 | Writing and reading method, device and equipment for large data volume data |
| CN110908809A (en) * | 2019-10-28 | 2020-03-24 | 苏宁云计算有限公司 | Query service calling method and device |
| CN113297203A (en) * | 2020-07-15 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Data query and write-in method and device, computer storage medium and electronic equipment |
| CN111966751A (en) * | 2020-08-14 | 2020-11-20 | 苏州浪潮智能科技有限公司 | Distributed object storage metadata storage method and system, and reading method and system |
| CN112632098A (en) * | 2020-12-18 | 2021-04-09 | 平安普惠企业管理有限公司 | Dynamic generation method of structured query statement and related equipment |
| CN112597354A (en) * | 2020-12-22 | 2021-04-02 | 贝壳技术有限公司 | Method, device, system and storage medium for providing configuration parameters |
| CN114584576A (en) * | 2022-03-04 | 2022-06-03 | 拉扎斯网络科技（上海）有限公司 | Data storage method, device, equipment, storage medium and computer program product |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104317926B (en) | 2017-10-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104317926A (en) | Persistent data storage method, persistent data query method, persistent data storage device and persistent data query system | |
| US10795788B2 (en) | Remote data replication method and system | |
| CN101460930B (en) | Maintenance of link level consistency between database and file system | |
| US8214334B2 (en) | Systems and methods for distributed system scanning | |
| US9715507B2 (en) | Techniques for reconciling metadata and data in a cloud storage system without service interruption | |
| US9195668B2 (en) | Log access method storage control apparatus, archive system, and method of operation | |
| US7546429B1 (en) | Method of detection of data corruption in mirrored storage | |
| CN101334797B (en) | Distributed file systems and its data block consistency managing method | |
| CN101888405B (en) | Cloud computing file system and data processing method | |
| US20120259863A1 (en) | Low Level Object Version Tracking Using Non-Volatile Memory Write Generations | |
| CN102591982A (en) | Method and system of performing incremental sql server database backups | |
| US8380663B2 (en) | Data integrity in a database environment through background synchronization | |
| CN103617277A (en) | Method for restoring data table content deleted mistakenly | |
| US20190121793A1 (en) | Data updating method and device for a distributed database system | |
| KR101674176B1 (en) | Method and apparatus for fsync system call processing using ordered mode journaling with file unit | |
| CN104020961A (en) | Distributed data storage method, device and system | |
| CN104217174A (en) | Safety storage system and safety storage method for distributed files | |
| CN102314503A (en) | Indexing method | |
| CN107229540A (en) | A kind of database restoring method and system based on time point | |
| KR101424568B1 (en) | Client and database server for resumable transaction and method thereof | |
| CN106776795B (en) | Data writing method and device based on Hbase database | |
| US20040143609A1 (en) | System and method for data extraction in a non-native environment | |
| CN104182182A (en) | Intelligent terminal and data backup method thereof | |
| CN106991118A (en) | Entangled based on CEPH and delete fault-tolerant reading document method and device | |
| US10545829B2 (en) | Using file system extended attributes to recover databases in hierarchical file systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |