CN105677579A - Data access method and system in cache system - Google Patents

Data access method and system in cache system Download PDF

Info

Publication number
CN105677579A
CN105677579A CN201410668491.7A CN201410668491A CN105677579A CN 105677579 A CN105677579 A CN 105677579A CN 201410668491 A CN201410668491 A CN 201410668491A CN 105677579 A CN105677579 A CN 105677579A
Authority
CN
China
Prior art keywords
data
field
configuration file
internal memory
read request
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410668491.7A
Other languages
Chinese (zh)
Other versions
CN105677579B (en
Inventor
祁舟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Burson Marsteller Network Game Development (shenzhen) Co Ltd
Original Assignee
Burson Marsteller Network Game Development (shenzhen) Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Burson Marsteller Network Game Development (shenzhen) Co Ltd filed Critical Burson Marsteller Network Game Development (shenzhen) Co Ltd
Priority to CN201410668491.7A priority Critical patent/CN105677579B/en
Publication of CN105677579A publication Critical patent/CN105677579A/en
Application granted granted Critical
Publication of CN105677579B publication Critical patent/CN105677579B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

Provided is a data access method in a cache system. The method comprises following steps: receiving a writing request of a requester; writing the request according to data and writing request-writing data to a memory; splitting data written into the memory into multiple fields according to a pre-set configuration file including corresponding relation between data types and files; verifying fields obtained after splitting; and re-writing data written in the memory back to the database. The method is adopted so that data types are not needed to be considered during data storage. No rewriting program is needed to be complied due to corresponding storage of data and data types as for different kinds of data, leading to a sharp decrease in working load of program developers. Furthermore, the invention further provides a data access system in the cache system.

Description

Data access method in caching system and system
Technical field
The present invention relates to field of computer technology, particularly relate to the data access method in a kind of caching system and system.
Background technology
Polytype data of buffer memory are stored in internal memory by data storage aspect current commonly used Redis, MemCache etc., improve the reading speed of data, improve the real time response speed of data-storage system with this. Traditional data storage method is data storages corresponding to data type, when different types of data are written back to data base by internal memory, it is required for different data types and writes different write-back programs respectively, thus cause the workload of application developer to increase, the substantial amounts of time is wasted.
Summary of the invention
Based on this, it is necessary to for above-mentioned technical problem, it is provided that data access method in a kind of caching system that can save application developer's workload and system.
A kind of data access method in caching system, described method includes:
Receive the data write request of requesting party;
According to described data write request by the data write internal memory of request write;
According to default configuration file, the described data written into internal memory are split as multiple field, described configuration file comprises the corresponding relation of data type and field;
The field obtained after splitting is verified;
The described data written into internal memory by rear, are then written back to data base with field form by verification.
A kind of data access system in caching system, described system includes:
Request receiver module, for receiving the data write request of requesting party;
Data write. module, for writing internal memory according to described data write request by the data of request write;
Data split module, for the described data written into internal memory being split as multiple field according to the configuration file preset, comprise the corresponding relation of data type and field in described configuration file;
First field correction verification module, for verifying the field obtained after splitting;
The described data written into internal memory for verification by rear, are then written back to data base with field form by write back data module.
Data access method in said buffer system and system, according to data write request by the data write internal memory of request write, according to preset configuration file the data written into internal memory it is split as multiple field and verifies, data written into internal memory, by rear, are written back to data base with field form by verification. Owing to configuration file comprising the corresponding relation of data type and field, data written into internal memory are to be split into field according to configuration file, verify by after be written back to data base in the form of fields, therefore, when data store without considering data type, thus overcoming factor data storage corresponding to data type and being required for different types of data and write the problem of write-back program, thus it is greatly saved the workload of application developer.
Accompanying drawing explanation
Fig. 1 is the flow chart of the data access method in an embodiment in caching system;
Data are split into field the flow chart verified by Fig. 2 in one embodiment;
Fig. 3 is the applied environment figure of the data access method in an embodiment in data buffering system;
Fig. 4 is the flow chart of digital independent in an embodiment;
Fig. 5 is the flow chart carrying out in data read process in an embodiment verifying;
Fig. 6 is the structural representation of the data access system in an embodiment in caching system;
Fig. 7 is the structural representation of the first field correction verification module in an embodiment;
Fig. 8 is the structural representation of the data access system in another embodiment in caching system;
Fig. 9 is the structural representation of the second field correction verification module in an embodiment;
Figure 10 is data deletion modular structure schematic diagram in an embodiment.
Detailed description of the invention
In order to make the purpose of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, the present invention is further elaborated. Should be appreciated that specific embodiment described herein is only in order to explain the present invention, is not intended to limit the present invention.
In one embodiment, as shown in Figure 1, it is provided that the data access method in a kind of caching system, the present embodiment is applied to server end in this way and illustrates, specifically includes:
Step 102, receives the data write request of requesting party.
Build the system architecture of a kind of data access in advance at server end, concrete can be build a data package, and has default configuration file in server storage, includes but not limited to the corresponding relation of data type and field in configuration file. Data package can include data buffering system, multiple different virtual server and data base. Data buffering system supports multiple different data type, includes but not limited to character string, chained list, set, Hash table etc.
Requesting party is directed to a side of data buffering system generation request of data, it is possible to be the client relative with server end, it is also possible to be other application programs operating in server end. Communicated by network before client and data buffering system. Data write includes data interpolation, data modification etc.
Step 104, according to data write request by the data write internal memory of request write.
After receiving the data write request that requesting party sends, according to this request, by the data write internal memory of request write. Such as, internal memory adds new data, or data existing in internal memory are modified. After data write internal memory, return operating result to requesting party, added or amendment etc. as returned data.
Data written into internal memory are split as multiple field according to default configuration file by step 106, comprise the corresponding relation of data type and field in configuration file.
Field can be expressed as the row in list in data base. Such as, in address book data storehouse, name, telephone number are the attributes that all row in list are total, it is possible to these row are called name field and telephone number field. The configuration file preset in data package comprises the corresponding relation of data type and field, the quantity of field as corresponding in data type or the title etc. of field, for instance: corresponding 2 fields of character string, corresponding 5 fields of chained list etc. Data written into internal memory are split by the corresponding relation according to data type in configuration file Yu field, concrete, it is possible to data to be split with reference to separator, the field after being split. Data can also not done and split, the data of write are encoded, the mode of coding can be add description information at data header, can include field name etc. in description information, using the data after coding as a field.
Step 108, verifies the field obtained after splitting.
The field obtained after splitting is verified by the field quantity corresponding according to the data type preset in configuration file or field name. Concrete, the quantity of the field obtained after fractionation is matched with the field quantity in configuration file, then verification is passed through. Or the title of the field obtained after fractionation matched with the field name in configuration file, then verification is passed through.
Step 110, the data written into internal memory by rear, are then written back to data base with field form by verification.
The field obtained after fractionation verifies by rear, with field form, the data written into internal memory is written back to data base and stores. If the field obtained after splitting is not validated, then by the data deletion written into internal memory.
In the present embodiment, owing to configuration file comprising the corresponding relation of data type and field, data written into internal memory are to be split into field according to configuration file, verify by after be written back to data base in the form of fields, therefore, when data store without considering data type, thus overcoming factor data storage corresponding to data type and being required for different types of data and write the problem of write-back program, thus it is greatly saved the workload of application developer. Simultaneously, field form is adopted to store, further overcome owing to Redis originally stored data with binary data stream mode or default command format, the problem causing artificially reading the data that None-identified has stored, so that application developer can identify the data of storage by naked eyes, bring facility for application developer.
In one embodiment, as in figure 2 it is shown, the step that the field obtained after splitting is verified includes:
Step 202, is ranked up the field obtained after fractionation according to the order of write internal memory.
Step 204, after sequence, the field obtained after splitting is verified by the field quantity corresponding according to the data type preset in configuration file or field name.
Step 206, if the title of field that the quantity of field obtained after splitting obtains after matching with the field quantity in configuration file or splits matches with the field name in configuration file, then by verification.
After the field that obtains after splitting is ranked up according to the order of write internal memory, if the quantity of the field obtained after splitting is identical with the field quantity in configuration file or meets the requirement of field quantity in configuration file, then by verification. Such as, corresponding 2 fields of character string preset in configuration file or more than 2 and less than 5, if the field that the data that data type is character string obtain after splitting adds up to 2 or 4, then by verifying; If less than 2, then verify failure. Or, the title of the field obtained after fractionation is identical with the field name in configuration file or comprises identical keyword, then by verifying. Such as, the keyword comprised in the field name that character string default in configuration file is corresponding is " name ", if containing " name " in the title of the field after then splitting, then by verification, otherwise, verifies unsuccessfully. The mode of verification can effectively remove dirty data, and dirty data includes that data form is illegal, encode nonstandard data and the data etc. illegally distorted. Thus being effectively increased the safety and reliability of data storage.
In one embodiment, the data access method in caching system can apply in applied environment as shown in Figure 3. A data package is built at background server end, data package includes data buffering system 302, data acquisition server 304, data renewal server 306 and data base 308, and wherein data acquisition server 304 and data update server 306 is virtual server. Data package may operate on a physical server, this physical server only need to store a configuration file, it is also possible to be separately operable on multiple stage physical server, and every physical server stores a configuration file respectively. Data buffering system 302 and data acquisition server 304, data update and are attached respectively through network between server 306, and communication mode can adopt asynchronous communication, thus can improve Data Concurrent rate. Additionally, data buffering system 302 and data acquisition server 304, data are updated and can also be attached by message queue between server 306. Data acquisition server 304, data update server 306 and are attached respectively through network with data base 308.
Client sends data write request by network to data buffering system 302, after data buffering system 302 receives this data write request, by the data write internal memory of request write, and returns operating result to client. Data written into internal memory are sent to data renewal server 306 by data buffering system 302, data update server 306, according to configuration file, the data written into internal memory are split as multiple field, and the field obtained after splitting is verified, verification is by rear, and data update server 306 and with field form, the data written into internal memory are written back to data base 308.
In one embodiment, as shown in Figure 4, after the data written into internal memory are written back to field form the step of data base, also include:
Step 402, receives the data read request of requesting party.
Step 404, according to the data whether storing correspondence in data read request audit memory; If having, then entering step 406, otherwise, entering step 408.
The data corresponding with data read request are carried out extracting and being back to requesting party by step 406.
Step 408, extracts the field of correspondence, and verifies according to configuration file according to data read request data base.
Step 410, the field groups of extraction by rear, then dressed up the data corresponding with data read request, and the data corresponding with data read request is back to requesting party by verification.
Data buffering system receives the data read request that requesting party sends, and according to whether this requesting query internal memory stores the data of correspondence. If having, the data corresponding with data read request are extracted by data buffering system from internal memory, and corresponding data are back to requesting party. Otherwise, data read request is forwarded to data acquisition server by data buffering system. Data acquisition server is inquired about at server according to this request, if data base exists the field corresponding with data read request, then corresponding field being extracted, the field extracted is verified by the field quantity corresponding according to the data type preset in configuration file or field name.
Verification is by rear, and the field groups of extraction is dressed up the data corresponding with data read request by data acquisition server, concrete, for splitting, by separator, the field that obtains, can write the order of internal memory according to field or field name assembles; For the field obtained after coding, can carrying out the decoding of correspondence, the mode of decoding can be delete the description information that data header adds, by data convert. After being completed, the data corresponding with data read request are back to data buffering system by data acquisition server, and corresponding data are back to requesting party by data buffering system.
Be absent from the data corresponding with data read request if being appreciated that in data base, then data acquisition server returns the non-existent result of data to data buffering system, and data buffering system returns data to requesting party and is absent from accordingly.
In the present embodiment, according to the data whether storing correspondence in data read request audit memory, if having, data that then extracting directly is corresponding are also back to requesting party, otherwise, extract the field of correspondence according to data read request data base and according to configuration file, field verified, verify by after the field groups of extraction dressed up the data corresponding with data read request and is back to requesting party. Thus effectively prevent the loss of data owing to being written back to data base and need to restart Redis, and Redis last time can be operated in data all carry out the situation that loads. If being written back to the loss of data of data base, not needing to restart data buffering system, only according to data read request loading data, system resource need to be saved.
In one embodiment, as it is shown in figure 5, extract the field of correspondence data base according to data read request, and the step carrying out verifying according to configuration file includes:
Step 502, extracts corresponding field according to the order that data read request writes internal memory according to field from data base.
The field extracted is verified by step 504, the field quantity corresponding according to the data type preset in configuration file or field name.
Step 506, if the title of field that the field quantity in quantity and the configuration file of the field extracted matches or extracts matches with the field name in configuration file, then by verification.
In data base, corresponding field is extracted according to the order that data read request writes internal memory according to field, concrete, for splitting, by separator, the field that obtains, according to order corresponding to field and separator, the field corresponding with read requests can be extracted from data base; For the field that obtains after coding, by order corresponding to field and coding, the field corresponding with read requests can be extracted from data base. If the quantity of field extracted is identical with the preset field quantity in configuration file or meets the requirement of preset field quantity in configuration file, then by verifying, if or the title of field extracted is identical with the field name in configuration file or comprises identical keyword, then by verification. Which thereby enhance the reliability of data.
In one embodiment, method also includes: deletes in internal memory and is not accessed for data beyond in the accessed or nearest Preset Time of Preset Time.
Configuration file can also include the superseded mode of cold data. Cold data refer to that not being accessed in data or nearest Preset Time beyond Preset Time is not accessed for data, and Preset Time can be nearest a period of time, such as nearest 1 month, it is also possible to be not accessed for the time more than certain time, as more than 3 months. Cold data are deleted by superseded the referring to of cold data from internal memory. According to configuration file, cold data are eliminated, thereby saving memory headroom, improve the efficiency of data buffering system.
In one embodiment, as shown in Figure 6, providing the data access system in a kind of caching system, this system includes: request receiver module 602, Data write. module 604, data split module the 606, first field correction verification module 608 and write back data module 610, wherein:
Request receiver module 602, for receiving the data write request of requesting party.
Data write. module 604, for writing internal memory according to data write request by the data of request write.
Data split module 606, for the data written into internal memory being split as multiple field according to the configuration file preset, comprise the corresponding relation of data type and field in configuration file.
First field correction verification module 608, for verifying the field obtained after splitting.
Data written into internal memory for verification by rear, are then written back to data base with field form by write back data module 610.
In one embodiment, as it is shown in fig. 7, the first field correction verification module 608 includes: sequencing unit 608a and the first verification unit 608b, wherein:
Sequencing unit 608a, is ranked up according to the order of write internal memory for the field obtained after splitting.
First verification unit 608b, after sequence, the field obtained after splitting is verified by the field quantity corresponding according to the data type preset in configuration file or field name; If the title of the field that the quantity of the field obtained after splitting obtains after matching with the field quantity in configuration file or split matches with the field name in configuration file, then by verifying.
In one embodiment, as shown in Figure 8, request receiver module 602 is additionally operable to receive the data read request of requesting party; This system also includes: data inquiry module the 612, first data return module the 614, second field correction verification module 616 and the second data return module 618, wherein:
Data inquiry module 612, for according to the data whether storing correspondence in data read request audit memory.
First data return module 614, if having the data of correspondence for storage in internal memory, then are undertaken extracting and being back to requesting party by the data corresponding with data read request.
Second field correction verification module 616, if for the data being absent from correspondence in internal memory, then extracting the field of correspondence, and verify according to configuration file according to data read request data base.
Second data return module 618, for verification by rear, then the field groups of extraction is dressed up the data corresponding with data read request, and the data corresponding with data read request are back to requesting party.
In one embodiment, as it is shown in figure 9, the second field correction verification module 616 includes: extraction unit 616a and the second verification unit 616b, wherein:
Extraction unit 616a, extracts corresponding field for the order writing internal memory according to field according to data read request in data base.
Second verification unit 616a, verifies the field extracted for the field quantity corresponding according to the data type preset in configuration file or field name; If the title of the field that the quantity of the field extracted and the field quantity in configuration file match or extracts matches with the field name in configuration file, then by verifying.
In one embodiment, as shown in Figure 10, this system also includes: data deletion module 620, is used for deleting in internal memory and is not accessed for data beyond in the accessed or nearest Preset Time of Preset Time.
Embodiment described above only have expressed the several embodiments of the present invention, and it describes comparatively concrete and detailed, but therefore can not be interpreted as the restriction to the scope of the claims of the present invention. It should be pointed out that, for the person of ordinary skill of the art, without departing from the inventive concept of the premise, it is also possible to making some deformation and improvement, these broadly fall into protection scope of the present invention. Therefore, the protection domain of patent of the present invention should be as the criterion with claims.

Claims (10)

1. the data access method in caching system, described method includes:
Receive the data write request of requesting party;
According to described data write request by the data write internal memory of request write;
According to default configuration file, the described data written into internal memory are split as multiple field, described configuration file comprises the corresponding relation of data type and field;
The field obtained after splitting is verified;
The described data written into internal memory by rear, are then written back to data base with field form by verification.
2. method according to claim 1, it is characterised in that the step that the described field to obtaining after splitting verifies includes:
The field obtained after described fractionation is ranked up according to the order of write internal memory;
After sequence, the field obtained after described fractionation is verified by the field quantity corresponding according to the data type preset in described configuration file or field name;
If the title of the field that the quantity of the field obtained after described fractionation and the described field quantity in described configuration file match or obtains after described fractionation matches with the field name in described configuration file, then by verifying.
3. method according to claim 1, it is characterised in that after the described step that the described data written into internal memory are written back to field form data base, also include:
Receive the data read request of requesting party;
According to the data whether storing correspondence in described data read request audit memory;
If having, then undertaken extracting and being back to requesting party by the data corresponding with described data read request;
Otherwise, extract the field of correspondence according to described data read request data base, and according to described configuration file, the field extracted is verified;
The field groups of described extraction by rear, then dressed up the data corresponding with described data read request, and the data corresponding with described data read request is back to requesting party by verification.
4. method according to claim 3, it is characterised in that the described field extracting correspondence according to described data read request data base, and according to described configuration file, the step that verifies of field extracted is included:
From data base, corresponding field is extracted according to the order that described data read request writes internal memory according to field;
The field extracted is verified by the field quantity corresponding according to the data type preset in described configuration file or field name;
If the quantity of the field of described extraction and the field quantity in described configuration file match or the title of the field of described extraction matches with the field name in described configuration file, then by verifying.
5. the method according to Claims 1-4 any one, it is characterised in that described method also includes:
Delete in internal memory and be not accessed for data beyond in the accessed or nearest Preset Time of Preset Time.
6. the data access system in a caching system, it is characterised in that described system includes:
Request receiver module, for receiving the data write request of requesting party;
Data write. module, for writing internal memory according to described data write request by the data of request write;
Data split module, for the described data written into internal memory being split as multiple field according to the configuration file preset, comprise the corresponding relation of data type and field in described configuration file;
First field correction verification module, for verifying the field obtained after splitting;
The described data written into internal memory for verification by rear, are then written back to data base with field form by write back data module.
7. system according to claim 6, it is characterised in that described first field correction verification module includes:
Sequencing unit, for being ranked up the field obtained after described fractionation according to the order of write internal memory;
First verification unit, after sequence, the field obtained after described fractionation is verified by the field quantity corresponding according to the data type preset in described configuration file or field name; If the title of the field that the quantity of the field obtained after described fractionation and the described field quantity in described configuration file match or obtains after described fractionation matches with the field name in described configuration file, then by verifying.
8. system according to claim 6, it is characterised in that described request receiver module is additionally operable to receive the data read request of requesting party;
Described system also includes:
Data inquiry module, for according to the data whether storing correspondence in described data read request audit memory;
First data return module, if having the data of correspondence for storage in internal memory, then are undertaken extracting and being back to requesting party by the data corresponding with described data read request;
Second field correction verification module, if for the data being absent from correspondence in internal memory, then extracting the field of correspondence, and verify according to described configuration file according to described data read request data base;
Second data return module, for verification by rear, then the field groups of described extraction is dressed up the data corresponding with described data read request, and the data corresponding with described data read request are back to requesting party.
9. system according to claim 8, it is characterised in that described second field correction verification module includes:
Field extraction unit, extracts corresponding field for the order writing internal memory according to field according to described data read request in data base;
Second verification unit, verifies the field extracted for the field quantity corresponding according to the data type preset in described configuration file or field name; If the quantity of the field of described extraction and the field quantity in described configuration file match or the title of the field of described extraction matches with the field name in described configuration file, then by verifying.
10. the system according to any one of claim 6 to 9, it is characterised in that described system also includes:
Data deletion module, is used for deleting in internal memory and is not accessed for data beyond in the accessed or nearest Preset Time of Preset Time.
CN201410668491.7A 2014-11-20 2014-11-20 Data access method in caching system and system Active CN105677579B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410668491.7A CN105677579B (en) 2014-11-20 2014-11-20 Data access method in caching system and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410668491.7A CN105677579B (en) 2014-11-20 2014-11-20 Data access method in caching system and system

Publications (2)

Publication Number Publication Date
CN105677579A true CN105677579A (en) 2016-06-15
CN105677579B CN105677579B (en) 2018-08-17

Family

ID=56957354

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410668491.7A Active CN105677579B (en) 2014-11-20 2014-11-20 Data access method in caching system and system

Country Status (1)

Country Link
CN (1) CN105677579B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106407345A (en) * 2016-09-06 2017-02-15 合网络技术(北京)有限公司 Method and apparatus for updating dirty data
CN110727691A (en) * 2019-10-22 2020-01-24 北京明略软件系统有限公司 Data analysis and verification method and device
CN111382128A (en) * 2020-03-20 2020-07-07 中国邮政储蓄银行股份有限公司 File splitting method and device and computer system
CN113268440A (en) * 2021-05-26 2021-08-17 上海哔哩哔哩科技有限公司 Cache elimination method and system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101902335A (en) * 2009-05-27 2010-12-01 北京启明星辰信息技术股份有限公司 Data filter and combination method
CN102387200A (en) * 2011-10-20 2012-03-21 中国科学院上海微系统与信息技术研究所 Sensor network backend data processing method based on labview and database
US8204911B2 (en) * 2001-01-09 2012-06-19 Nextair Corporation Software, devices and methods facilitating execution of server-side applications at mobile devices

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8204911B2 (en) * 2001-01-09 2012-06-19 Nextair Corporation Software, devices and methods facilitating execution of server-side applications at mobile devices
CN101902335A (en) * 2009-05-27 2010-12-01 北京启明星辰信息技术股份有限公司 Data filter and combination method
CN102387200A (en) * 2011-10-20 2012-03-21 中国科学院上海微系统与信息技术研究所 Sensor network backend data processing method based on labview and database

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106407345A (en) * 2016-09-06 2017-02-15 合网络技术(北京)有限公司 Method and apparatus for updating dirty data
CN106407345B (en) * 2016-09-06 2020-07-14 阿里巴巴(中国)有限公司 Dirty data updating method and device
CN110727691A (en) * 2019-10-22 2020-01-24 北京明略软件系统有限公司 Data analysis and verification method and device
CN111382128A (en) * 2020-03-20 2020-07-07 中国邮政储蓄银行股份有限公司 File splitting method and device and computer system
CN113268440A (en) * 2021-05-26 2021-08-17 上海哔哩哔哩科技有限公司 Cache elimination method and system

Also Published As

Publication number Publication date
CN105677579B (en) 2018-08-17

Similar Documents

Publication Publication Date Title
KR102240557B1 (en) Method, device and system for storing data
US10248556B2 (en) Forward-only paged data storage management where virtual cursor moves in only one direction from header of a session to data field of the session
CN103136243B (en) File system duplicate removal method based on cloud storage and device
CN102629247B (en) Method, device and system for data processing
US10509701B2 (en) Performing data backups using snapshots
US11263194B2 (en) File block addressing for backups
CN102567427B (en) Method and device for processing object data
CN105183839A (en) Hadoop-based storage optimizing method for small file hierachical indexing
CN107436725A (en) A kind of data are write, read method, apparatus and distributed objects storage cluster
CN104408111A (en) Method and device for deleting duplicate data
US9600486B2 (en) File system directory attribute correction
CN105100051A (en) Method and system for realizing data resource access right control
CN107832423B (en) File reading and writing method for distributed file system
CN105677579A (en) Data access method and system in cache system
CN103067519A (en) Method and device of data distribution storage under heterogeneous platform
CN109471843A (en) A kind of metadata cache method, system and relevant apparatus
CN102523301A (en) Method for caching data on client in cloud storage
CN113806300A (en) Data storage method, system, device, equipment and storage medium
CN103713926A (en) Method and system for updating software of client in advance
US8612717B2 (en) Storage system
CN108205482A (en) File mount restoration methods
US20110047165A1 (en) Network cache, a user device, a computer program product and a method for managing files
CN101556595A (en) Method for fast positioning relevant documents in document system
CN110825715B (en) Multi-object data second combination implementation method based on Ceph object storage
CN111339042B (en) Data operation processing method, system and scheduling server

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant