CN108271420A - Manage method, file system and the server system of file - Google Patents

Manage method, file system and the server system of file Download PDF

Info

Publication number
CN108271420A
CN108271420A CN201680003120.4A CN201680003120A CN108271420A CN 108271420 A CN108271420 A CN 108271420A CN 201680003120 A CN201680003120 A CN 201680003120A CN 108271420 A CN108271420 A CN 108271420A
Authority
CN
China
Prior art keywords
metadata
data
file
area
data fragmentation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201680003120.4A
Other languages
Chinese (zh)
Other versions
CN108271420B (en
Inventor
王力涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN108271420A publication Critical patent/CN108271420A/en
Application granted granted Critical
Publication of CN108271420B publication Critical patent/CN108271420B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers

Abstract

A kind of method, file system and server system for managing file.This method includes:Receive written document request;It is asked according to the written document, determines the data to be stored of file and the metadata of this document;Determine multiple data fragmentations of the data to be stored of this document;Determine the local metadata of each data fragmentation in multiple data fragmentation;The local metadata of data fragmentation each in data fragmentation each in multiple data fragmentation, multiple data fragmentation and the metadata of this document are stored to data area;By the metadata storage of this document to metadata area.The program can effectively protect metadata.

Description

Manage method, file system and the server system of file Technical field
The present invention relates to information technology fields, and more particularly, to a kind of method, file system and server system for managing file.
Background technique
Distributed file system is a more complicated system, and the data of management generally can simplify as two clusters of data and metadata.Data are exactly the true data that user sees, what is substantially referred to is exactly the true content of file.Metadata is also known as " data of data ", the mapping relations etc. mainly between the attribute information and catalogue of bibliographic structure, file and catalogue.Metadata, which is used to realize, quickly searches the functions such as data, is file system internal management information.
To can find a file or search its information in current file system mechanisms, all it is the directory search layer by layer since root, eventually finds a file, then open this file.Entire hierarchical relationship is all got off by metadata record.If metadata cluster crash, even if data are not all damaged, we also cannot again get up these data organizations, data and its catalogue even filename cannot be done any association, also just cannot achieve the functions such as the lookup of file.
Currently, in order to guarantee that the reliability of metadata cluster, each file system use the logic or physical overhead of various complexity.For example, use the scheme of metadata backup to guarantee the reliability of metadata, by the important metadata in part in distributed file system, perhaps whole metadata is backuped using database or another cluster;Alternatively, recording the change of metadata by the way of log or snapshot, the metadata at a nearest time point can be played back or directly rolled back to when something goes wrong, reduces the content of loss.Above scheme is more complicated or expense is larger, and therefore, it is necessary to a kind of more succinct metadata protection mechanisms.
Summary of the invention
The embodiment of the invention provides a kind of method, file system and server systems for managing file, can be effectively protected metadata.
In a first aspect, providing a kind of method for managing file in file system, the storage region of this document system administration includes data area and metadata area;This method comprises:
Receive written document request;
It is requested according to the written document, determines the data to be stored of file and the metadata of this document;
Determine multiple data fragmentations of the data to be stored of this document;
Determine the local metadata of each data fragmentation in multiple data fragmentation;
The local metadata of each data fragmentation in data fragmentation each in multiple data fragmentation, multiple data fragmentation and the storage of the metadata of this document are arrived into the data area;
The metadata area is arrived into the metadata storage of this document.
The method of the management file of the embodiment of the present invention; in addition to the metadata of the metadata area storage file in file system management; also in the metadata of the data area storage file of file system management; in this way; when metadata area breaks down; it can restore metadata by data area, so as to be effectively protected metadata.
In some possible implementations, the local metadata of each data fragmentation in data fragmentation each in multiple data fragmentation, multiple data fragmentation and the storage of the metadata of this document are arrived into the data area, comprising:
Extend the corresponding local metadata area in the data area of each data fragmentation in multiple data fragmentation;
By data fragmentation each in multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
By the subregion before the local metadata storage of data fragmentation each in multiple data fragmentation to the extension in corresponding local metadata area;
The metadata of this document is stored into multiple data fragmentation the extension subregion in the corresponding local metadata area of each data fragmentation.
In some possible implementations, which is 512 bytes.
In some possible implementations, the local metadata of each data fragmentation in data fragmentation each in multiple data fragmentation, multiple data fragmentation and the storage of the metadata of this document are arrived into the data area, comprising:
By data fragmentation each in multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
By the local metadata storage of data fragmentation each in multiple data fragmentation to the first subregion in the corresponding local metadata area in the data area;
The metadata of this document is stored into the second subregion into multiple data fragmentation in the corresponding local metadata area in the data area of each data fragmentation.
In some possible implementations, by the metadata of data fragmentation, the local metadata of data fragmentation and file together lower wall.
The method of the management file of the embodiment of the present invention, in data area, the metadata of file and the local metadata of data fragmentation are stored together to local metadata area, and increased I/O expense is seldom, therefore, the reliability of metadata can be improved with the expense of very little.
In some possible implementations, this method further include:
When the metadata area breaks down, according to the metadata of the file in the data area, which is restored.
In some possible implementations, according to the metadata of the file in the data area, which is restored, comprising:
Read the metadata of the file in the corresponding local metadata area of each data fragmentation in the data area;
According to the metadata of the file of reading, restore the catalogue hierarchical relationship in the metadata area.
In some possible implementations, when metadata area breaks down, the metadata of the file in the metadata area of each data fragmentation local can be read according to data fragmentation list with scan data fragment list.
In some possible implementations, if the metadata of file is stored in rear 512 bytes of local metadata area, the metadata of file in 512 bytes is read.
The local metadata area in scan data region is only needed in some possible implementations, when scanning the metadata of file.
Restore in process in the metadata area of the embodiment of the present invention, only needs the specific region in scan data region, therefore it is simple to restore process CIMS.
In some possible implementations, as soon as often obtaining the metadata of a file, a record is added in the catalogue level of metadata area.
It, can be using the temporary record relationship that be not together in series of hash table record in some possible implementations.
In some possible implementations, multiple data fragmentations of the data to be stored of this document are determined, comprising:
According to the protected mode of this document system, multiple data fragmentation is determined.
In some possible implementations, the protected mode of this document system is EC protected mode.
Second aspect, provides a kind of file system, and the storage region of this document system administration includes data Region and metadata area;This document system includes: file management unit, Data Management Unit and metadata management unit;
This document administrative unit, for receiving written document request;It is requested according to the written document, determines the data to be stored of file and the metadata of this document;Determine multiple data fragmentations of the data to be stored of this document;The metadata of multiple data fragmentation and this document is sent to the Data Management Unit;The metadata of this document is sent to the metadata management unit;
The Data Management Unit, for determining the local metadata of each data fragmentation in multiple data fragmentation;The local metadata of each data fragmentation in data fragmentation each in multiple data fragmentation, multiple data fragmentation and the storage of the metadata of this document are arrived into the data area;
The metadata management unit, for the metadata area to be arrived in the metadata storage of this document.
The file system of the embodiment of the present invention; in addition to the metadata of the metadata area storage file in file system management; also in the metadata of the data area storage file of file system management; in this way; when metadata area breaks down; it can restore metadata by data area, so as to be effectively protected metadata.
In some possible implementations, which is specifically used for,
Extend the corresponding local metadata area in the data area of each data fragmentation in multiple data fragmentation;
By data fragmentation each in multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
By the subregion before the local metadata storage of data fragmentation each in multiple data fragmentation to the extension in corresponding local metadata area;
The metadata of this document is stored into multiple data fragmentation the extension subregion in the corresponding local metadata area of each data fragmentation.
In some possible implementations, which is specifically used for,
By data fragmentation each in multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
By the local metadata storage of data fragmentation each in multiple data fragmentation to the first subregion in the corresponding local metadata area in the data area;
The metadata of this document is stored into the second subregion into multiple data fragmentation in the corresponding local metadata area in the data area of each data fragmentation.
In some possible implementations, when the metadata area breaks down,
The Data Management Unit is also used to read the metadata of the file in the data area, and the metadata of the file of reading is sent to the metadata management unit;
The metadata for the file that the metadata management unit is also used to be sent according to the Data Management Unit, restores the metadata area.
In some possible implementations, which is specifically used for, and reads the metadata of the file in the corresponding local metadata area of each data fragmentation in the data area, the metadata of the file of reading is sent to the metadata management unit;
The metadata management unit is specifically used for, and according to the metadata for the file that the Data Management Unit is sent, restores the catalogue hierarchical relationship in the metadata area.
In some possible implementations, this document administrative unit is specifically used for the protected mode according to this document system, determines multiple data fragmentation.
The third aspect provides a kind of server system, comprising:
File system in any possible implementation of above-mentioned second aspect or second aspect;And
Storage resource, the storage resource include the storage region of this document system administration.
Fourth aspect provides a kind of server system, comprising:
Storage resource, the storage resource include the storage region of file system management, which includes data area and metadata area;
Administrative unit, the method in any possible implementation for executing above-mentioned first aspect or first aspect.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, attached drawing needed in the embodiment of the present invention will be briefly described below, drawings in the following description are only some embodiments of the invention, is also possible to obtain other drawings based on these drawings.
Fig. 1 is the schematic diagram of the applicable server system of technical solution of the embodiment of the present invention.
Fig. 2 is the architecture diagram of the system of the embodiment of the present invention.
Fig. 3 is the schematic flow chart of the method for the management file of the embodiment of the present invention.
Fig. 4 is the flow chart of the written document of the embodiment of the present invention.
Fig. 5 is the flow chart of the recovery metadata of the embodiment of the present invention.
Fig. 6 is the schematic block diagram of the file system of the embodiment of the present invention.
Fig. 7 is the schematic block diagram of the server system of one embodiment of the invention.
Fig. 8 is the schematic block diagram of the server system of another embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is a part of the embodiments of the present invention, rather than whole embodiments.Every other embodiment obtained based on the embodiments of the present invention, all should belong to the scope of protection of the invention.
The technical solution of the embodiment of the present invention can be applied to various file system, including distributed file system and non-distributed file systems.
In the embodiment of the present invention, the metadata of file is overseas in addition to being stored in meta-data region, is also additionally saved in data area.Data area and metadata area may belong in different failure domains, such as positioned at different logical places or positioned at different physical locations.Therefore, the protection to the metadata of file can be enhanced.Such as it data fragmentation, the local metadata of this data fragmentation and the metadata of file, is issued in the same I/O request in storage medium (such as hard disk, solid state hard disk etc.).It is stored in data area along with each data fragmentation, there can be the metadata of text document to be also stored on data area.Therefore, the quantity of data fragmentation is more, and the number that metadata is backed up is more.
Since the metadata of file is adjoint data fragmentation lower wall together, such way is very small on system performance influence, and can increase substantially the reliability of the metadata of file.
Fig. 1 is can be using the schematic diagram of the server system of the technical solution of the embodiment of the present invention.
As shown in Figure 1, server system 100 may include at least one server 110, each server 110 includes storage resource 101, such as disk, solid state hard disk or other storage resources, provides memory space.It can also include administrative unit 102 on server 110, the function of file system is realized by administrative unit 102, the access service of file system is provided.
For distributed file system, the data of file can be stored according to distributed way into the storage resource 101 of any server 110;For non-distributed file systems, the data of file are stored into the storage resource 101 of corresponding server 110.
Each server 110 can be data and/or metadata node, that is, can storing data or metadata, can also simultaneously storing data and metadata.The data area of the region configuration file system administration for storing data of Servers-all 110, the metadata area of the configuration file system administration in region used to store metadata of Servers-all.Data area and metadata area logically separate, and can physically be located at identical node (such as server), can also be located at different nodes.
It should be understood that in various embodiments of the present invention, various administrative units can be the functional module implemented by processor, for example, it may be the program of operation in the processor;Various administrative units are also possible to hardware, such as can be one or more processors.Various storage resources can be hardware, such as disk, solid state hard disk or volatile memory;Various storage resources are also possible to memory space in logic, such as virtualize and generate to physical memory resources, and the logical memory space that can be managed with managed unit.For sake of simplicity, repeating no more below.
Fig. 2 shows the system architecture diagram of the embodiment of the present invention in logic.
As shown in Fig. 2, system 200 includes metadata cluster 210 and data cluster 220.
Metadata cluster 210 and data cluster 220 can physically be dispersed in different physical nodes, can also share with some physical nodes, only logically divide.
Metadata cluster 210 includes metadata area 211, the metadata for storage file.Metadata area 211 can be located on one or more nodes.Metadata cluster 210 further includes one or more metadata management units 212, for managing the metadata of metadata cluster Chinese part.Similarly, one or more metadata management units 212 can also be located on one or more nodes.
Data cluster 220 includes data area 221, other than for the data of storage file and local metadata, is also used to the metadata of storage file.Local metadata is referred to as local file system metadata, the information such as size, creation time including data fragmentation.
Metadata management unit 212 is functional unit, can be located at the distributed file system that individual server or multiple servers form.Metadata management unit 212 can be software, in a distributed manner for, can be collectively constituted by the distributed software for operating in multiple servers;It is also possible to hardware, such as is collectively constituted by the processor of multiple servers, these processors can runs the distributed software.Metadata area 211 receives the management of metadata management unit 212, and the data for 212 read/write of metadata management unit provide memory space.Metadata area 211 can be physical storage medium, such as the hard disk or solid state hard disk of multiple servers;It is also possible to memory space in logic, such as the memory space by forming on the memory logic of multiple servers.
Data Management Unit 222 and data area 221 in data cluster 220, similar with metadata management unit 212 and metadata area 211 respectively, details are not described herein again.
Optionally, in the local metadata area that local metadata and the metadata of file can be stored in data area 221 with one piece.For example, local metadata area can be extended, the region expanded is known as the extension subregion of local metadata area, will local metadata be stored in original region, the metadata of file is stored in extension subregion by the subregion before referred to as extending.In addition, if local meta-data region Space provided by domain just stores the metadata of local metadata and file enough originally, or local metadata area is extended in advance, the metadata of local metadata and file can be then stored respectively in the different subregions in local metadata area, the first subregion and the second subregion being stored respectively in local metadata area, such as, first subregion can be the predetermined bite of front in local metadata area, and the second subregion can be subsequent predetermined bite in local metadata area.
Similarly, data area 221 can be located on one or more nodes.Such as each node provides a part of memory space, collectively constitutes data area 221.Data cluster 220 further includes one or more Data Management Unit 222, for managing the data of the file in data cluster, the metadata of local metadata and file.Similarly, one or more Data Management Unit 222 can also be located on one or more nodes.Such as multiple nodes all operation data management softwares, the whole composition data administrative unit 222 of these softwares.
In some implementations, metadata management unit 212 and Data Management Unit 222 are the functional unit in file system.For example, can be the functional unit in the administrative unit 102 in Fig. 1.It should be understood that the functional unit in file system can also include the functional unit that other are managed file, the present invention does not limit this.
Metadata area 211 and data area 221 are the storage region of file system management.
File system and the storage region of file system management may be disposed in server system, for example, the server system 100 in Fig. 1.
Fig. 3 shows the schematic flow chart of the method 300 of the management file of the embodiment of the present invention.
In embodiments of the present invention, the storage region of file system management includes data area and metadata area, for example, data area 221 and metadata area 211 in Fig. 2.
This method 300 can be executed by the file system in server system perhaps server system for example, can be executed by the administrative unit in server system or file system, which is specifically as follows one or more administrative units again.For ease of description, it is illustrated by taking server system as an example below.
310, receive written document request.
In written document, user end to server system sends written document request.Written document request may include identification information, data to be stored and information of access address of file etc..
The data to be stored of file is the truthful data of file, that is, carries the data of file content.
Which file what the identification information of file indicated to be write is, for example, being specifically as follows directory name and filename.
The information of access address indicates the data to be stored address to be written, for example, being specifically as follows head Address and address space length.
320, it is requested according to the written document, determines the data to be stored of file and the metadata of this document.
After receiving written document request, server system determines the data to be stored of file and the metadata of this document.The data to be stored of file can be carried directly in written document request;The metadata of file can be requested according to written document in information generate, be equivalent to indirectly carry written document request in.The metadata of this document includes the information such as the attribute of the bibliographic structure of file, file and catalogue.
330, determine multiple data fragmentations of the data to be stored of this document.
It is alternatively possible to determine multiple data fragmentation according to the protected mode of file system.
The data fragmentation for determining the data to be stored of file can be and data to be stored is logically divided into multiple data fragmentations.For example, correcting and eleting codes (erasure coding, EC) protected mode can be used, multiple data fragmentations are splitted the file into.
It should be understood that the present invention to protected mode without limitation, that is to say, that other protected modes can also be used.
Optionally, above-mentioned steps 310-330 can specifically be executed by the file management unit in system, and then, the metadata of multiple data fragmentation and this document is sent to the Data Management Unit in system by file management unit.
340, determine the local metadata of each data fragmentation in multiple data fragmentation.
In written document, need to handle two kinds of data, one is the data to be stored of file, another kind is the metadata of file.After the data wait store of file are divided into data fragmentation, the data area of file system management will be stored in.In addition, each data fragmentation is there are also corresponding local metadata, which includes the information such as the size of data fragmentation, creation time.Local metadata is also stored into data area, the local metadata area being specifically possibly stored in data area.
After getting multiple data fragmentations of file, server system determines the local metadata of each data fragmentation.Specifically, if generating local metadata according to new data fragmentation before without corresponding local metadata;If existing local metadata modifies local metadata according to new data fragmentation.
350, the local metadata of each data fragmentation in data fragmentation each in multiple data fragmentation, multiple data fragmentation and the storage of the metadata of this document are arrived into the data area.
In this step, data area is arrived in one piece of the metadata of each data fragmentation, the local metadata of each data fragmentation and file storage.
Optionally, the local metadata of each data fragmentation and the metadata of file can be with local metadata area of one piece of storage into data area.
Specifically, data area can also be divided into two parts, a part of fragment for storing data is properly termed as data fragmentation region;Another part is properly termed as local metadata area for storing metadata.It should be understood that above two region can also be should not be construed as limiting the invention using other statements, specific statement.
In embodiments of the present invention, the metadata of file and one piece of the local metadata of each data fragmentation storage are arrived into local metadata area.The case where compared to the only local metadata of storing data fragment, the local metadata area in the embodiment of the present invention are big.In other words, the technical solution of the embodiment of the present invention using biggish local metadata area or is extended local metadata area.
Optionally, as an embodiment of the present invention, the corresponding local metadata area in the data area of each data fragmentation in multiple data fragmentation can be extended;
By data fragmentation each in multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
By the subregion before the local metadata storage of data fragmentation each in multiple data fragmentation to the extension in corresponding local metadata area;
The metadata of this document is stored into multiple data fragmentation the extension subregion in the corresponding local metadata area of each data fragmentation.
Specifically, in the present embodiment, local metadata area corresponding to data fragmentation is extended, the metadata of file is stored into the extension subregion in local metadata area.That is, will local metadata be stored in original region, the metadata of file is stored in the subregion of extension.
For example, the corresponding local metadata area of each data fragmentation can be extended 512 bytes, the metadata of file is inserted in the region of extension.
It should be understood that above-mentioned 512 bytes are only illustrated, it should not be construed as limiting the invention, when specific implementation can be arranged according to the size reasonable of the metadata of file.
Optionally, as another embodiment of the invention, data fragmentation each in multiple data fragmentation can be stored to the corresponding data fragmentation region in the data area;
By the local metadata storage of data fragmentation each in multiple data fragmentation to the first subregion in the corresponding local metadata area in the data area;
The metadata of this document is stored into the second subregion into multiple data fragmentation in the corresponding local metadata area in the data area of each data fragmentation.
Specifically, in the present embodiment, local metadata area can preset it is sufficiently large, in this way, can be directly by the metadata storage of file to the particular sub-area in local metadata area.
For example, local metadata area can be divided into two sub-regions, previous sub-regions store local metadata, the metadata of latter sub-regions storage file.
In specific implementation, before by the metadata lower wall of the local metadata of data fragmentation, data fragmentation and file, first corresponding data can be handled in the buffer, then lower wall together, i.e. write-in disk.In this way, the one piece of storage of the metadata of file and local metadata not will increase how many I/O expenses to local metadata area.
Optionally, above-mentioned steps 340 and 350 can specifically be executed by the Data Management Unit in system.Then, Data Management Unit writes success message to file management unit transmission, this writes success message designation date fragment and the metadata of file is write as function.Metadata management unit into system sends the metadata of file to file management unit again, to request the metadata management unit to update the metadata of file.
360, the metadata area is arrived into the metadata storage of this document.
Metadata of the server system in the meta-data region area update file of file system management.Optionally, which can execute after function is write as in data area, can also carry out parallel with the processing of writing of data area, the present invention does not limit.
Optionally, above-mentioned steps 360 can specifically be executed by the metadata management unit in system.Then, metadata management unit writes success message to file management unit transmission, which is write as function.File management unit sends file to client again and writes success message.
The method of the management file of the embodiment of the present invention; in addition to the metadata of the metadata area storage file in file system management; also in the metadata of the data area storage file of file system management; in this way; when metadata area breaks down; it can restore metadata by data area, so as to be effectively protected metadata.
Further, the method for the management file of the embodiment of the present invention, in data area, the metadata of file and the local metadata of data fragmentation are stored together to local metadata area, increased I/O expense is seldom, therefore, the reliability of metadata can be improved with the expense of very little.
The foregoing describe Stored Procedures, restore process to metadata below and are described.
Optionally, as shown in figure 3, this method 300 can also include:
370, when the metadata area breaks down, according to the metadata of the file in the data area, which is restored.
Due to also storing the metadata of file in data area, when metadata area breaks down, the metadata of metadata area can be restored by the metadata in scan data region.
Specifically, it can read in the corresponding local metadata area of each data fragmentation in the data area File metadata;According to the metadata of the file of reading, restore the catalogue hierarchical relationship in the metadata area.
For example, when metadata area breaks down the metadata of the file in the metadata area of each data fragmentation local can be read according to data fragmentation list with scan data fragment list.For example, reading the metadata of file in 512 bytes if the metadata of file is stored in rear 512 bytes of local metadata area.
Because data area be it is complete available, the local metadata area in scan data region is only needed when scanning the metadata of file.
As soon as often obtaining the metadata of a file, a record is added in the catalogue level of metadata area.It is alternatively possible to the record relationship not being together in series temporarily using Hash (hash) table record.After collecting etc. all records, the catalogue hierarchical relationship of metadata area, which is just established, to be finished.
Optionally, above-mentioned scanning process can be executed by Data Management Unit, and the metadata of the file read is sent to metadata management unit;Above-mentioned catalogue hierarchical relationship establishment process can be executed by metadata management unit, and be successfully recovered message to file management unit transmission after establishing completion, this is successfully recovered message instruction metadata area and is recovered.
It can be seen from the above technical proposal that the metadata area in the embodiment of the present invention is restored in process, the specific region in scan data region is only needed, therefore it is simple to restore process CIMS.
Below with reference to Fig. 4 and Fig. 5, from the technical solution of the angle the present invention is described in detail embodiment of each administrative unit.It should be understood that each administrative unit in Fig. 4 and Fig. 5 is the administrative unit functionally divided, physically they be can be set on identical node, also can be set on different nodes.It, can be with reference to the description in aforementioned various embodiments in addition, the correlation and function of each administrative unit in Fig. 4 and Fig. 5, and with the relationship of other assemblies in system etc..
Fig. 4 is the flow chart of the written document of one embodiment of the invention.
401, client sends written document request.
Written document request is sent to server system by client, is specifically sent to file management unit.Written document request may include identification information, data to be stored and information of access address of file etc..
402, file management unit determines the data to be stored of file and the metadata of this document.
The metadata of this document includes the information such as the attribute of the bibliographic structure of file, file and catalogue.
403, file management unit determines multiple data fragmentations of the data to be stored of this document.
It is alternatively possible to according to the protected mode of file system, such as EC protected mode, split the file into multiple data fragmentations.
404, the metadata of multiple data fragmentation and this document is sent to Data Management Unit by file management unit.
405, the data received are written and are cached by Data Management Unit.
It is cached that is, the metadata of data fragmentation and file is written.
406, Data Management Unit determines local metadata.
The local metadata includes the information such as the size of data fragmentation, creation time.Data Management Unit determines the local metadata of each data fragmentation according to multiple data fragmentation.
407, metadata of the Data Management Unit in local metadata area filling file.
For example, the local metadata area of each data fragmentation is extended 512 bytes by Data Management Unit, the metadata of file is inserted in the region of extension;Alternatively, Data Management Unit inserts the metadata of file in rear 512 bytes of the local metadata area extended in advance.
408, Data Management Unit is by the metadata of data fragmentation, the local metadata of data fragmentation and file together lower wall.
In this way, Data Management Unit stores the metadata of data fragmentation, the local metadata of data fragmentation and file together has arrived data area.
409, the metadata of Data Management Unit response document administrative unit data fragmentation and file is write as function.
410, file management unit is sent out to metadata management unit and is requested, and request updates the metadata of file.
411, metadata management unit stores the metadata of file to metadata area.
412, metadata management unit returns to metadata to file management unit and writes success message.
413, file management unit returns to file to client and writes success message.
Fig. 5 is the flow chart of the recovery metadata of one embodiment of the invention.
501, Data Management Unit scan data fragment list.
When metadata area breaks down, according to the metadata of data area, the metadata of metadata area is restored.Data Management Unit scan data fragment list carries out operations described below for each data fragmentation.
502, Data Management Unit reads the metadata of the file in the metadata area of each fragment local according to data fragmentation list.
For example, reading the metadata of file in 512 bytes if the metadata of file is stored in rear 512 bytes of local metadata area.
Because data area be it is complete available, the local metadata area in scan data region is only needed when scanning the metadata of file.
503, the metadata of the file of reading is sent to metadata management unit by Data Management Unit.
504, metadata management unit restores catalogue hierarchical relationship according to the metadata of the file received.
As soon as metadata management unit often receives the metadata of a file, a record is added in the catalogue level of metadata area.It is alternatively possible to the record relationship not being together in series temporarily using hash table record.After collecting etc. all records, the catalogue hierarchical relationship of metadata area, which is just established, to be finished.
505, metadata management unit is successfully recovered message to file management unit transmission.
After metadata area is recovered, metadata management unit circular document administrative unit, metadata area is recovered, so that file service is restored to provide.
It should be understood that, in various embodiments of the present invention, magnitude of the sequence numbers of the above procedures are not meant that the order of the execution order, and the execution sequence of each process should be determined by its function and internal logic, and the implementation process of the embodiments of the invention shall not be constituted with any limitation.
It should also be understood that the specific example in the embodiment of the present invention is intended merely to that those skilled in the art is helped to more fully understand the embodiment of the present invention, the range for the embodiment that is not intended to limit the present invention.
The method that management file according to an embodiment of the present invention has been described in detail above, is described below file system according to an embodiment of the present invention and server system.
Fig. 6 shows the schematic block diagram of the file system 600 of the embodiment of the present invention.
The storage region that this document system 600 manages includes data area and metadata area.As shown in fig. 6, this document system 600 may include: file management unit 610, Data Management Unit 620 and metadata management unit 630.
This document administrative unit 610, for receiving written document request;It is requested according to the written document, determines the data to be stored of file and the metadata of this document;Determine multiple data fragmentations of the data to be stored of this document;The metadata of multiple data fragmentation and this document is sent to the Data Management Unit 620;The metadata of this document is sent to the metadata management unit 630.
The Data Management Unit 620, for determining the local metadata of each data fragmentation in multiple data fragmentation;The local metadata of each data fragmentation in data fragmentation each in multiple data fragmentation, multiple data fragmentation and the storage of the metadata of this document are arrived into the data area.
The metadata management unit 630, for the metadata area to be arrived in the metadata storage of this document.
The file system of the embodiment of the present invention; in addition to the metadata of the metadata area storage file in file system management; also in the metadata of the data area storage file of file system management; in this way; when metadata area breaks down; it can restore metadata by data area, so as to be effectively protected metadata.
Optionally, in an embodiment of the invention, which is specifically used for,
Extend the corresponding local metadata area in the data area of each data fragmentation in multiple data fragmentation;
By data fragmentation each in multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
By the subregion before the local metadata storage of data fragmentation each in multiple data fragmentation to the extension in corresponding local metadata area;
The metadata of this document is stored into multiple data fragmentation the extension subregion in the corresponding local metadata area of each data fragmentation.
Optionally, in an embodiment of the invention, which is specifically used for,
By data fragmentation each in multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
By the local metadata storage of data fragmentation each in multiple data fragmentation to the first subregion in the corresponding local metadata area in the data area;
The metadata of this document is stored into the second subregion into multiple data fragmentation in the corresponding local metadata area in the data area of each data fragmentation.
Optionally, in an embodiment of the invention, when the metadata area breaks down,
The Data Management Unit 620 is also used to read the metadata of the file in the data area, and the metadata of the file of reading is sent to the metadata management unit 630;
The metadata for the file that the metadata management unit 630 is also used to be sent according to the Data Management Unit 620, restores the metadata area.
Optionally, in an embodiment of the invention, the Data Management Unit 620 is specifically used for, and reads the metadata of the file in the corresponding local metadata area of each data fragmentation in the data area, the metadata of the file of reading is sent to the metadata management unit 630;
The metadata management unit 630 is specifically used for, and according to the metadata for the file that the Data Management Unit 620 is sent, restores the catalogue hierarchical relationship in the metadata area.
Optionally, in an embodiment of the invention, this document administrative unit 610 is specifically used for the protected mode according to this document system, determines multiple data fragmentation.
The method that the file system 600 of the embodiment of the present invention can execute the management file of the embodiment of the present invention, and above and other operation and/or function of each unit in file system 600 is respectively in order to realize the corresponding process of aforementioned each method, it can be with reference to the description in aforementioned various embodiments, in order to succinct Details are not described herein.
Fig. 7 shows the schematic block diagram of the server system 700 of one embodiment of the invention.As shown in fig. 7, the server system 700 may include:
The file system 600 of the aforementioned embodiment of the present invention;And
Storage resource 710, the storage resource 710 include the storage region that this document system 600 manages.
The detailed description of file system 600 about the embodiment of the present invention can refer to previous embodiment, for sake of simplicity, details are not described herein.
Fig. 8 shows the schematic block diagram of the server system 800 of another embodiment of the present invention.As shown in figure 8, the server system 800 may include:
Storage resource 810, the storage resource 810 include the storage region of file system management, which includes data area and metadata area;
Administrative unit 820, is used for:
Receive written document request;
It is requested according to the written document, determines the data to be stored of file and the metadata of this document;
Determine multiple data fragmentations of the data to be stored of this document;
Determine the local metadata of each data fragmentation in multiple data fragmentation;
The local metadata of each data fragmentation in data fragmentation each in multiple data fragmentation, multiple data fragmentation and the storage of the metadata of this document are arrived into the data area;
The metadata area is arrived into the metadata storage of this document.
The server system of the embodiment of the present invention; in addition to the metadata of the metadata area storage file in file system management; also in the metadata of the data area storage file of file system management; in this way; when metadata area breaks down; it can restore metadata by data area, so as to be effectively protected metadata.
Optionally, in an embodiment of the invention, which is specifically used for,
Extend the corresponding local metadata area in the data area of each data fragmentation in multiple data fragmentation;
By data fragmentation each in multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
By the subregion before the local metadata storage of data fragmentation each in multiple data fragmentation to the extension in corresponding local metadata area;
The metadata of this document is stored into multiple data fragmentation the corresponding local of each data fragmentation Extension subregion in metadata area.
Optionally, in an embodiment of the invention, which is specifically used for,
By data fragmentation each in multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
By the local metadata storage of data fragmentation each in multiple data fragmentation to the first subregion in the corresponding local metadata area in the data area;
The metadata of this document is stored into the second subregion into multiple data fragmentation in the corresponding local metadata area in the data area of each data fragmentation.
Optionally, in an embodiment of the invention, which is also used to,
When the metadata area breaks down, according to the metadata of the file in the data area, which is restored.
Optionally, in an embodiment of the invention, which is specifically used for,
Read the metadata of the file in the corresponding local metadata area of each data fragmentation in the data area;
According to the metadata of the file of reading, restore the catalogue hierarchical relationship in the metadata area.
Optionally, in an embodiment of the invention, which is specifically used for,
According to the protected mode of this document system, multiple data fragmentation is determined.
Administrative unit 820 in the server system 800 of the embodiment of the present invention can execute each process in preceding method embodiment, and corresponding specifically describe can refer to foregoing embodiments, for sake of simplicity, details are not described herein.
It should be understood that in embodiments of the present invention, term "and/or" is only a kind of incidence relation for describing affiliated partner, indicate may exist three kinds of relationships.For example, A and/or B, can indicate: individualism A exists simultaneously A and B, these three situations of individualism B.In addition, character "/" herein, typicallys represent the relationship that forward-backward correlation object is a kind of "or".
Those of ordinary skill in the art may be aware that, unit and algorithm steps described in conjunction with the examples disclosed in the embodiments of the present disclosure, it can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly illustrate the interchangeability of hardware and software, each exemplary composition and step are generally described according to function in the above description.These functions are implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Professional technician can use different methods to achieve the described function each specific application, but such implementation should not be considered as beyond the scope of the present invention.
It is apparent to those skilled in the art that for convenience of description and succinctly, system, the specific work process of device and unit of foregoing description can refer to corresponding processes in the foregoing method embodiment, details are not described herein.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods may be implemented in other ways.Such as, the apparatus embodiments described above are merely exemplary, such as, the division of the unit, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components can be combined or can be integrated into another system, or some features can be ignored or not executed.In addition, shown or discussed mutual coupling, direct-coupling or communication connection can be through some interfaces, the indirect coupling or communication connection of device or unit, be also possible to electricity, the connection of mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, and component shown as a unit may or may not be physical unit, it can and it is in one place, or may be distributed over multiple network units.It can select some or all of unit therein according to the actual needs to realize the purpose of the embodiment of the present invention.
In addition, the functional units in various embodiments of the present invention may be integrated into one processing unit, it is also possible to each unit and physically exists alone, is also possible to two or more units and is integrated in one unit.Above-mentioned integrated unit both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and when sold or used as an independent product, can store in a computer readable storage medium.Based on this understanding, technical solution of the present invention substantially the part that contributes to existing technology in other words, or all or part of the technical solution can be embodied in the form of software products, the computer software product is stored in a storage medium, it uses including some instructions so that a computer equipment (can be personal computer, server or the network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), the various media that can store program code such as magnetic or disk.
It is described above; only a specific embodiment of the invention; but scope of protection of the present invention is not limited thereto; anyone skilled in the art is in the technical scope disclosed by the present invention; various equivalent modifications or substitutions can be readily occurred in, these modifications or substitutions should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be subject to the protection scope in claims.

Claims (19)

  1. The method of file is managed in a kind of file system, which is characterized in that the storage region of the file system management includes data area and metadata area;The described method includes:
    Receive written document request;
    It is requested according to the written document, determines the data to be stored of file and the metadata of the file;
    Determine multiple data fragmentations of the data to be stored of the file;
    Determine the local metadata of each data fragmentation in the multiple data fragmentation;
    The local metadata of each data fragmentation in data fragmentation each in the multiple data fragmentation, the multiple data fragmentation and the metadata of the file are stored to the data area;
    By the metadata storage of the file to the metadata area.
  2. The method according to claim 1, wherein described store the local metadata of each data fragmentation in data fragmentation each in the multiple data fragmentation, the multiple data fragmentation and the metadata of the file to the data area, comprising:
    Extend the corresponding local metadata area in the data area of each data fragmentation in the multiple data fragmentation;
    By data fragmentation each in the multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
    By the subregion before the local metadata storage of data fragmentation each in the multiple data fragmentation to the extension in corresponding local metadata area;
    The metadata of the file is stored into the multiple data fragmentation the extension subregion in the corresponding local metadata area of each data fragmentation.
  3. The method according to claim 1, wherein described store the local metadata of each data fragmentation in data fragmentation each in the multiple data fragmentation, the multiple data fragmentation and the metadata of the file to the data area, comprising:
    By data fragmentation each in the multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
    By the local metadata storage of data fragmentation each in the multiple data fragmentation to the first subregion in the corresponding local metadata area in the data area;
    The metadata of the file is stored into the second subregion into the multiple data fragmentation in the corresponding local metadata area in the data area of each data fragmentation.
  4. According to the method in any one of claims 1 to 3, which is characterized in that the method Further include:
    When the metadata area breaks down, according to the metadata of the file in the data area, the metadata area is restored.
  5. According to the method described in claim 4, it is characterized in that, the metadata according to the file in the data area, restores the metadata area, comprising:
    Read the metadata of the file in the corresponding local metadata area of each data fragmentation in the data area;
    According to the metadata of the file of reading, restore the catalogue hierarchical relationship in the metadata area.
  6. The method according to any one of claims 1 to 5, which is characterized in that multiple data fragmentations of the data to be stored of the determination file, comprising:
    According to the protected mode of the file system, the multiple data fragmentation is determined.
  7. A kind of file system, which is characterized in that the storage region of the file system management includes data area and metadata area;The file system includes: file management unit, Data Management Unit and metadata management unit;
    The file management unit, for receiving written document request;It is requested according to the written document, determines the data to be stored of file and the metadata of the file;Determine multiple data fragmentations of the data to be stored of the file;The metadata of the multiple data fragmentation and the file is sent to the Data Management Unit;The metadata of the file is sent to the metadata management unit;
    The Data Management Unit, for determining the local metadata of each data fragmentation in the multiple data fragmentation;The local metadata of each data fragmentation in data fragmentation each in the multiple data fragmentation, the multiple data fragmentation and the metadata of the file are stored to the data area;
    The metadata management unit, for storing the metadata of the file to the metadata area.
  8. File system according to claim 7, which is characterized in that the Data Management Unit is specifically used for,
    Extend the corresponding local metadata area in the data area of each data fragmentation in the multiple data fragmentation;
    By data fragmentation each in the multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
    By the subregion before the local metadata storage of data fragmentation each in the multiple data fragmentation to the extension in corresponding local metadata area;
    The metadata of the file is stored into the multiple data fragmentation the extension subregion in the corresponding local metadata area of each data fragmentation.
  9. File system according to claim 7, which is characterized in that the Data Management Unit is specifically used for,
    By data fragmentation each in the multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
    By the local metadata storage of data fragmentation each in the multiple data fragmentation to the first subregion in the corresponding local metadata area in the data area;
    The metadata of the file is stored into the second subregion into the multiple data fragmentation in the corresponding local metadata area in the data area of each data fragmentation.
  10. File system according to any one of claims 7 to 9, which is characterized in that when the metadata area breaks down,
    The Data Management Unit is also used to read the metadata of the file in the data area, and the metadata of the file of reading is sent to the metadata management unit;
    The metadata for the file that the metadata management unit is also used to be sent according to the Data Management Unit, restores the metadata area.
  11. File system according to claim 10, it is characterized in that, the Data Management Unit is specifically used for, and reads the metadata of the file in the corresponding local metadata area of each data fragmentation in the data area, the metadata of the file of reading is sent to the metadata management unit;
    The metadata management unit is specifically used for, and according to the metadata for the file that the Data Management Unit is sent, restores the catalogue hierarchical relationship in the metadata area.
  12. File system according to any one of claims 7 to 11, which is characterized in that the file management unit is specifically used for the protected mode according to the file system, determines the multiple data fragmentation.
  13. A kind of server system characterized by comprising
    File system according to any one of claims 7 to 12;And
    Storage resource, the storage resource include the storage region of the file system management.
  14. A kind of server system characterized by comprising
    Storage resource, the storage resource include the storage region of file system management, and the storage region includes data area and metadata area;
    Administrative unit is used for:
    Receive written document request;
    It is requested according to the written document, determines the data to be stored of file and the metadata of the file;
    Determine multiple data fragmentations of the data to be stored of the file;
    Determine the local metadata of each data fragmentation in the multiple data fragmentation;
    The local metadata of each data fragmentation in data fragmentation each in the multiple data fragmentation, the multiple data fragmentation and the metadata of the file are stored to the data area;
    By the metadata storage of the file to the metadata area.
  15. Server system according to claim 14, which is characterized in that the administrative unit is specifically used for,
    Extend the corresponding local metadata area in the data area of each data fragmentation in the multiple data fragmentation;
    By data fragmentation each in the multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
    By the subregion before the local metadata storage of data fragmentation each in the multiple data fragmentation to the extension in corresponding local metadata area;
    The metadata of the file is stored into the multiple data fragmentation the extension subregion in the corresponding local metadata area of each data fragmentation.
  16. Server system according to claim 14, which is characterized in that the administrative unit is specifically used for,
    By data fragmentation each in the multiple data fragmentation storage to the corresponding data fragmentation region in the data area;
    By the local metadata storage of data fragmentation each in the multiple data fragmentation to the first subregion in the corresponding local metadata area in the data area;
    The metadata of the file is stored into the second subregion into the multiple data fragmentation in the corresponding local metadata area in the data area of each data fragmentation.
  17. Server system described in any one of 4 to 16 according to claim 1, which is characterized in that the administrative unit is also used to,
    When the metadata area breaks down, according to the metadata of the file in the data area, the metadata area is restored.
  18. Server system according to claim 17, which is characterized in that the administrative unit is specifically used for,
    Read the metadata of the file in the corresponding local metadata area of each data fragmentation in the data area;
    According to the metadata of the file of reading, restore the catalogue hierarchical relationship in the metadata area.
  19. Server system described in any one of 4 to 18 according to claim 1, which is characterized in that the administrative unit is specifically used for,
    According to the protected mode of the file system, the multiple data fragmentation is determined.
CN201680003120.4A 2016-11-02 2016-11-02 Method for managing files, file system and server system Active CN108271420B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/104385 WO2018081960A1 (en) 2016-11-02 2016-11-02 File management method, file system, and server system

Publications (2)

Publication Number Publication Date
CN108271420A true CN108271420A (en) 2018-07-10
CN108271420B CN108271420B (en) 2020-11-27

Family

ID=62075382

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680003120.4A Active CN108271420B (en) 2016-11-02 2016-11-02 Method for managing files, file system and server system

Country Status (2)

Country Link
CN (1) CN108271420B (en)
WO (1) WO2018081960A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113986944A (en) * 2021-12-29 2022-01-28 天地伟业技术有限公司 Writing method and system of fragment data and electronic equipment
CN114328421A (en) * 2022-03-17 2022-04-12 联想凌拓科技有限公司 Metadata service architecture management method, computer system, electronic device and medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103019626A (en) * 2012-12-17 2013-04-03 华为技术有限公司 Storage system, method and device for controlling cluster metadata
CN103608783A (en) * 2011-06-08 2014-02-26 微软公司 Storage architecture for backup application
CN104166524A (en) * 2014-08-19 2014-11-26 浪潮电子信息产业股份有限公司 Processing method of metadata and data
CN105786655A (en) * 2016-03-08 2016-07-20 成都云祺科技有限公司 Repeated data deleting method for virtual machine backup data

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8112531B2 (en) * 2004-07-14 2012-02-07 Nokia Corporation Grouping of session objects
CN101656094B (en) * 2009-09-25 2012-04-18 杭州华三通信技术有限公司 Data storage method and storage device
CN102088389B (en) * 2009-12-02 2015-01-28 中兴通讯股份有限公司 Distributed content access scheduling device and content reading method
CN102024059B (en) * 2010-12-31 2012-07-18 成都市华为赛门铁克科技有限公司 Method and device for protecting redundant array of independent disk in file system
CN105159607A (en) * 2015-08-28 2015-12-16 浪潮(北京)电子信息产业有限公司 Discrete storage based high-speed writing method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103608783A (en) * 2011-06-08 2014-02-26 微软公司 Storage architecture for backup application
CN103019626A (en) * 2012-12-17 2013-04-03 华为技术有限公司 Storage system, method and device for controlling cluster metadata
CN104166524A (en) * 2014-08-19 2014-11-26 浪潮电子信息产业股份有限公司 Processing method of metadata and data
CN105786655A (en) * 2016-03-08 2016-07-20 成都云祺科技有限公司 Repeated data deleting method for virtual machine backup data

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113986944A (en) * 2021-12-29 2022-01-28 天地伟业技术有限公司 Writing method and system of fragment data and electronic equipment
CN113986944B (en) * 2021-12-29 2022-03-25 天地伟业技术有限公司 Writing method and system of fragment data and electronic equipment
CN114328421A (en) * 2022-03-17 2022-04-12 联想凌拓科技有限公司 Metadata service architecture management method, computer system, electronic device and medium

Also Published As

Publication number Publication date
WO2018081960A1 (en) 2018-05-11
CN108271420B (en) 2020-11-27

Similar Documents

Publication Publication Date Title
US20210173853A1 (en) Selective synchronization of content items in a content management system
US8515911B1 (en) Methods and apparatus for managing multiple point in time copies in a file system
US8606759B2 (en) Apparatus, system and method for recovering meta data using fragmentary information
US10599535B2 (en) Restoring distributed shared memory data consistency within a recovery process from a cluster node failure
CN105814544B (en) System and method for supporting persistent partition recovery in a distributed data grid
US9367579B1 (en) System and method for maintaining a file change log within a distributed file system
CN109739815B (en) File processing method, system, device, equipment and storage medium
EP2879040B1 (en) Data storage method, data storage apparatus, and storage device
US8332600B2 (en) Storage system and method for operating storage system
US10013312B2 (en) Method and system for a safe archiving of data
CN108415986B (en) Data processing method, device, system, medium and computing equipment
EP3731097A1 (en) System and method for accelerated data access
CN109241004B (en) Metadata file size recovery method, system, device and readable storage medium
JPWO2016117022A1 (en) Log management method and computer system
US20160191331A1 (en) Method and system for administration of storage objects
US10915403B2 (en) Versioned records management using restart era
US20200097581A1 (en) Systems and methods of managing manifest refresh in a database
CN108271420A (en) Manage method, file system and the server system of file
JP2021515304A (en) Methods, computer programs, and equipment for post-failure recovery using checkpoints in key-value stores in a time-series log structure in the system.
CN111309799A (en) Method, device and system for realizing data merging and storage medium
US9852031B2 (en) Computer system and method of identifying a failure
CN111753141A (en) Data management method and related equipment
CN114328007B (en) Container backup and restoration method, device and medium thereof
US10922277B1 (en) Logging file system metadata changes using a single log hold per cached block of metadata
CN111399753A (en) Method and device for writing pictures

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant