CN109542911A - A kind of metadata organization method, system, equipment and computer readable storage medium - Google Patents
A kind of metadata organization method, system, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN109542911A CN109542911A CN201811463459.XA CN201811463459A CN109542911A CN 109542911 A CN109542911 A CN 109542911A CN 201811463459 A CN201811463459 A CN 201811463459A CN 109542911 A CN109542911 A CN 109542911A
- Authority
- CN
- China
- Prior art keywords
- metadata
- flash memory
- group
- full flash
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This application discloses a kind of metadata organization method, system, equipment and computer readable storage mediums, are applied in the storage of full flash memory, this method comprises: obtaining target metadata group；Using B+ tree construction organizational goal metadata group, B+ tree metadata is obtained；B+ tree metadata is stored in the memory of full flash memory storage；Target metadata group is stored directly in the disk of full flash memory storage.A kind of metadata organization method disclosed in the present application, B+ tree metadata is stored in the memory of full flash memory storage by full flash memory storage, and target metadata group is stored directly in the disk of full flash memory storage, in this way when reorganizing metadata, the B+ tree construction in memory need to only be reorganized, compared with prior art, it does not need to reorganize the B+ tree construction in disk, the organizational efficiency of metadata can be improved.A kind of metadata organization system, equipment and computer readable storage medium disclosed in the present application also solve the problems, such as relevant art.
Description
Technical field
Technical field of memory is dodged this application involves complete, more specifically to a kind of metadata organization method, system, is set
Standby and computer readable storage medium.
Background technique
The development of information age, it is higher and higher to storage equipment high load, the requirement of low time delay, full flash memory storage meet the tendency of and
It is raw, to support increasingly fat swollen mass data business.The capacity of full flash memory storage is bigger, and corresponding metadata is needed also to get over
It is more, and the memory size of full flash memory storage can not be infinitely great, just needs reasonable organization metadata thus.
A kind of existing metadata organization method is: saving cloud data using the tree-like formula of B+, and B+ tree is stored in full sudden strain of a muscle
In the memory and disk of storage.
However, in a kind of existing metadata organization method, when needing to reorganize metadata in disk, need pair
Entire B+ tree carries out tissue, inefficiency.
In conclusion the organizational efficiency for how improving metadata organization method is that current those skilled in the art are urgently to be resolved
The problem of.
Summary of the invention
The purpose of the application is to provide a kind of metadata organization method, can solve how to improve first number to a certain extent
According to method for organizing organizational efficiency the technical issues of.Present invention also provides a kind of metadata organization system, equipment and computers
Readable storage medium storing program for executing.
To achieve the goals above, the application provides the following technical solutions:
A kind of metadata organization method is applied in the storage of full flash memory, comprising:
Obtain target metadata group；
Using target metadata group described in B+ tree construction tissue, B+ tree metadata is obtained；
The B+ tree metadata is stored in the memory of the full flash memory storage；
The target metadata group is stored directly in the disk of the full flash memory storage.
Preferably, it is described the target metadata group is stored directly in the disk of the full flash memory storage after, also wrap
It includes:
Data pick-up is carried out to the target metadata group according to default metadata length, obtains corresponding second level member number
According to；
The second level metadata is stored into the memory of the full flash memory storage.
Preferably, described that data pick-up is carried out to the target metadata group according to default metadata length, it obtains corresponding
Second level metadata after, further includes:
Judge whether to receive write request；
If so, first being handled based on the write request the second level metadata, then based on the write request to institute
The target metadata group stated in the disk of full flash memory storage is handled.
Preferably, described that data pick-up is carried out to the target metadata group according to default metadata length, it obtains corresponding
Second level metadata after, further includes:
Judge whether to receive read request；
The second level metadata is handled if so, being directly based upon the read request.
Preferably, described that data pick-up is carried out to the target metadata group according to default metadata length, it obtains corresponding
Second level metadata after, further includes:
Judge whether the data structure of the target metadata group changes；
If so, the data structure based on the target metadata group, to the mesh in the disk of the full flash memory storage
Mark metadata group is migrated, and updates the second level metadata.
Preferably, after the storage second level metadata is into the memory of the full flash memory storage, further includes:
Establish and save the storage mapping relationship between the second level metadata and the memory of the full flash memory storage.
Preferably, it is described the target metadata group is stored directly in the disk of the full flash memory storage after, also wrap
It includes:
Judge whether the target metadata group in the disk of the full flash memory storage is complete；
If it is not, then the B+ tree metadata is unfolded, the target metadata group is obtained, and be based on the target element
Data group updates the disk of the full flash memory storage.
A kind of metadata organization system is applied in the storage of full flash memory, comprising:
First obtains module, for obtaining target metadata group；
The first tissue module, for obtaining B+ tree metadata using target metadata group described in B+ tree construction tissue；
First memory module, for the B+ tree metadata to be stored in the memory of the full flash memory storage；
Second memory module, for the target metadata group to be stored directly in the disk of the full flash memory storage.
A kind of metadata organization equipment, comprising:
Memory, for storing computer program；
Processor realizes as above any metadata organization method when for executing the computer program.
A kind of computer readable storage medium is stored with computer program in the computer readable storage medium, described
As above any metadata organization method is realized when computer program is executed by processor.
A kind of metadata organization method provided by the present application is applied in the storage of full flash memory, obtains target metadata group；Using
B+ tree construction organizational goal metadata group, obtains B+ tree metadata；B+ tree metadata is stored in the memory of full flash memory storage；It will
Target metadata group is stored directly in the disk of full flash memory storage.A kind of metadata organization method provided by the present application, full flash memory
B+ tree metadata is stored in the memory of full flash memory storage by storage, and target metadata group is stored directly in the disk of full flash memory storage
In, in this way when reorganizing metadata, the B+ tree construction that need to only reorganize in memory does not need compared with prior art
The B+ tree construction in disk is reorganized, the organizational efficiency of metadata can be improved.A kind of metadata organization provided by the present application
System, equipment and computer readable storage medium also solve the problems, such as relevant art.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The embodiment of application for those of ordinary skill in the art without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is a kind of first pass figure of metadata organization method provided by the embodiments of the present application；
Fig. 2 is a kind of second flow chart of metadata organization method provided by the embodiments of the present application；
Fig. 3 is a kind of structural schematic diagram of metadata organization system provided by the embodiments of the present application；
Fig. 4 is a kind of structural schematic diagram of metadata organization equipment provided by the embodiments of the present application；
Fig. 5 is a kind of another structural schematic diagram of metadata organization equipment provided by the embodiments of the present application.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on
Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall in the protection scope of this application.
The development of information age, it is higher and higher to storage equipment high load, the requirement of low time delay, full flash memory storage meet the tendency of and
It is raw, to support increasingly fat swollen mass data business.The capacity of full flash memory storage is bigger, and corresponding metadata is needed also to get over
It is more, and the memory size of full flash memory storage can not be infinitely great, just needs reasonable organization metadata thus.A kind of existing first number
It is according to method for organizing: cloud data is saved using the tree-like formula of B+, and B+ tree is stored in the memory and disk of full flash memory storage.So
And in a kind of existing metadata organization method, when need in disk reorganize metadata when, need to entire B+ tree into
Row tissue, inefficiency.The organizational efficiency of metadata can be improved in a kind of metadata organization method provided by the present application.
Referring to Fig. 1, Fig. 1 is a kind of first pass figure of metadata organization method provided by the embodiments of the present application.
A kind of metadata organization method provided by the embodiments of the present application is applied in the storage of full flash memory, may include following step
It is rapid:
Step S101: target metadata group is obtained.
In practical application, full flash memory storage can first obtain target metadata group, the particular content and class of target metadata group
Type can determine that the quantity for the metadata for including in target metadata group can also according to actual needs really according to specific needs
It is fixed.The target metadata group of acquisition can be the target metadata group obtained by the transmission port that full flash memory stores up, be also possible to
It is extraneous it is specified under, be target element obtained from target metadata group by the metadata group selection having in advance in the storage of full flash memory
Data group etc..
Step S102: B+ tree construction organizational goal metadata group is used, B+ tree metadata is obtained.
In practical application, after obtaining target metadata group, B+ tree construction organizational goal metadata group can be used, is obtained
To B+ tree metadata.B+ tree referred to herein is a kind of data tree structure, is a n fork sorting tree, and each node usually has
Multiple children, a B+ tree includes root node, internal node and leaf node, and root node may be a leaf node, can also
It can be the node comprising two or more child nodes.Using B+ tree construction organizational goal metadata group, B+ is obtained
The process for setting metadata can be refering to the prior art, and details are not described herein by the application, is also not specifically limited.
Step S103: B+ tree metadata is stored in the memory of full flash memory storage.
In practical application, after obtaining B+ tree metadata, B+ tree metadata can be stored in the memory of full flash memory storage
In, since the capacity of memory can not be infinitely great, so B+ tree metadata is stored in the memory of full flash memory storage, can save
The capacity of the memory of full flash memory storage, so that more metadata can be accommodated in the content of full flash memory storage.
Step S104: target metadata group is stored directly in the disk of full flash memory storage.
In practical application, after obtaining target metadata group, directly target metadata group can be stored directly in entirely
In the disk of flash memory storage.Due to the scalability of the disk of full flash memory storage, target metadata group is directly stored in full flash memory and is stored up
Disk in, although more disk spaces can be occupied, convenient for directly handling target metadata group, such as to target
The read-write operation etc. of metadata group.
In concrete application scene, for the ease of the processing to target metadata group, directly stored by target metadata group
After in the disk of full flash memory storage, data pick-up can also be carried out to target metadata group according to default metadata length, obtained
To corresponding second level metadata；In the memory that storage second level metadata is stored up to full flash memory.Default metadata length can be 8M etc..
Due to carrying out data pick-up to target metadata group, obtain second level metadata, it is possible to second level metadata is handled and
It realizes the processing to single metadata, for example second level metadata is subjected to migration etc. of the migration realization to single metadata.Specifically
, when need to target metadata group carry out write operation when, in order to improve efficiency, according to default metadata length to target element
Data group carries out data pick-up can also determine whether to receive write request after obtaining corresponding second level metadata；If so,
Then first second level metadata is handled based on write request, then the target metadata in the disk stored up based on write request to full flash memory
Group is handled.Specifically, when needing to carry out read operation to target metadata group, in order to improve efficiency, according to default member
Data length carries out data pick-up to target metadata group can also determine whether to connect after obtaining corresponding second level metadata
Receive read request；Second level metadata is handled if so, being directly based upon read request.
In concrete application scene, it is understood that there may be the case where data structure of target metadata group changes, for synchronization
The data structure of target metadata group is carrying out data pick-up to target metadata group according to default metadata length, is obtaining phase
After the second level metadata answered, it can also judge whether the data structure of target metadata group changes；If so, being based on mesh
The data structure for marking metadata group migrates the target metadata group in the disk of full flash memory storage, and updates second level member number
According to.Namely change in the data structure of target metadata group, and when having second level metadata in the memory of full flash memory storage,
Need to the target metadata group in the disk that is stored up to full flash memory of the data structure based on target metadata group carry out migration operation, with same
The data structure of the target metadata group in the disk of full flash memory storage is walked, and updates the second level member number in the memory that full flash memory stores up
According to so that the second level metadata in the memory of full flash memory storage is synchronous with the target metadata group in the disk that full flash memory stores up.
In concrete application scene, for the ease of quickly handling the second level metadata in the memory of full flash memory storage,
After in the memory that is stored up to full flash memory of storage second level metadata, can also establish and save second level metadata stored up with full flash memory it is interior
Storage mapping relationship between depositing.In this way, subsequent directly can determine second level metadata in full flash memory according to storage mapping relationship
Storage location in the memory of storage improves the treatment effeciency to second level metadata.
In concrete application scene, in the disk that target metadata group is stored directly in the storage of full flash memory after, can be with
Judge whether the target metadata group in the disk of full flash memory storage is complete；If it is not, then B+ tree metadata is unfolded, mesh is obtained
Metadata group is marked, and updates the disk of full flash memory storage based on target metadata group.Namely the target element in the disk of full flash memory storage
Data group may lose, and in order to avoid such situation, need to judge whether is target metadata in the disk of full flash memory storage
Completely, specifically, can constantly judge whether the target metadata in the disk of full flash memory storage complete, can also according to it is default when
Between interval judge whether the target metadata in disk that full flash memory stores up complete etc..
A kind of metadata organization method provided by the present application is applied in the storage of full flash memory, obtains target metadata group；Using
B+ tree construction organizational goal metadata group, obtains B+ tree metadata；B+ tree metadata is stored in the memory of full flash memory storage；It will
Target metadata group is stored directly in the disk of full flash memory storage.A kind of metadata organization method provided by the present application, full flash memory
B+ tree metadata is stored in the memory of full flash memory storage by storage, and target metadata group is stored directly in the disk of full flash memory storage
In, in this way when reorganizing metadata, the B+ tree construction that need to only reorganize in memory does not need compared with prior art
The B+ tree construction in disk is reorganized, the organizational efficiency of metadata can be improved.
Referring to Fig. 2, Fig. 2 is a kind of second flow chart of metadata organization method provided by the embodiments of the present application.
In practical application, a kind of metadata organization method provided by the embodiments of the present application be may comprise steps of:
Step S201: target metadata group is obtained.
Step S202: B+ tree construction organizational goal metadata group is used, B+ tree metadata is obtained.
Step S203: B+ tree metadata is stored in the memory of full flash memory storage.
Step S204: target metadata group is stored directly in the disk of full flash memory storage.
Step S205: data pick-up is carried out to target metadata group according to default metadata length, obtains corresponding second level
Metadata.
Step S206: in the memory that storage second level metadata is stored up to full flash memory.
Step S207: establishing and saves the storage mapping relationship between second level metadata and the memory of full flash memory storage.
Step S208: judging whether the data structure of target metadata group changes, if so, S209 is thened follow the steps,
If it is not, then directly executing step S210.
Step S209: the data structure based on target metadata group, to the target metadata group in the disk of full flash memory storage
It is migrated, and updates second level metadata.
Step S210: judge whether the target metadata group in the disk of full flash memory storage is complete；If it is not, thening follow the steps
S211, if so, directly executing step S212.
Step S211: being unfolded B+ tree metadata, obtains target metadata group, and update based on target metadata group
The disk of full flash memory storage.
Step S212: judge whether to receive write request；If so, S213 is thened follow the steps, if it is not, then directly executing step
S214。
Step S213: first second level metadata is handled based on write request, then the magnetic that full flash memory is stored up based on write request
Target metadata group in disk is handled.
Step S214: judge whether to receive read request；If so, thening follow the steps S215.
Step S215: it is directly based upon read request and second level metadata is handled.
Present invention also provides a kind of metadata organization systems, with a kind of metadata group provided by the embodiments of the present application
The correspondence effect that organization method has.Referring to Fig. 3, Fig. 3 is a kind of knot of metadata organization system provided by the embodiments of the present application
Structure schematic diagram.
A kind of metadata organization system provided by the embodiments of the present application is applied in the storage of full flash memory, may include:
First obtains module 101, for obtaining target metadata group；
The first tissue module 102 obtains B+ tree metadata for using B+ tree construction organizational goal metadata group；
First memory module 103, for B+ tree metadata to be stored in the memory of full flash memory storage；
Second memory module 104, for target metadata group to be stored directly in the disk of full flash memory storage.
A kind of metadata organization system provided by the embodiments of the present application is applied in the storage of full flash memory, can also include:
Target metadata group is stored directly in the disk of full flash memory storage by the first abstraction module for the second memory module
Later, data pick-up is carried out to target metadata group according to default metadata length, obtains corresponding second level metadata；
Third memory module, for storing in the memory that second level metadata is stored up to full flash memory.
A kind of metadata organization system provided by the embodiments of the present application is applied in the storage of full flash memory, can also include:
First judgment module carries out data to target metadata group according to default metadata length for the first abstraction module
It extracts, after obtaining corresponding second level metadata, judges whether to receive write request；If so, first based on write request to second level
Metadata is handled, then the target metadata group in the disk stored up based on write request to full flash memory is handled.
A kind of metadata organization system provided by the embodiments of the present application is applied in the storage of full flash memory, can also include:
Second judgment module carries out data to target metadata group according to default metadata length for the first abstraction module
It extracts, after obtaining corresponding second level metadata, judges whether to receive read request；If so, being directly based upon read request to two
Grade metadata is handled.
A kind of metadata organization system provided by the embodiments of the present application is applied in the storage of full flash memory, can also include:
Third judgment module carries out data to target metadata group according to default metadata length for the first abstraction module
It extracts, after obtaining corresponding second level metadata, judges whether the data structure of target metadata group changes；If so,
Based on the data structure of target metadata group, the target metadata group in the disk of full flash memory storage is migrated, and updates two
Grade metadata.
A kind of metadata organization system provided by the embodiments of the present application is applied in the storage of full flash memory, can also include:
First establishes module, after storing in the memory that second level metadata is stored up to full flash memory for third memory module, builds
Found and save the storage mapping relationship between second level metadata and the memory of full flash memory storage.
A kind of metadata organization system provided by the embodiments of the present application is applied in the storage of full flash memory, can also include:
Target metadata group is stored directly in the disk of full flash memory storage by the 4th judgment module for the second memory module
Later, judge whether the target metadata group in the disk of full flash memory storage is complete；If it is not, then B+ tree metadata is unfolded,
Target metadata group is obtained, and updates the disk of full flash memory storage based on target metadata group.
Present invention also provides a kind of metadata organization equipment and computer readable storage mediums, all have the application reality
A kind of correspondence effect that metadata organization method has of example offer is provided.Referring to Fig. 4, Fig. 4 is provided by the embodiments of the present application
A kind of structural schematic diagram of metadata organization equipment.
A kind of metadata organization equipment provided by the embodiments of the present application, including memory 201 and processor 202, memory
Computer program is stored in 201, processor 202 realizes following steps when executing the computer program stored in memory 201:
Obtain target metadata group；
Using B+ tree construction organizational goal metadata group, B+ tree metadata is obtained；
B+ tree metadata is stored in the memory of full flash memory storage；
Target metadata group is stored directly in the disk of full flash memory storage.
A kind of metadata organization equipment provided by the embodiments of the present application, including memory 201 and processor 202, memory
Computer subprogram, specific implementation when processor 202 executes the computer subprogram stored in memory 201 are stored in 201
Following steps: after target metadata group is stored directly in the disk of full flash memory storage, according to default metadata length to mesh
It marks metadata group and carries out data pick-up, obtain corresponding second level metadata；In the memory that storage second level metadata is stored up to full flash memory.
A kind of metadata organization equipment provided by the embodiments of the present application, including memory 201 and processor 202, memory
Computer subprogram, specific implementation when processor 202 executes the computer subprogram stored in memory 201 are stored in 201
Following steps: according to default metadata length to target metadata group carry out data pick-up, obtain corresponding second level metadata it
Afterwards, judge whether to receive write request；If so, first handling based on write request second level metadata, then it is based on write request
Target metadata group in the disk of full flash memory storage is handled.
A kind of metadata organization equipment provided by the embodiments of the present application, including memory 201 and processor 202, memory
Computer subprogram, specific implementation when processor 202 executes the computer subprogram stored in memory 201 are stored in 201
Following steps: according to default metadata length to target metadata group carry out data pick-up, obtain corresponding second level metadata it
Afterwards, judge whether to receive read request；Second level metadata is handled if so, being directly based upon read request.
A kind of metadata organization equipment provided by the embodiments of the present application, including memory 201 and processor 202, memory
Computer subprogram, specific implementation when processor 202 executes the computer subprogram stored in memory 201 are stored in 201
Following steps: according to default metadata length to target metadata group carry out data pick-up, obtain corresponding second level metadata it
Afterwards, judge whether the data structure of target metadata group changes；If so, the data structure based on target metadata group,
Target metadata group in the disk of full flash memory storage is migrated, and updates second level metadata.
A kind of metadata organization equipment provided by the embodiments of the present application, including memory 201 and processor 202, memory
Computer subprogram, specific implementation when processor 202 executes the computer subprogram stored in memory 201 are stored in 201
Following steps: it after in the memory that storage second level metadata is stored up to full flash memory, establishes and saves second level metadata and full flash memory stores up
Memory between storage mapping relationship.
A kind of metadata organization equipment provided by the embodiments of the present application, including memory 201 and processor 202, memory
Computer subprogram, specific implementation when processor 202 executes the computer subprogram stored in memory 201 are stored in 201
Following steps: after target metadata group is stored directly in the disk of full flash memory storage, in the disk that judges full flash memory storage
Whether target metadata group is complete；If it is not, then B+ tree metadata is unfolded, target metadata group is obtained, and be based on target
Metadata group updates the disk of full flash memory storage.
Referring to Fig. 5, can also include: in another kind metadata organization equipment provided by the embodiments of the present application and processor
The input port 203 of 202 connections is used for transmission the extraneous order inputted to processor 202；The display being connect with processor 202
Unit 204, the processing result for video-stream processor 202 is to the external world；The communication module 205 being connect with processor 202, for real
Existing metadata organization equipment and extraneous communication.Display unit 204 can make display etc. for display panel, laser scanning；It is logical
Believe that communication mode used by module 205 includes but is not limited to mobile high definition chained technology (HML), universal serial bus
(USB), high-definition media interface (HDMI), wireless connection: adopting wireless fidelity technology (WiFi), Bluetooth Communication Technology, low-power consumption are blue
The tooth communication technology, the communication technology based on IEEE802.11s.
A kind of computer readable storage medium provided by the embodiments of the present application is stored with meter in computer readable storage medium
Calculation machine program, realizes following steps when computer program is executed by processor:
Obtain target metadata group；
Using B+ tree construction organizational goal metadata group, B+ tree metadata is obtained；
B+ tree metadata is stored in the memory of full flash memory storage；
Target metadata group is stored directly in the disk of full flash memory storage.
A kind of computer readable storage medium provided by the embodiments of the present application is stored with meter in computer readable storage medium
Loom program is calculated, computer subprogram is implemented as follows step when being executed by processor: target metadata group is directly stored
After in the disk of full flash memory storage, data pick-up is carried out to target metadata group according to default metadata length, is obtained corresponding
Second level metadata；In the memory that storage second level metadata is stored up to full flash memory.
A kind of computer readable storage medium provided by the embodiments of the present application is stored with meter in computer readable storage medium
Loom program is calculated, computer subprogram is implemented as follows step when being executed by processor: according to default metadata length to mesh
Mark metadata group carries out data pick-up and judges whether to receive write request after obtaining corresponding second level metadata；If so,
First second level metadata is handled based on write request, then the target metadata group in the disk stored up based on write request to full flash memory
It is handled.
A kind of computer readable storage medium provided by the embodiments of the present application is stored with meter in computer readable storage medium
Loom program is calculated, computer subprogram is implemented as follows step when being executed by processor: according to default metadata length to mesh
Mark metadata group carries out data pick-up and judges whether to receive read request after obtaining corresponding second level metadata；If so,
Read request is directly based upon to handle second level metadata.
A kind of computer readable storage medium provided by the embodiments of the present application is stored with meter in computer readable storage medium
Loom program is calculated, computer subprogram is implemented as follows step when being executed by processor: according to default metadata length to mesh
It marks metadata group and carries out data pick-up, after obtaining corresponding second level metadata, judge that the data structure of target metadata group is
It is no to change；If so, the data structure based on target metadata group, to the target metadata group in the disk of full flash memory storage
It is migrated, and updates second level metadata.
A kind of computer readable storage medium provided by the embodiments of the present application is stored with meter in computer readable storage medium
Loom program is calculated, computer subprogram is implemented as follows step when being executed by processor: storage second level metadata to full flash memory
After in the memory of storage, the storage mapping relationship between second level metadata and the memory of full flash memory storage is established and saved.
A kind of computer readable storage medium provided by the embodiments of the present application is stored with meter in computer readable storage medium
Loom program is calculated, computer subprogram is implemented as follows step when being executed by processor: target metadata group is directly stored
After in the disk of full flash memory storage, judge whether the target metadata group in the disk of full flash memory storage is complete；If it is not, then to B+
Tree metadata is unfolded, and target metadata group is obtained, and the disk of full flash memory storage is updated based on target metadata group.
Computer readable storage medium involved in the application includes random access memory (RAM), memory, read-only memory
(ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technical field
Any other form of storage medium well known to interior.
Dependent part in a kind of metadata organization system provided by the embodiments of the present application, equipment and computer readable storage medium
The explanation divided refers to the detailed description of corresponding part in a kind of metadata organization method provided by the embodiments of the present application, herein not
It repeats again.In addition, in above-mentioned technical proposal provided by the embodiments of the present application with correspond to technical solution realization principle in the prior art
Consistent part is simultaneously unspecified, in order to avoid excessively repeat.
It should also be noted that, herein, relational terms such as first and second and the like are used merely to one
Entity or operation are distinguished with another entity or operation, without necessarily requiring or implying between these entities or operation
There are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant are intended to contain
Lid non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
The foregoing description of the disclosed embodiments makes those skilled in the art can be realized or use the application.To this
A variety of modifications of a little embodiments will be apparent for a person skilled in the art, and the general principles defined herein can
Without departing from the spirit or scope of the application, to realize in other embodiments.Therefore, the application will not be limited
It is formed on the embodiments shown herein, and is to fit to consistent with the principles and novel features disclosed in this article widest
Range.
Claims (10)
1. a kind of metadata organization method, which is characterized in that be applied in the storage of full flash memory, comprising:
Obtain target metadata group；
Using target metadata group described in B+ tree construction tissue, B+ tree metadata is obtained；
The B+ tree metadata is stored in the memory of the full flash memory storage；
The target metadata group is stored directly in the disk of the full flash memory storage.
2. the method according to claim 1, wherein it is described the target metadata group is stored directly in it is described
After in the disk of full flash memory storage, further includes:
Data pick-up is carried out to the target metadata group according to default metadata length, obtains corresponding second level metadata；
The second level metadata is stored into the memory of the full flash memory storage.
3. according to the method described in claim 2, it is characterized in that, it is described according to default metadata length to the target element number
A data pick-up is carried out according to group, after obtaining corresponding second level metadata, further includes:
Judge whether to receive write request；
If so, first being handled based on the write request the second level metadata, then based on the write request to described complete
The target metadata group in the disk of flash memory storage is handled.
4. according to the method described in claim 2, it is characterized in that, it is described according to default metadata length to the target element number
A data pick-up is carried out according to group, after obtaining corresponding second level metadata, further includes:
Judge whether to receive read request；
The second level metadata is handled if so, being directly based upon the read request.
5. according to the method described in claim 2, it is characterized in that, it is described according to default metadata length to the target element number
A data pick-up is carried out according to group, after obtaining corresponding second level metadata, further includes:
Judge whether the data structure of the target metadata group changes；
If so, the data structure based on the target metadata group, to the target element in the disk of the full flash memory storage
Data group is migrated, and updates the second level metadata.
6. according to the method described in claim 2, it is characterized in that, the storage second level metadata to the full flash memory stores up
Memory in after, further includes:
Establish and save the storage mapping relationship between the second level metadata and the memory of the full flash memory storage.
7. method according to any one of claims 1 to 6, which is characterized in that described that the target metadata group is direct
After being stored in the disk of the full flash memory storage, further includes:
Judge whether the target metadata group in the disk of the full flash memory storage is complete；
If it is not, then the B+ tree metadata is unfolded, the target metadata group is obtained, and be based on the target metadata
Group updates the disk of the full flash memory storage.
8. a kind of metadata organization system, which is characterized in that be applied in the storage of full flash memory, comprising:
First obtains module, for obtaining target metadata group；
The first tissue module, for obtaining B+ tree metadata using target metadata group described in B+ tree construction tissue；
First memory module, for the B+ tree metadata to be stored in the memory of the full flash memory storage；
Second memory module, for the target metadata group to be stored directly in the disk of the full flash memory storage.
9. a kind of metadata organization equipment characterized by comprising
Memory, for storing computer program；
Processor realizes metadata organization side as described in any one of claim 1 to 7 when for executing the computer program
Method.
10. a kind of computer readable storage medium, which is characterized in that be stored with computer in the computer readable storage medium
Program, the computer program realize metadata organization side as described in any one of claim 1 to 7 when being executed by processor
Method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811463459.XA CN109542911B (en) | 2018-12-03 | 2018-12-03 | Metadata organization method, system, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811463459.XA CN109542911B (en) | 2018-12-03 | 2018-12-03 | Metadata organization method, system, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109542911A true CN109542911A (en) | 2019-03-29 |
| CN109542911B CN109542911B (en) | 2021-10-29 |
Family
ID=65852620
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811463459.XA Active CN109542911B (en) | 2018-12-03 | 2018-12-03 | Metadata organization method, system, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109542911B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110134340A (en) * | 2019-05-23 | 2019-08-16 | 苏州浪潮智能科技有限公司 | A kind of method, apparatus of metadata updates, equipment and storage medium |
| CN110502457A (en) * | 2019-08-23 | 2019-11-26 | 北京浪潮数据技术有限公司 | A kind of metadata storing method and device |
| CN110532201A (en) * | 2019-08-23 | 2019-12-03 | 北京浪潮数据技术有限公司 | A kind of metadata processing method and device |
| CN111881064A (en) * | 2020-07-24 | 2020-11-03 | 北京浪潮数据技术有限公司 | Method, device and equipment for processing access request in full flash memory storage system |
| CN113836051A (en) * | 2021-11-29 | 2021-12-24 | 苏州浪潮智能科技有限公司 | Metadata space recovery method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103294786A (en) * | 2013-05-17 | 2013-09-11 | 华中科技大学 | Metadata organization and management method and system of distributed file system |
| CN103309820A (en) * | 2013-06-28 | 2013-09-18 | 曙光信息产业(北京)有限公司 | Implementation method for disk array cache |
| CN105159616A (en) * | 2015-09-11 | 2015-12-16 | 浪潮(北京)电子信息产业有限公司 | Disk space management method and device |
| CN106202492A (en) * | 2016-07-19 | 2016-12-07 | 浪潮(北京)电子信息产业有限公司 | The Metadata Service optimization method of a kind of NFS and system |
| CN106708825A (en) * | 2015-07-29 | 2017-05-24 | 腾讯科技（深圳）有限公司 | Data file processing method and system |
| US20180173638A1 (en) * | 2016-12-21 | 2018-06-21 | EMC IP Holding Company LLC | Method and apparatus for data access |
-
2018
- 2018-12-03 CN CN201811463459.XA patent/CN109542911B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103294786A (en) * | 2013-05-17 | 2013-09-11 | 华中科技大学 | Metadata organization and management method and system of distributed file system |
| CN103309820A (en) * | 2013-06-28 | 2013-09-18 | 曙光信息产业(北京)有限公司 | Implementation method for disk array cache |
| CN106708825A (en) * | 2015-07-29 | 2017-05-24 | 腾讯科技（深圳）有限公司 | Data file processing method and system |
| CN105159616A (en) * | 2015-09-11 | 2015-12-16 | 浪潮(北京)电子信息产业有限公司 | Disk space management method and device |
| CN106202492A (en) * | 2016-07-19 | 2016-12-07 | 浪潮(北京)电子信息产业有限公司 | The Metadata Service optimization method of a kind of NFS and system |
| US20180173638A1 (en) * | 2016-12-21 | 2018-06-21 | EMC IP Holding Company LLC | Method and apparatus for data access |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110134340A (en) * | 2019-05-23 | 2019-08-16 | 苏州浪潮智能科技有限公司 | A kind of method, apparatus of metadata updates, equipment and storage medium |
| CN110502457A (en) * | 2019-08-23 | 2019-11-26 | 北京浪潮数据技术有限公司 | A kind of metadata storing method and device |
| CN110532201A (en) * | 2019-08-23 | 2019-12-03 | 北京浪潮数据技术有限公司 | A kind of metadata processing method and device |
| CN110532201B (en) * | 2019-08-23 | 2021-08-31 | 北京浪潮数据技术有限公司 | Metadata processing method and device |
| CN110502457B (en) * | 2019-08-23 | 2022-02-18 | 北京浪潮数据技术有限公司 | Metadata storage method and device |
| CN111881064A (en) * | 2020-07-24 | 2020-11-03 | 北京浪潮数据技术有限公司 | Method, device and equipment for processing access request in full flash memory storage system |
| CN113836051A (en) * | 2021-11-29 | 2021-12-24 | 苏州浪潮智能科技有限公司 | Metadata space recovery method, device, equipment and storage medium |
| CN113836051B (en) * | 2021-11-29 | 2022-03-22 | 苏州浪潮智能科技有限公司 | Metadata space recovery method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109542911B (en) | 2021-10-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109542911A (en) | A kind of metadata organization method, system, equipment and computer readable storage medium | |
| US9292217B2 (en) | Logical volume space sharing | |
| CN102255962B (en) | Distributive storage method, device and system | |
| CN107111450A (en) | The disk partition splicing and equilibrium again carried out using partition table | |
| CN109213699A (en) | A kind of metadata management method, system, equipment and computer readable storage medium | |
| CN104778222B (en) | Media library based on USB storage device is established and update method | |
| CN103019953A (en) | Construction system and construction method for metadata | |
| CN103647850B (en) | Data processing method, device and system of distributed version control system | |
| CN110347651A (en) | Method of data synchronization, device, equipment and storage medium based on cloud storage | |
| CN104182508A (en) | Data processing method and data processing device | |
| CN110471900A (en) | Data processing method and terminal device | |
| CN109783522A (en) | A kind of data distribution formula caching method, system, equipment and computer storage medium | |
| CN109558456A (en) | A kind of file migration method, apparatus, equipment and readable storage medium storing program for executing | |
| CN104636441B (en) | NFS implementation method and device | |
| CN102769642A (en) | Mobile cloud memory system and implementation method of mobile cloud memory | |
| CN106598548A (en) | Solution method and device for read-write conflict of storage unit | |
| CN107451271A (en) | A kind of Hash table processing method, device, equipment and storage medium | |
| CN110532425A (en) | Video data placement formula storage method, device, computer equipment and storage medium | |
| CN102651674B (en) | Data transmission method of reflective memory network | |
| CN113836116A (en) | Data migration method and device, electronic equipment and readable storage medium | |
| CN108897698A (en) | A kind of file data blocks addressing method, system and equipment and storage medium | |
| CN104391735A (en) | Method and system for scheduling virtual machines in virtualized all-in-one machine cluster | |
| CN103348653A (en) | Capacity expansion method and device and data access method and device | |
| CN111190983B (en) | Substation graph and model and transmission line splicing device, system and method | |
| CN105138528A (en) | Multi-value data storage and reading method and apparatus and multi-value data access system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |