CN109614045A - A kind of metadata rule method, apparatus and relevant device - Google Patents
A kind of metadata rule method, apparatus and relevant device Download PDFInfo
- Publication number
- CN109614045A CN109614045A CN201811488967.3A CN201811488967A CN109614045A CN 109614045 A CN109614045 A CN 109614045A CN 201811488967 A CN201811488967 A CN 201811488967A CN 109614045 A CN109614045 A CN 109614045A
- Authority
- CN
- China
- Prior art keywords
- metadata
- rule
- memory
- disk
- pressure value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 238000012545 processing Methods 0.000 claims abstract description 43
- 238000004590 computer program Methods 0.000 claims description 11
- 230000001960 triggered effect Effects 0.000 claims description 4
- 230000009286 beneficial effect Effects 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 4
- 230000006872 improvement Effects 0.000 description 2
- RAQQRQCODVNJCK-JLHYYAGUSA-N N-[(4-amino-2-methylpyrimidin-5-yl)methyl]-N-[(E)-5-hydroxy-3-(2-hydroxyethyldisulfanyl)pent-2-en-2-yl]formamide Chemical compound C\C(N(Cc1cnc(C)nc1N)C=O)=C(\CCO)SSCCO RAQQRQCODVNJCK-JLHYYAGUSA-N 0.000 description 1
- 230000001680 brushing effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005034 decoration Methods 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0674—Disk device
- G06F3/0676—Magnetic disk device
Abstract
This application discloses a kind of metadata rule methods, instruct including issuing pressure acquisition according to the instruction of the data rule of acquisition to pressure acquisition device；Receive the system pressure value that pressure acquisition device returns；Judge whether system pressure value exceeds preset pressure value；If reading disk metadata merges processing to magnetic disk metadata and memory metadata in memory, and metadata after merging is sent to disk, without departing from preset pressure value to complete rule；If exceeding preset pressure value, memory metadata is sent to disk, processing is merged to magnetic disk metadata and memory metadata in disk, metadata after being merged, to complete rule；The metadata rule method can be under the premise of guaranteeing metadata rule efficiency, the reliability of the effective stability for improving storage system and its metadata.Disclosed herein as well is a kind of metadata rule device, equipment, system and computer readable storage mediums, all have above-mentioned beneficial effect.
Description
Technical field
This application involves technical field of memory, in particular to a kind of metadata rule method further relates to a kind of metadata and falls
Disk device, equipment, system and computer readable storage medium.
Background technique
Metadata is to describe the data of data, is primarily referred to as the information of description data attribute, for supporting instruction such as to store
The functions such as position, historical data, resource lookup, file record.Metadata rule refers to writes metadata in the form of persistence
Onto disk, can quickly to carry out data positioning when host carries out data query, and data acquisition and relevant operation are realized.
When host issues IO (input/output, input and output) request, first metadata can be stored into memory, but
Be due to by storage system memory limitation and metadata it is resident in when there are storage systems situations such as powered-off fault occurs
Under the data loss problem that may cause, so, when metadata reaches certain threshold value in memory, rule can be triggered,
It will be brushed on disk under metadata in memory.
Brush can be generally divided into two kinds of situations under traditional metadata.One is directly by the metadata in memory it is direct under
It brushes on disk, and directly merges the metadata in the metadata and disk of lower brush in disk, however, due to first number
It is generally stored according in disk in the form of B+Tree (B+ tree), in the biggish situation of data pressure original in disk, very
It is easy to generate the complex operations of many B+Tree, such as data splitting when lower brush metadata quantity is excessive；In addition, in metadata
B+Tree can also be locked during lower brush, will seriously affect normal IO read-write, reduce IO efficiency.Another metadata
Lower brush method is an intermediate memory block temporarily to be generated, to right when the metadata quantity in memory reaches lower brush threshold value
Metadata is merged with the metadata in disk in memory, then with brushing at present to disk, however, since intermediate memory block is real
It is also to establish on border in memory, therefore, brush mode can occupy biggish memory headroom under this kind；Meanwhile when system needs
The pressure for carrying out data processing is larger, or when needing combined metadata very more on disk, and when lower brush fast speed, possibility
The case where will appear low memory, leads to not normal response host IO, to reduce the stability of storage system and reliable
Property.
Therefore, how a kind of metadata rule method is provided, it can be under the premise of guaranteeing metadata rule efficiency, effectively
The reliability of the stability and its metadata that improve storage system is those skilled in the art's urgent problem to be solved.
Summary of the invention
The purpose of the application is to provide a kind of metadata rule method, which can fall guaranteeing metadata
Under the premise of disk efficiency, the reliability of the effective stability for improving storage system and its metadata；The another object of the application
It is to provide a kind of metadata rule device, equipment, system and computer readable storage medium, it may have above-mentioned beneficial effect.
In order to solve the above technical problems, this application provides a kind of metadata rule method, the metadata rule method
Include:
Pressure acquisition is issued according to the instruction of the data rule of acquisition to instruct to pressure acquisition device；
Receive the system pressure value that the pressure acquisition device returns；
Judge whether the system pressure value exceeds preset pressure value；
If without departing from the preset pressure value, reading disk metadata, in memory to the magnetic disk metadata and interior
It deposits metadata and merges processing, and metadata after merging is sent to disk, to complete rule；
If exceeding the preset pressure value, the memory metadata is sent to the disk, it is right in the disk
The magnetic disk metadata and the memory metadata merge processing, obtain metadata after the merging, to complete rule.
It is preferably, described to issue pressure acquisition according to the instruction of the data rule of acquisition and instruct to before pressure acquisition device,
Further include:
The quantity of the memory metadata is monitored in real time；
When the quantity reaches preset threshold, the data rule instruction is triggered.
It is preferably, described that processing is merged to the magnetic disk metadata and memory metadata in memory, comprising:
Intermediate memory block is created in the memory；
Processing is merged to the magnetic disk metadata and the memory metadata in the intermediate memory block.
Preferably, described that metadata after merging is sent to disk, after completing rule, further includes:
The intermediate memory block is deleted.
Preferably, metadata and the form of B+ tree are stored in the disk after the merging.
In order to solve the above technical problems, this application provides a kind of metadata rule device, the metadata rule device
Include:
Instruction issues module, instructs for issuing pressure acquisition according to the instruction of the data rule of acquisition to pressure acquisition dress
It sets；
Pressure acquisition module, the system pressure value returned for receiving the pressure acquisition device；
Pressure judgment module, for judging whether the system pressure value exceeds preset pressure value；
First rule module, if for the system pressure value without departing from the preset pressure value, reading disk member number
According to merging processing to the magnetic disk metadata and memory metadata in memory, and metadata after merging is sent to magnetic
Disk, to complete rule；
Second rule module, if exceeding the preset pressure value for the system pressure value, by the memory member number
According to the disk is sent to, processing is merged to the magnetic disk metadata and the memory metadata in the disk, is obtained
Metadata after the merging, to complete rule.
Preferably, the metadata rule device further include:
Instruction triggers module monitors in real time for the quantity to the memory metadata；When the quantity reaches pre-
If when threshold value, triggering the data rule instruction.
In order to solve the above technical problems, this application provides a kind of metadata rule equipment, the metadata rule equipment
Include:
Memory, for storing computer program；
Processor, the step of any one of the above metadata rule method is realized when for executing the computer program.
In order to solve the above technical problems, this application provides a kind of metadata rule system, the metadata rule system
Include:
Data rule equipment as described above, for when receiving the instruction of data rule, issue pressure acquisition instruct to
Pressure acquisition device receives the system pressure value that the pressure acquisition device returns, judges whether the system pressure value exceeds
Preset pressure value；If it is not, then reading disk metadata, in memory merges the magnetic disk metadata and memory metadata
Processing, and metadata after merging is sent to disk, to complete rule；If so, the memory metadata is sent to described
Disk merges processing to the magnetic disk metadata and the memory metadata in the disk, after obtaining the merging
Metadata, to complete rule；
The pressure acquisition device is used for the system pressure value according to the pressure acquisition instruction acquisition；
The memory, for storing the memory metadata；
The disk, for storing metadata after the magnetic disk metadata and the merging.
In order to solve the above technical problems, this application provides a kind of computer readable storage medium, it is described computer-readable
Computer program is stored on storage medium, the computer program realizes any one of the above metadata when being executed by processor
The step of rule method.
A kind of metadata rule method provided herein is adopted including issuing pressure according to the instruction of the data rule of acquisition
Collection is instructed to pressure acquisition device；Receive the system pressure value that the pressure acquisition device returns；Judge the system pressure value
Whether preset pressure value is exceeded；If without departing from the preset pressure value, reading disk metadata, in memory to the disk
Metadata and memory metadata merge processing, and metadata after merging is sent to disk, to complete rule；If beyond institute
State preset pressure value, then the memory metadata be sent to the disk, in the disk to the magnetic disk metadata and
The memory metadata merges processing, obtains metadata after the merging, to complete rule.
As it can be seen that metadata rule method provided herein, data processing operation can be currently executed according to system and be held
The method that the pressure received determines metadata rule, when system pressure is smaller, memory headroom is sufficient, and occupancy is lower, can be used
First carry out the method that metadata merges rule again in memory, as a result, can while not influencing normal data treatment effeciency,
The problems such as avoiding the data volume of the merging as needed for the disk larger data splitting that may cause；It is interior when system pressure is larger
It is inadequate to deposit space, not influence the normal data processing operation of system, first rule can be used and closed in disk again
And method, carried out since the process for merging data has been placed in disk, be not necessarily to committed memory space, system has been effectively ensured
Middle data processing operation is normally carried out, and the technical solution can take different metadata according to the difference of system pressure as a result,
Rule method, flexibility with higher, and realize under the premise of guaranteeing metadata rule efficiency, reach and has effectively improved
The stability of storage system and its purpose of metadata reliability.
A kind of metadata rule device, equipment, system and computer readable storage medium provided herein, has
There is above-mentioned beneficial effect, details are not described herein.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The embodiment of application for those of ordinary skill in the art without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is a kind of flow diagram of metadata rule method provided herein；
Fig. 2 is a kind of structural schematic diagram of metadata rule device provided herein；
Fig. 3 is a kind of structural schematic diagram of metadata rule equipment provided herein；
Fig. 4 is a kind of structural schematic diagram of metadata rule system provided herein.
Specific embodiment
The core of the application is to provide a kind of metadata rule method, which can fall guaranteeing metadata
Under the premise of disk efficiency, the reliability of the effective stability for improving storage system and its metadata；Another core of the application
It is to provide a kind of metadata rule device, equipment, system and computer readable storage medium, it may have above-mentioned beneficial effect.
To keep the purposes, technical schemes and advantages of the embodiment of the present application clearer, below in conjunction with the embodiment of the present application
In attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is
Some embodiments of the present application, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art
All other embodiment obtained without making creative work, shall fall in the protection scope of this application.
Referring to FIG. 1, Fig. 1 is a kind of flow diagram of metadata rule method provided herein, the metadata
Rule method may include:
S100: pressure acquisition is issued according to the instruction of the data rule of acquisition and is instructed to pressure acquisition device；
Specifically, since technical solution provided herein is according to the side of the determining metadata rule of difference of system pressure
Therefore method when processor gets the instruction of data rule, can further generate pressure acquisition instruction, and the pressure is adopted
Collection instruction is sent to corresponding pressure acquisition device, to be acquired to system pressure value.
Wherein, the acquisition methods of above-mentioned data rule instruction are not unique, and it is straight can be based on corresponding client by user
It connects and issues acquisition, may be based on certain preset trigger condition automatic triggers and automated toed respond to that is, when reaching the trigger condition
It is specified to state data rule.Therefore, the application is not specifically limited its acquisition modes.In addition, for above-mentioned pressure acquisition device
Concrete type, actual demand can be based on by user and carries out otherness setting, such as acquisition system I/O operation request pressure, interior
The pressure acquisition device of the related pressures information such as occupancy, disk occupancy is deposited, likewise, for its type and quantity, this
Application is also without specifically limiting.
As a kind of preferred embodiment, it is above-mentioned issue pressure acquisition according to the instruction of the data rule of acquisition and instruct to pressure adopt
It can also include being monitored in real time to the quantity of memory metadata before acquisition means；When quantity reaches preset threshold, triggering
The instruction of data rule.
This application provides a kind of acquisition methods of more specific data rule instruction.Specifically, due in memory
And can be used for realizing data storage, but its memory space is smaller, and is prone to powered-off fault and leads to the feelings of loss of data
Condition, therefore, for guarantee data safety, can the quantity to memory metadata carry out real time monitoring statistics, when its quantity reaches
When certain amount, namely when reaching above-mentioned preset threshold, the instruction of automatic trigger data rule further realizes follow-up data rule
Process.
S200: the system pressure value that pressure acquisition device returns is received；
Specifically, complete pressure acquisition instruction issue after, can by pressure acquisition device carry out correspondence system pressure
The acquisition of value, this step aim at acquisition of the processor to system pressure value, i.e. pressure acquisition device completes system pressure value
Acquisition after, fed back to processor.
S300: judge whether system pressure value exceeds preset pressure value；
Since technical solution provided herein is the method for determining metadata rule according to the difference of system pressure, because
This, can judge system pressure value, to determine the size of current system pressure, at this point, then needing to preset a threshold
Value, i.e., above-mentioned preset pressure value, to realize the judgement to current system pressure size.Specifically, can determine whether that pressure acquisition fills
Whether the system pressure value for setting acquisition exceeds preset pressure value, if without departing from preset pressure value, it is believed that system is current
Pressure is smaller, if having exceeded preset pressure value, it is believed that the current pressure of system is larger.
Wherein, it for the specific value of above-mentioned preset pressure value, can be configured according to the actual characteristic of system, or can root
It is configured according to the actual needs of user, the application is not specifically limited, for example, median, i.e., 50% can be taken.
S400: if without departing from preset pressure value, reading disk metadata, in memory to magnetic disk metadata and memory member
Data merge processing, and metadata after merging is sent to disk, to complete rule；
Specifically, when that is, system pressure is smaller, illustrating system when advance when system pressure value is without departing from preset pressure value
Capable data processing operation is less, and memory headroom is sufficient, therefore can complete first number by the method for carrying out data merging in memory
According to rule.Specifically, data can be read in disk, magnetic disk metadata is obtained, and send it to memory, in memory will
Data rule instructs corresponding memory metadata to merge with magnetic disk metadata, and metadata after being merged, as a result,
Metadata after merging is sent in disk, to complete data rule.
Wherein, for the above-mentioned method for carrying out metadata merging in memory, any one in prior art can be used,
The application is not specifically limited.
Preferably, above-mentioned that processing is merged to magnetic disk metadata and memory metadata in memory, it is includable
Deposit memory block among middle creation；Processing is merged to magnetic disk metadata and memory metadata in intermediate memory block.
This application provides a kind of more specific metadata merging methods, to avoid data merging process and other from being based on
The data processing operation process of memory interacts, can be in memory after determination will carry out metadata merging in memory
Intermediate memory block is established, which is a memory that is independent and being exclusively used in execution metadata union operation in memory
Space further for the magnetic disk metadata read from disk, can directly save after reading to memory among this
Block, while the memory metadata for needing rule being stored to the intermediate memory block, it can be completed in memory block among this as a result,
The merging of metadata.
Preferably, above-mentioned that metadata after merging is sent to disk, after completing rule, can also include will be in centre
Counterfoil is deleted.
This step aims at the delete operation to intermediate memory block.Specifically, being completed to avoid memory headroom from wasting
Metadata merges, and sends it to after disk, can delete the intermediate memory block, execute in order to save memory headroom
Other data processing operations.
S500: if exceeding preset pressure value, being sent to disk for memory metadata, in disk to magnetic disk metadata and
Memory metadata merges processing, metadata after being merged, to complete rule.
Specifically, when that is, system pressure is larger, illustrating that system currently carries out when system pressure value exceeds preset pressure value
Data processing operation it is more, memory headroom is insufficient, therefore the method that can carry out data merging in disk again by first rule is complete
At metadata rule.Specifically, corresponding metadata, i.e., above-mentioned memory metadata directly can be instructed data in EMS memory rule
It is sent in disk, and merges it with magnetic disk metadata in disk, and metadata after being merged, it is i.e. complete as a result,
At data rule.
Likewise, the above-mentioned method for carrying out metadata merging in memory can be used any one in prior art
Kind, the application is not specifically limited.
Preferably, metadata and the form of B+ tree are stored in the disk after above-mentioned merging.
Specifically, positioned for data can be rapidly completed when carrying out data query convenient for host, can data after rule, i.e.,
Metadata is stored in disk in the form of B+ tree after above-mentioned merging.Specifically, B+ tree is to aim at disk or other are straight
A kind of balance search tree for connecing access ancillary equipment and designing, in B+ tree, all record nodes are all the sizes of key value
It is sequentially stored in the leaf node of same layer, each leaf node pointer is attached, and therefore, this kind of storage mode can effectively improve number
According to recall precision.
Certainly, form stored above is only a kind of implementation provided herein, can also be B-tree not uniquely,
Binary tree, balanced binary tree etc., the application does not limit this.
Metadata rule method provided herein can currently execute the pressure that data processing operation is born according to system
The method that power determines metadata rule, when system pressure is smaller, memory headroom is sufficient, and occupancy is lower, including can be used elder generation
Deposit the method that middle progress metadata merges rule again, as a result, can while not influencing normal data treatment effeciency, avoid by
The problems such as data volume of the merging needed for disk larger data splitting that may cause；When system pressure is larger, memory headroom
It is inadequate, not influence the normal data processing operation of system, the side that first rule merges in disk again can be used
Method is carried out since the process for merging data has been placed in disk, is not necessarily to committed memory space, data in system have been effectively ensured
Processing operation is normally carried out, and is carried out since the process for merging data has been placed in disk, is not necessarily to committed memory space, effectively
It ensure that being normally carried out for data processing operation in system, the metadata rule method, which realizes, as a result, is guaranteeing metadata
Under the premise of rule efficiency, the stability for effectively improving storage system and its metadata reliability are achieved the purpose that.
To solve the above problems, referring to FIG. 2, Fig. 2 is a kind of structure of metadata rule device provided herein
Schematic diagram, the metadata rule device can include:
Instruction issues module 1, instructs for issuing pressure acquisition according to the instruction of the data rule of acquisition to pressure acquisition dress
It sets；
Pressure acquisition module 2, for receiving the system pressure value of pressure acquisition device return；
Pressure judgment module 3, for judging whether system pressure value exceeds preset pressure value；
First rule module 4, if for system pressure value without departing from preset pressure value, reading disk metadata, inside
Processing is merged to magnetic disk metadata and memory metadata in depositing, and metadata after merging is sent to disk, to complete to fall
Disk；
Memory metadata is sent to magnetic if exceeding preset pressure value for system pressure value by the second rule module 5
Disk merges processing to magnetic disk metadata and memory metadata in disk, metadata after being merged, to complete rule.
As a kind of preferred embodiment, which can also include:
Instruction triggers module monitors in real time for the quantity to memory metadata；When quantity reaches preset threshold,
The instruction of trigger data rule.
As a kind of preferred embodiment, above-mentioned first rule module 4 may include:
Intermediate memory block creating unit, for creating memory intermediate mass in memory；
Metadata combining unit, for merging place to magnetic disk metadata and memory metadata in intermediate memory block
Reason.
As a kind of preferred embodiment, above-mentioned first rule module 4 can also include:
Intermediate memory block deletes unit, for deleting intermediate memory block.
Above method embodiment is please referred to for the introduction of device provided by the present application, this will not be repeated here by the application.
To solve the above problems, referring to FIG. 3, Fig. 3 is a kind of structure of metadata rule equipment provided herein
Schematic diagram, the metadata rule equipment can include:
Memory 11, for storing computer program；
Processor 12, realizes following steps when for executing computer program:
Pressure acquisition is issued according to the instruction of the data rule of acquisition to instruct to pressure acquisition device；Receive pressure acquisition device
The system pressure value of return；Judge whether system pressure value exceeds preset pressure value；If reading magnetic without departing from preset pressure value
Disk metadata merges processing to magnetic disk metadata and memory metadata in memory, and metadata after merging is sent to
Disk, to complete rule；If exceeding preset pressure value, memory metadata is sent to disk, to disk member number in disk
Processing is merged according to memory metadata, metadata after being merged, to complete rule.
Above method embodiment is please referred to for the introduction of equipment provided by the present application, this will not be repeated here by the application.
To solve the above problems, referring to FIG. 4, Fig. 4 is a kind of structure of metadata rule system provided herein
Schematic diagram, the metadata rule system can include:
Data rule equipment 10 as described above, for issuing pressure acquisition instruction when receiving the instruction of data rule
To pressure acquisition device, the system pressure value that pressure acquisition device 20 returns is received, it is default to judge whether system pressure value exceeds
Pressure value；If it is not, then reading disk metadata, merges processing to magnetic disk metadata and memory metadata in memory 30,
And metadata after merging is sent to disk 40, to complete rule；If so, memory metadata is sent to disk 40, in magnetic
Processing is merged to magnetic disk metadata and memory metadata in disk 40, metadata after being merged, to complete rule；
Pressure acquisition device 20, for according to pressure acquisition instruction acquisition system pressure value；
Memory 30 is used for stored memory metadata；
Disk 40, for metadata after storage disk metadata and merging.
Above method embodiment is please referred to for the introduction of system provided by the present application, this will not be repeated here by the application.
To solve the above problems, present invention also provides a kind of computer readable storage medium, the computer-readable storage
It is stored with computer program on medium, can be realized when computer program is executed by processor following rapid:
Pressure acquisition is issued according to the instruction of the data rule of acquisition to instruct to pressure acquisition device；Receive pressure acquisition device
The system pressure value of return；Judge whether system pressure value exceeds preset pressure value；If reading magnetic without departing from preset pressure value
Disk metadata merges processing to magnetic disk metadata and memory metadata in memory, and metadata after merging is sent to
Disk, to complete rule；If exceeding preset pressure value, memory metadata is sent to disk, to disk member number in disk
Processing is merged according to memory metadata, metadata after being merged, to complete rule.
The computer readable storage medium may include: USB flash disk, mobile hard disk, read-only memory (Read-Only
Memory, ROM), random access memory (Random Access Memory, RAM), magnetic or disk etc. is various to deposit
Store up the medium of program code.
Above method embodiment is please referred to for the introduction of computer readable storage medium provided by the present application, the application exists
This is not repeated them here.
Each embodiment is described in a progressive manner in specification, the highlights of each of the examples are with other realities
The difference of example is applied, the same or similar parts in each embodiment may refer to each other.For device disclosed in embodiment
Speech, since it is corresponded to the methods disclosed in the examples, so being described relatively simple, related place is referring to method part illustration
?.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure
And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and
The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These
Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession
Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered
Think beyond scope of the present application.
The step of method described in conjunction with the examples disclosed in this document or algorithm, can directly be held with hardware, processor
The combination of capable software module or the two is implemented.Software module can be placed in random access memory (RAM), memory, read-only deposit
Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology
In any other form of storage medium well known in field.
Above to metadata rule method, apparatus, system, equipment and computer-readable storage medium provided herein
Matter is described in detail.Specific examples are used herein to illustrate the principle and implementation manner of the present application, above
The explanation of embodiment is merely used to help understand the present processes and its core concept.It should be pointed out that for the art
Those of ordinary skill for, under the premise of not departing from the application principle, can also to the application carry out it is several improvement and repair
Decorations, these improvement and modification also fall into the protection scope element of the claim of this application.
Claims (10)
1. a kind of metadata rule method characterized by comprising
Pressure acquisition is issued according to the instruction of the data rule of acquisition to instruct to pressure acquisition device；
Receive the system pressure value that the pressure acquisition device returns；
Judge whether the system pressure value exceeds preset pressure value；
If without departing from the preset pressure value, reading disk metadata, in memory to the magnetic disk metadata and memory member
Data merge processing, and metadata after merging is sent to disk, to complete rule；
If exceeding the preset pressure value, the memory metadata is sent to the disk, to described in the disk
Magnetic disk metadata and the memory metadata merge processing, obtain metadata after the merging, to complete rule.
2. metadata rule method as described in claim 1, which is characterized in that under the instruction according to the data rule of acquisition
Hair pressure acquisition is instructed to before pressure acquisition device, further includes:
The quantity of the memory metadata is monitored in real time；
When the quantity reaches preset threshold, the data rule instruction is triggered.
3. metadata rule method as described in claim 1, which is characterized in that described in memory to the magnetic disk metadata
Processing is merged with memory metadata, comprising:
Intermediate memory block is created in the memory；
Processing is merged to the magnetic disk metadata and the memory metadata in the intermediate memory block.
4. metadata rule method as claimed in claim 3, which is characterized in that described that metadata after merging is sent to magnetic
Disk, after completing rule, further includes:
The intermediate memory block is deleted.
5. the metadata rule method as described in Claims 1-4 any one, which is characterized in that metadata after the merging
It is stored in the disk with the form of B+ tree.
6. a kind of metadata rule device characterized by comprising
Instruction issues module, instructs for issuing pressure acquisition according to the instruction of the data rule of acquisition to pressure acquisition device；
Pressure acquisition module, the system pressure value returned for receiving the pressure acquisition device；
Pressure judgment module, for judging whether the system pressure value exceeds preset pressure value；
First rule module, if for the system pressure value without departing from the preset pressure value, reading disk metadata,
Processing is merged to the magnetic disk metadata and memory metadata in memory, and metadata after merging is sent to disk, with
Complete rule；
Second rule module sends out the memory metadata if exceeding the preset pressure value for the system pressure value
It send to the disk, processing is merged to the magnetic disk metadata and the memory metadata in the disk, obtain institute
Metadata after merging is stated, to complete rule.
7. metadata rule device as claimed in claim 6, which is characterized in that further include:
Instruction triggers module monitors in real time for the quantity to the memory metadata；When the quantity reaches default threshold
When value, the data rule instruction is triggered.
8. a kind of metadata rule equipment characterized by comprising
Memory, for storing computer program；
Processor realizes the metadata rule as described in claim 1 to 5 any one when for executing the computer program
The step of method.
9. a kind of metadata rule system characterized by comprising
Data rule equipment as claimed in claim 8, for issuing pressure acquisition instruction when receiving the instruction of data rule
To pressure acquisition device, the system pressure value that the pressure acquisition device returns is received, judges whether the system pressure value surpasses
Preset pressure value out；If it is not, then reading disk metadata, in memory closes the magnetic disk metadata and memory metadata
And handle, and metadata after merging is sent to disk, to complete rule；If so, the memory metadata is sent to institute
Disk is stated, processing is merged to the magnetic disk metadata and the memory metadata in the disk, obtains the merging
Metadata afterwards, to complete rule；
The pressure acquisition device is used for the system pressure value according to the pressure acquisition instruction acquisition；
The memory, for storing the memory metadata；
The disk, for storing metadata after the magnetic disk metadata and the merging.
10. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium
Program realizes the metadata rule side as described in claim 1 to 5 any one when the computer program is executed by processor
The step of method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811488967.3A CN109614045B (en) | 2018-12-06 | 2018-12-06 | Metadata dropping method and device and related equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811488967.3A CN109614045B (en) | 2018-12-06 | 2018-12-06 | Metadata dropping method and device and related equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109614045A true CN109614045A (en) | 2019-04-12 |
| CN109614045B CN109614045B (en) | 2022-04-15 |
Family
ID=66007470
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811488967.3A Active CN109614045B (en) | 2018-12-06 | 2018-12-06 | Metadata dropping method and device and related equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109614045B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110134340A (en) * | 2019-05-23 | 2019-08-16 | 苏州浪潮智能科技有限公司 | A kind of method, apparatus of metadata updates, equipment and storage medium |
| CN110147204A (en) * | 2019-05-22 | 2019-08-20 | 苏州浪潮智能科技有限公司 | A kind of metadata rule method, apparatus, system and computer readable storage medium |
| CN111158594A (en) * | 2019-12-27 | 2020-05-15 | 浪潮电子信息产业股份有限公司 | Metadata disk-dropping method, device, equipment and storage medium |
| CN111984554A (en) * | 2020-07-31 | 2020-11-24 | 新华三技术有限公司成都分公司 | Data processing method and device |
| CN113672523A (en) * | 2021-07-09 | 2021-11-19 | 济南浪潮数据技术有限公司 | Cache pool data flushing method and system, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150012698A1 (en) * | 2013-07-08 | 2015-01-08 | Dell Products L.P. | Restoring temporal locality in global and local deduplication storage systems |
| CN104809237A (en) * | 2015-05-12 | 2015-07-29 | 百度在线网络技术（北京）有限公司 | LSM-tree (The Log-Structured Merge-Tree) index optimization method and LSM-tree index optimization system |
| CN105183384A (en) * | 2015-09-10 | 2015-12-23 | 浪潮(北京)电子信息产业有限公司 | Direct erasure correction implementation method and device |
| CN105511802A (en) * | 2015-11-24 | 2016-04-20 | 北京达沃时代科技有限公司 | Buffer memory writing method and apparatus and synchronizing method and apparatus for disk cache region |
| US20160328157A1 (en) * | 2014-11-19 | 2016-11-10 | International Business Machines Corporation | Asynchronous tape backup and restore from tape backup in a disk storage environment |
| CN107608911A (en) * | 2017-09-12 | 2018-01-19 | 郑州云海信息技术有限公司 | One kind is data cached to write with a brush dipped in Chinese ink method, apparatus, equipment and storage medium |
| CN108647151A (en) * | 2018-04-26 | 2018-10-12 | 郑州云海信息技术有限公司 | It is a kind of to dodge system metadata rule method, apparatus, equipment and storage medium entirely |
-
2018
- 2018-12-06 CN CN201811488967.3A patent/CN109614045B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150012698A1 (en) * | 2013-07-08 | 2015-01-08 | Dell Products L.P. | Restoring temporal locality in global and local deduplication storage systems |
| US20160328157A1 (en) * | 2014-11-19 | 2016-11-10 | International Business Machines Corporation | Asynchronous tape backup and restore from tape backup in a disk storage environment |
| CN104809237A (en) * | 2015-05-12 | 2015-07-29 | 百度在线网络技术（北京）有限公司 | LSM-tree (The Log-Structured Merge-Tree) index optimization method and LSM-tree index optimization system |
| CN105183384A (en) * | 2015-09-10 | 2015-12-23 | 浪潮(北京)电子信息产业有限公司 | Direct erasure correction implementation method and device |
| CN105511802A (en) * | 2015-11-24 | 2016-04-20 | 北京达沃时代科技有限公司 | Buffer memory writing method and apparatus and synchronizing method and apparatus for disk cache region |
| CN107608911A (en) * | 2017-09-12 | 2018-01-19 | 郑州云海信息技术有限公司 | One kind is data cached to write with a brush dipped in Chinese ink method, apparatus, equipment and storage medium |
| CN108647151A (en) * | 2018-04-26 | 2018-10-12 | 郑州云海信息技术有限公司 | It is a kind of to dodge system metadata rule method, apparatus, equipment and storage medium entirely |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110147204A (en) * | 2019-05-22 | 2019-08-20 | 苏州浪潮智能科技有限公司 | A kind of metadata rule method, apparatus, system and computer readable storage medium |
| CN110147204B (en) * | 2019-05-22 | 2020-03-10 | 苏州浪潮智能科技有限公司 | Metadata disk-dropping method, device and system and computer-readable storage medium |
| CN110134340A (en) * | 2019-05-23 | 2019-08-16 | 苏州浪潮智能科技有限公司 | A kind of method, apparatus of metadata updates, equipment and storage medium |
| CN110134340B (en) * | 2019-05-23 | 2020-03-06 | 苏州浪潮智能科技有限公司 | Method, device, equipment and storage medium for updating metadata |
| CN111158594A (en) * | 2019-12-27 | 2020-05-15 | 浪潮电子信息产业股份有限公司 | Metadata disk-dropping method, device, equipment and storage medium |
| CN111984554A (en) * | 2020-07-31 | 2020-11-24 | 新华三技术有限公司成都分公司 | Data processing method and device |
| CN113672523A (en) * | 2021-07-09 | 2021-11-19 | 济南浪潮数据技术有限公司 | Cache pool data flushing method and system, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109614045B (en) | 2022-04-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109614045A (en) | A kind of metadata rule method, apparatus and relevant device | |
| CN108572792B (en) | Data storage method and device, electronic equipment and computer readable storage medium | |
| US20190391744A1 (en) | Automated selection of functions to reduce storage capacity based on performance requirements | |
| CN105204781B (en) | Compression method, device and equipment | |
| EP3070591A1 (en) | Cold and hot data identification threshold calculation method, apparatus and system | |
| CN106470219A (en) | The dilatation of computer cluster and capacity reduction method and equipment | |
| CN111045956B (en) | Solid state disk garbage recycling method and device based on multi-core CPU | |
| CN105243109A (en) | Data backup method and data processing system | |
| CN115576501B (en) | Node updating method, system and related device of RAID card | |
| US20180364920A1 (en) | Data check method and storage system | |
| CN110007870A (en) | A kind of storage equipment write request processing method and relevant apparatus | |
| CN106569750A (en) | Data compression method and device | |
| CN109471843A (en) | A kind of metadata cache method, system and relevant apparatus | |
| CN105373487A (en) | Defragmentation method and system for storage operation system | |
| CN109582649A (en) | A kind of metadata storing method, device, equipment and readable storage medium storing program for executing | |
| CN116450287A (en) | Method, device, equipment and readable medium for managing storage capacity of service container | |
| CN107315652B (en) | Data backup method and cloud HDFS system | |
| CN108959614A (en) | A kind of snapshot management method, system, device, equipment and readable storage medium storing program for executing | |
| CN109213450A (en) | A kind of associated metadata delet method, device and equipment based on flash array | |
| CN116339643B (en) | Formatting method, formatting device, formatting equipment and formatting medium for disk array | |
| CN108958891A (en) | A kind of virutal machine memory distribution method, device and terminal | |
| CN104246716B (en) | The processing method and equipment of memory space object | |
| CN107357686A (en) | A kind of daily record delet method and device | |
| CN107786670A (en) | A kind of system and method that data and cloud storage R. concomitans are locally stored | |
| CN107330061A (en) | A kind of file delet method and device based on distributed storage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |