CN110018796A - A kind of method, apparatus of storage system processing request of data - Google Patents
A kind of method, apparatus of storage system processing request of data Download PDFInfo
- Publication number
- CN110018796A CN110018796A CN201910290063.8A CN201910290063A CN110018796A CN 110018796 A CN110018796 A CN 110018796A CN 201910290063 A CN201910290063 A CN 201910290063A CN 110018796 A CN110018796 A CN 110018796A
- Authority
- CN
- China
- Prior art keywords
- metadata
- node
- metadata node
- data
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/062—Securing storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Abstract
The invention discloses a kind of methods of storage system processing request of data, the storage system includes two metadata nodes, after client sends write request, it is that data to be written distribute logical space and physical space according to configuration strategy is simplified automatically, and generate metadata evolution instruction, when two metadata nodes all operate normally, one metadata node is updated according to metadata evolution instruction execution to be operated, and another metadata node is synchronized to by result is updated, after a metadata node failure, another metadata node can be executed according to metadata instructions updates operation, and default memory space is backuped to by result is updated.It handles metadata alteration command as it can be seen that this method is cooperated by two metadata nodes and is backed up, avoid metadata loss, significantly improve the safety of storage system.In addition, being acted on corresponding with the effect of the above method the present invention also provides the device and storage system of a kind of storage system processing request of data.
Description
Technical field
The present invention relates to field of storage, in particular to a kind of method, apparatus of storage system processing request of data, storage system
System.
Background technique
The realization principle of automatic simplify configuration is to simplify in storage pool to provide memory space on demand and use to user from one,
Automatic simplify configuration, relative to the non-simplify configuration of tradition, without distributing the disk size taken less than in advance so space utilisation
It is higher, it is therefore desirable to safeguard a large amount of metadata, metadata is lost then user data and will be lost, therefore ensures user data member number
According to safety be particularly important.
Summary of the invention
The object of the present invention is to provide method, apparatus, the storage systems of a kind of storage system processing request of data, to solve
Certainly need to safeguard a large amount of metadata using the storage system of automatic simplify configuration, thus metadata safety is to be improved asks
Topic.
In order to solve the above technical problems, the present invention provides a kind of method of storage system processing request of data, it is described to deposit
Storage system includes the first metadata node and the second metadata node, which comprises
In response to the write request that client is sent, according to configuration strategy is simplified automatically, logic is distributed for data to be written
Space and physical space；
According to the logical space and the physical space, metadata evolution instruction is generated；
When the first metadata node and the second metadata node operate normally, the metadata evolution is instructed and is sent
To first metadata node, grasped in order to which first metadata node is updated according to the metadata evolution instruction execution
Make, and be synchronized to the second metadata node for result is updated, wherein described to update the operation that operation includes insertion target metadata
Or the metadata prestored is revised as to the operation of target metadata, the target metadata includes the logical space to the object
Manage the mapping relations in space；
When first metadata node breaks down and second metadata node operates normally, by first number
It is sent to second metadata node according to alteration command, in order to which second metadata node is according to the metadata instructions
The update operation is executed, and backups to default memory space for result is updated.
Optionally, second metadata node is sent by metadata evolution instruction described, in order to described
Second metadata node is operated according to the metadata instructions execution update, and will be updated result and backuped to default storage sky
Between before, further includes:
Obtain the running state parameter of first metadata node；
Parameter according to the operation state, judges whether first metadata node breaks down.
It optionally, is to be written according to configuration strategy is simplified automatically in the write request sent in response to client
Data are distributed before logical space and physical space, further includes:
Receive the request of data that client is sent；
Judge whether the request of data is write request；
If not write request, then when the first metadata node and the second metadata node operate normally, according to described
Request of data searches corresponding metadata from second metadata node, in order to according to metadata determination and the number
According to the physical space where the corresponding data of request.
Optionally, second metadata node is sent by metadata evolution instruction described, in order to described
Second metadata node is operated according to the metadata instructions execution update, and will be updated result and backuped to default storage sky
Between after, further includes:
Judge whether first metadata node is restored to operate normally；
If restoring to operate normally, the metadata in second metadata node is synchronized to the first metadata section
Point, and discharge the default memory space.
Optionally, it is synchronized to first metadata node in the metadata by second metadata node,
And after discharging the default memory space, further includes:
Judge whether the dirty data in the caching of first metadata node brushes disk under whole；
If so, determining that first metadata node and second metadata node operate normally.
Correspondingly, the present invention also provides a kind of device of storage system processing request of data, the storage system includes
First metadata node and the second metadata node, described device include:
Space distribution module: the write request for sending in response to client is to be written according to configuration strategy is simplified automatically
The data distribution logical space and physical space entered；
Alteration command generation module: for generating metadata evolution and referring to according to the logical space and the physical space
It enables；
First sending module:, will be described for when the first metadata node and the second metadata node operate normally
Metadata evolution instruction is sent to first metadata node, in order to which first metadata node is according to the metadata
Alteration command, which executes, updates operation, and is synchronized to the second metadata node for result is updated, wherein the update operation includes inserting
Enter the operation of target metadata or the metadata prestored is revised as to the operation of target metadata, the target metadata includes institute
State logical space to the physical space mapping relations；
Second sending module: for breaking down in first metadata node and second metadata node is normal
When operation, second metadata node is sent by metadata evolution instruction, in order to second metadata node
The update operation is executed according to the metadata instructions, and backups to default memory space for result is updated.
Optionally, described device includes:
State parameter obtains module: for obtaining the running state parameter of first metadata node；
Breakdown judge module: for parameter according to the operation state, judge whether first metadata node occurs
Failure.
Optionally, described device further include:
Request receiving module: for receiving the request of data of client transmission；
Request judgment module: for judging whether the request of data is write request；
Metadata lookup module: for when the request of data is not write request, in the first metadata node and second
When metadata node operates normally, corresponding metadata is searched from second metadata node according to the request of data,
In order to determine the physical space where data corresponding with the request of data according to the metadata.
Optionally, described device further include:
Restore normal judgment module: for judging whether first metadata node is restored to operate normally；
Release module: for when restoring to operate normally, the metadata in second metadata node to be synchronized to institute
The first metadata node is stated, and discharges the default memory space.
Finally, the present invention also provides a kind of storage systems, comprising: client, storage server, the first metadata section
Point, the second metadata node；
Wherein, the client is for issuing write request；
The storage server is used in response to the write request, is number to be written according to configuration strategy is simplified automatically
According to distribution logical space and physical space, and generate metadata evolution instruction；
First metadata node is used for when itself is operated normally with second metadata node, according to described
Metadata evolution instruction execution updates operation, and is synchronized to the second metadata node for result is updated, wherein the update operation
Including being inserted into the operation of target metadata or the metadata prestored being revised as to the operation of target metadata, the target metadata
Including the logical space to the mapping relations of the physical space；
When second metadata node is used to break down in first metadata node and itself is operated normally, root
The update operation is executed according to the metadata instructions, and backups to default memory space for result is updated.
A kind of method of storage system processing request of data provided by the present invention, which includes two metadata
Node, after client sends write request, can according to simplify automatically configuration strategy be data to be written distribute logical space and
Physical space, and generate metadata evolution instruction, when two metadata nodes all operate normally, a metadata node according to
Metadata evolution instruction execution updates operation, and is synchronized to another metadata node for result is updated, in a metadata section
After point failure, another metadata node can according to metadata instructions execute update operation, and will update result backup to it is default
Memory space.As it can be seen that this method is directed to the storage system of automatic simplify configuration, handled by two metadata node mutual cooperations
Metadata evolution is instructed and is backed up, and is avoided metadata loss, is significantly improved the safety of storage system.
In addition, the present invention also provides a kind of storage system processing request of data device and storage system, effect with
The effect of the above method is corresponding, and which is not described herein again.
Detailed description of the invention
It, below will be to embodiment or existing for the clearer technical solution for illustrating the embodiment of the present invention or the prior art
Attached drawing needed in technical description is briefly described, it should be apparent that, the accompanying drawings in the following description is only this hair
Bright some embodiments for those of ordinary skill in the art without creative efforts, can be with root
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is the implementation process for the embodiment of the method one that a kind of storage system provided by the present invention handles request of data
Figure；
Fig. 2 is the implementation process for the embodiment of the method two that a kind of storage system provided by the present invention handles request of data
Figure；
Fig. 3 is the functional block diagram for the Installation practice that a kind of storage system provided by the present invention handles request of data；
Fig. 4 is a kind of structural block diagram of storage system embodiment provided by the present invention.
Specific embodiment
Core of the invention is to provide the method, apparatus and storage system of a kind of storage system processing request of data, for
The storage system of automatic simplify configuration is realized and is gone forward side by side by two metadata nodes mutual cooperation processing metadata alteration commands
Row backup, reduces the probability of metadata loss, significantly improves the safety of storage system.
In order to enable those skilled in the art to better understand the solution of the present invention, with reference to the accompanying drawings and detailed description
The present invention is described in further detail.Obviously, described embodiments are only a part of the embodiments of the present invention, rather than
Whole embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not making creative work premise
Under every other embodiment obtained, shall fall within the protection scope of the present invention.
A kind of embodiment of the method one of storage system processing request of data provided by the invention is introduced below, referring to
Fig. 1, embodiment one include:
Step S101: the write request sent in response to client is data to be written according to configuration strategy is simplified automatically
Distribute logical space and physical space.
The present embodiment is applied to storage system, which includes client, storage server, the first metadata node
With the second metadata node, wherein client is used for sending request of data, including but not limited to write request, storage server
In storing data, the first metadata node and the second metadata node are for storing metadata, and the two has no essential distinction, just
Often in the case where operation, the metadata in the first metadata node and the second metadata node is consistent.Automatic simplify configuration
Strategy refers to that storage system is managed collectively storage resource, and storage resource of distributing according to need is to upper layer application, as described above, when upper
Write request is initiated in layer application, according to configuration strategy is simplified automatically, distributes logical space and physical space for data to be written.
Step S102: according to the logical space and the physical space, metadata evolution instruction is generated.
While data are written in client request, it would be desirable to more new metadata, such as inserting metadata or modification
Metadata, specifically, at least saving above-mentioned logical space in the metadata to the mapping relations between physical space.
Step S103: when the first metadata node and the second metadata node operate normally, the metadata is become
More instruction is sent to first metadata node, in order to which first metadata node is instructed according to the metadata evolution
It executes and updates operation, and be synchronized to the second metadata node for result is updated.
Wherein, above-mentioned update operation includes the operation of insertion target metadata or the metadata prestored is revised as target element
The operation of data, above-mentioned target metadata include mapping relations of the logical space to the physical space.
Step S104: when first metadata node breaks down and second metadata node operates normally,
Second metadata node is sent by metadata evolution instruction, in order to which second metadata node is according to
Metadata instructions execute the update operation, and backup to default memory space for result is updated.
Between the first metadata node and the second metadata node, only one node is held according to metadata evolution instruction
Row change operation is immediately switched to another node when executing the nodes break down of change operation.Another metadata section
Point will change result and store the default memory space obtained to pre- first to file, in this way, working as the node when executing change operation
When breaking down, data recovery can be carried out to metadata node according to the data in default memory space.It is noted that
Metadata evolution can be instructed while be issued the first metadata node and the second metadata node, latter two right metadata node
Determine itself whether execute metadata evolution instruction in conjunction with the operating status of the two.
In addition, the metadata in the caching of the first metadata node and the second metadata node is to support power down protection
, i.e. power down is saved in system disk, after node failure restores, by storage system memory management module, by memory by BBU
The metadata and user data of power down protection are restored, this is first of safety line.
The present embodiment provides a kind of method of storage system processing request of data, which includes two metadata
Node, after client sends write request, can according to simplify automatically configuration strategy be data to be written distribute logical space and
Physical space, and generate metadata evolution instruction, when two metadata nodes all operate normally, a metadata node according to
Metadata evolution instruction execution updates operation, and is synchronized to another metadata node for result is updated, in a metadata section
After point failure, another metadata node can according to metadata instructions execute update operation, and will update result backup to it is default
Memory space.As it can be seen that this method is directed to the storage system of automatic simplify configuration, handled by two metadata node mutual cooperations
Metadata evolution is instructed and is backed up, and is avoided metadata loss, is significantly improved the safety of storage system.
Start that a kind of embodiment of the method two of storage system processing request of data provided by the invention is discussed in detail below, it is real
It applies example two one to realize based on the above embodiment, and has carried out expansion to a certain extent on the basis of example 1.
Specifically, the present embodiment handles metadata and data using owner-backup mode, i.e., in a domain
One is used as owner in two metadata nodes, another is as backup.When two metadata nodes operate normally,
The two is caching mode, and when another metadata node is operated normally when a metadata node failure, the two is
Logging mode.
Below based on foregoing description, the implementation process of embodiment two is introduced, referring to fig. 2, embodiment two includes:
Step S201: the request of data that client is sent is received.
Step S202: judging whether the request of data is write request, if so, metadata evolution instruction is generated, if it is not,
Then generate metadata query instruction.
When step S203:caching mode, owner node will become according to metadata evolution instruction execution change operation
More result is synchronized to backup node, and backup node is according to the corresponding metadata of metadata query instructions query.
So-called caching mode, i.e. the modification operation of owner node processing metadata node and insertion operation, by first number
According to inquiry and modification as a result, being backuped in a manner of transaction to backup node, backup node becomes metadata
More instruction is forwarded to owner node processing.In this way when owner node when something goes wrong, backup node can then continue with
Host IO and metadata, while corresponding fault handling operation can be triggered, i.e. it is brushed under cache, metadata rule etc., ensures data
Safety.
Caching mode, that is, the change of owner node metadata are used under normal circumstances, can be passed through
The mode of transaction backups in backup node, so that the metadata in two nodal caches is kept to be consistent, when
When one node failure, another node can be taken over immediately, without generating the case where data are inconsistent and loss of data.
When step S204:logging mode, backup node is incited somebody to action according to metadata evolution instruction execution change operation
It changes result or Log memory space is arrived in metadata evolution instruction storage.
When the metadata node that only one in storage system operates normally, owner-backup relationship can not be formed,
It will cause data reliability reduction, therefore, the present embodiment is provided with Logging mode, i.e., by applying for that independent Log storage is empty
Between, Log memory space is written into metadata evolution instruction or updated metadata in sequence, in corresponding metadata just
After the metadata node rule often run, it is invalid to set the log storage resource.
The process for being converted to logging mode by caching mode is as follows: firstly, if what is broken down is owner section
Point can then trigger the operation of switching node, ensure the processing not influenced to metadata instructions；Then, bankup nodal test
The whether complete rule of dirty data in the caching of owner node can trigger rule operation if not having, and allow dirty data before failure
Start rule, ensures data safety.Finally, then switching chaching mode is Logging mode, guarantee that only one node can
IO is handled to receive.
If owner node restores to operate normally after breaking down, can be deposited according to the data and Log of cache power down protection
The metadata for storing up spatial registration carries out data recovery according to timing, ensures data safety.But at this time will not immediately with
Bankup node enters caching mode, but the whether complete rule of the dirty data for judging owner node and Long are deposited
Whether the data in storage space update owner node, only can just come back to caching under conditions of the two meets simultaneously
Mode.
As it can be seen that a kind of method of storage system processing request of data provided in this embodiment, to the member of automatic simplify configuration
Data processing mode is designed, by dual control caching, the mode of single control Logging ensure metadata safety and
Consistency, while failure to double-control system and restoring process flow and control adapts it to dual control node failure and its extensive
It is multiple, the data safety of storage system can be ensured when the system failure is unstable, improve product reliability and processing capacity, mention
Rise product competitiveness.
A kind of device of storage system processing request of data provided in an embodiment of the present invention is introduced below, is hereafter retouched
The method of a kind of device for storage system processing request of data stated and a kind of above-described storage system processing request of data
Reference can be corresponded to each other.
As shown in figure 3, the device includes:
Space distribution module 301: the write request for sending in response to client is according to configuration strategy is simplified automatically
Data distribution logical space to be written and physical space.
Alteration command generation module 302: for generating metadata evolution according to the logical space and the physical space
Instruction.
First sending module 303: for when the first metadata node and the second metadata node operate normally, by institute
It states metadata evolution instruction and is sent to first metadata node, in order to which first metadata node is according to first number
It is executed according to alteration command and updates operation, and be synchronized to the second metadata node for result is updated, wherein the update, which operates, includes
It is inserted into the operation of target metadata or the metadata prestored is revised as to the operation of target metadata, the target metadata includes
Mapping relations of the logical space to the physical space.
Second sending module 304: for breaking down and second metadata node in first metadata node
When normal operation, second metadata node is sent by metadata evolution instruction, in order to second metadata
Node executes the update according to the metadata instructions and operates, and backups to default memory space for result is updated.
As an alternative embodiment, described device includes:
State parameter obtains module 305: for obtaining the running state parameter of first metadata node；
Breakdown judge module 306: for parameter according to the operation state, judge whether first metadata node is sent out
Raw failure.
As an alternative embodiment, described device further include:
Request receiving module 307: for receiving the request of data of client transmission；
Request judgment module 308: for judging whether the request of data is write request；
Metadata lookup module 309: if not being used for write request, then in the first metadata node and the second metadata node
When operating normally, corresponding metadata is searched from second metadata node according to the request of data, in order to basis
The metadata determines the physical space where data corresponding with the request of data.
As an alternative embodiment, described device further include:
Restore normal judgment module 310: for judging whether first metadata node is restored to operate normally；
Release module 311: if for restoring to operate normally, the metadata in second metadata node is synchronized to
First metadata node, and discharge the default memory space.
A kind of device of the storage system processing request of data of the present embodiment for realizing a kind of storage system above-mentioned at
The method for managing request of data, therefore the visible storage system processing data one of above of specific embodiment in the device are asked
The embodiment part for the method asked, for example, space distribution module 301, alteration command generation module 302, the first sending module
303, the second sending module 304 is respectively used to step S101 in the method for realizing a kind of above-mentioned storage system processing request of data,
S102, S103, S104.So specific embodiment is referred to the description of corresponding various pieces embodiment, herein no longer
Expansion is introduced.
In addition, since a kind of device of storage system processing request of data of the present embodiment is deposited for realizing one kind above-mentioned
The method that storage system handles request of data, therefore its effect is corresponding with the effect of the above method, which is not described herein again.
In addition, the present invention also provides a kind of storage system embodiment, a kind of storage system described below with retouch above
A kind of method for storage system processing request of data stated can correspond to each other reference.Referring to fig. 4, which includes: client
401, storage server 402, the first metadata node 403, the second metadata node 404 are held, the effect of each section is as follows:
The client 401 is for issuing write request；
The storage server 402 is used in response to the write request, is to be written according to configuration strategy is simplified automatically
Data distribute logical space and physical space, and generate metadata evolution instruction；
First metadata node 403 is used for when itself is operated normally with second metadata node 404, root
It updates and operates according to the metadata evolution instruction execution, and be synchronized to the second metadata node 404 for result is updated, wherein institute
The operation or the operation that the metadata prestored is revised as to target metadata for updating that operation includes insertion target metadata are stated, it is described
Target metadata includes mapping relations of the logical space to the physical space；
Second metadata node 404 is used to break down in first metadata node 403 and itself normal fortune
When row, the update is executed according to the metadata instructions and is operated, and backups to default memory space for result is updated.
A kind of device of the storage system processing request of data of the present embodiment for realizing a kind of storage system above-mentioned at
The method for managing request of data, therefore the visible storage system processing data one of above of specific embodiment in the device are asked
The embodiment part for the method asked, and its effect is corresponding with above method embodiment, which is not described herein again.
Each embodiment in this specification is described in a progressive manner, the highlights of each of the examples are with it is other
The difference of embodiment, same or similar part may refer to each other between each embodiment.For being filled disclosed in embodiment
For setting, since it is corresponded to the methods disclosed in the examples, so being described relatively simple, related place is referring to method part
Explanation.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure
And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and
The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These
Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession
Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered
Think beyond the scope of this invention.
The step of method described in conjunction with the examples disclosed in this document or algorithm, can directly be held with hardware, processor
The combination of capable software module or the two is implemented.Software module can be placed in random access memory (RAM), memory, read-only deposit
Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology
In any other form of storage medium well known in field.
Above to a kind of method, apparatus and storage system progress of storage system processing request of data provided by the present invention
It is discussed in detail.Used herein a specific example illustrates the principle and implementation of the invention, above embodiments
Explanation be merely used to help understand method and its core concept of the invention.It should be pointed out that for the common of the art
, without departing from the principle of the present invention, can be with several improvements and modifications are made to the present invention for technical staff, these
Improvement and modification are also fallen within the protection scope of the claims of the present invention.
Claims (10)
1. a kind of method of storage system processing request of data, which is characterized in that the storage system includes the first metadata section
Point and the second metadata node, which comprises
In response to the write request that client is sent, according to configuration strategy is simplified automatically, logical space is distributed for data to be written
And physical space；
According to the logical space and the physical space, metadata evolution instruction is generated；
When the first metadata node and the second metadata node operate normally, institute is sent by metadata evolution instruction
The first metadata node is stated, is operated in order to which first metadata node is updated according to the metadata evolution instruction execution,
And by update result be synchronized to the second metadata node, wherein it is described update operation include insertion target metadata operation or
The metadata prestored is revised as to the operation of target metadata, the target metadata includes the logical space to the physics
The mapping relations in space；
When first metadata node breaks down and second metadata node operates normally, the metadata is become
More instruction is sent to second metadata node, in order to which second metadata node is executed according to the metadata instructions
The update operation, and default memory space is backuped to by result is updated.
2. the method as described in claim 1, which is characterized in that send described for metadata evolution instruction described
Binary data node operates in order to which second metadata node executes the update according to the metadata instructions, and will
Result is updated to backup to before default memory space, further includes:
Obtain the running state parameter of first metadata node；
Parameter according to the operation state, judges whether first metadata node breaks down.
3. the method as described in claim 1, which is characterized in that in the write request sent in response to client, according to certainly
Dynamic simplify configuration strategy, is distributed before logical space and physical space for data to be written, further includes:
Receive the request of data that client is sent；
Judge whether the request of data is write request；
If not write request, then when the first metadata node and the second metadata node operate normally, according to the data
Request searches corresponding metadata from second metadata node, in order to be asked according to metadata determination with the data
Seek the physical space where corresponding data.
4. method as claimed in any one of claims 1-3, which is characterized in that sent out in described instruct the metadata evolution
It is sent to second metadata node, in order to which second metadata node executes the update according to the metadata instructions
Operation, and backuped to result is updated after default memory space, further includes:
Judge whether first metadata node is restored to operate normally；
If restoring to operate normally, the metadata in second metadata node is synchronized to first metadata node,
And discharge the default memory space.
5. method as claimed in claim 4, which is characterized in that described that metadata in second metadata node is same
First metadata node is walked, and after discharging the default memory space, further includes:
Judge whether the dirty data in the caching of first metadata node brushes disk under whole；
If so, determining that first metadata node and second metadata node operate normally.
6. a kind of device of storage system processing request of data, which is characterized in that the storage system includes the first metadata section
Point and the second metadata node, described device include:
Space distribution module: the write request for sending in response to client is to be written according to configuration strategy is simplified automatically
Data distribute logical space and physical space；
Alteration command generation module: for generating metadata evolution instruction according to the logical space and the physical space；
First sending module: for when the first metadata node and the second metadata node operate normally, by first number
It is sent to first metadata node according to alteration command, in order to which first metadata node is according to the metadata evolution
Instruction execution updates operation, and is synchronized to the second metadata node for result is updated, wherein the update operation includes insertion mesh
It marks the operation of metadata or the metadata prestored is revised as to the operation of target metadata, the target metadata includes described patrols
The mapping relations of volume space to the physical space；
Second sending module: for first metadata node break down and second metadata node operate normally
When, by the metadata evolution instruction be sent to second metadata node, in order to second metadata node according to
The metadata instructions execute the update operation, and backup to default memory space for result is updated.
7. device as claimed in claim 6, which is characterized in that described device includes:
State parameter obtains module: for obtaining the running state parameter of first metadata node；
Breakdown judge module: for parameter according to the operation state, judge whether first metadata node breaks down.
8. device as claimed in claim 6, which is characterized in that described device further include:
Request receiving module: for receiving the request of data of client transmission；
Request judgment module: for judging whether the request of data is write request；
Metadata lookup module: for when the request of data is not write request, in the first metadata node and binary number
When operating normally according to node, corresponding metadata is searched from second metadata node according to the request of data, so as to
Physical space where determining data corresponding with the request of data according to the metadata.
9. the device as described in claim 6-8 any one, which is characterized in that described device further include:
Restore normal judgment module: for judging whether first metadata node is restored to operate normally；
Release module: for when restoring to operate normally, the metadata in second metadata node to be synchronized to described the
One metadata node, and discharge the default memory space.
10. a kind of storage system characterized by comprising client, storage server, the first metadata node, binary number
According to node；
Wherein, the client is for issuing write request；
The storage server is used in response to the write request, according to configuration strategy is simplified automatically, for data to be written point
With logical space and physical space, and generate metadata evolution instruction；
First metadata node is used for when itself is operated normally with second metadata node, according to first number
It is executed according to alteration command and updates operation, and be synchronized to the second metadata node for result is updated, wherein the update, which operates, includes
It is inserted into the operation of target metadata or the metadata prestored is revised as to the operation of target metadata, the target metadata includes
Mapping relations of the logical space to the physical space；
When second metadata node is used to break down in first metadata node and itself is operated normally, according to institute
It states metadata instructions and executes the update operation, and backup to default memory space for result is updated.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910290063.8A CN110018796B (en) | 2019-04-11 | 2019-04-11 | Method and device for processing data request by storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910290063.8A CN110018796B (en) | 2019-04-11 | 2019-04-11 | Method and device for processing data request by storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110018796A true CN110018796A (en) | 2019-07-16 |
| CN110018796B CN110018796B (en) | 2022-07-08 |
Family
ID=67191092
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910290063.8A Active CN110018796B (en) | 2019-04-11 | 2019-04-11 | Method and device for processing data request by storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110018796B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112578996A (en) * | 2019-09-30 | 2021-03-30 | 华为技术有限公司 | Method for sending metadata of storage system and storage system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102122306A (en) * | 2011-03-28 | 2011-07-13 | 中国人民解放军国防科学技术大学 | Data processing method and distributed file system applying same |
| CN105718217A (en) * | 2016-01-18 | 2016-06-29 | 浪潮(北京)电子信息产业有限公司 | Method and device for maintaining data consistency of thin provisioning database |
-
2019
- 2019-04-11 CN CN201910290063.8A patent/CN110018796B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102122306A (en) * | 2011-03-28 | 2011-07-13 | 中国人民解放军国防科学技术大学 | Data processing method and distributed file system applying same |
| CN105718217A (en) * | 2016-01-18 | 2016-06-29 | 浪潮(北京)电子信息产业有限公司 | Method and device for maintaining data consistency of thin provisioning database |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112578996A (en) * | 2019-09-30 | 2021-03-30 | 华为技术有限公司 | Method for sending metadata of storage system and storage system |
| WO2021063242A1 (en) * | 2019-09-30 | 2021-04-08 | 华为技术有限公司 | Metadata transmission method of storage system, and storage system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110018796B (en) | 2022-07-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP5902716B2 (en) | Large-scale storage system | |
| CN105739924B (en) | Caching method and system based on cache cluster | |
| US6405284B1 (en) | Distributing data across multiple data storage devices in a data storage system | |
| US8069191B2 (en) | Method, an apparatus and a system for managing a snapshot storage pool | |
| CN105718217B (en) | A kind of method and device of simplify configuration storage pool data sign processing | |
| WO2017022002A1 (en) | Storage device, storage system, and control method for storage system | |
| US6654771B1 (en) | Method and system for network data replication | |
| JP2008065525A (en) | Computer system, data management method and management computer | |
| JPH04299748A (en) | Automatic file extension system | |
| US11188229B2 (en) | Adaptive storage reclamation | |
| CN108776579A (en) | A kind of distributed storage cluster expansion method, device, equipment and storage medium | |
| CN109271376A (en) | Database upgrade method, apparatus, equipment and storage medium | |
| CN109144792A (en) | Data reconstruction method, device and system and computer readable storage medium | |
| CN109739435A (en) | File storage and update method and device | |
| CN109726264A (en) | Method, apparatus, equipment and the medium updated for index information | |
| CN113254536A (en) | Database transaction processing method, system, electronic device and storage medium | |
| JP7215971B2 (en) | METHOD AND APPARATUS FOR PROCESSING DATA LOCATION IN STORAGE DEVICE, COMPUTER DEVICE AND COMPUTER-READABLE STORAGE MEDIUM | |
| CN104793981A (en) | Online snapshot managing method and device for virtual machine cluster | |
| US20050160313A1 (en) | Real-time remote backup system and related method | |
| CN110018796A (en) | A kind of method, apparatus of storage system processing request of data | |
| JP7421078B2 (en) | Information processing equipment, information processing system, and data relocation program | |
| CN108319522A (en) | A method of reinforcing distributed memory system reliability | |
| CN111400273A (en) | Database capacity expansion method and device, electronic equipment and machine-readable storage medium | |
| CN107943615B (en) | Data processing method and system based on distributed cluster | |
| CN115878361A (en) | Node management method and device for database cluster and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |