CN108121497A - Storage method and storage system - Google Patents
Storage method and storage system Download PDFInfo
- Publication number
- CN108121497A CN108121497A CN201611066907.3A CN201611066907A CN108121497A CN 108121497 A CN108121497 A CN 108121497A CN 201611066907 A CN201611066907 A CN 201611066907A CN 108121497 A CN108121497 A CN 108121497A
- Authority
- CN
- China
- Prior art keywords
- disk
- physical disk
- physical
- virtual
- matrix
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
- G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
- G06F3/0664—Virtualisation aspects at device level, e.g. emulation of a storage device or system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0689—Disk arrays, e.g. RAID, JBOD
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of storage method and storage systems, are related to computer memory technical field.It can be realized by virtual disk in the present invention and the physical disk for belonging to different server in storage cluster is managed collectively, during progress object storage by the way of virtual disk is randomly selected, and since the corresponding physical disk of virtual disk is also what is randomly selected, so that Servers-all has equal opportunity to be written into data, data are equably stored on Servers-all, it ensure that the load balancing of each server, realize effective management to disk in storage cluster, in addition, since the different copies of same target store on a different server, it can also avoid the problem that due to the damage of certain server the copy of some objects being caused all to lose and can not recover.
Description
Technical field
The present invention relates to computer memory technical field, more particularly to a kind of storage method and storage system.
Background technology
Object storage is the cloud storage service of a kind of magnanimity, elasticity, High Availabitity, high performance-price ratio.In object storage system,
Data will be generally stored on different disks in the form of multiple copies.
For the storage cluster for having certain scale, the disk in cluster how is managed, it is reliability to data, entire
The performance and operation cost of system have vital influence.
The content of the invention
A purpose being realized of the invention is：It is proposed a kind of new storage method, to the disk in storage cluster into
The effective management of row.
According to an aspect of the present invention, a kind of storage method provided, including：It is the storage object to be write from disk
A virtual disk is randomly selected in matrix；Being intended to each copy of the storage object of write-in, to be respectively written into virtual disk corresponding
In each physical disk；Wherein, the corresponding each physical disk of same virtual disk is each server from storage cluster
It is randomly selected in physical disk.
In one embodiment, this method further includes：Each position that statistics faulty physical disk occurs in disk matrix
It puts；An alternate physical disk is randomly selected from storage cluster for the faulty physical disk of each position, wherein, each position
Replacement disk belong to different from the normal physical disk corresponding to the virtual disk belonging to the faulty physical disk of the position
Physical disk；By the copy of the storage object corresponding to the virtual disk belonging to the faulty physical disk of each position, it is restored to
In the alternate physical disk of the position.
In one embodiment, this method further includes：Choose the physics magnetic that occurrence number is most in each column of disk matrix
Disk is determined as high-frequency physical disk；High-frequency physical disk is replaced with into new physical disk according to preset ratio.
In one embodiment, high-frequency physical disk is replaced with new physical disk according to preset ratio includes：It presses
The replacement position of high-frequency physical disk is chosen in each column of disk matrix according to preset ratio；By high-frequency physical disk for
The copy of the corresponding storage object of change place, is restored in new physical disk.
In one embodiment, this method further includes：Determine the line number and columns of disk matrix, often row sets one virtually
Disk；Physical disk is randomly selected from storage cluster by each virtual disk to be put into the row that the virtual disk is expert at；It builds
The correspondence of vertical each physical disk per a line and the virtual disk of the row, to form disk matrix.
According to another aspect of the present invention, a kind of storage system provided, including：Virtual disk chooses module, is used for
A virtual disk is randomly selected from disk matrix for the storage object to be write；Copy writing module, for being intended to write
Each copy of storage object be respectively written into the corresponding each physical disk of virtual disk；Wherein, same virtual disk pair
The each physical disk answered is to be randomly selected from storage cluster in the physical disk of each server.
In one embodiment, which further includes：Failed disk replacement module, for counting faulty physical disk in magnetic
The each position occurred in disk matrix randomly selects a substitute for the faulty physical disk of each position from storage cluster
Disk is managed, wherein, corresponding to the virtual disk belonging to the faulty physical disk for substituting disk and the position of each position just
Normal physical disk belongs to different physical disks, by depositing corresponding to the virtual disk belonging to the faulty physical disk of each position
The copy of object is stored up, is restored in the alternate physical disk of the position.
In one embodiment, which further includes：Wire module on new disk, for choosing in each column of disk matrix
The most physical disk of occurrence number is determined as high-frequency physical disk, and high-frequency physical disk is replaced with newly according to preset ratio
Physical disk.
In one embodiment, wire module on new disk, for being chosen according to preset ratio in each column of disk matrix
High-frequency physical disk is being replaced the copy of the corresponding storage object in position, recovered by the replacement position of high-frequency physical disk
Into new physical disk.
In one embodiment, which further includes：Disk matrix build module, for determine the line number of disk matrix and
Columns, one virtual disk of often row setting, randomly selects physical disk for each virtual disk from storage cluster and is put into the void
Intend in the row that disk is expert at, establish the correspondence of each physical disk and the virtual disk of the row of every a line, to be formed
Disk matrix.
It can be realized by virtual disk in the present invention and the physical disk for belonging to different server in storage cluster is carried out
Unified management, when carrying out object storage by the way of virtual disk is randomly selected, and due to the corresponding physics of virtual disk
Disk is also what is randomly selected so that Servers-all has equal opportunity to be written into data, and data are equably stored in institute
Have on server, ensure that the load balancing of each server, realize effective management to disk in storage cluster, in addition,
Since the different copies of same target store on a different server, the damage due to certain server can also be avoided to cause
The copy of some objects is all lost the problem of can not recovering.
By referring to the drawings to the detailed description of exemplary embodiment of the present invention, other feature of the invention and its
Advantage will become apparent.
Description of the drawings
It in order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention, for those of ordinary skill in the art, without creative efforts, can be with
Other attached drawings are obtained according to these attached drawings.
Fig. 1 shows the flow diagram of the storage method of one embodiment of the present of invention.
Fig. 2 shows the flow diagram of the storage method of an alternative embodiment of the invention.
Fig. 3 shows the flow diagram of the storage method of another embodiment of the present invention.
Fig. 4 shows the structure diagram of the storage system of one embodiment of the present of invention.
Fig. 5 shows the structure diagram of the storage system of an alternative embodiment of the invention.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.Below
Description only actually at least one exemplary embodiment is illustrative, is never used as to the present invention and its application or makes
Any restrictions.Based on the embodiments of the present invention, those of ordinary skill in the art are not making creative work premise
Lower all other embodiments obtained, belong to the scope of protection of the invention.
The present invention proposes a kind of new storage method, can realize effective management to the disk in storage cluster.
With reference to the storage method of Fig. 1 description present invention.
Fig. 1 is the flow chart of storage method one embodiment of the present invention.As shown in Figure 1, the method for the embodiment includes：
Step S102 randomly selects a virtual disk for the storage object to be write from disk matrix.
Wherein, the setting of disk matrix is for the ease of each physical disk in management storage cluster, passes through matrix
Form can more intuitively represent virtual disk to be included and belongs to each object of same virtual disk for which physical disk
Manage the corresponding storage object of disk.A kind of form of disk matrix is for example shown in table 1, wherein, represent that correspondence is same per a line
The different physical disks of virtual disk.
| Virtual disk | 1st row | 2nd row | 3rd row | …… |
| Virtual disk 0 | Physical disk 1 | Physical disk 2 | Physical disk 3 | …… |
| Virtual disk 1 | Physical disk 2 | Physical disk 3 | Physical disk 1 | …… |
| Virtual disk 2 | Physical disk 3 | Physical disk 2 | Physical disk 1 | …… |
| …… | …… | …… | …… | …… |
Table 1
The structure of disk matrix can be by the following method：Determine the line number and columns of disk matrix, often row sets one
Virtual disk randomly selects the row that physical disk is put into the virtual disk and is expert at by each virtual disk from storage cluster
In, the correspondence of each physical disk of the foundation per a line and the virtual disk of the row, to form disk matrix.Wherein, may be used
To determine disk matrix column number according to the number of copies of storage object, according to the memory capacity of each physical disk and physics magnetic
The quantity of disk determines the number i.e. line number of disk matrix of virtual disk.After determining line number and columns, each position with
Machine choose storage cluster a physical disk be put into the position, and ensure disk matrix with a line each physical disk not
It can repeat, the physical disk for corresponding to same virtual disk in very maximum probability as a result, belongs to different servers, meanwhile, it is same
Multiple copies of storage object are not stored on a physical disk, when a physical disk damages, at most lose storage
One copy of object.
Step S104, each copy for being intended to the storage object of write-in are respectively written into the corresponding each physics magnetic of virtual disk
In disk.
Wherein, the corresponding each physical disk of same virtual disk is the physical disk of each server from storage cluster
In randomly select.
After each storage object is write virtual disk, that is, storage object and the mapping relations of virtual disk are established, into
One step can be with the simpler physical disk quickly known where storage object by disk matrix.
One application examples of the above method：3 copies of one object of storage are needed, have been randomly selected from table 1 virtual
Disk 2, then write physical disk 3 by first copy of the object, and second copy writes physical disk 2, the 3rd copy
Write physical disk 1.
The method of above-described embodiment can realize the physics to belonging to different server in storage cluster by virtual disk
Disk is managed collectively, when carrying out object storage by the way of virtual disk is randomly selected, and due to virtual disk pair
The physical disk answered is also what is randomly selected so that Servers-all has equal opportunity to be written into data, data equably by
It stores on Servers-all, ensure that the load balancing of each server, realize effective pipe to disk in storage cluster
Reason, can additionally be caused to avoid the damage due to certain server some objects copy all loss can not recover ask
Topic.
In the prior art, when disk failures occurs in certain server, the other of same server are restored data to
Physical disk gets on.The data so recovered can be all focused on a server, cause the physics magnetic on certain server
Disk free space is significantly lower than other servers, so that the useful space of entire cluster is reduced at double.In addition, this method
The load for also resulting in single server when data are recovered is higher.For this problem, the present invention also proposes a kind of faulty physical
The processing scheme of disk, is described with reference to Fig. 2.
Fig. 2 is the flow chart of another embodiment of storage method of the present invention.As shown in Fig. 2, this hair after step s 104
Bright method further includes：
Step S206, each position that statistics faulty physical disk occurs in disk matrix.
By determining position of the faulty physical disk in disk matrix, it may be determined that virtual belonging to faulty physical disk
Disk, and then determine the object of faulty physical disk storage.
Step S208 randomly selects an alternate physical magnetic for the faulty physical disk of each position from storage cluster
Disk.
Wherein, corresponding to the virtual disk belonging to the faulty physical disk for substituting disk and the position of each position just
Normal physical disk belongs to different physical disks, that is, substituting cannot be with other disk weight of same a line after disk is put into disk matrix
It is multiple.
Step S210, by the pair of the storage object corresponding to the virtual disk belonging to the faulty physical disk of each position
This, is restored in the alternate physical disk of the position.
For a faulty physical disk, multiple and different positions is appeared in disk matrix, in each position
Corresponding storage object is all different, and the alternate physical disk chosen is also multiple, that is, depositing faulty physical disk
The content of storage is restored to respectively in different alternate physical disks, since alternate physical disk randomly selects, very probably
Belong to different servers in rate, therefore, the content of the storage of faulty physical disk is restored to respectively in different servers.
It can be located at other the normal disks of disk matrix with a line by same virtual disk is belonged to faulty physical disk during recovery
The copy of corresponding storage object is restored on alternate physical disk in the virtual disk.
One application examples of the above method is described with reference to table 2 and table 3.
Storage cluster includes 10 servers, and every server has 60 pieces of disks.Cluster is come using the pattern of three copies
Storage object arranges disk arranged in matrix into 3,6000 rows.Disk matrix to build as shown in table 2.
Table 2
In subsequent operational process, physical disk 1 breaks down, and needs to perform the replacement flow of failed disk at this time.
Shown in contrast table 2 and table 3, in the 1st row, the physical disk 78 that the physical disk 1 in virtual disk 0 is randomly picked is replaced,
Copy of the physical disk 2 or 3 in 0 corresponding storage object of virtual disk can be recovered into physical disk 78；Virtual disk 3
In the physical disk 2 that is randomly picked of physical disk 1 replaced, can be right in virtual disk 3 by physical disk 622 or 124
The copy for the storage object answered recovers into physical disk 2；The physics magnetic that physical disk 1 in virtual disk 4 is randomly picked
Disk 181 is replaced, and can be recovered copy of the physical disk 8 or 99 in the corresponding storage object of the row into physical disk 2, together
Reason, the 2nd row are replaced with the physical disk 1 in the 3rd row using same method.
| Virtual disk | 1st row | 2nd row | 3rd row |
| Virtual disk 0 | Physical disk 78 | Physical disk 2 | Physical disk 3 |
| Virtual disk 1 | Physical disk 2 | Physical disk 3 | Physical disk 99 |
| Virtual disk 2 | Physical disk 3 | Physical disk 2 | Physical disk 127 |
| Virtual disk 3 | Physical disk 2 | Physical disk 62 | Physical disk 124 |
| Virtual disk 4 | Physical disk 181 | Physical disk 8 | Physical disk 99 |
| Virtual disk 5 | Physical disk 544 | Physical disk 4 | Physical disk 58 |
| …… | …… | …… | …… |
Table 3
The method of above-described embodiment randomly selects multiple alternate physical disks from storage cluster and replaces faulty physical magnetic
Disk recovers the content of faulty physical disk storage to multiple alternate physical disks respectively, due to alternate physical disk be with
What machine was chosen, the chance that each server is selected is impartial, ensure that the load balancing of each server when data are recovered,
Avoid the disk load too high on single server.Further, since alternate physical disk void corresponding with faulty physical disk
Other physical disks intended in disk are different, so when one piece of disk failures, an object at most only can lose one
Copy.
After faulty physical disk is offline, has new physical disk and add in storage cluster, this hair is described with reference to Fig. 3
The process that bright new physical disk is reached the standard grade.
Fig. 3 is the flow chart of another embodiment of storage method of the present invention.As shown in figure 3, this hair after step S210
Bright method further includes：
Step S312 chooses the physical disk that occurrence number is most in each column of disk matrix and is determined as high-frequency physics magnetic
Disk.
When building disk matrix, each physical disk is generally evenly distributed in each row, due to faulty physical disk by for
Change, the number that some physical disks occur in disk matrix can be caused to become more, so cause the loads of these physical disks compared with
Weight, therefore the physical disk for selecting these frequencies of occurrences higher is replaced the load balancing that can ensure each disk.
High-frequency physical disk is replaced with new physical disk according to preset ratio by step S314.
Specifically, the replacement position of high-frequency physical disk is chosen in each column of disk matrix according to preset ratio, it will
High-frequency physical disk is restored in the copy for replacing the corresponding storage object in position in new physical disk.For example, from each
First position that row high-frequency physical disk occurs starts, and is replaced successively using new disk, until high-frequency physics
Disk and new physical disk number it is equal or difference 1, for each row high-frequency physical disk all with new physical disk
It replaces one time, if there is multiple new physical disks, then according to above-mentioned steps, using each new physical disk to disk matrix
In disk once replaced.
One application examples of the above method is described with reference to table 3 and table 4.New physical disk is 601, as shown in table 4,
In 1st row, 2 occurrence number of physical disk is most, and therefore, the physical disk 2 for having preset ratio in the 1st row is replaced by physics
During disk the 601, the 2nd arranges, 4 occurrence number of physical disk is most, therefore, have in the 2nd row the physical disk 4 of preset ratio by for
It changes into the row of physical disk the 601, the 3rd, 99 occurrence number of physical disk is most, still, due to belonging to the physics magnetic of virtual disk 1
Disk 2 has been replaced by physical disk 601, so in the 3rd row, the physical disk 99 of virtual disk 1 cannot be replaced by physics magnetic
Disk 601, and the physical disk 99 for choosing other rows is replaced.
| Virtual disk | 1st row | 2nd row | 3rd row |
| Virtual disk 0 | Physical disk 78 | Physical disk 2 | Physical disk 3 |
| Virtual disk 1 | Physical disk 601 | Physical disk 3 | Physical disk 99 |
| Virtual disk 2 | Physical disk 3 | Physical disk 2 | Physical disk 127 |
| Virtual disk 3 | Physical disk 601 | Physical disk 62 | Physical disk 124 |
| Virtual disk 4 | Physical disk 181 | Physical disk 8 | Physical disk 601 |
| Virtual disk 5 | Physical disk 544 | Physical disk 601 | Physical disk 58 |
| …… | …… | …… | …… |
Table 4
The method of above-described embodiment utilizes the most physics of each column occurrence number in new physical disk Replace Disk and Press Anykey To Reboot matrix
Disk, the load that can cause each disk is more balanced, further, since alternate physical disk is corresponding with faulty physical disk
Other physical disks in virtual disk are different, so when one piece of disk failures, an object at most only can lose one
A copy.
The present invention also provides a kind of storage systems, are described with reference to Fig. 4.
Fig. 4 is the structure chart of storage system one embodiment of the present invention.As shown in figure 4, the system 40 includes：
Virtual disk chooses module 402, for randomly selecting a void from disk matrix for the storage object to be write
Intend disk.
Copy writing module 404, each copy for being intended to the storage object of write-in are respectively written into virtual disk and correspond to
Each physical disk in.
Wherein, the corresponding each physical disk of same virtual disk is the physical disk of each server from storage cluster
In randomly select.
The storage system of the present invention can also realize the replacement of faulty physical disk and the upper line process of new physics disk,
It is described with reference to Fig. 5.
Fig. 5 is the structure chart of another embodiment of storage system of the present invention.As shown in figure 5, the system 40 further includes：
Failed disk replacement module 506, each position occurred for counting faulty physical disk in disk matrix are
The faulty physical disk of each position randomly selects an alternate physical disk from storage cluster, wherein, each position is replaced
Belong to different physics from the normal physical disk corresponding to the virtual disk belonging to the faulty physical disk of the position for disk
Disk by the copy of the storage object corresponding to the virtual disk belonging to the faulty physical disk of each position, is restored to the position
In the alternate physical disk put.
In one embodiment, storage system 40 further includes：Wire module 508 on new disk,
It is determined as high-frequency physical disk for choosing the physical disk that occurrence number is most in each column of disk matrix, it will
High-frequency physical disk replaces with new physical disk according to preset ratio.
Specifically, wire module 508 on new disk, for choosing high-frequency in each column of disk matrix according to preset ratio
High-frequency physical disk is being replaced the copy of the corresponding storage object in position, is being restored to new by the replacement position of physical disk
In physical disk.
In one embodiment, storage system 40 further includes：Disk matrix builds module 510, for determining disk matrix
Line number and columns, often row one virtual disk is set, physical disk is randomly selected from storage cluster for each virtual disk
It is put into the row that the virtual disk is expert at, establishes each physical disk pass corresponding with the virtual disk of the row per a line
System, to form disk matrix.
One of ordinary skill in the art will appreciate that hardware can be passed through by realizing all or part of step of above-described embodiment
It completes, relevant hardware can also be instructed to complete by program, the program can be stored in a kind of computer-readable
In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all the present invention spirit and
Within principle, any modifications, equivalent replacements and improvements are made should all be included in the protection scope of the present invention.
Claims (10)
1. a kind of storage method, which is characterized in that including：
A virtual disk is randomly selected from disk matrix for the storage object to be write；
The each copy for being intended to the storage object of write-in is respectively written into the corresponding each physical disk of the virtual disk；
Wherein, the corresponding each physical disk of same virtual disk be from storage cluster in the physical disk of each server with
What machine was chosen.
2. it according to the method described in claim 1, it is characterized in that, further includes：
Each position that statistics faulty physical disk occurs in disk matrix；
An alternate physical disk is randomly selected from storage cluster for the faulty physical disk of each position, wherein, Mei Gewei
The replacement disk put belongs to different from the normal physical disk corresponding to the virtual disk belonging to the faulty physical disk of the position
Physical disk；
By the copy of the storage object corresponding to the virtual disk belonging to the faulty physical disk of each position, the position is restored to
Alternate physical disk in.
3. method according to claim 1 or 2, which is characterized in that further include：
It chooses the physical disk that occurrence number is most in each column of the disk matrix and is determined as high-frequency physical disk；
The high-frequency physical disk is replaced with into new physical disk according to preset ratio.
4. according to the method described in claim 3, it is characterized in that,
It is described the high-frequency physical disk is replaced with into new physical disk according to preset ratio to include：
The replacement position of the high-frequency physical disk is chosen in each column of the disk matrix according to preset ratio；
By the high-frequency physical disk in the copy of the corresponding storage object in the replacement position, the new physics is restored to
In disk.
5. method according to claim 1 or 2, which is characterized in that further include：
Determine the line number and columns of the disk matrix, often row sets a virtual disk；
Physical disk is randomly selected by each virtual disk from the storage cluster to be put into the row that the virtual disk is expert at；
The correspondence of the virtual disk of each physical disk and the row per a line is established, to form the disk matrix.
6. a kind of storage system, which is characterized in that including：
Virtual disk chooses module, for randomly selecting a virtual disk from disk matrix for the storage object to be write；
Copy writing module, it is corresponding each that each copy for being intended to the storage object of write-in is respectively written into the virtual disk
In a physical disk；
Wherein, the corresponding each physical disk of same virtual disk be from storage cluster in the physical disk of each server with
What machine was chosen.
7. system according to claim 6, which is characterized in that further include：
Failed disk replacement module, each position occurred for counting faulty physical disk in disk matrix are each position
The faulty physical disk put randomly selects an alternate physical disk from storage cluster, wherein, the replacement disk of each position
Belong to different physical disks from the normal physical disk corresponding to the virtual disk belonging to the faulty physical disk of the position, it will
The copy of the storage object corresponding to virtual disk belonging to the faulty physical disk of each position is restored to the replacement of the position
In physical disk.
8. the system according to claim 6 or 7, which is characterized in that further include：
Wire module on new disk, is determined as height for choosing the physical disk that occurrence number is most in each column of the disk matrix
The high-frequency physical disk is replaced with new physical disk according to preset ratio by frequency physical disk.
9. system according to claim 8, which is characterized in that
Wire module on the new disk, for choosing the high-frequency object in each column of the disk matrix according to preset ratio
The replacement position of disk is managed, by the high-frequency physical disk in the copy of the corresponding storage object in the replacement position, recovery
Into the new physical disk.
10. the system according to claim 6 or 7, which is characterized in that further include：
Disk matrix builds module, and for determining the line number and columns of the disk matrix, often row sets a virtual disk, is
Each virtual disk randomly selects physical disk from the storage cluster and is put into the row that the virtual disk is expert at, and establishes every
The correspondence of each physical disk of a line and the virtual disk of the row, to form the disk matrix.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611066907.3A CN108121497B (en) | 2016-11-29 | 2016-11-29 | Storage method and storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611066907.3A CN108121497B (en) | 2016-11-29 | 2016-11-29 | Storage method and storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108121497A true CN108121497A (en) | 2018-06-05 |
| CN108121497B CN108121497B (en) | 2021-04-30 |
Family
ID=62224104
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611066907.3A Active CN108121497B (en) | 2016-11-29 | 2016-11-29 | Storage method and storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108121497B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110795261A (en) * | 2019-09-26 | 2020-02-14 | 北京浪潮数据技术有限公司 | Virtual disk fault detection method and device |
| CN111338559A (en) * | 2018-12-19 | 2020-06-26 | 深圳市茁壮网络股份有限公司 | Data processing method, user module, information management module and system |
| CN112000282A (en) * | 2020-08-07 | 2020-11-27 | 北京浪潮数据技术有限公司 | Storage double-live method, device and related components |
| CN113515233A (en) * | 2021-05-24 | 2021-10-19 | 锐捷网络股份有限公司 | Block group building method and device and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101566931A (en) * | 2003-08-14 | 2009-10-28 | 克姆佩棱特科技公司 | Virtual disk drive system and method |
| CN101604226A (en) * | 2009-07-14 | 2009-12-16 | 浪潮电子信息产业股份有限公司 | A kind of method that makes up raising performance of storage system in dynamic buffering pond based on virtual RAID |
| US20140281215A1 (en) * | 2011-11-30 | 2014-09-18 | Huawei Technologies Co., Ltd. | Storage method and storage apparatus |
| CN104375784A (en) * | 2014-11-17 | 2015-02-25 | 浙江宇视科技有限公司 | Method and device for lowering complexity of virtual disk management |
-
2016
- 2016-11-29 CN CN201611066907.3A patent/CN108121497B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101566931A (en) * | 2003-08-14 | 2009-10-28 | 克姆佩棱特科技公司 | Virtual disk drive system and method |
| CN101604226A (en) * | 2009-07-14 | 2009-12-16 | 浪潮电子信息产业股份有限公司 | A kind of method that makes up raising performance of storage system in dynamic buffering pond based on virtual RAID |
| US20140281215A1 (en) * | 2011-11-30 | 2014-09-18 | Huawei Technologies Co., Ltd. | Storage method and storage apparatus |
| CN104375784A (en) * | 2014-11-17 | 2015-02-25 | 浙江宇视科技有限公司 | Method and device for lowering complexity of virtual disk management |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111338559A (en) * | 2018-12-19 | 2020-06-26 | 深圳市茁壮网络股份有限公司 | Data processing method, user module, information management module and system |
| CN111338559B (en) * | 2018-12-19 | 2023-11-10 | 深圳市茁壮网络股份有限公司 | Data processing method, user module, information management module and system |
| CN110795261A (en) * | 2019-09-26 | 2020-02-14 | 北京浪潮数据技术有限公司 | Virtual disk fault detection method and device |
| CN110795261B (en) * | 2019-09-26 | 2022-06-17 | 北京浪潮数据技术有限公司 | Virtual disk fault detection method and device |
| CN112000282A (en) * | 2020-08-07 | 2020-11-27 | 北京浪潮数据技术有限公司 | Storage double-live method, device and related components |
| CN113515233A (en) * | 2021-05-24 | 2021-10-19 | 锐捷网络股份有限公司 | Block group building method and device and electronic equipment |
| CN113515233B (en) * | 2021-05-24 | 2024-07-19 | 锐捷网络股份有限公司 | Block assembly method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108121497B (en) | 2021-04-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108052655B (en) | Data writing and reading method | |
| CN108121497A (en) | Storage method and storage system | |
| CN101916173B (en) | RAID (Redundant Array of Independent Disks) based data reading and writing method and system thereof | |
| CN109597567B (en) | Data processing method and device | |
| US20090063807A1 (en) | Data redistribution in shared nothing architecture | |
| CN102508733B (en) | A kind of data processing method based on disk array and disk array manager | |
| US10521304B1 (en) | Multidimensional RAID | |
| CN107025066A (en) | The method and apparatus that data storage is write in the storage medium based on flash memory | |
| CN111857592A (en) | Data storage method and device based on object storage system and electronic equipment | |
| CN103246549B (en) | A kind of method and system of data conversion storage | |
| CN105630919A (en) | Storage method and system | |
| CN107133228A (en) | A kind of method and device of fast resampling | |
| CN108540315A (en) | Distributed memory system, method and apparatus | |
| CN110147203B (en) | File management method and device, electronic equipment and storage medium | |
| CN107357689A (en) | The fault handling method and distributed memory system of a kind of memory node | |
| CN103535014A (en) | A network storage system, data processing method and the client | |
| CN111488127B (en) | Data parallel storage method and device based on disk cluster and data reading method | |
| CN104484131A (en) | Device and corresponding method for processing data of multi-disk servers | |
| CN108153495A (en) | Date storage method, device and data-storage system | |
| CN110032469A (en) | Data processing system and its operating method | |
| US11860746B2 (en) | Resilient data storage system with efficient space management | |
| CN111488124A (en) | Data updating method and device, electronic equipment and storage medium | |
| CN107729182B (en) | Data storage and access method and device | |
| CN107948229A (en) | The method, apparatus and system of distributed storage | |
| CN106547484A (en) | It is a kind of that internal storage data reliability method and system realized based on RAID5 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220126 Address after: 100007 room 205-32, floor 2, building 2, No. 1 and No. 3, qinglonghutong a, Dongcheng District, Beijing Patentee after: Tianyiyun Technology Co.,Ltd. Address before: No.31, Financial Street, Xicheng District, Beijing, 100033 Patentee before: CHINA TELECOM Corp.,Ltd. |
|
| TR01 | Transfer of patent right |