CN103970484A - Method, device and system for controlling data storage - Google Patents

Method, device and system for controlling data storage Download PDF

Info

Publication number
CN103970484A
CN103970484A CN201310047163.0A CN201310047163A CN103970484A CN 103970484 A CN103970484 A CN 103970484A CN 201310047163 A CN201310047163 A CN 201310047163A CN 103970484 A CN103970484 A CN 103970484A
Authority
CN
China
Prior art keywords
memory
data
target data
disk
storer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201310047163.0A
Other languages
Chinese (zh)
Inventor
岳银亮
张子刚
熊劲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Institute of Computing Technology of CAS
Original Assignee
Huawei Technologies Co Ltd
Institute of Computing Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd, Institute of Computing Technology of CAS filed Critical Huawei Technologies Co Ltd
Priority to CN201310047163.0A priority Critical patent/CN103970484A/en
Priority to PCT/CN2014/070520 priority patent/WO2014121674A1/en
Publication of CN103970484A publication Critical patent/CN103970484A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16Error detection or correction of the data by redundancy in hardware
    • G06F11/20Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2056Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
    • G06F11/2069Management of state, configuration or failover
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1471Saving, restoring, recovering or retrying involving logging of persistent data for recovery

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

An embodiment of the invention provides a method, a device and a system for controlling data storage. The method for controlling data storage includes writing target data into a first storage and a second storage which belong to a storage group; synchronizing the target data with a mirror storage of the first storage when storages with residual storage spaces smaller than or equal to threshold values are available in the storage group; labeling the target data in the second storage as invalid. The storage group comprises at least two storages. The mirror storage of the first storage belongs to a storage group which is a mirror of the previous storage group. The method, the device and the system have the advantages that log procedures and synchronization procedures of the target data can be completed; individual log discs for storing the target data can be omitted, so that the performance of the system for controlling data storage is unaffected by the performance of the log discs and can be effectively improved.

Description

Data storage control method, Apparatus and system
Technical field
The embodiment of the present invention relates to computer technology, relates in particular to a kind of data storage control method, Apparatus and system.
Background technology
Along with the fast development of infotech, amount of digital information presents the trend of rapid growth, and return to zero becomes important digital information recording mode.Currently used extensive disk storage system, aspect reliability, performance and capacity, all has outstanding advantage.Be accompanied by the development of magnetic storage technology, the capacity of disk is increasing, for fear of the loss of data in storage system, conventionally adopts the mode that increases redundant data to improve the reliability that data are stored.
Adopting Redundant Array of Independent Disks (RAID) (Redundant Array of Independent Disks, RAID) in 10 disk storage system, the data of each master disk and the mirrored disk mirror image each other that distributes, if comprise the master disk group of N master disk composition, correspondingly comprise the mirrored disk group of N mirrored disk composition.The power consumption state of disk is divided into three kinds of activity (active) state, free time (idle) state and standby (standby) states.Wherein, disk consumes energy the highest in the time of active state, and in the time of idle state, secondly power consumption, consumes energy minimum in the time of standby state.
Adopt in the disk storage system of green Redundant Array of Independent Disks (RAID) (Green Redundant Array of IndependentDisks, GRAID), except master disk and mirrored disk, also comprise a special daily record dish.Each daily record cycle period comprises a daily record cycle and a synchronizing cycle.Within the daily record cycle, all mirrored disks are placed in standby state, and two piece of data of each write operation are written to respectively the position of the target location of master disk and the log space of daily record dish.When the utilization factor of daily record dish is during higher than predefined threshold value, trigger and start synchronizing cycle.Within synchronizing cycle, all mirrored disks are all switched to the active state of high energy consumption by the standby state by low energy consumption, and now all inconsistent data piece on master disk and mirrored disk, is all synchronized to mirrored disk from master disk.
But because daily record dish is single disk, another target data that is written to respectively the data of master disk all needs to be written to this daily record dish, and the Disk bandwidth of single disk is limited, and therefore the performance of disk storage system will be subject to the restriction of daily record dish performance.
Summary of the invention
The embodiment of the present invention provides a kind of data storage control method, Apparatus and system, will be subject to the problem of restriction of daily record dish performance for the performance that solves disk storage system.
First aspect of the embodiment of the present invention is to provide a kind of data storage control method, comprising:
Target data is write to first memory and second memory, and described first memory and described second memory belong to memory set, and described memory set comprises at least two storeies;
While existing residual memory space to be less than or equal to the storer of threshold value in described memory set, described target data is synchronized in the mirroring memory of described first memory, the mirroring memory of first memory belongs to and the described memory set memory set of mirror image each other;
It is invalid that described target data in described second memory is labeled as.
The data storage control method providing in conjunction with first aspect, in the possible implementation of the first, described method also comprises:
While existing residual memory space to be less than or equal to the storer of described threshold value, the mirroring memory of described first memory, from holding state, is transformed into active state or idle condition in described memory set.
The data storage control method providing in conjunction with first aspect, in the possible implementation of the second, described method also comprises:
Described described target data in described second memory is labeled as invalid after, described first memory and described second memory, from active state or idle condition, are transformed into holding state.
The data storage control method providing in conjunction with first aspect, in the third possible implementation, described method also comprises: the described mirroring memory that described target data is synchronized to described first memory comprises:
By the described target data in described second memory, write in the mirroring memory of described first memory.
In conjunction with first aspect or first to three kind of possible implementation, in the 4th kind of possible implementation, there are neighbouring relations in described first memory and described second memory.
In conjunction with first aspect or first to three kind of possible implementation, in the 5th kind of possible implementation, described storer is disk or server.
Second aspect of the embodiment of the present invention is to provide a kind of data recording control apparatus, comprising:
Writing unit, for target data being write to first memory and second memory, described first memory and described second memory belong to memory set, and described memory set comprises at least two storeies;
Processing unit, for in the time that described memory set exists residual memory space to be less than or equal to the storer of threshold value, described target data is synchronized in the mirroring memory of described first memory, the mirroring memory of first memory belongs to and the described memory set memory set of mirror image each other;
Indexing unit is invalid for the described target data of described second memory is labeled as.
The data recording control apparatus providing in conjunction with second aspect, in the possible implementation of the first, described data recording control apparatus also comprises:
Converting unit, when existing residual memory space to be less than or equal to the storer of described threshold value in described memory set, from holding state, is transformed into active state or idle condition by the mirroring memory of described first memory.
The data recording control apparatus providing in conjunction with second aspect, in the possible implementation of the second, described data recording control apparatus also comprises: described converting unit also for:
Described described target data in described second memory is labeled as invalid after, described first memory and described second memory, from active state or idle condition, are transformed into holding state.
The data recording control apparatus providing in conjunction with second aspect, in the third possible implementation, described processing unit also for:
While existing residual memory space to be less than or equal to the storer of threshold value in described memory set, by the described target data in described second memory, write in the mirroring memory of described first memory.
In conjunction with second aspect or first to three kind of possible implementation, in the 4th kind of possible implementation, there are neighbouring relations in described first memory and described second memory.
In conjunction with second aspect or first to three kind of possible implementation, in the 5th kind of possible implementation, described storer is disk or server.
The 3rd aspect of the embodiment of the present invention is to provide a kind of data storage control system, comprise above-mentioned data recording control apparatus and two memory set, mirror each other between described two memory set, each memory set comprises at least two storeies, and described data recording control apparatus communicates to connect respectively and between described two memory set.
The data storage control method that the embodiment of the present invention provides, Apparatus and system, target data is write respectively to first memory and second memory, in the time existing residual memory space to be less than or equal to the storer of threshold value in memory set, target data is write in the mirroring memory of first memory, and this target data in second memory is labeled as invalid, daily record process and the synchronizing process of target data are completed, owing to not needing that daily record disk storage target data is set separately, make the performance of data storage control system no longer be subject to the impact of daily record dish performance, effectively improve the performance of data storage control system.
Brief description of the drawings
The process flow diagram of the data storage control method that Fig. 1 provides for the embodiment of the present invention;
The process flow diagram of another data storage control method that Fig. 2 provides for the embodiment of the present invention;
The process flow diagram of the another data storage control method that Fig. 3 provides for the embodiment of the present invention;
The structural representation of the data recording control apparatus that Fig. 4 provides for the embodiment of the present invention;
The structural representation of another data recording control apparatus that Fig. 5 provides for the embodiment of the present invention;
The structural representation of the another data recording control apparatus that Fig. 6 provides for the embodiment of the present invention;
The structural representation of the data storage control system that Fig. 7 provides for the embodiment of the present invention.
Embodiment
Be subject to the problem of daily record dish performance limitations in order to solve the performance of disk storage system, daily record dish is set no longer separately in various embodiments of the present invention, but a copy of data to be written is stored in a storer of memory set, its another copy is stored in the virtual log space being formed by the idle storage space of another storer in this memory set, thereby makes the performance of disk storage system no longer be subject to the restriction of daily record dish performance.
Storer described in various embodiments of the present invention can be disk or server, and wherein server can be data center or the equipment with memory function.Data storage control method described in various embodiments of the present invention, can be applied in the data storage control system of disk storage system or other kinds.
Data recording control apparatus described in various embodiments of the present invention can be the functional module in server or equipment, can be also opertaing device independently.
The process flow diagram of the data storage control method that Fig. 1 provides for the embodiment of the present invention, as shown in Figure 1, the method comprises:
101, target data is write to first memory and second memory.
Wherein, described first memory and described second memory belong to memory set, and described memory set comprises at least two storeies.Need the positional information of two copies storing of record object data, i.e. the corresponding relation of two copies of target data simultaneously.
Concrete, comprise data recording control apparatus and two memory set at data storage control system, mirror each other between these two memory set, that is to say, these two memory set can be used as mirroring memory group each other.When one of them memory set is during as primary memory group, another is as the mirroring memory group of primary memory group; In the time that mirroring memory consists of current primary memory group, original primary memory consists of current mirroring memory group.
Each memory set comprises at least two storeies, and the mirroring memory of each storer belongs to another memory set.Two storeies in a memory set are called to first memory and second memory, and first memory and second memory belong to same memory set; Correspondingly, the mirroring memory of first memory, and the mirroring memory of second memory belongs to another memory set.
Alleged target data in various embodiments of the present invention, is the data in current data storage control system to be written.When target data stores this data storage control system into, need to write respectively in the virtual log space in first memory and second memory.In the time that memory set comprises three or more storer, for the target data writing in each storer, all write in the virtual log space of another storer in this memory set simultaneously.Data recording control apparatus can carry out record to the memory location of each target data by the mode of tables of data, and upgrades in the time there is change.
In various embodiments of the present invention, taking first memory and second memory as example describes, for the data storage control method between other every two storeies in memory set, can adopt similar implementation.
102,, while existing residual memory space to be less than or equal to the storer of threshold value in described memory set, described target data is synchronized in the mirroring memory of described first memory.
Wherein, the mirroring memory of first memory belongs to and the described memory set memory set of mirror image each other.According to the positional information of two copies storing of target data, target data is synchronized in the mirroring memory of described first memory.
Concrete, in data recording control apparatus, setting in advance a threshold value, the size of this threshold value can arrange as required.The residual memory space of each storer in data recording control apparatus monitoring memory set, in the time occurring that residual memory space is less than or equal to the storer of this threshold value in the each storer that monitors memory set, data recording control apparatus is by this target data being stored in first memory, or be stored in this target data in the virtual log space of second memory, be written in the mirroring memory of first memory.
103, the described target data in described second memory is labeled as invalid.
Concrete, data recording control apparatus in the mirroring memory that target data is written to first memory after, it is invalid that this target data in virtual log space that is stored in second memory is labeled as, can be for writing other data thereby store the storage space of this target data.
Data recording control apparatus writes target data in the virtual log space of second memory, is daily record process; This target data being written in the mirroring memory of first memory, is synchronizing process.Therefore,, through after above-mentioned steps, data recording control apparatus has been realized the storage to data in data storage control system.
If each memory set comprises multiple storeies, when data recording control apparatus monitors while wherein existing the residual memory space of one or more storeies to be less than or equal to this threshold value, the target data in each storer of this memory set is all synchronized in the memory set with its mirror image.
The data storage control method that the embodiment of the present invention provides, target data is write respectively to first memory and second memory, in the time existing residual memory space to be less than or equal to the storer of threshold value in memory set, target data is write in the mirroring memory of first memory, and this target data in second memory is labeled as invalid, daily record process and the synchronizing process of target data are completed, owing to not needing that daily record disk storage target data is set separately, make the performance of data storage control system no longer be subject to the impact of daily record dish performance, effectively improve the performance of data storage control system.
The process flow diagram of another data storage control method that Fig. 2 provides for the embodiment of the present invention, as shown in Figure 2, the method comprises:
201, target data is write to first memory and second memory.
Concrete, can be referring to the implementation described in step 101.
202, while existing residual memory space to be less than or equal to the storer of threshold value in described memory set, by the mirroring memory of described first memory from holding state, be transformed into active state or idle condition, and by the described target data in described second memory, write in the mirroring memory of described first memory.Concrete, can be referring to the implementation described in step 102, and monitor while occurring that residual memory space is less than or equal to the storer of threshold value in memory set at data recording control apparatus, can be preferably by the target data being stored in the virtual log space of second memory, be written in the mirroring memory of first memory.
In order to reduce energy consumption, before data recording control apparatus monitors and occurs that residual memory space is less than or equal to the storer of threshold value in memory set, can the mirroring memory of first memory and the mirroring memory of second memory be set to the holding state of low energy consumption; Or, can, by the each storer in the memory set at the mirroring memory place of the mirroring memory of first memory and second memory, all be set to holding state.
When data recording control apparatus monitors while occurring that residual memory space is less than or equal to the storer of threshold value in memory set, then the mirroring memory of first memory and the mirroring memory of second memory are set to active state or idle condition; Or, can, by the each storer in the memory set at the mirroring memory place of the mirroring memory of first memory and second memory, be set to active state or idle condition.So that the storer in this memory set can enter can data writing duty.
Further, there are neighbouring relations in described first memory and described second memory, and the mirroring memory of described first memory and the mirroring memory of described second memory exist neighbouring relations.
Concrete, in daily record process, store respectively the storer of two target datas, can be the storer that has neighbouring relations.That is to say, if memory set comprises storer 1, storer 2, storer 3 and storer 4, storer 1 and storer 2 can be respectively as first memory and second memories; Storer 2 and storer 3 can be respectively as first memory and second memories; Storer 3 and storer 4 can be respectively as first memory and second memories; Storer 4 and storer 1 can be respectively as first memory and second memories.
Correspondingly, between corresponding mirroring memory, also can there are neighbouring relations respectively with first memory and second memory.
203, the described target data in described second memory is labeled as invalid, described first memory and described second memory, from active state or idle condition, are transformed into holding state.
Concrete, can be referring to the implementation described in step 103, and described described target data in described second memory is labeled as invalid after, described first memory and described second memory, from active state or idle condition, are transformed into holding state.
Data recording control apparatus is by this target data in the virtual log space of second memory, be labeled as invalid before, first memory and second memory are in active state or idle condition; Or the storer in the memory set at first memory and second memory place is all in active state or idle condition.
Because data recording control apparatus is by this target data in the virtual log space of second memory, be labeled as invalid after, synchronizing process completes.In order to reduce energy consumption, data recording control apparatus can first memory and second memory be set to holding state; Or the storer in the memory set at first memory and second memory place is all set to holding state.
The mirroring memory of first memory becomes current first memory, and the mirroring memory of second memory becomes current second memory, and above-mentioned steps is carried out in circulation successively.
The data storage control method that the embodiment of the present invention provides, target data is write respectively to first memory and second memory, in the time existing residual memory space to be less than or equal to the storer of threshold value in memory set, target data is write in the mirroring memory of first memory, and this target data in second memory is labeled as invalid, daily record process and the synchronizing process of target data are completed, owing to not needing that daily record disk storage target data is set separately, make the performance of data storage control system no longer be subject to the impact of daily record dish performance, effectively improve the performance of data storage control system, by according to the implementation progress of daily record process and synchronizing process, duty to storer in two memory set is adjusted, the current holding state that does not need the storer of data writing to be set to low energy consumption, is conducive to reduce the energy consumption of data storage control system.
The process flow diagram of the another data storage control method that Fig. 3 provides for the embodiment of the present invention, as shown in Figure 3, in the time that described storer is disk, the method comprises: in the situation that storer is disk, memory set is master disk group and mirrored disk group, and the storer in master disk group is master disk; Storer in mirrored disk group is mirrored disk.
Utilize storage space idle on the disk of RAID10, as virtual log space, one of them target data in two target datas of store data, i.e. daily record data.Idle storage space on master disk, after virtual log space uses, is entered to synchronous phase, and the idle storage space on continuation use mirrored disk is as virtual log space.After the data of the idle storage space on master disk are synchronized to mirrored disk, because this part storage space is released, follow-up continuation used as virtual log space.
In RAID10 controller, increase a data block and remap module, the position of two target datas of recording data blocks, data are by after synchronous, and data block remaps the corresponding map information recording in module and will be updated.
301, data storage control system initialization.
Concrete, data recording control apparatus is in the time that system is initial, and all master disk is set to active state or idle condition, and all mirrored disks are set to holding state, to reduce energy consumption.
302, data storage control system enters the daily record stage of master disk group.
Concrete, data recording control apparatus, in the daily record stage of master disk group, writes two copies of data to be written respectively in the virtual log space of corresponding master disk and master disk group.Now, master disk is active state or idle condition, and mirrored disk is holding state.Need the positional information of two copies storing of record object data, i.e. the corresponding relation of two copies of target data simultaneously.
303,, while being used up in the virtual log space of master disk group, data storage control system enters the synchronous phase of master disk group.
Concrete, data recording control apparatus is in the time of occupied being finished in the virtual log space of master disk group, and all mirrored disks are set to active state or idle condition, by the copies synchronized in the virtual log space of master disk group in mirrored disk.According to the positional information of two copies storing of target data, target data is synchronized in mirrored disk.
And data recording control apparatus is invalid by the data markers in the virtual log space of master disk group, or the virtual log space of master disk group is discharged.
Data recording control apparatus, after the synchronous phase of master disk group finishes, is switched to holding state by all master disk, to reduce energy consumption.
304, data storage control system enters the daily record stage of mirrored disk group.
Concrete, data recording control apparatus is in the daily record stage of mirrored disk group, and keeping all mirrored disks is active state or idle condition, and all master disk is holding state, to reduce energy consumption.
Data recording control apparatus writes two copies of current data to be written respectively in the virtual log space of corresponding mirrored disk and mirrored disk group.
305,, while being used up in the virtual log space of mirrored disk group, data storage control system enters the synchronous phase of mirrored disk group.
Concrete, data recording control apparatus is in the time of occupied being finished in the virtual log space of mirrored disk group, and all master disk is set to active state or idle condition, and the target data in the virtual log space of mirrored disk group is synchronized in master disk.
And data recording control apparatus is invalid by the data markers in the virtual log space of mirrored disk group, or the virtual log space of mirrored disk group is discharged.
Data recording control apparatus, after the synchronous phase of mirrored disk group finishes, is switched to holding state by all mirrored disks, to reduce energy consumption.
After execution of step 305, return to execution step 302.
The situation that comprises data recording control apparatus and eight disks taking data storage control system, as example, describes.
Eight hard disk composition RAID10.These eight disks form four groups, and every group comprises a master disk and a mirrored disk.Four master disk D1, D2, D3 and D4 composition master disk groups; Four mirrored disk D5, D6, D7 and D8 composition mirrored disk groups.D5 is the mirrored disk of D1; D6 is the mirrored disk of D2; D7 is the mirrored disk of D3; D8 is the mirrored disk of D4.
In the time of system initialization, data recording control apparatus D1, D2, D3 and D4 are set to active state or idle condition, D5, D6, D7 and D8 are set to holding state, and utilize the idle storage space of D1, D2, D3 and D4 as the virtual log space of master disk group.
For two copies of data to be written, in i disk, store one of them copy, another copy is stored in the virtual log space of i+1 disk, and the rest may be inferred.
After data storage control system carries out the daily record stage of T1, data D1T1 is written into the virtual log space of log space and the disk D2 of disk D1; Data D2T1 is written into the virtual log space of log space and the disk D3 of disk D2; Data D3T1 is written into the virtual log space of log space and the disk D4 of disk D3; Data D4T1 is written into the virtual log space of log space and the disk D1 of disk D4.
After the virtual log space of master disk group is fully written, data storage control system enters the synchronous phase of T1.
Data recording control apparatus wakes all mirrored disks up, and mirrored disk is set to active state or idle condition.
After data storage control system enters the synchronous phase of T1, data recording control apparatus by the copies synchronized on the virtual log space of master disk group to the mirrored disk of mirrored disk group.
That is to say, in the synchronous phase of T1, be stored in data D1T1 in the virtual log space of disk D2 and be synchronized to the log space of disk D5; Be stored in data D2T1 in the virtual log space of disk D3 and be synchronized to the log space of disk D6; Be stored in data D3T1 in the virtual log space of disk D4 and be synchronized to the log space of disk D7; Be stored in data D4T1 in the virtual log space of disk D1 and be synchronized to the log space of disk D8.
Data recording control apparatus is invalid by the data markers in the virtual log space of master disk group, and all master disk is set to holding state.
Data storage control system, after the synchronous phase of T1 finishes, enters the daily record stage of T2.Utilize the idle storage space of each mirrored disk as the virtual log space of mirrored disk group.
In the daily record stage of T2, data D1T2 is written into the virtual log space of log space and the disk D6 of disk D5; Data D2T2 is written into the virtual log space of log space and the disk D7 of disk D6; Data D3T2 is written into the virtual log space of log space and the disk D8 of disk D7; Data D4T2 is written into the virtual log space of log space and the disk D5 of disk D8.
After the virtual log space of mirrored disk group is fully written, data storage control system enters the synchronous phase of T2.
Data recording control apparatus wakes all master disk up, and master disk is set to active state or idle condition.Utilize in master disk group d/d virtual log space as new virtual log space.
After data storage control system enters the synchronous phase of T2, data recording control apparatus is synchronized to the datum target data on the virtual log space of mirrored disk group on the master disk of master disk group.
That is to say, in the synchronous phase of T2, be stored in data D1T2 in the virtual log space of disk D6 and be synchronized to the log space of disk D1; Be stored in data D2T2 in the virtual log space of disk D7 and be synchronized to the log space of disk D2; Be stored in data D3T2 in the virtual log space of disk D8 and be synchronized to the log space of disk D33; Be stored in data D4T2 in the virtual log space of disk D5 and be synchronized to the log space of disk D4.
Data recording control apparatus is invalid by the data markers in the virtual log space of mirrored disk group, and all mirrored disks are set to holding state.
Data storage control system, after the synchronous phase of T2 finishes, enters the daily record stage of T3.Utilize the idle storage space of each mirrored disk as the virtual log space of mirrored disk group.
The implementation in the implementation in the daily record stage of T3 and the daily record stage of T1 is similar.Be equivalent to the daily record stage of T1, synchronous phase, the daily record stage of T2 and the cycling of the synchronous phase of T2 formation of T1.
Owing to utilizing the idle storage space of disk as virtual log space in various embodiments of the present invention, effectively improve the utilization factor of disk; And because the target data in each disk has Backup Data on other disk, ensure the reliability of data storage control system; In addition, by master disk and/or mirrored disk are changed between active state, idle condition and holding state, make master disk group and mirrored disk group all shorter in the time of active state or idle condition, effectively reduced the energy consumption of data storage control system.
The structural representation of the data recording control apparatus that Fig. 4 provides for the embodiment of the present invention, as shown in Figure 4, this data recording control apparatus comprises: writing unit 11, processing unit 12 and indexing unit 13.
Writing unit 11, for target data being write to first memory and second memory, described first memory and described second memory belong to memory set, and described memory set comprises at least two storeies;
Processing unit 12, for in the time that described memory set exists residual memory space to be less than or equal to the storer of threshold value, described target data is synchronized in the mirroring memory of described first memory, the mirroring memory of first memory belongs to and the described memory set memory set of mirror image each other;
Indexing unit 13 is invalid for the described target data of described second memory is labeled as.
The data storage control method that the embodiment of the present invention provides, target data is write respectively to first memory and second memory, in the time existing residual memory space to be less than or equal to the storer of threshold value in memory set, target data is write in the mirroring memory of first memory, and this target data in second memory is labeled as invalid, daily record process and the synchronizing process of target data are completed, owing to not needing that daily record disk storage target data is set separately, make the performance of data storage control system no longer be subject to the impact of daily record dish performance, effectively improve the performance of data storage control system.
Further, this data recording control apparatus can also comprise: record cell, and for the positional information of two copies storing of record object data, the i.e. corresponding relation of two copies of target data.This processing unit, the concrete positional information according to two copies storing of target data is synchronized to target data in the mirroring memory of described first memory.
The structural representation of another data recording control apparatus that Fig. 5 provides for the embodiment of the present invention, as shown in Figure 5, this data recording control apparatus can also comprise: converting unit 14.
Converting unit 14, when existing residual memory space to be less than or equal to the storer of described threshold value in described memory set, from holding state, is transformed into active state or idle condition by the mirroring memory of described first memory.
Further, described converting unit 14 also for:
Described described target data in described second memory is labeled as invalid after, described first memory and described second memory, from active state or idle condition, are transformed into holding state.
Further, described processing unit 12 also for:
While existing residual memory space to be less than or equal to the storer of threshold value in described memory set, by the described target data in described second memory, write in the mirroring memory of described first memory.
Further, there are neighbouring relations in described first memory and described second memory.
Further, described storer is disk or server.
Concrete, the data recording control apparatus that the embodiment of the present invention provides carries out the method that data storage is controlled, can be referring to the implementation described in the embodiment of the method for above-mentioned correspondence.
The data storage control method that the embodiment of the present invention provides, target data is write respectively to first memory and second memory, in the time existing residual memory space to be less than or equal to the storer of threshold value in memory set, target data is write in the mirroring memory of first memory, and this target data in second memory is labeled as invalid, daily record process and the synchronizing process of target data are completed, owing to not needing that daily record disk storage target data is set separately, make the performance of data storage control system no longer be subject to the impact of daily record dish performance, effectively improve the performance of data storage control system, by according to the implementation progress of daily record process and synchronizing process, duty to storer in two memory set is adjusted, the current holding state that does not need the storer of data writing to be set to low energy consumption, is conducive to reduce the energy consumption of data storage control system.
The structural representation of the another data recording control apparatus that Fig. 6 provides for the embodiment of the present invention, as shown in Figure 6, this data recording control apparatus comprises:
Processor 21, storer 22, bus 23 and communication interface 24.Between processor 21, storer 22 and communication interface 24, connect by bus 23 and complete mutual communication.
Processor 21 may be monokaryon or multinuclear CPU (central processing unit) (Central Processing Unit, CPU), or be specific integrated circuit (Application Specific Integrated Circuit, ASIC), or for being configured to implement one or more integrated circuit of the embodiment of the present invention.
Storer 22 can be high-speed RAM storer, can be also nonvolatile memory (non-volatile memory), for example at least one magnetic disk memory.
Storer 22 is for depositing program 221.Concrete, in program 221, can comprise program code, described program code comprises computer-managed instruction.
Processor 21 working procedures 221, to carry out:
Target data is write to first memory and second memory, and described first memory and described second memory belong to memory set, and described memory set comprises at least two storeies;
While existing residual memory space to be less than or equal to the storer of threshold value in described memory set, described target data is synchronized in the mirroring memory of described first memory, the mirroring memory of first memory belongs to and the described memory set memory set of mirror image each other;
It is invalid that described target data in described second memory is labeled as.
Concrete, the data recording control apparatus that the embodiment of the present invention provides carries out the method that data storage is controlled, can be referring to the implementation described in the embodiment of the method for above-mentioned correspondence.
The structural representation of the data storage control system that Fig. 7 provides for the embodiment of the present invention, as shown in Figure 7, this data storage control system comprises data recording control apparatus 1 and two memory set 2 as shown in Fig. 4, Fig. 5 or Fig. 6, mirror each other between described two memory set 2, each memory set comprises at least two storeies, and described data recording control apparatus 1 communicates to connect respectively and between described two memory set 2.
Concrete, the data storage control system that the embodiment of the present invention provides carries out the method that data storage is controlled, can be referring to the implementation described in the embodiment of the method for above-mentioned correspondence.
One of ordinary skill in the art will appreciate that: all or part of step that realizes above-mentioned each embodiment of the method can complete by the relevant hardware of programmed instruction.Aforesaid program can be stored in a computer read/write memory medium.This program, in the time carrying out, is carried out the step that comprises above-mentioned each embodiment of the method; And aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CDs.
Finally it should be noted that: above each embodiment, only in order to technical scheme of the present invention to be described, is not intended to limit; Although the present invention is had been described in detail with reference to aforementioned each embodiment, those of ordinary skill in the art is to be understood that: its technical scheme that still can record aforementioned each embodiment is modified, or some or all of technical characterictic is wherein equal to replacement; And these amendments or replacement do not make the essence of appropriate technical solution depart from the scope of various embodiments of the present invention technical scheme.

Claims (13)

1. a data storage control method, is characterized in that, comprising:
Target data is write to first memory and second memory, and described first memory and described second memory belong to memory set, and described memory set comprises at least two storeies;
While existing residual memory space to be less than or equal to the storer of threshold value in described memory set, described target data is synchronized in the mirroring memory of described first memory, the mirroring memory of first memory belongs to and the described memory set memory set of mirror image each other;
It is invalid that described target data in described second memory is labeled as.
2. data storage control method according to claim 1, is characterized in that, described method also comprises:
While existing residual memory space to be less than or equal to the storer of described threshold value, the mirroring memory of described first memory, from holding state, is transformed into active state or idle condition in described memory set.
3. data storage control method according to claim 1, is characterized in that, described method also comprises:
Described described target data in described second memory is labeled as invalid after, described first memory and described second memory, from active state or idle condition, are transformed into holding state.
4. data storage control method according to claim 1, is characterized in that, the described mirroring memory that described target data is synchronized to described first memory comprises:
By the described target data in described second memory, write in the mirroring memory of described first memory.
5. according to arbitrary described data storage control method in claim 1-4, it is characterized in that, there are neighbouring relations in described first memory and described second memory.
6. according to arbitrary described data storage control method in claim 1-4, it is characterized in that, described storer is disk or server.
7. a data recording control apparatus, is characterized in that, comprising:
Writing unit, for target data being write to first memory and second memory, described first memory and described second memory belong to memory set, and described memory set comprises at least two storeies;
Processing unit, for in the time that described memory set exists residual memory space to be less than or equal to the storer of threshold value, described target data is synchronized in the mirroring memory of described first memory, the mirroring memory of first memory belongs to and the described memory set memory set of mirror image each other;
Indexing unit is invalid for the described target data of described second memory is labeled as.
8. data recording control apparatus according to claim 7, is characterized in that, described data recording control apparatus also comprises:
Converting unit, when existing residual memory space to be less than or equal to the storer of described threshold value in described memory set, from holding state, is transformed into active state or idle condition by the mirroring memory of described first memory.
9. data recording control apparatus according to claim 7, is characterized in that, described converting unit also for:
Described described target data in described second memory is labeled as invalid after, described first memory and described second memory, from active state or idle condition, are transformed into holding state.
10. data recording control apparatus according to claim 7, is characterized in that, described processing unit also for:
While existing residual memory space to be less than or equal to the storer of threshold value in described memory set, by the described target data in described second memory, write in the mirroring memory of described first memory.
11. according to arbitrary described data recording control apparatus in claim 7-10, it is characterized in that, described first memory and described second memory exist neighbouring relations.
12. according to arbitrary described data recording control apparatus in claim 7-10, it is characterized in that, described storer is disk or server.
13. 1 kinds of data storage control systems, it is characterized in that, comprise as data recording control apparatus and two memory set as described in arbitrary in claim 7-12, mirror each other between described two memory set, each memory set comprises at least two storeies, and described data recording control apparatus communicates to connect respectively and between described two memory set.
CN201310047163.0A 2013-02-06 2013-02-06 Method, device and system for controlling data storage Pending CN103970484A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201310047163.0A CN103970484A (en) 2013-02-06 2013-02-06 Method, device and system for controlling data storage
PCT/CN2014/070520 WO2014121674A1 (en) 2013-02-06 2014-01-13 Method, device and system for controlling data storing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310047163.0A CN103970484A (en) 2013-02-06 2013-02-06 Method, device and system for controlling data storage

Publications (1)

Publication Number Publication Date
CN103970484A true CN103970484A (en) 2014-08-06

Family

ID=51240043

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310047163.0A Pending CN103970484A (en) 2013-02-06 2013-02-06 Method, device and system for controlling data storage

Country Status (2)

Country Link
CN (1) CN103970484A (en)
WO (1) WO2014121674A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107229535B (en) * 2017-05-23 2020-01-21 杭州宏杉科技股份有限公司 Multi-copy storage method, storage device and data reading method for data block

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060004973A1 (en) * 2004-06-30 2006-01-05 Sardella Steven D System for caching data
CN101520688A (en) * 2009-03-26 2009-09-02 成都市华为赛门铁克科技有限公司 Method, device and system for storing data
CN101840313A (en) * 2010-04-13 2010-09-22 杭州华三通信技术有限公司 LUN mirror image processing method and equipment
CN102081509A (en) * 2009-11-30 2011-06-01 英业达股份有限公司 Method and device for reading RAID1 (Redundant Array of Inexpensive Disk 1) equipment

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101984400B (en) * 2010-11-05 2012-10-03 成都市华为赛门铁克科技有限公司 RAID control method, device and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060004973A1 (en) * 2004-06-30 2006-01-05 Sardella Steven D System for caching data
CN101520688A (en) * 2009-03-26 2009-09-02 成都市华为赛门铁克科技有限公司 Method, device and system for storing data
CN102081509A (en) * 2009-11-30 2011-06-01 英业达股份有限公司 Method and device for reading RAID1 (Redundant Array of Inexpensive Disk 1) equipment
CN101840313A (en) * 2010-04-13 2010-09-22 杭州华三通信技术有限公司 LUN mirror image processing method and equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107229535B (en) * 2017-05-23 2020-01-21 杭州宏杉科技股份有限公司 Multi-copy storage method, storage device and data reading method for data block

Also Published As

Publication number Publication date
WO2014121674A1 (en) 2014-08-14

Similar Documents

Publication Publication Date Title
US7330931B2 (en) Method and system for accessing auxiliary data in power-efficient high-capacity scalable storage system
KR20210079394A (en) ZNSs in Solid State Drives
CN103136074B (en) Data storage method and data storage system of multiple disk array systems
CN101976175B (en) Method for constructing disk array by horizontal grouping parallel concentrated verification
EP0874313A2 (en) Method of storing data in a redundant array of disks
US8201001B2 (en) Method for optimizing performance and power usage in an archival storage system by utilizing massive array of independent disks (MAID) techniques and controlled replication under scalable hashing (CRUSH)
CN101782875B (en) Storage unit and data storage method
US20220156000A1 (en) Data Aggregation In ZNS Drive
CN104778018A (en) Broad-strip disk array based on asymmetric hybrid type disk image and storage method of broad-strip disk array
CN102096561B (en) Hierarchical data storage processing method, device and storage equipment
JP4687814B2 (en) Virtual tape device, data backup method and recording medium
CN104615381B (en) A kind of redundant arrays of inexpensive disks of video monitoring system
CN114730604A (en) Dynamic ZNS open zone activity restriction
CN103092765B (en) Solid-state memory system, device and method for writing data
CN101976177A (en) Method for constructing vertical grouped disk array capable of being subject to parallel centralized check
CN102314321B (en) Storage system, utilization storage system carry out the method and apparatus of data access
CN103019623A (en) Memory disc processing method and device
US20090204760A1 (en) Storage apparatus, relay device, and method of controlling operating state
CN102789422B (en) The method for writing data of solid state hard disc
CN102520885A (en) Data management system for hybrid hard disk
CN101794246B (en) Backup storage system, backup system, data backup method and recovery method
CN101520688B (en) Method, device and system for storing data
US8171324B2 (en) Information processing device, data writing method, and program for the same
CN102214073A (en) Hot spare switching control method of redundant array of independent disks (RAID) and controller
CN104572374A (en) Storage processing method, storage processing device and storage equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20140806