CN102262511A - Cache management system and method for RAID (Redundant Array of Independent Disks) - Google Patents
Cache management system and method for RAID (Redundant Array of Independent Disks) Download PDFInfo
- Publication number
- CN102262511A CN102262511A CN2011101590892A CN201110159089A CN102262511A CN 102262511 A CN102262511 A CN 102262511A CN 2011101590892 A CN2011101590892 A CN 2011101590892A CN 201110159089 A CN201110159089 A CN 201110159089A CN 102262511 A CN102262511 A CN 102262511A
- Authority
- CN
- China
- Prior art keywords
- module
- raid
- characteristic bar
- data
- management system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Memory System Of A Hierarchy Structure (AREA)
Abstract
The invention relates to the technical field of computer hard disks, in particular to a cache management system and method for a RAID (Redundant Array of Independent Disks). The management system comprises a target module (1), a cache management module (2), a RAID nucleus module (3), an input/output scheduling module and a starter module which are sequentially connected. The cache management system not only can conveniently manage storage blocks in a cache, but also facilitates data communication with a next stage, and meanwhile has a good mechanism which can reduce read-write of magnetic discs, thus the efficiency and the performance of a whole system are improved.
Description
Technical field
The present invention relates to the hard disc of computer technical field, particularly a kind of raid-array (Redundant Array of Independent Disk, cache management system RAID) and method of being used for.
Background technology
In recent years, computer network is the fast development of multimedia technology especially, it is used and has expanded and be penetrated into the every field of economy, politics, social life, along with the continuous expansion and the raising of its range of application and level, to the also constantly higher requirement of proposition of memory capacity, read or write speed and error correction tolerance limit ability of computer data information.At this requirement, the RAID technology provides good solution, and has therefore obtained development rapidly and application widely.
RAID high-speed cache (Cache) technology is in recent years, in the disk storage technology field, and development very fast, as high-end storage, Cache has been the core place of whole storage, is exactly the low and middle-end storage, also has very big Cache to exist.
Cache can effectively improve the I/O performance of system, its principle is that the data that CPU will write disk are write earlier among the Cache that is made of RAM, write in the disk by Cache, perhaps earlier the data on the disk are read among the Cache, CPU reads data from Cache more then.In the RAID system, Cache is the part of Installed System Memory, and its speed is than fast many of the speed of hard disk.Therefore, the design of Cache part has great influence to the efficient of whole RAID system.
The Cache capacity is compared with the next stage storer, be very little, the just subclass of next stage memory content that it is preserved, content exchange between Cache and the next stage storer is unit with the piece generally, but in prior art storage block can't be efficiently in Cache with the next stage storer in data exchange.
Summary of the invention
(1) technical matters that will solve
The technical problem to be solved in the present invention is: storage block in Cache how organizing ability efficiently with the next stage storer in data exchange.
(2) technical scheme
For solving the problems of the technologies described above, the invention provides the cache management system of a kind of RAID of being used for, comprising: the object machine module of Lian Jieing, caching management module, RAID nucleus module, input/output scheduling module and starter module successively,
Described object machine module is used to receive the input and output request from main frame, and this input and output request is encapsulated, and is sent to described caching management module after the encapsulation;
Described caching management module, be used for and split into the certain characteristics data strip through the input and output request after the encapsulation, and judge one by one according to read-write type whether the data of described certain characteristics data strip correspondence hit, the characteristic bar that hits is sent to described RAID nucleus module, otherwise, the solution that must conflict by the time of miss characteristic bar;
Described RAID nucleus module is used to receive the described characteristic bar that hits, and calculates the RAID rank of the described characteristic bar that hits, and successively the described characteristic bar that hits is sent to described input/output scheduling module according to other height of described RAID level;
Described input/output scheduling module is used for receiving successively the described characteristic bar that hits, and successively the characteristic bar that receives is positioned over the tail of the queue of request queue, and is sent to described starter module from team's head taking-up characteristic bar successively;
Described starter module is used for according to the godet module on the described characteristic bar startup disk, to finish the read-write operation of physical hard disk.
Preferably, the cache management system of the described RAID of being used for also comprises: interconnective configurating terminal module and global configuration module,
Described configurating terminal module is used for showing the duty of described global configuration module on described main frame, and receives the control command from described main frame;
Described global configuration module is used for other modules on the cache management system of the described RAID of being used for of load or unload, and the external interface of other modules on the cache management system of the described RAID of being used for is provided.
The invention also discloses a kind of management method of utilizing the cache management system of the described RAID of being used for, may further comprise the steps:
S1: receive input and output request, and this input and output request is encapsulated from main frame;
S2: will split into the certain characteristics data strip through the input and output request after the encapsulation, and judge one by one according to read-write type whether the data of described certain characteristics data strip correspondence hit, the characteristic bar execution in step S3 that hits, otherwise, the solution that must conflict by the time of miss characteristic bar;
S3: the RAID rank of calculating the described characteristic bar that hits;
S4: successively the characteristic bar that receives is positioned over the tail of the queue of request queue according to other height of described RAID level, and takes out the characteristic bar from team's head successively;
S5: according to the godet module on the described characteristic bar startup disk, to finish the read-write operation of physical hard disk.
Preferably, the determination methods that judgment data is hit among the step S2 is specially:
If read request and data hit, the data that then described characteristic bar corresponding address section is stored are the data that need read, and the described characteristic bar corresponding address section data of being stored are not upgraded by write request or the read request data are not hit renewal;
If write request and data hit, then described characteristic bar corresponding address section exists and is unoccupied, and perhaps described characteristic bar corresponding address section does not exist.
Preferably, calculating other algorithm of RAID level among the step S3 comprises: RAID0, RAID1, RAID5, RAID6 and disk cluster.
Preferably, press described RAID rank from high to low among the step S4.
(3) beneficial effect
The present invention not only can manage each storage block among the Cache easily, and is convenient to exchange with the next stage data, and having preferably simultaneously, mechanism can reduce the read-write of disk to improve overall system efficiency and performance.
Description of drawings
Fig. 1 is the structured flowchart according to the cache management system that is used for RAID of one embodiment of the present invention.
Embodiment
Below in conjunction with drawings and Examples, the specific embodiment of the present invention is described in further detail.Following examples are used to illustrate the present invention, but are not used for limiting the scope of the invention.
The object of the present invention is to provide the system of the cache management of a kind of RAID of being used for, this system can make Cache carry out data efficiently with the next stage storage system easily and exchange.
Fig. 1 is according to the process flow diagram of the cache management system that is used for RAID of one embodiment of the present invention, comprising: the object machine module 1 of Lian Jieing, caching management module 2, RAID nucleus module 3, input/output scheduling module 4 and starter module 5 successively,
Described object machine module 1 is used to receive the input and output request from main frame 8, and this input and output request is encapsulated, and is sent to described caching management module 2 after the encapsulation;
Described caching management module 2, be used for and split into the certain characteristics data strip through the input and output request after the encapsulation, and judge one by one according to read-write type whether the data of described certain characteristics data strip correspondence hit, the characteristic bar that hits is sent to described RAID nucleus module 3, otherwise, the solution that must conflict by the time of miss characteristic bar;
Described RAID nucleus module 3, be used to receive the described characteristic bar that hits, and calculate the RAID rank of the described characteristic bar that hits, successively the described characteristic bar that hits is sent to described input/output scheduling module 4 according to other height of described RAID level;
Described input/output scheduling module 4 is used for receiving successively the described characteristic bar that hits, and successively the characteristic bar that receives is positioned over the tail of the queue of request queue, and is sent to described starter module 5 from team's head taking-up characteristic bar successively;
Described starter module 5 is used for according to the godet module 9 on the described characteristic bar startup disk, to finish the read-write operation of physical hard disk 10.
The godet module is responsible for the dirty data among the Cache is written to disk immediately, keeps the consistance of Cache buffer zone and disk physical data.The godet operation is divided into idle godet, forces three kinds on godet, active godet.Idle godet is meant and detects host operating system after the free time, utilizes free time that dirty data is written to operation in the disk.Force godet to be meant at the Cache buffer zone full, or when producing the Cache conflict, in the time of can't distributing the Cache buffer zone for new read-write requests, the godet operation of host operating system force start forces dish will empty portion C ache buffer zone to satisfy new I/O request.Current I when forcing to coil/O request is forced to hang up, and this moment, the host operating system performance was very low, must avoid forcing the generation of godet as far as possible.And initiatively the purpose of godet is exactly for fear of the generation of forcing godet, and host operating system regularly detects the dirty data ratio, if ratio is higher than the high limit that sets in advance, just starts the godet operation, is reduced to the lower bound that sets in advance up to the dirty data ratio.
Described object machine module 1, caching management module 2, RAID nucleus module 3, input/output scheduling module 4 and starter module 5 all have separately independently kernel thread, and these thread parallel work are each other with asynchronous system delivery request and response.Each module is all safeguarded an internal queues, and this formation is used to preserve from higher level's module request that sends and the response of returning from subordinate's module.When formation when being empty, kernel thread changes sleep over to, is waken up when new request or response arrive and handles them.This asynchronous working method has guaranteed that each module all independently carries out work, handles with the form of streamline through each module successively from the I/O request that main frame sends.
Present embodiment adopts internal memory to cushion the data of read-write requests as Cache, can effectively improve the I/O performance of storage system like this.The data of looking ahead are put into read among the Cache, because time, the spatial locality of data access, these data probably can be utilized once more, at this moment just can directly from read Cache, take out data, need not to go to read on the memory device of reality, can shorten the response time of system so greatly.And after the data of write order are put into Cache, just finish to ST module report write operation, and then the godet operation is carried out with the actual disk that is written to of data in the backstage in suitable.Can improve the response speed of write request like this, repeatedly write operation may repeat to revise same place in addition, and Cache can reduce actual writing disk manipulation.
The data organization form of Cache is with SU (Stripe Unit, continuous memory cell on a Logical Disk, described Logical Disk refers to the logical memory blocks of dividing on internal memory) be base unit, a plurality of SU form a characteristic bar STRIPE, and (described characteristic bar is the set by the SU of data map relation decision, described data map is closed the mapping relations that mean between logic storage unit and the physical memory cell), the data of each Logical Disk are that unit organization becomes a Hash table with characteristic bar STRIPE then, and the hash function of use is: StripeId%HashSize.
Preferably, the cache management system of the described RAID of being used for also comprises: interconnective configurating terminal module 6 and global configuration module 7,
Described configurating terminal module 6 is used for showing the duty of described global configuration module 7 on described main frame, and receives the control command from described main frame;
Described global configuration module 7, be used for other modules (other modules comprise: described object machine module 1, caching management module 2, RAID nucleus module 3, input/output scheduling module 4, starter module 5 and configurating terminal module 6) on the cache management system of the described RAID of being used for of load or unload, and the external interface of other modules on the cache management system of the described RAID of being used for is provided, described external interface refers to be used between described other modules the interface of data interaction.
The invention also discloses a kind of management method of the cache management system based on the described RAID of being used for, may further comprise the steps:
S1: receive input and output request, and this input and output request is encapsulated from main frame;
S2: will split into the certain characteristics data strip through the input and output request after the encapsulation, and judge one by one according to read-write type whether the data of described certain characteristics data strip correspondence hit, the characteristic bar execution in step S3 that hits, otherwise, the solution that must conflict by the time of miss characteristic bar;
S3: the RAID rank of calculating the described characteristic bar that hits;
S4: successively the characteristic bar that receives is positioned over the tail of the queue of request queue according to other height of described RAID level, and takes out the characteristic bar from team's head successively;
S5: according to the godet module on the described characteristic bar startup disk, to finish the read-write operation of physical hard disk.
Preferably, the determination methods that judgment data is hit among the step S2 is specially:
If read request and data hit, the data that then described characteristic bar corresponding address section is stored are the data that need read, and the described characteristic bar corresponding address section data of being stored are not upgraded by write request or the read request data are not hit renewal;
If write request and data hit, then described characteristic bar corresponding address section exists and is unoccupied, and perhaps described characteristic bar corresponding address section does not exist.
Preferably, calculating other algorithm of RAID level among the step S3 comprises: RAID0, RAID1, RAID5, RAID6 and disk cluster.
Preferably, press described RAID rank from high to low among the step S4.
Above embodiment only is used to illustrate the present invention; and be not limitation of the present invention; the those of ordinary skill in relevant technologies field; under the situation that does not break away from the spirit and scope of the present invention; can also make various variations and modification; therefore all technical schemes that are equal to also belong to category of the present invention, and scope of patent protection of the present invention should be defined by the claims.
Claims (6)
1. a cache management system that is used for RAID is characterized in that, comprising: the object machine module (1) of Lian Jieing, caching management module (2), RAID nucleus module (3), input/output scheduling module (4) and starter module (5) successively,
Described object machine module (1) is used for receiving the input and output request from main frame (8), and this input and output request is encapsulated, and is sent to described caching management module (2) after the encapsulation;
Described caching management module (2), be used for and split into the certain characteristics data strip through the input and output request after the encapsulation, and judge one by one according to read-write type whether the data of described certain characteristics data strip correspondence hit, the characteristic bar that hits is sent to described RAID nucleus module (3), otherwise, the solution that must conflict by the time of miss characteristic bar;
Described RAID nucleus module (3), be used to receive the described characteristic bar that hits, and calculate the RAID rank of the described characteristic bar that hits, successively the described characteristic bar that hits is sent to described input/output scheduling module (4) according to other height of described RAID level;
Described input/output scheduling module (4) is used for receiving successively the described characteristic bar that hits, and successively the characteristic bar that receives is positioned over the tail of the queue of request queue, and is sent to described starter module (5) from team's head taking-up characteristic bar successively;
Described starter module (5) is used for according to the godet module (9) on the described characteristic bar startup disk, to finish the read-write operation of physical hard disk (10).
2. as each described cache management system that is used for RAID of claim 1, it is characterized in that the cache management system of the described RAID of being used for also comprises: interconnective configurating terminal module (6) and global configuration module (7),
Described configurating terminal module (6) is used for showing the duty of described global configuration module (7) on described main frame, and receives the control command from described main frame;
Described global configuration module (7) is used for other modules on the cache management system of the described RAID of being used for of load or unload, and the external interface of other modules on the cache management system of the described RAID of being used for is provided.
3. one kind based on claim 1 or the 2 described management methods that are used for the cache management system of RAID, it is characterized in that, may further comprise the steps:
S1: receive input and output request, and this input and output request is encapsulated from main frame;
S2: will split into the certain characteristics data strip through the input and output request after the encapsulation, and judge one by one according to read-write type whether the data of described certain characteristics data strip correspondence hit, the characteristic bar execution in step S3 that hits, otherwise, the solution that must conflict by the time of miss characteristic bar;
S3: the RAID rank of calculating the described characteristic bar that hits;
S4: successively the characteristic bar that receives is positioned over the tail of the queue of request queue according to other height of described RAID level, and takes out the characteristic bar from team's head successively;
S5: according to the godet module on the described characteristic bar startup disk, to finish the read-write operation of physical hard disk.
4. management method as claimed in claim 3 is characterized in that, the determination methods that judgment data is hit among the step S2 is specially:
If read request and data hit, the data that then described characteristic bar corresponding address section is stored are the data that need read, and the described characteristic bar corresponding address section data of being stored are not upgraded by write request or the read request data are not hit renewal;
If write request and data hit, then described characteristic bar corresponding address section exists and is unoccupied, and perhaps described characteristic bar corresponding address section does not exist.
5. the cache management system that is used for RAID as claimed in claim 3 is characterized in that, calculates other algorithm of RAID level among the step S3 and comprises: RAID0, RAID1, RAID5, RAID6 and disk cluster.
6. the cache management system that is used for RAID as claimed in claim 3 is characterized in that, presses described RAID rank from high to low among the step S4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110159089 CN102262511B (en) | 2011-06-14 | 2011-06-14 | Cache management system and method for RAID (Redundant Array of Independent Disks) |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110159089 CN102262511B (en) | 2011-06-14 | 2011-06-14 | Cache management system and method for RAID (Redundant Array of Independent Disks) |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102262511A true CN102262511A (en) | 2011-11-30 |
| CN102262511B CN102262511B (en) | 2013-09-11 |
Family
ID=45009151
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201110159089 Active CN102262511B (en) | 2011-06-14 | 2011-06-14 | Cache management system and method for RAID (Redundant Array of Independent Disks) |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102262511B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106569728A (en) * | 2015-10-09 | 2017-04-19 | 中兴通讯股份有限公司 | Processing method and device for shared write cache of redundant arrays of independent disks (RAIDs) |
| CN109508147A (en) * | 2018-11-09 | 2019-03-22 | 郑州云海信息技术有限公司 | A kind of data cached storage method, system and storage equipment |
| CN110968271A (en) * | 2019-11-25 | 2020-04-07 | 北京劲群科技有限公司 | High-performance data storage method, system and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7111228B1 (en) * | 2002-05-07 | 2006-09-19 | Marvell International Ltd. | System and method for performing parity checks in disk storage system |
| US20100037019A1 (en) * | 2008-08-06 | 2010-02-11 | Sundrani Kapil | Methods and devices for high performance consistency check |
| JP2010204885A (en) * | 2009-03-03 | 2010-09-16 | Nec Corp | Disk array device and method for controlling the same |
| CN102063276A (en) * | 2010-12-23 | 2011-05-18 | 创新科存储技术有限公司 | Storage equipment with both RAID (Redundant Array Of Inexpensive Disk) and VTL (Virtual Tape Library) functions and method |
-
2011
- 2011-06-14 CN CN 201110159089 patent/CN102262511B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7111228B1 (en) * | 2002-05-07 | 2006-09-19 | Marvell International Ltd. | System and method for performing parity checks in disk storage system |
| US20100037019A1 (en) * | 2008-08-06 | 2010-02-11 | Sundrani Kapil | Methods and devices for high performance consistency check |
| JP2010204885A (en) * | 2009-03-03 | 2010-09-16 | Nec Corp | Disk array device and method for controlling the same |
| CN102063276A (en) * | 2010-12-23 | 2011-05-18 | 创新科存储技术有限公司 | Storage equipment with both RAID (Redundant Array Of Inexpensive Disk) and VTL (Virtual Tape Library) functions and method |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106569728A (en) * | 2015-10-09 | 2017-04-19 | 中兴通讯股份有限公司 | Processing method and device for shared write cache of redundant arrays of independent disks (RAIDs) |
| CN106569728B (en) * | 2015-10-09 | 2021-02-23 | 中兴通讯股份有限公司 | Processing method and device for sharing write cache by multiple disk arrays RAID (redundant array of independent disks) |
| CN109508147A (en) * | 2018-11-09 | 2019-03-22 | 郑州云海信息技术有限公司 | A kind of data cached storage method, system and storage equipment |
| CN110968271A (en) * | 2019-11-25 | 2020-04-07 | 北京劲群科技有限公司 | High-performance data storage method, system and device |
| CN110968271B (en) * | 2019-11-25 | 2024-02-20 | 北京劲群科技有限公司 | High-performance data storage method, system and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102262511B (en) | 2013-09-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105027093B (en) | Method and apparatus for compressing and compacting virtual memory | |
| CN103049397B (en) | A kind of solid state hard disc inner buffer management method based on phase transition storage and system | |
| CN101604226B (en) | Method for building dynamic buffer pool to improve performance of storage system based on virtual RAID | |
| US7640443B2 (en) | Computer apparatus, storage apparatus, system management apparatus, and hard disk unit power supply controlling method | |
| CN103885728B (en) | A kind of disk buffering system based on solid-state disk | |
| CN102364474B (en) | Metadata storage system for cluster file system and metadata management method | |
| CN102012791B (en) | Flash based PCIE (peripheral component interface express) board for data storage | |
| CN102207830B (en) | Cache dynamic allocation management method and device | |
| US20140006687A1 (en) | Data Cache Apparatus, Data Storage System and Method | |
| WO2018019119A1 (en) | Method and device for dynamic partial-parallel data layout for continuous data storage | |
| CN102637147A (en) | Storage system using solid state disk as computer write cache and corresponding management scheduling method | |
| CN103577339A (en) | Method and system for storing data | |
| CN103608782A (en) | Selective data storage in LSB and MSB pages | |
| CN106528001A (en) | Cache system based on nonvolatile memory and software RAID | |
| CN101644996A (en) | Storage method of index data and storage control device | |
| CN103049396B (en) | The method of writing with a brush dipped in Chinese ink of data and device | |
| CN103049216B (en) | Solid state hard disc and data processing method, system | |
| CN102945207A (en) | Cache management method and system for block-level data | |
| CN103345368B (en) | Data caching method in buffer storage | |
| CN102262512A (en) | System, device and method for realizing disk array cache partition management | |
| US8856442B2 (en) | Method for volume management | |
| CN101777028A (en) | Realization method and device of mixed secondary storage system | |
| CN100428193C (en) | Data preacquring method for use in data storage system | |
| CN101957729B (en) | Logical block transformation method and method and device compatible with reading and writing of user based on same | |
| CN109491613A (en) | A kind of continuous data protection storage system and its storage method using the system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP02 | Change in the address of a patent holder |
Address after: Xiangcheng District Chunxing road Xiangcheng Economic Development Zone, Suzhou City, Jiangsu Province, No. 6 215143 Patentee after: Suzhou Etron Electronics Co.,Ltd Address before: 215132 Yong Qing Road, Huangqiao Industrial Park, Suzhou, Jiangsu, Xiangcheng District Patentee before: Suzhou Etron Electronics Co.,Ltd |
|
| C56 | Change in the name or address of the patentee | ||
| CP03 | Change of name, title or address |
Address after: Chun Hing Road Xiangcheng Economic Development Zone in Suzhou City, Jiangsu Province, No. 50 215143 Patentee after: Suzhou eTron Polytron Technologies Inc Address before: Xiangcheng District Chunxing road Xiangcheng Economic Development Zone, Suzhou City, Jiangsu Province, No. 6 215143 Patentee before: Suzhou Etron Electronics Co.,Ltd |