CN105739920A - Automated tiered storage method and server - Google Patents

Automated tiered storage method and server Download PDF

Info

Publication number
CN105739920A
CN105739920A CN201610046496.5A CN201610046496A CN105739920A CN 105739920 A CN105739920 A CN 105739920A CN 201610046496 A CN201610046496 A CN 201610046496A CN 105739920 A CN105739920 A CN 105739920A
Authority
CN
China
Prior art keywords
data
solid state
hard disc
state hard
serial port
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610046496.5A
Other languages
Chinese (zh)
Inventor
林鹏程
周枫
李俊宗
张涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Virtual Clusters Information Technology Co Ltd
Original Assignee
Shenzhen Virtual Clusters Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Virtual Clusters Information Technology Co Ltd filed Critical Shenzhen Virtual Clusters Information Technology Co Ltd
Priority to CN201610046496.5A priority Critical patent/CN105739920A/en
Publication of CN105739920A publication Critical patent/CN105739920A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061Improving I/O performance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1004Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's to protect a block of data words, e.g. CRC or checksum
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • G06F3/064Management of blocks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0647Migration mechanisms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0652Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0653Monitoring storage devices or systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0683Plurality of storage devices
    • G06F3/0689Disk arrays, e.g. RAID, JBOD

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)

Abstract

The invention discloses an automated tiered storage method. Two pieces of storage equipment of different types of performance are established on a server side, wherein the two pieces of storage equipment are independently a solid state disk and a serial disk; the solid state disk is used for storing the hotspot data of the server side; the serial disk is used for storing all pieces of data which needs to be stored on the server side; when the solid state disk stores data, the copy data of the data is synchronously stored in the serial disk; the server side establishes a detection module used for detecting whether the data stored in the solid state disk has errors or not; and when the detection module detects that the data stored in the solid state disk has the errors, the copy data stored in the serial disk is migrated into the solid state disk. The automated tiered storage method adopts the solid state disk and the serial disk as tiered storage media by aiming at the problems of low reading speed and excessive burden in automated tiered storage, and the problem of low response speed in the automated tiered storage is solved since the solid state disk has a high read-write response speed.

Description

A kind of automated hierarchical storage method and server
Technical field
The present invention relates to a kind of Computer Storage method, particularly a kind of automated hierarchical storage method and server.
Background technology
AUTOMATIC ZONING technology can migrate data between the dissimilar medium of same an array.Bedding storage is a long-standing practice, by access time or frequency of access, data can being stored in respectively on the storage medium of different access speed/cost, preferably balancing thus obtaining between access efficiency and cost.Consider the storage complexity of environment, maintenance difficulties, and automatically adjust data distribution to reach the requirement of best layered effect according to access behavior, generally to consider to carry out automated hierarchical storage.
Automated hierarchical storage can adjust data distribution according to the storage behavior of user, such as by hot data from storage pool Autonomic Migration Framework to performance pond, thus improving the overall performance of system.
Currently mainly there is the Data Migration problem that over-burden in automated hierarchical storage:
Due to Data Migration it is generally required to striding equipment is written and read operation, therefore CPU, network, the system integral load such as IO is all higher, and reading speed is relatively slow first, is even significantly less than original performance of each storage pool.This results in some vast scale and only reads scene once and reduce overall performance on the contrary, is suitable for scene single.
Summary of the invention
The technical problem that present invention mainly solves is to provide a kind of automated hierarchical storage method, the reading speed problem that over-burden more slowly is there is in storing for automated hierarchical, adopt solid state hard disc and the serial port hard disk medium as Bedding storage, owing to solid state hard disc has higher read-write response speed, improving the problem that in automated hierarchical storage, response speed is slower, leaving the data in serial port hard disk in additionally, due to Bedding storage can for repairing the error in data that solid state hard disc occurs.
For solving above-mentioned technical problem, the technical scheme that the present invention adopts is: provides a kind of automated hierarchical storage method, sets up the storage device of solid state hard disc and two kinds of different performances of serial port hard disk at server end;Described solid state hard disc is for storing the hot spot data of server end;Described serial port hard disk needs all data of storage for storing server end;Synchronize to store the copy data of these data in serial port hard disk during described solid state hard disc storage data;Setting up detection module at server end, whether the data of detection solid state hard disc storage data are wrong;Described detection module detects when mistake occur in solid state hard disc storage data, is moved in solid state hard disc by the copy data that serial port hard disk stores.
Further, described error in data includes: corrupted data is miss with data.
Further, during described solid state hard disc storage corrupted data, migrate to the copy data that serial port hard disk stores in solid state hard disc to repair and damage data.
Further, when the storage data search of described solid state hard disc is miss, server end reads the copy data of serial port hard disk storage by solid state hard disc, and copy data migrates to solid state hard disc storage simultaneously.
Further, when described copy data migrates from serial port hard disk to solid state hard disc, described copy data is divided into the data block of fixed size.
Further, after described copy data is divided into data block, bitmap file is adopted to record the transition state of each data block;In institute's bitmap file record complete copy data, which data block the transition state of data block, follow the tracks of and be arranged in solid state hard disc, and which data block is arranged in serial port hard disk.
Further, during described reparation solid state hard disc corrupted data, position the particular location of described corrupted data data;Location damages data are arranged in which data block of copy data;Migrate the data block comprising data degradation file.
Further, the aging data described solid state hard disc stored is cleared up.
Further, verify during the cleaning of described aging data;Whether the copy data of detection serial port hard disk storage is complete, and detection copy data is complete, then be made directly cleaning;If it is not, then migrate to reverse for the data in solid state hard disc in serial port hard disk.
For solving above-mentioned technical problem, the present invention also provides for a kind of server, particularly as follows: a kind of server, including solid state hard disc, serial port hard disk and detecting device;Synchronize to store the copy data of these data in serial port hard disk during described solid state hard disc storage data;Whether the data of described detection module detection solid state hard disc storage data are wrong;Described detection module detects when mistake occur in solid state hard disc storage data, is moved in solid state hard disc by the copy data that serial port hard disk stores.
The invention has the beneficial effects as follows: 1. there is the reading speed problem that over-burden more slowly in storing for automated hierarchical, adopt solid state hard disc and the serial port hard disk medium as Bedding storage, owing to solid state hard disc has higher read-write response speed, improving the problem that in automated hierarchical storage, response speed is slower, leaving the data in serial port hard disk in additionally, due to Bedding storage can for repairing the error in data that solid state hard disc occurs.
2. when the present invention is in by the Data Migration in serial port hard disk to solid state hard disc, data are carried out striping process, it is about to the data block needing the copy data of migration to be divided into fixed size, then pass through bitmap file by complete copy data location drawing record in addition, for following the tracks of in copy data those data block migration in solid state hard disc, which is also stayed in serial port hard disk.After adopting striping data to be split, when repairing solid state hard disc error in data, only need to position the particular location damaging data, location comprises the data block of these damage data, then by this data block migration to solid state hard disc, all move in solid state hard disc without by whole file, improve remediation efficiency, reduce IO load.
Accompanying drawing explanation
Fig. 1 is present configuration block diagram;
Fig. 2 is that the present invention repairs damage data flowchart.
Accompanying drawing illustrates: 100, server end;200, solid state hard disc;300, serial port hard disk;400, detection module.
Detailed description of the invention
For the ease of understanding the present invention, below in conjunction with the drawings and specific embodiments, the present invention will be described in more detail.It should be noted that be expressed " being fixed on " another element when element, it can directly on another element or can there is one or more element placed in the middle therebetween.When an element is expressed " connection " another element, it can be directly to another element or can there is one or more element placed in the middle therebetween.Term " vertical ", " level ", "left", "right" and similar statement that this specification uses are for illustrative purposes only.
Unless otherwise defined, all of technology that this specification uses is identical with the implication that the those skilled in the art belonging to the present invention are generally understood that with scientific terminology.The term used in the description of the invention in this specification is intended merely to the purpose describing specific embodiment, is not intended to the restriction present invention.The term "and/or" that this specification uses includes the arbitrary and all of combination of one or more relevant Listed Items.
Below in conjunction with drawings and embodiments, the present invention is described in detail.
Embodiment 1
Refer to Fig. 1, a kind of automated hierarchical storage method, the storage device of solid state hard disc 200 (SDD) and serial port hard disk 300 (SATA) two kinds of different performances is set up at server end 100, solid state hard disc 200 is for storing the hot spot data of server end 100, serial port hard disk 300 needs all data of storage for storing server end 100, synchronize to store the copy data of these data in serial port hard disk 300 when solid state hard disc 200 stores data, detection module is set up at server end 100, whether the data that detection solid state hard disc 200 stores data are wrong, detection module detects when solid state hard disc 200 stores data appearance mistake, the copy data that serial port hard disk 300 stores is moved in solid state hard disc 200.Wherein detection module is the detection module that software realizes, determine whether solid state hard disc 200 mistake occurs according to feedack in I/O execution task, when solid state hard disc 200 breaks down and cannot read, by this information value of feedback detection module, detection module then assert this solid state hard disc 200, and there was a mechanical failure, cannot normally read, and this information is uploaded onto the server.
Wherein, solid state hard disc 200 (SolidStateDrives), the solid dish of abbreviation, and the hard disk that solid state hard disc 200 is made with solid-state electronic storage chip array, it is made up of control unit and memory element (FLASH chip, dram chip).Solid state hard disc 200 has that fast reading and writing that traditional mechanical hard disk do not possess, light weight, energy consumption be low and the feature such as volume is little, but there is also bigger shortcoming, and still costly, capacity is relatively low for its price, once hardware damage, the more difficult recovery of data etc.;And also it is believed that the ruggedness of solid state hard disc 200 (life-span) is relatively short.The present invention adopts solid state hard disc 200 to store medium as hot spot data, is primarily due to the performance of solid state hard disc 200 fast reading and writing, it is possible to promote the corresponding speed of server.
Wherein, serial port hard disk 300 is that the hard disk using SATA (SerialATA) interface is again serial port hard disk 300.Adopt serial mode transmission data, and serial port hard disk 300 has higher reliability, instruction and data packet can be circulated redundancy check (CRC) by SATA simultaneously, not only can detect that all single bit and the mistake of double; two bit, and according to statistical principle, 99.998% mistake being likely to occur so can also be detected.
Error in data described in present embodiment specifically includes that corrupted data and data are miss,
Wherein, the meaning that data are miss specifically refers to: when I/O operation, to the data search of storage in solid state hard disc 200, but does not search corresponding data and is miss.In the present embodiment for the technical method of the miss employing of data particularly as follows: solid state hard disc 200 store data search miss time, the mode adopting solid state hard disc 200 agency reads copy data from serial port hard disk 300, solid state hard disc 200 agency specifically refer to: when server end 100 reads the copy data of serial port hard disk 300 storage, this copy data transfers to server actuating station from solid state hard disc 200, these data through solid state hard disc 200 time, copy data is recorded simultaneously and is stored on solid state hard disc 200, thus, this hot spot data can be preserved in solid state hard disc 200.
In some embodiments, when there was a mechanical failure or data are miss for solid state hard disc 200, server end 100 is directly from search in serial port hard disk 300 copy data reading these data, this approach application at solid state hard disc 200 without this information is stored, or this information access volume is limited, it is unworthy being deposited in solid state hard disc 200.
When in present embodiment, I/O performs task, when solid state hard disc 200 search mission data, search determines that this task data exists in solid state hard disc 200, when this task data is performed, when this character data cannot perform, this tasks carrying situation is fed back in detection module by I/O, and detection module assert this corrupted data.When I/O performs task, when solid state hard disc 200 search mission data, it has been found that when this task data is absent from, this tasks carrying situation is fed back in detection module by I/O, and detection module assert that these data are miss.
In present embodiment, the technical scheme that corrupted data is adopted is: when solid state hard disc 200 stores corrupted data, migrates to the copy data that serial port hard disk 300 stores to repair in solid state hard disc 200 and damages data.
The copy data of storage in serial port hard disk 300 is migrated to solid-state when firmly sending, this copy data need to be carried out striping process, concrete: copy data is divided into data block of the same size, the set of some data blocks is exactly complete copy data, copy data can be divided into how many data blocks and mainly see the size of copy data, splits according to the sequencing of the execution of data during data segmentation.In present embodiment data block be sized to 4K, different size of data block can be set according to the difference of concrete application scenarios.
In some embodiments, the size of data block is divided into the smaller value of serial port hard disk 300I/O configuration, when miss data are transferred to solid state hard disc 200 from serial port hard disk 300, and by solid state hard disc 200 upload onto the server actuating station time, the process of transmission just can complete data migration operation in passing, it is to avoid the I/O operation of redundancy.
As shown in Figure 2, in present embodiment, S100 after discovery solid state hard disc 200 corrupted data, detection module determines this corrupted data S200, server end 100 performs to damage data line by line, to determine the particular location S300 of corrupted data, upload onto the server after determining this particular location end 100 by this position, server end 100 searches the copy data of these damage data in serial port hard disk 300, after finding this copy data, the data block S400 of these damage data is comprised at copy data inner search, after determining this data block, by in this data block migration to solid state hard disc 200, carry out repairing S500 to damaging data.After adopting striping data to be split, when repairing solid state hard disc 200 error in data, only need to position the particular location damaging data, location comprises the data block of these damage data, then by this data block migration to solid state hard disc 200, all move in solid state hard disc 200 without by whole file, improve remediation efficiency, reduce IO load.
In some embodiments, after period of service execution finds corrupted data, in serial port hard disk 300, search the copy data of these damage data, after searching this copy data, all data of copy data are all migrated in solid state hard disc 200 soon, for repair damaged data.
In the present embodiment, after copy data is divided into data block of the same size, bitmap file (bitmap) is adopted to record the transition state of each data block, bitmap file is the image using pel array to represent, the color information of each pixel is represented by RGB combination or gray value.Bitmap file is according to the distribution sequence of data block, the form representing a data block with each pixel records each data block, when in the middle part of copy data, divided data block arrives solid state hard disc 200 through migrating, namely bitmap file changes the bitmap color representing this data block, by this method
In record complete copy data, which data block the transition state of data block, follow the tracks of and be arranged in solid state hard disc 200, and which data block is arranged in serial port hard disk 300.
In present embodiment, the aging data of solid state hard disc 200 storage being cleared up, verifies when aging data is cleared up, whether the copy data of detection serial port hard disk 300 storage is complete, and detection copy data is complete, then be made directly cleaning;If it is not, then migrate to reverse for the data in solid state hard disc 200 in serial port hard disk 300.
In present embodiment, mainly adopt method in 3 to be managed solid state hard disc 200 aging data, be respectively as follows:
1. manage solid state hard disc 200 space according to the idle condition of IO:
Solid state hard disc 200 is carried out the automatic detection of IO by server end, when the IO of server end 100 is idle, it should clear up solid state hard disc 200 space according to data scrubbing strategy.And when user IO being detected, then stop at once actively clearing up behavior.
2. the data scrubbing strategy simplified:
Data scrubbing strategy needs to be applicable to various scenes, and such as hot spot data is more fixing, and at this time hot spot data need not frequently be cleared up, because the Data Migration of repetition can be caused, and affects the service life of solid state hard disc 200.
1) according to the adjustable access time, if data exceed a period of time not accessed (such as one hour or one day, adjustable).Then think that data aging can be cleaned.But this is only merely a threshold value, system will not start data scrubbing when data aging at once.But there is actively cleaning and a basic threshold of passive cleaning.
2) according to adjustable remaining space.It is divided into startup threshold values and stops threshold values, only for when actively cleaning starts.Such as when hot pond remaining space is less than 10%, hot pond just can start actively cleaning when the IO free time.And (need and the access time matches when data are cleaned at most remaining space 30%, just clear up when condition meets simultaneously, therefore herein with expressing at most), stop actively cleaning.Generally, it is mutual that space cleaning has avoided with cold drop, and therefore I/O load is substantially reduced, because the threshold values keeping minor proportion is thought on ground, it is not necessary to frequently and the startup of vast scale actively clear up.
3) writing IO especially frequently causes hot pool space not enough.This situation needs to pay the utmost attention to that hot pool space is not enough or aging data threshold values is excessive, frequent especially when writing IO, and when remaining space is less than 10%, still can not improve this phenomenon, then with reference to a reading mode thirdly and write-back mode.Namely it is hot spot data for write data, and the situation that hot pool space is not enough, at this time system can only relatively aging data deletion, and threshold values can be ineffective at this.Performance can be influenced by some impacts simultaneously.
3 read-write modes also can affect data scrubbing frequency:
Writing IO situation especially frequently, it is proposed that consider to distinguish both of which, one is that data frequently write into, but not accessed in the short time, then suggestion is a reading mode, and another kind is that data frequently write into, and the data write can be accessed frequently in the short time, then suggestion is write-back mode.
1) a, reading mode.During write data, data are redirected directly to cold drop, without overheated pond.It not often the situation of hot spot data in a short time suitable in write data, can effectively share write and the IO load read.
2), write-back mode.During write data, data are through overheated pond and are written back to cold drop simultaneously.Suitable in the situation that write data high probability is hot spot data.The probability that Data Migration occurs can be reduced.
Embodiment 2
A kind of server, including solid state hard disc 200, serial port hard disk 300 and detecting device, synchronize to store the copy data of these data in serial port hard disk 300 when solid state hard disc 200 stores data, whether the data that detection module detection solid state hard disc 200 stores data are wrong, detection module detects when solid state hard disc 200 stores data appearance mistake, is moved in solid state hard disc 200 by the copy data that serial port hard disk 300 stores.Wherein detection module is the detection module that software realizes, determine whether solid state hard disc 200 mistake occurs according to feedack in I/O execution task, when solid state hard disc 200 breaks down and cannot read, by this information value of feedback detection module, detection module then assert this solid state hard disc 200, and there was a mechanical failure, cannot normally read, and this information is uploaded onto the server.
Server in present embodiment adopts the automated hierarchical storage method in embodiment 1, manages storage and the recovery of data in solid state hard disc 200 and serial port hard disk 300.
It should be noted that, the description of the present invention and accompanying drawing thereof give the preferred embodiment of the present invention, but, the present invention can be realized by many different forms, it is not limited to the embodiment described by this specification, these embodiments are not as the extra restriction to present invention, it is provided that the purpose of these embodiments is to make the understanding to the disclosure more thorough comprehensively.Further, above-mentioned each technical characteristic continues to be mutually combined, and forms various embodiments not enumerated above, is accordingly to be regarded as the scope that description of the present invention is recorded;Further, for those of ordinary skills, it is possible to improved according to the above description or convert, and all these improve and conversion all should belong to the protection domain of claims of the present invention.

Claims (10)

1. an automated hierarchical storage method, it is characterised in that set up the storage device of solid state hard disc and two kinds of different performances of serial port hard disk at server end;
Described solid state hard disc is for storing the hot spot data of server end;
Described serial port hard disk needs all data of storage for storing server end;
Synchronize to store the copy data of these data in serial port hard disk during described solid state hard disc storage data;
Setting up detection module at server end, whether the data of detection solid state hard disc storage data are wrong;
Described detection module detects when mistake occur in solid state hard disc storage data, is moved in solid state hard disc by the copy data that serial port hard disk stores.
2. automated hierarchical stores method according to claim 1, it is characterised in that described error in data includes: corrupted data is miss with data.
3. automated hierarchical stores method according to claim 2, it is characterised in that during described solid state hard disc storage corrupted data, migrates to the copy data that serial port hard disk stores in solid state hard disc to repair and damages data.
4. automated hierarchical stores method according to claim 2, it is characterized in that, when the storage data search of described solid state hard disc is miss, server end reads the copy data of serial port hard disk storage by solid state hard disc, and copy data migrates to solid state hard disc storage simultaneously.
5. automated hierarchical stores method according to claim 4, it is characterised in that when described copy data migrates from serial port hard disk to solid state hard disc, described copy data is divided into the data block of fixed size.
6. automated hierarchical stores method according to claim 5, it is characterised in that after described copy data is divided into data block, adopts bitmap file to record the transition state of each data block;
In institute's bitmap file record complete copy data, which data block the transition state of data block, follow the tracks of and be arranged in solid state hard disc, and which data block is arranged in serial port hard disk.
7. automated hierarchical stores method according to claim 6, it is characterised in that during described reparation solid state hard disc corrupted data, position the particular location of described corrupted data data;
Location comprises the data block of described damage data;
Migrate the data block comprising data degradation file.
8. automated hierarchical storage method according to claim 1~7 any one, it is characterised in that the aging data that described solid state hard disc is stored is cleared up.
9. automated hierarchical stores method according to claim 8, it is characterised in that verify during the cleaning of described aging data;
Whether the copy data of detection serial port hard disk storage is complete, and detection copy data is complete, then be made directly cleaning;If it is not, then migrate to reverse for the data in solid state hard disc in serial port hard disk.
10. a server, it is characterised in that include solid state hard disc, serial port hard disk and detecting device;
Synchronize to store the copy data of these data in serial port hard disk during described solid state hard disc storage data;
Whether the data of described detection module detection solid state hard disc storage data are wrong;
Described detection module detects when mistake occur in solid state hard disc storage data, is moved in solid state hard disc by the copy data that serial port hard disk stores.
CN201610046496.5A 2016-01-22 2016-01-22 Automated tiered storage method and server Pending CN105739920A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610046496.5A CN105739920A (en) 2016-01-22 2016-01-22 Automated tiered storage method and server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610046496.5A CN105739920A (en) 2016-01-22 2016-01-22 Automated tiered storage method and server

Publications (1)

Publication Number Publication Date
CN105739920A true CN105739920A (en) 2016-07-06

Family

ID=56246473

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610046496.5A Pending CN105739920A (en) 2016-01-22 2016-01-22 Automated tiered storage method and server

Country Status (1)

Country Link
CN (1) CN105739920A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107678697A (en) * 2017-10-24 2018-02-09 江苏都万电子科技有限公司 A kind of asymmetric backup storage method of data and memory
CN110825314A (en) * 2018-08-10 2020-02-21 浙江宇视科技有限公司 Data scheduling method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102117287A (en) * 2009-12-30 2011-07-06 成都市华为赛门铁克科技有限公司 Distributed file system access method, a metadata server and client side
US20120317337A1 (en) * 2011-06-09 2012-12-13 Microsoft Corporation Managing data placement on flash-based storage by use
CN103631536A (en) * 2013-11-26 2014-03-12 华中科技大学 Method for optimizing RAID5/6 writing performance by means of invalid data of SSD

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102117287A (en) * 2009-12-30 2011-07-06 成都市华为赛门铁克科技有限公司 Distributed file system access method, a metadata server and client side
US20120317337A1 (en) * 2011-06-09 2012-12-13 Microsoft Corporation Managing data placement on flash-based storage by use
CN103631536A (en) * 2013-11-26 2014-03-12 华中科技大学 Method for optimizing RAID5/6 writing performance by means of invalid data of SSD

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107678697A (en) * 2017-10-24 2018-02-09 江苏都万电子科技有限公司 A kind of asymmetric backup storage method of data and memory
WO2019080621A1 (en) * 2017-10-24 2019-05-02 江苏都万电子科技有限公司 Data asymmetric backup storage method and memory
CN110825314A (en) * 2018-08-10 2020-02-21 浙江宇视科技有限公司 Data scheduling method and device
CN110825314B (en) * 2018-08-10 2024-02-02 浙江宇视科技有限公司 Data scheduling method and device

Similar Documents

Publication Publication Date Title
US9229653B2 (en) Write spike performance enhancement in hybrid storage systems
JP5456063B2 (en) Method and system for dynamic storage tiering using allocate-on-write snapshots
CN113515471B (en) Method and apparatus for managing storage system
US7945732B2 (en) Storage system that executes performance optimization that maintains redundancy
KR101552753B1 (en) Allocate-on-write snapshot mechanism to provide dynamic storage tiering on-line data placement for volumes
CN103246478B (en) A kind of based on the disc array system of software PLC support without packet type overall situation HotSpare disk
CN103049349B (en) Based on Snapshot Method and the system of Bedding storage
JP2006024211A5 (en)
EP2356658A1 (en) System and method for recovering solid state drive data
US8234464B2 (en) Hybrid storage data migration by selective data removal
CN102576293A (en) Data management in solid-state storage devices and tiered storage systems
CN104583930A (en) Method of data migration, controller and data migration apparatus
CN104620230A (en) Method of managing memory
US10346051B2 (en) Storage media performance management
CN105718206A (en) Flash translation layer capable of perceiving RAID (Redundant Array of Independent Disks) and implementation method thereof
US20170322747A1 (en) Information processing apparatus and method for deduplication
CN102981966A (en) Data storage method with Flash storage blocks evenly assigned
US20180341423A1 (en) Storage control device and information processing system
JP2019028954A (en) Storage control apparatus, program, and deduplication method
US20180365118A1 (en) Storage control apparatus, method and non-transitory computer-readable storage medium
US11093339B2 (en) Storage utilizing a distributed cache chain and a checkpoint drive in response to a data drive corruption
CN105739920A (en) Automated tiered storage method and server
CN111124303A (en) Data storage method, device and system
CN105915595B (en) Method for cluster storage system to access data and cluster storage system
CN102622315A (en) Method, device and system for controlling disc visiting

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160706

RJ01 Rejection of invention patent application after publication