CN111324304A - Data protection method and device based on SSD hard disk life prediction - Google Patents
Data protection method and device based on SSD hard disk life prediction Download PDFInfo
- Publication number
- CN111324304A CN111324304A CN202010092847.2A CN202010092847A CN111324304A CN 111324304 A CN111324304 A CN 111324304A CN 202010092847 A CN202010092847 A CN 202010092847A CN 111324304 A CN111324304 A CN 111324304A
- Authority
- CN
- China
- Prior art keywords
- hard disk
- data
- migration
- ssd
- ssd hard
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000005299 abrasion Methods 0.000 claims abstract description 43
- 238000013508 migration Methods 0.000 claims description 86
- 230000005012 migration Effects 0.000 claims description 86
- 238000003860 storage Methods 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 12
- 230000003993 interaction Effects 0.000 claims description 5
- 238000012544 monitoring process Methods 0.000 claims description 5
- 238000004364 calculation method Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 abstract description 11
- 238000005516 engineering process Methods 0.000 abstract description 7
- 238000013403 standard screening design Methods 0.000 description 59
- 230000006870 function Effects 0.000 description 11
- 230000008901 benefit Effects 0.000 description 4
- 238000012423 maintenance Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 230000015556 catabolic process Effects 0.000 description 3
- 238000006731 degradation reaction Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 239000002245 particle Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
- G06F3/0616—Improving the reliability of storage systems in relation to life time, e.g. increasing Mean Time Between Failures [MTBF]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/2205—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing using arrangements specific to the hardware being tested
- G06F11/2221—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing using arrangements specific to the hardware being tested to test input/output devices or peripheral units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/2273—Test methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/16—Protection against loss of memory contents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0688—Non-volatile semiconductor memory arrays
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a data protection method and a device based on SSD hard disk life prediction, which comprises the following contents: reading S.M.A.R.T information of a hard disk, and acquiring the hard disk abrasion degree of the hard disk; self-defining a wear threshold; periodically comparing the hard disk wear level with the wear threshold, when the hard disk wear level is equal to the wear threshold: and stopping writing data into the hard disk, and migrating the data on the hard disk to other normal hard disks. The method solves the problems that when the existing data protection technology adopts a system reconstruction method to recover lost data, the reconstruction process consumes long time and other hard disk faults are easy to occur.
Description
[ technical field ] A method for producing a semiconductor device
The invention belongs to the technical field of computer reliability testing, and particularly relates to a data protection method and device based on SSD hard disk life prediction.
[ background of the invention ]
Hard disks are a consumable item and are the most problematic link in storage systems. Once the hard disk fails, the user is exposed to the possibility of data loss, which is an unacceptable risk to the user. Although various data protection technologies exist at present, in a single-cluster storage system, data protection schemes mainly can be divided into two types, one type is based on a traditional raid (redundant Arrays of Independent disks), and the technology is to check and disperse data on different hard disks; another is distributed storage that stores data in multiple copies to different nodes. Although the two data protection schemes have different implementation principles, for data degradation caused by one or more hard disk failures, system reconstruction is triggered to recover lost data, in the process, the system performance is affected, and along with the fact that the capacity of the current hard disk is larger and larger, reconstruction takes longer time, the pressure of a normal hard disk is increased, and the possibility that other hard disk failures occur in the reconstruction process is higher and higher.
With the development of semiconductor technology in recent years, ssd (solid State disk) has become a mainstream configuration in a storage system due to its superior read/write performance and acceptable cost performance. However, in most current storage systems, the conventional mechanical disk is still used for the SSD hard disk. This also means that SSDs, while having many features and advantages, are not fully utilized. For example, the failure time is hard to predict because mechanical disks are susceptible to internal structure and environmental factors, and the SSD has a fixed erase/write frequency of flash memory particles on the memory chip, and the endurance is directly related to the upper layer read/write. This makes the lifetime prediction of SSD hard disks more accurate and the more work that can be done in advance than mechanical disks. Although some methods and researches propose to predict the disk life through disk and system parameters, the selected sample number and hard disk type are difficult to cover the complex hard disk application scenario of the data center, the practical operability is small, the operation and maintenance pressure cannot be relieved through advanced preprocessing, and more data can be recovered through passive reconstruction, so that the above-mentioned problems can occur. In addition, the main control chip on the SSD has a function of wear leveling for the flash memory particles on the memory chip, that is, as the write amount of the hard disk is continuously increased, the entire service life of the memory chip is also reduced synchronously. Thus, for the same batch of hard disks, the user is also at risk of simultaneous failure of a large number of SSD hard disks in a short time. How to take advantage of these characteristics of SSD hard disks in order to better protect data is a problem that currently needs to be addressed within the industry.
In current storage systems, the handling of the problem of a failed hard disk is not well adapted to the new storage type, again in the manner of a conventional mechanical disk. Therefore, the advantages of the SSD hard disk cannot be exerted, the risks of data loss, performance reduction and even system crash are brought, and the burden of operation and maintenance personnel is also increased.
[ summary of the invention ]
The invention aims to provide a data protection method and a data protection device based on SSD hard disk service life prediction, and aims to solve the problems that when the existing data protection technology adopts a system reconstruction method to recover lost data, the reconstruction process takes longer time, and other hard disk faults are easy to occur.
The invention adopts the following technical scheme: a data protection method based on SSD hard disk life prediction comprises the following steps:
reading S.M.A.R.T information of a hard disk, and acquiring the hard disk abrasion degree of the hard disk;
self-defining a wear threshold;
periodically comparing the hard disk wear level with the wear threshold, when the hard disk wear level is equal to the wear threshold: and stopping writing data into the hard disk, and migrating the data on the hard disk to other normal hard disks.
Further, the method comprises the following steps:
s1, setting a wear threshold of the SSD hard disk and setting a data migration strategy;
s2, acquiring the abrasion degree data of the SSD hard disk, and periodically comparing the abrasion degree with the magnetic disk threshold: when the abrasion degree reaches a set threshold value, setting an abrasion mark of the SSD hard disk, marking the SSD hard disk as an abraded hard disk, and informing the start of migration;
s3, when receiving the migration starting command, stopping writing data into the SSD hard disk and continuously providing data reading service;
migrating data according to the migration strategy: and reading data from the SSD hard disk according to the migration rate, writing the read data into other normal hard disks, successfully migrating all the data, and removing the worn hard disk from the system where the worn hard disk is located.
Further, in S1, the migration policy includes a user-defined policy, where the user-defined policy is to migrate data at any specified migration time and migration rate.
Further, in S1, the migration policy includes an automatic migration policy, where the automatic migration policy is that the SSD hard disk is automatically migrated according to the current load condition of the system in which the SSD hard disk is located;
the migration rate calculation method comprises the following steps: r ═ Dr (1-MAX (Cu, Mu, Bu));
wherein, R is migration rate, Cu is system CPU utilization rate, and the value is 0-100%; mu, the memory utilization rate is 0-100%; du is the hard disk utilization rate, and the value is 0-100%; MAX: taking the maximum value of the three; dr hard disk read speed.
The second technical solution adopted by the present invention is a device for predicting the lifetime of an SSD hard disk, comprising:
the user interaction module is used for setting a wear threshold of the SSD hard disk and setting a migration strategy;
the data monitoring module is used for acquiring the abrasion degree data of the SSD hard disk, and periodically comparing the abrasion degree with the magnetic disk threshold value: when the abrasion degree reaches a set threshold value, setting an abrasion mark of the SSD hard disk, marking the SSD hard disk as an abraded hard disk, and informing the start of migration;
the data migration module is used for stopping writing data into the SSD when receiving a migration starting command and continuously providing data reading service; migrating data according to the migration strategy: and reading data from the SSD hard disk according to the migration rate, writing the read data into other normal hard disks, successfully migrating all the data, and removing the worn hard disk from the system where the worn hard disk is located.
A third technical solution adopted by the present invention is an apparatus for predicting the lifetime of an SSD hard disk, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method according to any one of claims 1 to 4 when executing the computer program.
A fourth technical solution adopted by the present invention is a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the data protection method based on SSD hard disk life prediction is implemented.
The invention has the beneficial effects that: according to the invention, the data is migrated in advance by predicting the fault disk, so that the data protection is more active, unnecessary data loss and performance degradation risks are reduced, meanwhile, an adjustable room is reserved for users, and the use scenes of different users are greatly facilitated.
[ description of the drawings ]
Fig. 1 is a flowchart of a data protection method based on SSD hard disk life prediction according to the present invention.
[ detailed description ] embodiments
The present invention will be described in detail below with reference to the accompanying drawings and specific embodiments.
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to" determining "or" in response to detecting ". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".
Furthermore, in the description of the present invention and the appended claims, the terms "first," "second," and the like are used for distinguishing between descriptions and not necessarily for describing or implying relative importance.
Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise.
The invention provides a data protection method based on SSD hard disk life prediction, which comprises the following steps: reading S.M.A.R.T information of a hard disk, and acquiring the hard disk abrasion degree of the hard disk; self-defining a wear threshold; periodically comparing the hard disk wear level with the wear threshold, when the hard disk wear level is equal to the wear threshold: and stopping writing data into the hard disk, and migrating the data on the hard disk to other normal hard disks.
The English language of S.M.A.R.T is called Self-Monitoring Analysis and reporting technology, and the Chinese name is Self-detection Analysis report technology. The acquired hard disk abrasion degree ranges from 0% to 100%, the value is 0% when a new disk is not read and written, the value can be increased along with continuous reading and writing, when the value reaches 100%, the hard disk is completely abraded, and the hard disk is not recommended to be continuously used. In the present invention, the wear threshold is set to 80% by default, and the user is free to change, but not advised to exceed 90%. The method comprises the steps of periodically comparing the abrasion degree of the hard disk with an abrasion threshold value defined by a user, stopping writing data into the hard disk reaching the abrasion threshold value, and simultaneously reading the data on the hard disk according to the migration rate calculated by the user or a system and migrating the data to other normal hard disks. In the process, as the hard disk is still healthy and available, the minimum influence on the performance can be realized through controlling the migration process, so that the balance between the performance and the data safety is achieved.
As shown in fig. 1, the above method is specifically implemented according to the following steps:
s1, setting a wear threshold of the SSD hard disk and setting a data migration strategy; the migration strategy comprises a user-defined strategy and an automatic migration strategy. The custom policy is to migrate data at any specified migration time and migration rate. The SSD hard disk automatically migrates according to the current load condition of the system where the SSD hard disk is located;
the migration rate calculation method comprises the following steps: r ═ Dr (1-MAX (Cu, Mu, Bu));
wherein, R is migration rate, Cu is system CPU utilization rate, and the value is 0-100%; mu, the memory utilization rate is 0-100%; du is the hard disk utilization rate, and the value is 0-100%; MAX: taking the maximum value of the three; dr hard disk read speed.
S2, acquiring the abrasion degree data of the SSD hard disk, and periodically comparing the abrasion degree with the magnetic disk threshold: when the abrasion degree reaches a set threshold value, setting an abrasion mark of the SSD hard disk, marking the SSD hard disk as an abraded hard disk, and informing the start of migration;
s3, when receiving the migration starting command, stopping writing data into the SSD hard disk and continuously providing data reading service;
migrating data according to the migration strategy: and reading data from the SSD hard disk according to the migration rate, writing the read data into other normal hard disks, successfully migrating all the data, and removing the worn hard disk from the system where the worn hard disk is located.
The invention provides a device for predicting the service life of an SSD, which comprises a user interaction module, a data monitoring module and a data migration module, as shown in FIG. 1.
And the user interaction module is used for setting a wear threshold of the SSD and setting a migration strategy. The module comprises display of hard disk abrasion degree, switch of a migration function and setting of a migration strategy, and the strategy supports dynamic modification in the migration process. And after the migration is finished, informing a user that the data migration is finished, and replacing the hard disk. Migration policies include customization and automation. In the custom module, the user can specify when and at what rate migration is to occur. For example, data is migrated at 00:00 to 06:00, 100M per second per day. If no strategy is set, migration is automatically carried out according to the load condition of the current system, and the migration rate is calculated as follows:
R＝(1-MAX(Cu,Mu,Bu))*Dr
r migration rate
Cu, the utilization rate of a system CPU is 0-100%;
mu, the memory utilization rate is 0-100%;
du is the hard disk utilization rate, and the value is 0-100%;
MAX: taking the maximum value of the three;
dr hard disk read speed.
The data monitoring module is used for acquiring the abrasion degree data of the SSD hard disk, and periodically comparing the abrasion degree with the magnetic disk threshold value: and when the abrasion degree reaches a set threshold value, setting an abrasion mark of the SSD hard disk, marking the SSD hard disk as an abraded hard disk, and informing the start of migration. The method comprises the steps of collecting the wear degree data of the SSD hard disk of the storage system, and obtaining and calculating the utilization rate of a CPU, an internal memory and a bandwidth. Wherein the hard disk wear level information is obtained by reading the s.m.a.r.t information. The hard disk utilization rate is the average of the utilization rates of all other hard disks in the current system. And when the abrasion degree of the hard disk reaches a set threshold value, setting the hard disk mark as abrasion, and informing the data migration module to start migration.
The data migration module is used for stopping writing data into the SSD when receiving a migration starting command and continuously providing data reading service; migrating data according to the migration strategy: and reading data from the SSD hard disk according to the migration rate, writing the read data into other normal hard disks, successfully migrating all the data, and removing the worn hard disk from the system where the worn hard disk is located. When it receives a command to start migration, it stops writing to the worn disk, but still supports reading. And the migration module reads data from the hard disks in sequence according to the set or calculated migration rate, ranks the abrasion degrees of other hard disks in the system, and preferentially selects the hard disk with the minimum abrasion degree to write the data.
It should be noted that, because the contents of information interaction, execution process, and the like between the modules are based on the same concept as the method embodiment of the present invention, specific functions and technical effects thereof may be referred to specifically in the method embodiment section, and are not described herein again.
It will be clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely illustrated, and in practical applications, the above function distribution may be performed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to perform all or part of the above described functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional modules are only used for distinguishing one functional module from another, and are not used for limiting the protection scope of the application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The invention further provides equipment for predicting the service life of the SSD, which comprises a memory, a processor and a computer program which is stored in the memory and can run on the processor, wherein the processor realizes the data protection method based on the service life prediction of the SSD when executing the computer program.
An apparatus for SSD hard disk life prediction may be a desktop computer, a notebook, a palm top computer, a cloud server, and other computing devices. The device may include, but is not limited to, a processor and a memory. The Processor may be a Central Processing Unit (CPU), or other general purpose Processor, a Digital Signal Processor (DSP), or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The memory may in some embodiments be an internal storage unit of the device, such as a hard disk or a memory of the device. The memory may also be an external storage device of the device in other embodiments, such as a plug-in hard drive provided on the device, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like. The memory may also include both internal and external storage units of the device. The memory is used for storing an operating system, application programs, a BootLoader (BootLoader), data, and other programs, such as program codes of the computer programs, and the like. The memory may also be used to temporarily store data that has been output or is to be output.
The invention also provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to realize the data protection method based on the SSD hard disk life prediction.
The data protection method and device based on SSD hard disk life prediction adopt active and effective data protection, flexible data migration protection strategies, adaptive migration rate and reduced influence on performance. The risk of data loss in the system is reduced. The system resource occupation is small, and the characteristics of the SSD hard disk are fully utilized. The invention provides a data migration protection scheme based on SSD hard disk life prediction. The method solves the problems and risks caused by the fact that a storage system passively waits for a hard disk fault to start rebuilding in the prior art.
The invention fully utilizes the characteristics of the SSD hard disk, is different from the data protection scheme of the existing storage system, realizes the advanced migration of data through the prediction of a fault disk, ensures that the data protection is more active and active, reduces unnecessary data loss and performance degradation risks, simultaneously leaves an adjustable room for users, and greatly facilitates the use scenes of different users. The user can conveniently replace the hard disks in the same batch through the function, the condition that a plurality of hard disks fail at the same time in the SSD is reduced, and the system stability is greatly improved. Meanwhile, the invention has the advantages of simple use of functions, convenient maintenance, small occupied system resources, suitability for large-scale deployment and reduction of the cost and pressure of system operation and maintenance.
Those of ordinary skill in the art will appreciate that the various illustrative modules and steps described in connection with the teachings of the present disclosure may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided by the present invention, it should be understood that the disclosed apparatus/device and method can be implemented in other ways. For example, the above-described apparatus/device embodiments are merely illustrative, and for example, a division of modules is merely a division of logical functions, and an actual implementation may have another division, for example, a plurality of modules may be combined or integrated into another system, or some features may be omitted, or not executed. Modules described as separate components may or may not be physically separate, and modules may or may not be physical units, i.e., may be located in one place, or may be distributed over a plurality of network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
Examples
Step 1: starting the function, and setting the SSD disk abrasion degree to be 90%;
step 2: setting a migration strategy as a user-defined strategy, wherein the migration starting time is 00:00-06:00 every day, the migration rate is 400M/S, and then starting data on a disk;
and step 3: reading the abrasion value of an SSD disk in the system every 5 minutes, and comparing the abrasion value with a value set by a user;
and 4, step 4: when the abrasion value of the disk reaches a threshold value, marking the disk as a disk to be migrated, and simultaneously informing a user of the disk to be migrated;
and 5: the system judges that the mark to be migrated is true, and stops writing data on the disk, so that the system turns to write other disks;
step 6: the set migration strategy is self-defined, so when the system time is 00:00, the migration is started, the system calculates the data volume to be migrated on the disk to be migrated, and then the data is read out according to the migration speed set by the user;
and 7: sequencing the abrasion degree and the capacity utilization rate of other normal disks in the system, and preferentially selecting the disk data with low abrasion degree and low capacity utilization rate to write;
and 8: when the data on the disk to be migrated is completely migrated, the data is kicked out of the system, and the user is informed that the migration is completed, so that the disk can be replaced.
Since the user can select the time to start migration according to the service scenario, it is assumed here that 00:00-06:00 is the service idle period. In contrast, in the system for shutting down the function, 6 SSD disks with a capacity of 1TB are selected, the disk is continuously written, a disk failure is simulated at an indeterminate point in time, the system starts to rebuild to recover the data, during which the user service performance is reduced by more than 50%, and the entire recovery process lasts for about 4 hours.
In the system with the function, the data on the disk is migrated in the idle period of the service due to the fact that the disk is predicted to be about to fail soon in advance, so that the performance of the system is not affected, and the whole migration process only lasts for about 40 minutes due to the fact that the data on the original disk is directly read out.
Through comparison, the invention reduces various risks and influences which are possibly generated by disk faults on the system, improves the stability of the system and further ensures the user service.
Claims (7)
1. A data protection method based on SSD hard disk life prediction is characterized by comprising the following steps:
reading S.M.A.R.T information of a hard disk, and acquiring the hard disk abrasion degree of the hard disk;
self-defining a wear threshold;
periodically comparing the hard disk wear level with the wear threshold, when the hard disk wear level is equal to the wear threshold: and stopping writing data into the hard disk, and migrating the data on the hard disk to other normal hard disks.
2. The data protection method based on the SSD hard disk life prediction as claimed in claim 1, is implemented according to the following steps:
s1, setting a wear threshold of the SSD hard disk and setting a data migration strategy;
s2, acquiring the abrasion degree data of the SSD hard disk, and periodically comparing the abrasion degree with the magnetic disk threshold: when the abrasion degree reaches a set threshold value, setting an abrasion mark of the SSD hard disk, marking the SSD hard disk as an abraded hard disk, and informing the start of migration;
s3, when receiving the migration starting command, stopping writing data into the SSD hard disk and continuously providing data reading service;
migrating data according to the migration strategy: and reading data from the SSD hard disk according to the migration rate, writing the read data into other normal hard disks, successfully migrating all the data, and removing the worn hard disk from the system where the worn hard disk is located.
3. The data protection method based on the lifetime prediction of the SSD hard disk of claim 2, wherein in S1, the migration policy comprises a user-defined policy, and the user-defined policy is to migrate data at any specified migration time and migration rate.
4. The data protection method based on the lifetime prediction of the SSD hard disk of claim 2, wherein in S1, the migration policy comprises an automatic migration policy, and the automatic migration policy is that the SSD hard disk is automatically migrated according to a current load condition of a system in which the SSD hard disk is located;
the migration rate calculation method comprises the following steps: r ═ Dr (1-MAX (Cu, Mu, Bu));
wherein, R is migration rate, Cu is system CPU utilization rate, and the value is 0-100%; mu, the memory utilization rate is 0-100%; du is the hard disk utilization rate, and the value is 0-100%; MAX: taking the maximum value of the three; dr hard disk read speed.
5. An apparatus for SSD hard disk life prediction, comprising:
the user interaction module is used for setting a wear threshold of the SSD hard disk and setting a migration strategy;
the data monitoring module is used for acquiring the abrasion degree data of the SSD hard disk, and periodically comparing the abrasion degree with the magnetic disk threshold value: when the abrasion degree reaches a set threshold value, setting an abrasion mark of the SSD hard disk, marking the SSD hard disk as an abraded hard disk, and informing the start of migration;
the data migration module is used for stopping writing data into the SSD when receiving a migration starting command and continuously providing data reading service; migrating data according to the migration strategy: and reading data from the SSD hard disk according to the migration rate, writing the read data into other normal hard disks, successfully migrating all the data, and removing the worn hard disk from the system where the worn hard disk is located.
6. An apparatus for SSD hard disk life prediction, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 1 to 4 when executing the computer program.
7. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010092847.2A CN111324304A (en) | 2020-02-14 | 2020-02-14 | Data protection method and device based on SSD hard disk life prediction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010092847.2A CN111324304A (en) | 2020-02-14 | 2020-02-14 | Data protection method and device based on SSD hard disk life prediction |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111324304A true CN111324304A (en) | 2020-06-23 |
Family
ID=71165215
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010092847.2A Pending CN111324304A (en) | 2020-02-14 | 2020-02-14 | Data protection method and device based on SSD hard disk life prediction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111324304A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112905119A (en) * | 2021-02-19 | 2021-06-04 | 山东英信计算机技术有限公司 | Data writing control method, device and equipment of distributed storage system |
| CN113419682A (en) * | 2021-06-30 | 2021-09-21 | 湖南国科微电子股份有限公司 | Data processing method and device and computer flash memory equipment |
| CN113590547A (en) * | 2021-06-30 | 2021-11-02 | 济南浪潮数据技术有限公司 | Cache management method and system for ICFS |
| WO2022057374A1 (en) * | 2020-09-18 | 2022-03-24 | 苏州浪潮智能科技有限公司 | Method and apparatus for improving raid data backup efficiency |
| CN116028312A (en) * | 2023-02-27 | 2023-04-28 | 浪潮电子信息产业股份有限公司 | Method, device and medium for processing expiration of service life of solid state disk |
| CN116774948A (en) * | 2023-08-18 | 2023-09-19 | 合肥联宝信息技术有限公司 | Data processing method, device, electronic device and storage medium |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101436153A (en) * | 2008-11-29 | 2009-05-20 | 成都市华为赛门铁克科技有限公司 | Method and apparatus for restoring solid storage hard disk data |
| CN101740132A (en) * | 2008-11-27 | 2010-06-16 | 成都市华为赛门铁克科技有限公司 | Early warning method for life service of solid state disc, solid state disc and early warning system |
| CN102521058A (en) * | 2011-12-01 | 2012-06-27 | 北京威视数据系统有限公司 | Disk data pre-migration method of RAID (Redundant Array of Independent Disks) group |
| JP2014135584A (en) * | 2013-01-09 | 2014-07-24 | Sharp Corp | Image forming apparatus |
| CN105760467A (en) * | 2016-02-05 | 2016-07-13 | 浪潮(北京)电子信息产业有限公司 | Real-time data read-write method, device and system and NFS server |
| US20170315753A1 (en) * | 2016-04-29 | 2017-11-02 | Netapp, Inc. | Drive Wear-Out Prediction Based on Workload and Risk Tolerance |
| CN107589913A (en) * | 2017-09-19 | 2018-01-16 | 郑州云海信息技术有限公司 | A kind of method, apparatus and equipment of memory cell distribution |
| CN108228384A (en) * | 2016-12-22 | 2018-06-29 | 北京奇虎科技有限公司 | A kind of method and apparatus of backup enterprise terminal data |
| CN108647136A (en) * | 2018-05-10 | 2018-10-12 | 南京道熵信息技术有限公司 | Hard disk corruptions prediction technique and device based on SMART information and deep learning |
| CN109062506A (en) * | 2018-07-16 | 2018-12-21 | 山东大学 | The full flash memory disk array of RAID-5 and the method for improving array bulk life time |
| US20190129647A1 (en) * | 2017-10-27 | 2019-05-02 | EMC IP Holding Company LLC | Method, device and computer program product for managing disk array |
| US20190227898A1 (en) * | 2018-01-19 | 2019-07-25 | Seagate Technology Llc | Wear Mitigation in a Data Storage System Through Data Migration |
| US10474371B1 (en) * | 2016-06-30 | 2019-11-12 | EMC IP Holding Company LLC | Method and apparatus for SSD/flash device replacement policy |
-
2020
- 2020-02-14 CN CN202010092847.2A patent/CN111324304A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101740132A (en) * | 2008-11-27 | 2010-06-16 | 成都市华为赛门铁克科技有限公司 | Early warning method for life service of solid state disc, solid state disc and early warning system |
| CN101436153A (en) * | 2008-11-29 | 2009-05-20 | 成都市华为赛门铁克科技有限公司 | Method and apparatus for restoring solid storage hard disk data |
| CN102521058A (en) * | 2011-12-01 | 2012-06-27 | 北京威视数据系统有限公司 | Disk data pre-migration method of RAID (Redundant Array of Independent Disks) group |
| JP2014135584A (en) * | 2013-01-09 | 2014-07-24 | Sharp Corp | Image forming apparatus |
| CN105760467A (en) * | 2016-02-05 | 2016-07-13 | 浪潮(北京)电子信息产业有限公司 | Real-time data read-write method, device and system and NFS server |
| US20170315753A1 (en) * | 2016-04-29 | 2017-11-02 | Netapp, Inc. | Drive Wear-Out Prediction Based on Workload and Risk Tolerance |
| US10474371B1 (en) * | 2016-06-30 | 2019-11-12 | EMC IP Holding Company LLC | Method and apparatus for SSD/flash device replacement policy |
| CN108228384A (en) * | 2016-12-22 | 2018-06-29 | 北京奇虎科技有限公司 | A kind of method and apparatus of backup enterprise terminal data |
| CN107589913A (en) * | 2017-09-19 | 2018-01-16 | 郑州云海信息技术有限公司 | A kind of method, apparatus and equipment of memory cell distribution |
| US20190129647A1 (en) * | 2017-10-27 | 2019-05-02 | EMC IP Holding Company LLC | Method, device and computer program product for managing disk array |
| US20190227898A1 (en) * | 2018-01-19 | 2019-07-25 | Seagate Technology Llc | Wear Mitigation in a Data Storage System Through Data Migration |
| CN108647136A (en) * | 2018-05-10 | 2018-10-12 | 南京道熵信息技术有限公司 | Hard disk corruptions prediction technique and device based on SMART information and deep learning |
| CN109062506A (en) * | 2018-07-16 | 2018-12-21 | 山东大学 | The full flash memory disk array of RAID-5 and the method for improving array bulk life time |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022057374A1 (en) * | 2020-09-18 | 2022-03-24 | 苏州浪潮智能科技有限公司 | Method and apparatus for improving raid data backup efficiency |
| CN112905119A (en) * | 2021-02-19 | 2021-06-04 | 山东英信计算机技术有限公司 | Data writing control method, device and equipment of distributed storage system |
| CN113419682A (en) * | 2021-06-30 | 2021-09-21 | 湖南国科微电子股份有限公司 | Data processing method and device and computer flash memory equipment |
| CN113590547A (en) * | 2021-06-30 | 2021-11-02 | 济南浪潮数据技术有限公司 | Cache management method and system for ICFS |
| CN113419682B (en) * | 2021-06-30 | 2022-06-03 | 湖南国科微电子股份有限公司 | Data processing method and device and computer flash memory equipment |
| CN113590547B (en) * | 2021-06-30 | 2024-02-23 | 济南浪潮数据技术有限公司 | Cache management method and system for ICFS |
| CN116028312A (en) * | 2023-02-27 | 2023-04-28 | 浪潮电子信息产业股份有限公司 | Method, device and medium for processing expiration of service life of solid state disk |
| CN116774948A (en) * | 2023-08-18 | 2023-09-19 | 合肥联宝信息技术有限公司 | Data processing method, device, electronic device and storage medium |
| CN116774948B (en) * | 2023-08-18 | 2023-11-28 | 合肥联宝信息技术有限公司 | Data processing method, device, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111324304A (en) | Data protection method and device based on SSD hard disk life prediction | |
| US7457916B2 (en) | Storage system, management server, and method of managing application thereof | |
| US8156381B2 (en) | Storage management apparatus and storage system | |
| US8914340B2 (en) | Apparatus, system, and method for relocating storage pool hot spots | |
| US8122158B1 (en) | Method for improving I/O performance of host systems by applying future time interval policies when using external storage systems | |
| US10067840B1 (en) | Life expectancy data migration | |
| JP5938965B2 (en) | Node device and processing speed management method of multi-node storage system | |
| WO2014098872A1 (en) | Raid storage processing | |
| US8812779B2 (en) | Storage system comprising RAID group | |
| CN111124264B (en) | Method, apparatus and computer program product for reconstructing data | |
| CN111104051B (en) | Method, apparatus and computer program product for managing a storage system | |
| US20100100677A1 (en) | Power and performance management using MAIDx and adaptive data placement | |
| US10606490B2 (en) | Storage control device and storage control method for detecting storage device in potential fault state | |
| CN111124262A (en) | Management method, apparatus and computer readable medium for Redundant Array of Independent Disks (RAID) | |
| CN110737924A (en) | method and equipment for data protection | |
| US8843781B1 (en) | Managing drive error information in data storage systems | |
| US11263069B1 (en) | Using unsupervised learning to monitor changes in fleet behavior | |
| CN109725835A (en) | For managing the method, equipment and computer program product of disk array | |
| CN110780821A (en) | Optimization method and device of distributed storage system, server and storage medium | |
| CN116414661B (en) | Processing method and device for solid state disk of distributed storage | |
| JPWO2013190649A1 (en) | Information processing method and apparatus for virtual disk migration | |
| CN115878052B (en) | RAID array inspection method, inspection device and electronic equipment | |
| US7546489B2 (en) | Real time event logging and analysis in a software system | |
| CN113811862A (en) | Dynamic performance level adjustment for storage drives | |
| CN109947365B (en) | Distributed storage data verification method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200623 |