CN111367466A - Disk pre-retirement method and device - Google Patents

Disk pre-retirement method and device Download PDF

Info

Publication number
CN111367466A
CN111367466A CN201811603251.3A CN201811603251A CN111367466A CN 111367466 A CN111367466 A CN 111367466A CN 201811603251 A CN201811603251 A CN 201811603251A CN 111367466 A CN111367466 A CN 111367466A
Authority
CN
China
Prior art keywords
disk
data
marked
retirement
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811603251.3A
Other languages
Chinese (zh)
Other versions
CN111367466B (en
Inventor
徐佳宏
李银
刘彬
李威青
刘勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Ipanel TV Inc
Original Assignee
Shenzhen Ipanel TV Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Ipanel TV Inc filed Critical Shenzhen Ipanel TV Inc
Priority to CN201811603251.3A priority Critical patent/CN111367466B/en
Publication of CN111367466A publication Critical patent/CN111367466A/en
Application granted granted Critical
Publication of CN111367466B publication Critical patent/CN111367466B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0616—Improving the reliability of storage systems in relation to life time, e.g. increasing Mean Time Between Failures [MTBF]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1458—Management of the backup or restore process
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0647—Migration mechanisms
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/065—Replication mechanisms
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0689—Disk arrays, e.g. RAID, JBOD
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the invention provides a disk pre-retirement method, which includes the steps of monitoring the service time T1 of a disk in real time, counting the total number N of disks to be marked, which are larger than a first preset time T2 and not marked in a retired state, of the current service time T1, determining a value M based on the difference value of the total number N, the disk survival time T and the service time T1, judging whether M is larger than or equal to 1, if the value M is larger than or equal to 1, marking the states of the disks to be marked, which are totally M disks to be marked from long to short, of the current corresponding service time T1 in the N disks to be marked as a pre-retirement state, migrating data in the disks marked in the pre-retirement state to a target disk, and updating the disk state of the pre-retirement state to be a retired state when all data in the disks in the pre-retirement state are migrated. By the disk pre-retirement method, the disk which uses a certain working time is retired according to a plan, so that the problem of data loss caused by damage of a large number of disks due to the service life of the disks is solved.

Description

Disk pre-retirement method and device
Technical Field
The invention relates to the technical field of computers, in particular to a disk pre-retirement method and a disk pre-retirement system.
Background
The server is a device for providing computing services for the computer, the server comprises a processor, a hard disk, a memory, a system bus and the like, the server is similar to a general computer architecture, but the server needs to provide highly reliable services, so the server has higher requirements on processing capacity, stability, reliability, safety, expandability, manageability and the like than the computer. The hard disk in a server is also called a disk, at least hundreds of disks and thousands of disks are arranged in one server, a large amount of data information is stored in the disks, and the server provides services for users by using the data information.
However, a disk is generally damaged after being used for three years, at least hundreds of disks are arranged in a server, and more hundreds of disks are arranged in the server.
Disclosure of Invention
In view of this, embodiments of the present invention provide a disk retirement method and system, which retire a disk in a server through the disk retirement method, so as to prevent data loss in the disk due to collective damage to the disk.
In order to achieve the above purpose, the embodiments of the present invention provide the following technical solutions:
the first aspect discloses a disk pre-retirement method, which comprises the following steps:
monitoring the use time T1 of the disk in real time, wherein the use time T1 is the time difference between the current system time and the first online time of the disk;
counting the total number N of the disks to be marked which are not marked as a retired state and have the current use time T1 being greater than a first preset time T2, wherein N is a positive integer greater than or equal to 1;
determining a value M based on a difference between the total number N, the disk lifetime T and the usage time T1, wherein M ≈ N ÷ (T-T1), and M is a rounded positive integer;
if the value M is greater than or equal to 1, marking the states of the M disks to be marked, which correspond to the service time T1 from long to short, in the N disks to be marked as a pre-retired state, wherein M is less than or equal to N;
migrating the data marked in the disk in the pre-retirement state to a target disk;
and when the data in the disk in the pre-retirement state is completely migrated, updating the disk state in the pre-retirement state to be a retired state.
Preferably, the migrating the data in the disk marked as the pre-retirement state to the target disk includes:
acquiring the id of a disk block with a use mark in the disk in the pre-retirement state;
determining a disk block to be migrated based on the id and the usage flag;
and determining a target disk, and migrating the data in the disk block to be migrated to the target disk, wherein the target disk is a disk which is not marked as a pre-retirement state.
Preferably, the determining a target disk, and migrating the data in the disk block to be migrated to the target disk, includes:
acquiring a disk which is not marked as a pre-retirement state within a preset time interval by using time T1;
determining that a disk with a free disk block in the disks which are not marked as the pre-retirement state is a target disk;
determining that the disk block to which the data in the disk block to be migrated belongs is a disk block to be migrated, and migrating the data in the disk block to be migrated to the free disk block;
and replacing the id of the disk block to be migrated in the disk block list with the id of the free disk block.
Preferably, the method further comprises the following steps:
reading the data in the disk in the pre-retirement state in the process of transferring the data in the disk marked in the pre-retirement state to a target disk;
judging whether the data in the disk in the pre-retirement state is migrated or not;
if the data is migrated, reading the data in a target disk block to which the data is migrated;
and if the data is migrating or the data is not migrating, reading the data in the disk in the pre-retirement state.
Preferably, the method further comprises the following steps:
in the process of transferring the data marked in the disk in the pre-retirement state to a target disk, if the disk in the pre-retirement state is damaged, acquiring the id of a disk block with a use mark in the disk in the pre-retirement state;
acquiring original data and coded data corresponding to the disk block with the use mark in a backup disk based on the id;
generating data to be migrated corresponding to the disk block with the use mark based on the original data and the encoded data;
and determining a target disk, and storing the data to be migrated into the target disk, wherein the target disk is a disk to be marked which is not marked as a retirement state.
Preferably, the method further comprises the following steps:
in the process of migrating the data in the disk marked in the pre-retirement state to a target disk, if a disk block of the data to be migrated in the pre-retirement disk is damaged, acquiring an id of the damaged disk block, and acquiring original data and encoded data corresponding to the damaged disk block in a backup disk based on the id;
generating migration data corresponding to the damaged disk block based on the original data and the encoded data;
and determining a target disk, and storing the migration data into the target disk, wherein the target disk is a disk to be marked which is not marked as a retirement state.
A second aspect discloses a disk pre-retirement system, comprising:
the monitoring module is used for monitoring the service time T1 of the disk in real time, wherein the service time T1 is the time difference between the current system time and the first online time of the disk;
the counting module is used for counting the total number N of the disks to be marked which are not marked as a retired state and have the use time T1 being greater than a first preset time T2, wherein N is a positive integer greater than or equal to 1;
an obtaining module, configured to determine a value M based on a difference between the total number N, the disk lifetime T, and the usage time T1, where M ≈ N ÷ (T-T1), and M is a rounded positive integer;
a marking module, configured to mark, in N disks to be marked, states of M disks to be marked, where M is less than or equal to N, that are currently corresponding to the service time T1 from long to short;
the migration module is used for migrating the data marked as the pre-retirement state in the disk to a target disk;
and the updating module is used for updating the disk state of the pre-retirement state to be a retired state when all data in the disk of the pre-retirement state are migrated.
Preferably, the migration module includes:
an obtaining unit, configured to obtain id of a disk block with a use flag in the disk in the pre-retirement state;
a first determination unit configured to determine a disk block to be migrated based on the id and the usage flag;
and the second determining unit is used for determining a target disk, and migrating the data in the disk block to be migrated to the target disk, wherein the target disk is a disk which is not marked to be in a pre-retirement state.
Preferably, the second determination unit includes:
the obtaining subunit is configured to obtain a disk, within a preset time interval, of the use time T1, where the disk is not marked as a pre-retirement state;
a first determining subunit, configured to determine, as a target disk, a disk having a free disk block in the disks that are not marked in the pre-retirement state;
a second determining subunit, configured to determine that a disk block to which data in the disk block to be migrated belongs is a disk block to be migrated, and migrate the data in the disk block to be migrated to the free disk block;
and the processing subunit is configured to replace the id of the disk block to be migrated in the disk block list with the id of the free disk block.
Preferably, the method further comprises the following steps:
a determining unit, configured to determine whether data in the disk in the pre-retirement state is migrated when the data in the disk in the pre-retirement state is read in a process of migrating the data in the disk marked in the pre-retirement state to a target disk, execute a first reading unit if the data is migrated, and execute a second reading unit if the data is migrating or the data is not migrated;
a first reading unit, configured to read the data in a target disk block to which the data is migrated;
and the second reading unit is used for reading the data in the magnetic disk in the pre-retirement state.
From the above, in the disk pre-retirement method and system of the present invention, the usage time T1 of a disk is monitored in real time, where the usage time T1 is a time difference between the current system time and the first time online time of the disk, then the current usage time T1 is counted as a positive integer greater than a first preset time T2, and the total number N of disks to be marked that are not marked as a retired state is greater than or equal to 1, then a value M is determined based on the difference between the total number N, the disk lifetime T, and the usage time T1, then whether M is greater than or equal to 1 is determined, if M is greater than or equal to 1, then in N disks to be marked, states of M disks to be marked that currently correspond to the usage time T1 from long to short are marked as a pre-retired state, and then data in the disks marked as the pre-retired state is migrated to a target disk, and when the data in the disk in the pre-retirement state is completely migrated, updating the disk state in the pre-retirement state to be a retired state. By the disk pre-retirement method, the disk which uses a certain working time is retired according to a plan, so that the problem of data loss caused by damage of a large number of disks due to the service life of the disks is solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a flowchart of a method for pre-retirement of a disk according to an embodiment of the present invention;
FIG. 2 is a flowchart of another method for pre-retirement of a disk according to an embodiment of the present invention;
FIG. 3 is a flowchart of another method for pre-retirement of a disk according to an embodiment of the present invention;
FIG. 4 is a flowchart of another method for pre-retirement of a disk according to an embodiment of the present invention;
FIG. 5 is a flowchart of another method for pre-retirement of a disk according to an embodiment of the present invention;
FIG. 6 is a flowchart of another method for pre-retirement of a disk according to an embodiment of the present invention;
FIG. 7 is a block diagram of a disk retirement system according to an embodiment of the present invention;
FIG. 8 is a block diagram of an alternative exemplary embodiment of a disk retirement system;
FIG. 9 is a block diagram of an alternative exemplary embodiment of a disk retirement system;
FIG. 10 is a block diagram of another exemplary embodiment of a disk retirement system.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In this application, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
An embodiment of the present invention provides a method for pre-retirement of a disk, a flowchart of which is shown in fig. 1, where the method at least includes the following steps:
step S101: the usage time T1 of the disk is monitored in real time.
The utilization time T1 is the difference between the current system time and the first time the disk is on-line, and is usually in days. The use time T1 is a dynamic time. For example, if the first online time of the disk is 12 months and 1 day in 2018, and the current system time is 12 months and 6 days in 2018, the usage time T1 monitored in real time in step S101 is 5 days. And continuing to perform monitoring, namely, after the current system time is 12 months and 7 days in 2018, the service time T1 of the currently monitored disk is 6 days.
It should be noted that all disks in the storage server cluster are managed uniformly in the information management module, and the information management module includes the physical device disk number diskid, the ip and port of the server, the retirement flag, and the online time of all disks. The diskid is uniformly allocated with a unique id to the disk from disk management when the disk is on line for the first time. And recording the disk diskid in the disk, and reporting the disk id, the ip and the port of the server to the information management module by the management program corresponding to the disk if the disk is online. Therefore, the use time of the disk can be monitored in real time through the current system time and the first online time of the disk recorded in the information management module.
Step S102: counting the total number N of the disks to be marked which are not marked in the pre-retirement state and have the current use time T1 being larger than a first preset time T2, wherein N is a positive integer larger than or equal to 1.
The first preset time T2 is set according to the service life of the disk and the number of disks in the storage server cluster, and the time unit in the present invention is preferably, but not limited to, a day. And counting the total number N of the disks to be marked which are not marked as the pre-retirement state and have the current use time T1 larger than the first preset time T2, wherein the disks marked as the retirement state do not have the disk for storing data, so that the disks marked as the retirement state do not need to be counted.
Step S103: and obtaining a value M by using a formula (1) based on the difference value of the total number N, the disk life time T and the use time T1.
The formula (1) is:
M≈N÷(T-T1) (1)
it should be noted that the lifetime T of the disk refers to the actual available time of the disk, i.e. the lifetime of the disk. The residual life of the disk is obtained by T-T1, the difference of the T-T1 is divided by N, if a numerical value which is larger than or equal to 1 is obtained, the numerical value is rounded to obtain a numerical value M, the M is the number of the disks which need to be retired in the current day of the residual life of the disk, the number of the retired disks in the current day can be understood as the number of the retired disks in the current day, the retirement can be carried out before the disk life reaches the preset time, the workload of the cluster system of the storage server is reduced, and the occurrence of an event that a plurality of disks are damaged together can be prevented.
For ease of understanding, the following examples are given.
For example, in a disk cluster, the first preset time T2 is 548 days, the lifetime of the disk is 1094 days, the lifetime of the disk is 1096 days, the difference between the lifetime T of the disk and the lifetime T1 is 1096-.
Step S104: and judging whether the M is greater than or equal to 1, if the M is less than 1, returning to the step S101, and if the M is greater than or equal to 1, executing the step S106.
If M is greater than or equal to 1, it indicates that more than T2 disks need to be retired within the first preset time T2; if M is less than 1, it means that there is no disk to be retired or the number of disks to be retired is small in the first preset time T2. Because no disks needing to be retired or the number of the disks needing to be retired is small, the disks which are online do not need to be retired, and if the disks which reach the preset time are damaged in the running process, the storage server cluster can restore the data in the damaged disks through other backup disks.
The storage server cluster adopts a distributed storage system, the system is a backup system or a coding system, namely, the data information in other disk blocks can be recovered according to the data block information in the damaged disk.
Step S105: and in the N disks to be marked, marking the states of the M disks to be marked, which correspond to the service time T1 from long to short, as a pre-retirement state, wherein M is less than or equal to N.
Since the lifetime of a magnetic disk is limited and the longest time to write data represents the most likely damage, it is necessary to select the magnetic disk whose time to write data is longest and perform retirement.
Step S106: and migrating the data marked as the disk in the pre-retirement state to a target disk.
It should be noted that the meaning of the existence of the disk itself is to store data, and in the present invention, the disk storing the data needs to be retired, so the data needs to be migrated to another disk before the disk is retired, so as to ensure that the data is not lost.
Step S107: and when the data in the disk in the pre-retirement state is completely migrated, updating the disk state in the pre-retirement state to be a retired state.
There are several disk blocks in a disk, so that when the data in these disk blocks need to be migrated, that is, all the data in the disk needs to be migrated, the disk state in the pre-retirement state is updated to the retired state.
It should be noted that, since the disk marked as the pre-retirement state is in a damaged edge, the data of the pre-retirement disk cannot be stored in the disk in the pre-retirement state, and in order to avoid storing the data in the disk in the pre-retirement state, after all the data in the disk in the pre-retirement state is migrated, the disk in the pre-retirement state is marked as the retirement disk, and the data is prevented from being stored in the disk.
According to the embodiment of the invention, the service time T1 of the disk is monitored in real time, wherein the service time T1 is the time difference between the current system time and the first online time of the disk; counting the total number N of the disks to be marked which are not marked as a retired state and have the current use time T1 being greater than a first preset time T2, wherein N is a positive integer greater than or equal to 1; determining a value M based on a difference between the total number N, the disk lifetime T, and the usage time T1; judging whether the M is greater than or equal to 1, if so, marking the current states of the M disks to be marked, which correspond to the service time T1 from long to short, in the N disks to be marked as pre-retired states; migrating the data marked in the disk in the pre-retirement state to a target disk; and when the data in the disk in the pre-retirement state is completely migrated, updating the disk state in the pre-retirement state to be a retired state. By the disk pre-retirement method, the disk which uses a certain working time is retired according to a plan, so that the problem of data loss caused by damage of a large number of disks due to the service life of the disks is solved.
Based on the method for pre-retiring a disk disclosed in the foregoing embodiment of the present invention, the specific implementation process of step S106 shown in fig. 1 includes the following steps as shown in fig. 2:
step S201: and acquiring the id of the disk block with the use mark in the disk in the pre-retirement state.
It should be noted that each disk is divided into a plurality of disk blocks, when a disk is initialized, all the disk blocks in the disk are numbered sequentially, the numbering starts from 0, the number of the largest disk block is the number of the disk block-1, the number of the disk block here is the id of the disk, and the id of the disk is stored in the information management module.
The information management module comprises the id, the use flag and the file identification of the disk block, if one disk block is used, the use flag of the disk block is used, the file identification is set to the id of the corresponding file, if the file corresponding to the file id is deleted, the data block is also set to be in an initialized state, the use flag is set to be 0, and the file identification is set to be 0.
Step S202: determining a disk block to be migrated based on the id and the usage flag.
It should be noted that, since the information of all the disk blocks is stored in the information management module, the disk block corresponding to the id can be found in the information management module by the id, so as to determine the disk block to be migrated.
Step S203: and determining a target disk, and migrating the data in the disk block to be migrated to the target disk, wherein the target disk is a disk which is not marked as a pre-retirement state.
It should be noted that, in the present invention, the disk marked as the pre-retirement state is the disk that needs to be retired immediately, if the target disk is the disk marked as the pre-retirement state and there are two or more disks that need to be retired on the same day, migrating the data of the disk marked as the pre-retirement state to another disk marked as the pre-retirement state is a dead loop process, and the object of the present invention cannot be achieved. Thus, the target disk must not be the disk marked as a pre-retired state.
When step S203 is executed, as shown in fig. 3, the specific implementation process includes the following steps:
step S301: and acquiring the disk which is not marked as a pre-retirement state within a preset time interval by using the time T1.
It should be noted that the present invention is built in a disk set having a large number of disks, for example, in a storage server cluster, there are a large number of disks that are not marked as a pre-retirement state, but in a large number of disks that are not marked as a pre-retirement state, there may be disks that will be marked as a pre-retirement in the next day. Therefore, it is necessary to search for a suitable disk among the disks not marked in the pre-retirement state as a target disk, that is, a disk whose time is within a predetermined time interval.
The preset time interval is a use time range interval, and the time interval is always within the service life range of the magnetic disk.
For example, in a disk cluster, there are 100 disks, and the 100 disks are all online one disk per day, so in the disk cluster, the use time of the 100 disks is 0 to 600 days, and if the preset time is 200 to 300 days, then the disk which is not marked as the pre-retirement state is selected from the use time of 200 to 300 days.
Step S302: and determining that the disk with the free disk block in the disks which are not marked as the pre-retirement state is the target disk.
In addition, in a large number of unmarked pre-retired disks, there are some disks that have no free disk blocks to store data, that is, there are disks that are full of data, and other data cannot be stored, so it is necessary to select a disk block that has free disk blocks as a target disk.
Step S303: and determining that the disk block to which the data in the disk block to be migrated belongs is the disk block to be migrated, and migrating the data in the disk block to be migrated to the free disk block.
It should be noted that, because there are many disk blocks in the disk and each disk block stores data separately, the disk block to which the data in the disk block to be migrated belongs needs to be the disk block to be migrated, and then the data of the disk to be migrated is migrated to the free disk block.
Step S304: and replacing the id of the disk block to be migrated in the disk block list with the id of the free disk block.
It should be noted that, in the information management module of a disk block, the data file id recorded by the id of each disk block in each disk is corresponding, the data in the disk block is migrated to another disk block, and in order to be able to read the migrated data file, the data file stored in the disk block needs to be found through the id of the disk, so that the original disk block id in the disk block list in the information management module needs to be replaced by the id of the existing disk block, so as to find the corresponding data file through the disk block id.
In the embodiment of the invention, the id of the disk block with the use mark in the disk in the pre-retirement state is obtained, the disk block to be migrated is determined based on the id and the use mark, then the target disk is determined, and the data in the disk block to be migrated is migrated to the target disk, wherein the target disk is the disk which is not marked as the pre-retirement state. By the disk pre-retirement method, data in the disk in the pre-retirement state are migrated to the target disk.
Based on the disk retirement method disclosed in the embodiment of the present invention, in the process of executing step S106 to migrate the data in the disk marked as the retirement state to the target disk, if the data in the disk in the retirement state needs to be read, the embodiment of the present invention also discloses a corresponding process of reading the data in the disk in the retirement state, as shown in fig. 4, including the following steps:
step S401: and judging whether the data in the disk in the pre-retirement state is migrated or not, if so, executing step S402, and if not, executing step S403.
It should be noted that, when the disk in the pre-retirement state is being retired, the user reads data, and since the original disk block is in a no-data state after data migration, the user cannot obtain data in the original disk block through the id of the original disk block. It is therefore necessary to determine whether the disk read by the user is migrated to determine in which disk block the user is fetching data.
Step S402: and reading the data in the target disk block to which the data is migrated.
It should be noted that, since the data in the disk block has been migrated, and the disk block id corresponding to the data file in the disk block list has been replaced with the id of the new disk block, the data file corresponding to the disk block may be read through the id of the new disk, that is, the data is read in the target disk.
Step S403: and reading the data in the disk in the pre-retirement state.
It should be noted that, because the data is being migrated or the data is not being migrated, the disk block id corresponding to the data file in the disk block list is not changed, the data corresponding to the disk block id may be stored in the original disk block or may be stored in a new disk block, if the data corresponding to the disk block id is stored in the original disk block, the data may be directly obtained through the disk block id, and if the data corresponding to the disk block id is stored in a new disk block, the new disk block id may be found through the id of the original disk block, and the data stored in the new disk block is obtained, that is, the data is read from the disk in the pre-retirement state.
The embodiment of the invention judges whether the data in the disk in the pre-retirement state is migrated, if the data is migrated, the data is read in the target disk block to which the data is migrated; and if the data is migrating or the data is not migrating, reading the data in the disk in the pre-retirement state. By reading the data in the disk in the pre-retirement state in the disk retirement process, the data in the disk in the pre-retirement state can be read in the disk pre-retirement process.
Based on the disk retirement method disclosed in the embodiment of the present invention, in the process of executing step S106 to migrate data in the disk marked as the retirement state to the target disk, if the disk in the retirement state is damaged, the embodiment of the present invention also discloses a corresponding data migration process of the damaged disk in the retirement state, as shown in fig. 5, including the following steps:
step S501: and acquiring the id of the disk block with the use mark in the disk in the pre-retirement state.
It should be noted that, due to inconsistent lifetime of the disk, the disk may be damaged during the disk retirement process, and in order to prevent data in the disk from being lost, data in the disk needs to be recovered, where a plurality of disk blocks exist in the disk, a used disk block exists in the plurality of disk blocks, an unused disk block also exists, and a use flag also exists in the used disk block, where data is stored. Therefore, it is necessary to first obtain the disk block id with the use flag in the disk in the pre-retirement state.
Step S502: and acquiring original data and coded data corresponding to the disk block with the use mark in the backup disk based on the id.
It should be noted that, in the storage server cluster, a backup system or an encoding system is used, that is, data in a disk block in which data is lost is recovered through data of other disk blocks, a data file id corresponding to the id of each disk block is stored in a disk block list, and an id of a backup disk block corresponding to the file id is also stored, and in the backup disk block, original data and encoded data corresponding to the data in the disk block, or a copy of the data in the disk block is stored.
The encoding system is to encode a group of original data to obtain encoded data, divide the original data and the encoded data into a plurality of parts, and store the parts in different disk blocks of different disks.
The backup system is to copy multiple copies of original data and encoded data to different disk blocks of different disks.
Step S503: and generating the data to be migrated corresponding to the disk block with the use mark based on the original data and the coded data.
It should be noted that, it is prior art to generate data to be migrated with a usage flag corresponding to a magnetic disk block through original data and encoded data, and details are not repeated here.
Step S504: and determining a target disk, and storing the data to be migrated into the target disk, wherein the target disk is a disk to be marked which is not marked as a retirement state.
It should be noted that the execution process and the specific execution process of step S504 are the same as the execution principle and the specific implementation process of step S203 shown in fig. 2, and reference may be made to the above corresponding description, which is not described herein again.
The method comprises the steps of obtaining id of a disk block with a use mark in a disk in a pre-retirement state, obtaining original data and coded data corresponding to the disk block with the use mark in a backup disk based on the id, generating to-be-migrated data corresponding to the disk block with the use mark based on the original data and the coded data, finally determining a target disk, and storing the to-be-migrated data in the target disk, wherein the target disk is a to-be-marked disk which is not marked as a retirement state. By the disk pre-retirement method, the original data and the coded data of the damaged disk are obtained from the backup disk, the data in the damaged disk are generated, and the problem of data loss caused by damage of the target disk in the process of transferring the data in the disk marked in the pre-retirement state to the target disk can be solved.
Based on the disk retirement method disclosed in the embodiment of the present invention, in the process of executing step S106 to migrate data in the disk marked as the retirement state to the target disk, if a disk block of the data to be migrated in the disk in the retirement state is damaged, the embodiment of the present invention also correspondingly discloses a data migration process of the damaged disk block of the corresponding data to be migrated, and as shown in fig. 6, the process of migrating the data in the disk marked as the retirement state to the target disk includes the following steps:
step S601: and acquiring the id of the damaged disk block, and acquiring the original data and the coded data corresponding to the damaged disk block in the backup disk based on the id.
It should be noted that, due to the lifetime of a disk block, a disk block may be damaged in a disk pre-retirement process, and in order to prevent data in the disk block from being lost, data in the disk block needs to be recovered, so that a disk block id needs to be obtained first, and original data and encoded data corresponding to the damaged disk block need to be obtained in a backup disk through the disk block id.
Step S602: and generating migration data corresponding to the damaged disk block based on the original data and the coded data.
Step S603: and determining a target disk, and storing the migration data into the target disk, wherein the target disk is a disk to be marked which is not marked as a retirement state.
It should be noted that the execution process and the specific execution process of step S602 and step S603 are the same as the execution principle and the specific implementation process of step S502 and step S503 shown in fig. 5, and reference may be made to the above corresponding description, which is not repeated herein.
The method comprises the steps of obtaining id of a damaged disk block, obtaining original data and coded data corresponding to the damaged disk block in a backup disk based on the id, generating migration data corresponding to the damaged disk block based on the original data and the coded data, then determining a target disk, and storing the migration data into the target disk, wherein the target disk is a disk to be marked which is not marked as a retired state. By the disk pre-retirement method, the original data and the coded data of the damaged disk block are obtained from the backup disk, the data in the damaged disk block is generated, and the problem of data loss caused by damage of the disk block in the target disk in the process of transferring the data in the disk marked in the pre-retirement state to the target disk can be solved.
Based on the disk pre-retirement method disclosed by the embodiment of the present invention, the embodiment of the present invention further discloses a disk pre-retirement system correspondingly, as shown in fig. 7, the disk pre-retirement system mainly includes:
the monitoring module 701 is configured to monitor a use time T1 of the disk in real time, where the use time T1 is a time difference between a current system time and a first time online time of the disk.
A counting module 702, configured to count a total number N of disks to be marked that are not marked as a retired state and are currently in the use time T1 greater than a first preset time T2, where N is a positive integer greater than or equal to 1.
An obtaining module 703, configured to determine a value M based on a difference between the total number N, the disk lifetime T, and the usage time T1, where M ≈ N ÷ (T-T1), and M is a rounded positive integer.
A marking module 704, configured to mark, in the N disks to be marked, states of the M disks to be marked, which are currently corresponding to the service time T1 from long to short, as a pre-retirement state, where M is less than or equal to N, if the value M is greater than or equal to 1.
Whether M is equal to or greater than 1 may be determined by an independent determination module, or may be determined by the marking module 705.
A migration module 705, configured to migrate the data in the disk marked as the pre-retirement state to the target disk.
An updating module 706, configured to update the disk state of the pre-retirement state to a retired state when all data in the disk of the pre-retirement state completes migration.
Preferably, the migration module 705, as shown in fig. 8, includes:
an obtaining unit 801, configured to obtain id of a disk block with a use flag in the disk in the pre-retirement state.
A first determining unit 802, configured to determine a disk block to be migrated based on the id and the usage flag.
A second determining unit 803, configured to determine a target disk, and migrate data in the disk block to be migrated to the target disk, where the target disk is a disk that is not marked as a pre-retirement state.
Preferably, the second determining unit 803, as shown in fig. 9, includes:
an obtaining subunit 901, configured to obtain a disk that is not marked as a pre-retirement state within a preset time interval using time T1.
A first determining subunit 902, configured to determine, as a target disk, a disk having a free disk block in the disks that are not marked as the pre-retirement state.
A second determining subunit 903, configured to determine that the disk block to which the data in the disk block to be migrated belongs is the disk block to be migrated, and migrate the data in the disk block to be migrated to the free disk block.
A processing subunit 904, configured to replace the id of the disk block to be migrated in the disk block list with the id of the free disk block.
Preferably, the disk retirement system, as shown in fig. 10, further includes:
a determining unit 1001, configured to determine whether data in the disk in the pre-retirement state is migrated or not when reading the data in the disk in the pre-retirement state during migrating the data in the disk marked in the pre-retirement state to a target disk, if the data is migrated, execute a first reading unit, and if the data is being migrated or the data is not migrated, execute a second reading unit.
A first reading unit 1002, configured to read the data in a target disk block to which the data is migrated.
A second reading unit 1003, configured to read the data in the disk in the pre-retired state.
Preferably, the disk retirement system further includes:
a first obtaining unit, configured to, in a process of migrating data in the disk marked as the pre-retirement state to a target disk, if the disk in the pre-retirement state is damaged, obtain an id of a disk block with a use flag in the disk in the pre-retirement state.
And the second acquisition unit is used for acquiring original data and coded data corresponding to the disk block with the use mark in the backup disk based on the id.
And the data generating unit is used for generating the data to be migrated corresponding to the disk block with the use mark based on the original data and the coded data.
And the data storage unit is used for determining a target disk and storing the data to be migrated into the target disk, wherein the target disk is a disk to be marked which is not marked as a retired state.
Preferably, the disk retirement system further includes:
and the obtaining unit is used for obtaining the id of the damaged disk block if the disk block of the data to be migrated in the pre-retired disk is damaged in the process of migrating the data marked in the pre-retired disk to the target disk, and obtaining the original data and the encoded data corresponding to the damaged disk block in the backup disk based on the id.
And the data generation unit is used for generating migration data corresponding to the damaged disk block based on the original data and the coded data.
And the data storage unit is used for determining a target disk and storing the migration data into the target disk, wherein the target disk is a disk to be marked which is not marked as a retired state.
The specific execution principle and execution process of each module and unit in the disk retirement system disclosed in the above embodiment of the present invention are the same as those of the disk retirement method disclosed in the above embodiment of the present invention, and reference may be made to corresponding parts in the disk retirement method disclosed in the above embodiment of the present invention, which are not described herein again.
The method comprises the steps that the service time T1 of a disk is monitored in real time through a monitoring module, wherein the service time T1 is the time difference between the current system time and the first online time of the disk; the counting module counts the total number N of the disks to be marked which are not marked as the retired state and the service time T1, wherein the service time T1 is greater than a first preset time T2, N is a positive integer greater than or equal to 1, a numerical value M is determined based on the difference between the total number N, the disk life time T and the service time T1, the judging module judges whether the M is greater than or equal to 1, if the M is greater than or equal to 1, a processing module is executed, the processing module marks the states of the disks to be marked, which are corresponding to the service time T1 from long to short, as the pre-retired state, the migration module migrates the data in the disks marked as the pre-retired state to a target disk, and the updating module updates the disk state of the retired state to be the retired state when all the data in the disks in the pre-retired state are migrated. By the disk pre-retirement system, the disk which uses a certain working time is retired according to a plan, so that the problem of data loss caused by damage of a large number of disks due to the service life of the disks is solved.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, the system or system embodiments are substantially similar to the method embodiments and therefore are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for related points. The above-described system and system embodiments are only illustrative, wherein the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. A method for pre-retirement of a disk, comprising:
monitoring the use time T1 of the disk in real time, wherein the use time T1 is the time difference between the current system time and the first online time of the disk;
counting the total number N of the disks to be marked which are not marked as a retired state and have the current use time T1 being greater than a first preset time T2, wherein N is a positive integer greater than or equal to 1;
determining a value M based on a difference between the total number N, the disk lifetime T and the usage time T1, wherein M ≈ N ÷ (T-T1), and M is a rounded positive integer;
if the value M is greater than or equal to 1, marking the states of the M disks to be marked, which correspond to the service time T1 from long to short, in the N disks to be marked as a pre-retired state, wherein M is less than or equal to N;
migrating the data marked in the disk in the pre-retirement state to a target disk;
and when the data in the disk in the pre-retirement state is completely migrated, updating the disk state in the pre-retirement state to be a retired state.
2. The method of claim 1, wherein migrating data in the disk marked as the pre-retirement state to a target disk comprises:
acquiring the id of a disk block with a use mark in the disk in the pre-retirement state;
determining a disk block to be migrated based on the id and the usage flag;
and determining a target disk, and migrating the data in the disk block to be migrated to the target disk, wherein the target disk is a disk which is not marked as a pre-retirement state.
3. The method of claim 2, wherein the determining a target disk and migrating the data in the disk block to be migrated to the target disk comprises:
acquiring a disk which is not marked as a pre-retirement state within a preset time interval by using time T1;
determining that a disk with a free disk block in the disks which are not marked as the pre-retirement state is a target disk;
determining that the disk block to which the data in the disk block to be migrated belongs is a disk block to be migrated, and migrating the data in the disk block to be migrated to the free disk block;
and replacing the id of the disk block to be migrated in the disk block list with the id of the free disk block.
4. The method according to any one of claims 1-3, further comprising:
reading the data in the disk in the pre-retirement state in the process of transferring the data in the disk marked in the pre-retirement state to a target disk;
judging whether the data in the disk in the pre-retirement state is migrated or not;
if the data is migrated, reading the data in a target disk block to which the data is migrated;
and if the data is migrating or the data is not migrating, reading the data in the disk in the pre-retirement state.
5. The method according to any one of claims 1-3, further comprising:
in the process of transferring the data marked in the disk in the pre-retirement state to a target disk, if the disk in the pre-retirement state is damaged, acquiring the id of a disk block with a use mark in the disk in the pre-retirement state;
acquiring original data and coded data corresponding to the disk block with the use mark in a backup disk based on the id;
generating data to be migrated corresponding to the disk block with the use mark based on the original data and the encoded data;
and determining a target disk, and storing the data to be migrated into the target disk, wherein the target disk is a disk to be marked which is not marked as a retirement state.
6. The method according to any one of claims 1-3, further comprising:
in the process of migrating the data in the disk marked in the pre-retirement state to a target disk, if a disk block of the data to be migrated in the pre-retirement disk is damaged, acquiring an id of the damaged disk block, and acquiring original data and encoded data corresponding to the damaged disk block in a backup disk based on the id;
generating migration data corresponding to the damaged disk block based on the original data and the encoded data;
and determining a target disk, and storing the migration data into the target disk, wherein the target disk is a disk to be marked which is not marked as a retirement state.
7. A disk pre-retirement system, comprising:
the monitoring module is used for monitoring the service time T1 of the disk in real time, wherein the service time T1 is the time difference between the current system time and the first online time of the disk;
the counting module is used for counting the total number N of the disks to be marked which are not marked as a retired state and have the use time T1 being greater than a first preset time T2, wherein N is a positive integer greater than or equal to 1;
an obtaining module, configured to determine a value M based on a difference between the total number N, the disk lifetime T, and the usage time T1, where M ≈ N ÷ (T-T1), and M is a rounded positive integer;
a marking module, configured to mark, in N disks to be marked, states of M disks to be marked, where M is less than or equal to N, that are currently corresponding to the service time T1 from long to short;
the migration module is used for migrating the data marked as the pre-retirement state in the disk to a target disk;
and the updating module is used for updating the disk state of the pre-retirement state to be a retired state when all data in the disk of the pre-retirement state are migrated.
8. The system of claim 1, wherein the migration module comprises:
an obtaining unit, configured to obtain id of a disk block with a use flag in the disk in the pre-retirement state;
a first determination unit configured to determine a disk block to be migrated based on the id and the usage flag;
and the second determining unit is used for determining a target disk, and migrating the data in the disk block to be migrated to the target disk, wherein the target disk is a disk which is not marked to be in a pre-retirement state.
9. The system of claim 2, wherein the second determining unit comprises:
the obtaining subunit is configured to obtain a disk, within a preset time interval, of the use time T1, where the disk is not marked as a pre-retirement state;
a first determining subunit, configured to determine, as a target disk, a disk having a free disk block in the disks that are not marked in the pre-retirement state;
a second determining subunit, configured to determine that a disk block to which data in the disk block to be migrated belongs is a disk block to be migrated, and migrate the data in the disk block to be migrated to the free disk block;
and the processing subunit is configured to replace the id of the disk block to be migrated in the disk block list with the id of the free disk block.
10. The system according to any one of claims 7-9, further comprising:
a determining unit, configured to determine whether data in the disk in the pre-retirement state is migrated when the data in the disk in the pre-retirement state is read in a process of migrating the data in the disk marked in the pre-retirement state to a target disk, execute a first reading unit if the data is migrated, and execute a second reading unit if the data is migrating or the data is not migrated;
a first reading unit, configured to read the data in a target disk block to which the data is migrated;
and the second reading unit is used for reading the data in the magnetic disk in the pre-retirement state.
CN201811603251.3A 2018-12-26 2018-12-26 Disk retirement method and device Active CN111367466B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811603251.3A CN111367466B (en) 2018-12-26 2018-12-26 Disk retirement method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811603251.3A CN111367466B (en) 2018-12-26 2018-12-26 Disk retirement method and device

Publications (2)

Publication Number Publication Date
CN111367466A true CN111367466A (en) 2020-07-03
CN111367466B CN111367466B (en) 2023-08-15

Family

ID=71209020

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811603251.3A Active CN111367466B (en) 2018-12-26 2018-12-26 Disk retirement method and device

Country Status (1)

Country Link
CN (1) CN111367466B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10199118A (en) * 1997-01-10 1998-07-31 Sony Corp Data recording and reproducing device and lifetime control method for hard disk drive
US20040162940A1 (en) * 2003-02-17 2004-08-19 Ikuya Yagisawa Storage system
CN101689130A (en) * 2006-12-06 2010-03-31 弗森多系统公司（dba弗森-艾奥） Adopt device, the system and method for progressive raid storage data
CN102147714A (en) * 2011-03-17 2011-08-10 杭州宏杉科技有限公司 Management method and management device of network storage system
CN104461824A (en) * 2014-12-01 2015-03-25 北京同有飞骥科技股份有限公司 Magnetic disk health information optimal management method and device
WO2015042778A1 (en) * 2013-09-24 2015-04-02 华为技术有限公司 Data migration method, data migration apparatus and storage device
US9250823B1 (en) * 2014-05-20 2016-02-02 Emc Corporation Online replacement of physical storage in a virtual storage system
CN107799157A (en) * 2017-11-24 2018-03-13 苏州韦科韬信息技术有限公司 A kind of method for refreshing data

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10199118A (en) * 1997-01-10 1998-07-31 Sony Corp Data recording and reproducing device and lifetime control method for hard disk drive
US20040162940A1 (en) * 2003-02-17 2004-08-19 Ikuya Yagisawa Storage system
CN101689130A (en) * 2006-12-06 2010-03-31 弗森多系统公司（dba弗森-艾奥） Adopt device, the system and method for progressive raid storage data
CN102147714A (en) * 2011-03-17 2011-08-10 杭州宏杉科技有限公司 Management method and management device of network storage system
WO2015042778A1 (en) * 2013-09-24 2015-04-02 华为技术有限公司 Data migration method, data migration apparatus and storage device
US9250823B1 (en) * 2014-05-20 2016-02-02 Emc Corporation Online replacement of physical storage in a virtual storage system
CN104461824A (en) * 2014-12-01 2015-03-25 北京同有飞骥科技股份有限公司 Magnetic disk health information optimal management method and device
CN107799157A (en) * 2017-11-24 2018-03-13 苏州韦科韬信息技术有限公司 A kind of method for refreshing data

Also Published As

Publication number Publication date
CN111367466B (en) 2023-08-15

Similar Documents

Publication Publication Date Title
US11880340B2 (en) Programmatically choosing preferred storage parameters for files in large-scale distributed storage systems
US10795905B2 (en) Data stream ingestion and persistence techniques
US10467105B2 (en) Chained replication techniques for large-scale data streams
US10691716B2 (en) Dynamic partitioning techniques for data streams
US9471585B1 (en) Decentralized de-duplication techniques for largescale data streams
US10635644B2 (en) Partition-based data stream processing framework
US20150134797A1 (en) Managed service for acquisition, storage and consumption of large-scale data streams
CN109358947B (en) Method and system for realizing virtual machine snapshot
CN110147203B (en) File management method and device, electronic equipment and storage medium
CN111966449B (en) Virtual machine backup management method, system, terminal and storage medium
US9411817B2 (en) Programmatically choosing preferred storage parameters for files in large-scale distributed storage systems based on desired file reliability or availability
CN114746843A (en) Memory health tracking for differentiated data recovery configurations
CN115756955A (en) Data backup and data recovery method and device and computer equipment
CN108369503A (en) Automatic system response to external field replaceable units (FRU) process
CN111367466B (en) Disk retirement method and device
WO2021061146A1 (en) Lifecycle change cryptographic ledger
JP2013148938A (en) Information processor and information processing system
CN109669814A (en) A kind of restoration methods of Metadata Service, device, equipment and readable storage medium storing program for executing
WO2015042531A1 (en) Programmatically choosing preferred storage parameters for files in large-scale distributed storage systems
CN114896128A (en) Application program performance testing method and device based on block chain
CN114138187A (en) Method and device for managing timed snapshot volume of volume mapping copy service plug-in
CN113254271B (en) Data sequence recovery method, device, equipment and storage medium
CN110196785B (en) Data backup management method and device and electronic equipment
CN112256201A (en) Distributed block storage system and volume information management method thereof
CN105095197A (en) Method and device for processing data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant