WO2017190578A1 - Hard disk data wiping method, server and system - Google Patents

Hard disk data wiping method, server and system Download PDF

Info

Publication number
WO2017190578A1
WO2017190578A1 PCT/CN2017/079863 CN2017079863W WO2017190578A1 WO 2017190578 A1 WO2017190578 A1 WO 2017190578A1 CN 2017079863 W CN2017079863 W CN 2017079863W WO 2017190578 A1 WO2017190578 A1 WO 2017190578A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
hard disk
disk
sas
server
Prior art date
Application number
PCT/CN2017/079863
Other languages
French (fr)
Chinese (zh)
Inventor
牛功彪
蔡进
邹巍
张文涛
李舒
Original Assignee
阿里巴巴集团控股有限公司
牛功彪
蔡进
邹巍
张文涛
李舒
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴集团控股有限公司, 牛功彪, 蔡进, 邹巍, 张文涛, 李舒 filed Critical 阿里巴巴集团控股有限公司
Publication of WO2017190578A1 publication Critical patent/WO2017190578A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0652Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/062Securing storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0673Single storage device
    • G06F3/0674Disk device
    • G06F3/0676Magnetic disk device

Definitions

  • the present invention relates to the field of computer technologies, and in particular, to a hard disk data erasing method, a server, and a system.
  • SSDs solid state drives
  • Storage components need to come out of the data center for a variety of reasons.
  • the data carried on the storage component must be effectively destroyed before taking out the data center to avoid data leakage.
  • the current data destruction in some data centers uses a permanent method of destroying the hard disk, such as permanent physical damage to the hard disk. After such physical damage, the existing data on the disk cannot be recovered, but at the same time, the end of the service life of the disk directly leads to the failure of the hard disk to fully utilize its entire service life, thus increasing the maintenance cost of the data center.
  • One of the technical problems solved by the present invention is to provide a hard disk data erasing method, server and system.
  • a hard disk data erasing method comprising: transmitting a data write command to the disk cluster device; writing by the data The input command writes the first type of data to the plurality of hard disks mounted by the disk cluster, thereby overwriting the original data.
  • the method further includes: sending a check read command to the disk cluster device, initiating a read verify operation; and mounting from the disk cluster according to the check read command The plurality of hard disks read data in parallel; and judge whether the read data is the repeated data or random data, thereby completing the verification.
  • the method before initiating the data writing operation, further includes: controlling to start multiple hard disks mounted on the disk cluster device, and determining whether there is an unrecognizable hard disk; and performing hot plugging for the unrecognized hard disk Pull out the replacement instructions.
  • the method further includes: generating and saving an operation log for each controlled hard disk, where the operation log records a command executed by the hard disk during the operation, and a task completion condition.
  • the method further includes: providing an erasure configuration interface to the user; receiving a configuration option input by the user on the erasure configuration interface, and performing erasure control according to the information of the configuration option; the configuration option includes: In addition to the system hard drive, the model of the hard drive to be erased, and/or the erase mode.
  • the method further includes: setting one or more SAS control modules respectively corresponding to the one or more disk cluster devices; and implementing, in the SAS control module, a disk cluster corresponding to the SAS control module by using a SAS expander The layout of the hard disk array of multiple hard disks mounted by the device.
  • the method further includes: configuring, in the SAS control module, the SAS expander to be a multi-stage cascading mode; and expanding the number of the controlled hard disks and the parallelism by using the multi-level cascading multi-layer SAS expander.
  • the method further includes: according to the cascading manner of the multi-level cascaded multi-layer SAS expander, according to the first-level SAS from the highest-level SAS expander The order of the expanders sequentially activates the hard disks corresponding to the SAS expanders of each level.
  • the method further includes: simulating a hard disk fault identification panel corresponding to the hard disk array layout; and using the hard disk fault identification panel to view the state of each hard disk and locate the hard disk with an abnormal state.
  • the method controls one or more external disk cluster devices by using a SAS protocol, and writes the first type of data to the hard disk mounted by the disk cluster in parallel, thereby mounting the disk cluster device.
  • the data of multiple hard disks is bulk erased.
  • the first type of data is preset data, duplicate data, random data, or template type data.
  • a hard disk data erasing server comprising: a write operation control module, configured to send a data write command to the disk cluster device; The data write command controls to write the first type of data to the plurality of hard disks mounted by the disk cluster, thereby overwriting the original data.
  • the method further includes: a read verification control module, configured to send a check read command to the disk cluster device, initiate a read verify operation; and hang from the disk cluster according to the check read command
  • a read verification control module configured to send a check read command to the disk cluster device, initiate a read verify operation; and hang from the disk cluster according to the check read command
  • the plurality of hard disks are loaded in parallel to read data; and, whether the read data is the duplicate data or the random data, thereby completing the verification.
  • the method further includes: a hard disk boot recognition module, configured to control a plurality of hard disks mounted on the disk cluster device, and determine whether there is an unrecognizable hard disk; and, for an unrecognized hard disk, issue heat Insert and remove instructions.
  • a hard disk boot recognition module configured to control a plurality of hard disks mounted on the disk cluster device, and determine whether there is an unrecognizable hard disk; and, for an unrecognized hard disk, issue heat Insert and remove instructions.
  • the method further includes: an operation log module, configured to generate and save an operation log for each controlled hard disk, where the operation log records a command executed by the hard disk during the operation, and a task completion condition.
  • an operation log module configured to generate and save an operation log for each controlled hard disk, where the operation log records a command executed by the hard disk during the operation, and a task completion condition.
  • the method further includes: an erasing configuration interface module, configured to provide an erasing configuration interface to the user; and receiving a configuration option input by the user on the erasing configuration interface, and erasing according to the information of the configuration option Control; the configuration options include: whether to erase the system hard disk, the model of the hard disk to be erased, and/or the erasing mode.
  • an erasing configuration interface module configured to provide an erasing configuration interface to the user; and receiving a configuration option input by the user on the erasing configuration interface, and erasing according to the information of the configuration option Control; the configuration options include: whether to erase the system hard disk, the model of the hard disk to be erased, and/or the erasing mode.
  • the method further includes: one or more SAS control modules respectively corresponding to the one or more disk cluster devices, configured to implement a magnetic field corresponding to the SAS control module by using a SAS expander The layout of the hard disk array of multiple hard disks mounted by the cluster device.
  • the SAS control module is further configured to configure the SAS expander to be a multi-stage cascading mode, and expand the number of controlled hard disks and the parallelism by using a multi-level cascaded multi-layer SAS expander.
  • the SAS control module is further configured to start according to the cascading manner of the multi-level cascaded multi-layer SAS expander according to the sequence from the highest-level SAS expander to the first-level SAS expander.
  • the hard disk corresponding to each level of SAS expander.
  • the method further includes: a hard disk fault identification panel module, configured to simulate a hard disk fault identification panel corresponding to the hard disk array layout; and, through the hard disk fault identification panel, view the state of each hard disk and locate the hard disk with an abnormal state.
  • a hard disk fault identification panel module configured to simulate a hard disk fault identification panel corresponding to the hard disk array layout; and, through the hard disk fault identification panel, view the state of each hard disk and locate the hard disk with an abnormal state.
  • the server controls one or more external disk cluster devices through the SAS protocol, and writes the first type of data to the hard disks mounted by the disk clusters in parallel, thereby mounting the disk cluster devices.
  • the data of multiple hard disks is bulk erased.
  • the first type of data is preset data, duplicate data, random data, or template type data.
  • a hard disk data erasing system comprising the server of any of the above, and a disk cluster device.
  • the present invention designs and constructs a set of parallel erasure suitable for the original data of the hard disk by applying the relatively stable SAS interconnection technology.
  • This solution can be used for data erasing in data centers.
  • the invention has the advantage of high parallelism.
  • the SAS command is directly sent to the disk cluster device by the erasing server, and the erasing process is controlled by the SAS card, thereby avoiding I/O communication through the operating system and the disk during the erasing process, which greatly saves the economy.
  • the system resources are also the embodiment of the high concurrency mentioned above.
  • the invention only needs one ordinary server as the machine head, and can complete corresponding functions such as data writing, erasure verification, log analysis and bad disk recording.
  • the overall investment is controllable and can be used for a short time Non-destructive data destruction of nearly one thousand large-capacity hard disks in the room.
  • the so-called non-destructive means that the hard disk is non-destructive, and the data is permanently destroyed without any data fragments remaining.
  • the solution of the invention can ensure that the original data is effectively covered, so that the erased mechanical hard disk and the solid state hard disk can still be used.
  • FIG. 1 is a flow chart of a hard disk data erasing method according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram showing the principle of writing data of a hard disk in a hard disk data erasing method according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a top-level architecture of data erasing in a hard disk data erasing method according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram of an extended manner of a SAS control module in a hard disk data erasing method according to an embodiment of the present invention
  • FIG. 5 is a schematic diagram of a process of starting an erase in a hard disk data erasing method according to an embodiment of the present invention
  • FIG. 6 is a schematic diagram of a shutdown erase process in a hard disk data erasing method according to an embodiment of the present invention
  • FIG. 7 is a schematic diagram of a hard disk fault identification panel in a hard disk data erasing method according to an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of a hard disk data erasing server according to an embodiment of the present invention.
  • the computer device includes a user device and a network device.
  • the user equipment includes, but is not limited to, a computer, a smart phone, a PDA, etc.
  • the network device includes but is not limited to a single network server, a server group composed of multiple network servers, or a cloud computing based computer Or a cloud composed of a network server, wherein cloud computing is a type of distributed computing, a super virtual computer composed of a group of loosely coupled computers.
  • the computer device can be operated separately to implement the present invention, and can also access the network and implement the present invention by interacting with other computer devices in the network.
  • the network in which the computer device is located includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a VPN network, and the like.
  • the user equipment, the network equipment, the network, and the like are merely examples, and other existing or future possible computer equipment or networks, such as those applicable to the present invention, are also included in the scope of the present invention. It is included here by reference.
  • SAS Serial Attached SCSI
  • SCSI-3 extended instruction set and is compatible with SATA devices. It is a multi-level storage device. Connect to the protocol stack.
  • SAS Expander is a functional module in the SAS protocol, which is used to connect multiple SAS devices together, including SAS array cards, SAS hard disks, etc., to form a SAS domain.
  • cluster The smallest unit of disk file storage management is called "cluster", and a disk cluster device (JBOD device) is a storage device with multiple disk drives installed on one backplane.
  • JBOD device disk cluster device
  • the first type of data is used to cover the original data to implement data erasure, including but not limited to preset data, duplicate data, random data or template type data.
  • the repeated data may be all zero data
  • the random data is data automatically generated by the machine
  • the preset data is preset data
  • the template data is data generated according to the preset template.
  • the first type of data is generally meaningless data, as long as the original data is overwritten to achieve data erasure, and the specific form of the data is not limited.
  • FIG. 1 is a flow chart of a method for erasing hard disk data according to an embodiment of the present invention, which is used for bulk erasing data of a plurality of solid state hard disks or mechanical hard disks, wherein the erasing server passes SAS (Serial Attached SCSI, string)
  • SAS Serial Attached SCSI, string
  • the Line Attached SCSI protocol controls one or more Just a Bunch Of Disks (JBOD) devices to bulk erase data from multiple hard disks mounted on a disk cluster device.
  • JBOD Just a Bunch Of Disks
  • the erasing server controls a plurality of hard disks mounted on the disk cluster device, and determines whether there is an unrecognizable hard disk; and performs hot plugging for the unrecognized hard disk. Instructions for change;
  • the erasing server sends a data write command to the disk cluster device, and writes the first type data to the plurality of hard disks mounted by the disk cluster in parallel through the data write command, thereby overwriting the original data;
  • the erasing server sends a check read command to the disk cluster device to initiate a read verify operation.
  • data is read out from the plurality of hard disks mounted by the disk cluster in parallel; and the read data is determined. Whether it is the first type of data, thus completing the verification.
  • the hard disk includes, but is not limited to, a high-density storage device such as a mechanical hard disk (such as a hard disk drive, a Hard Disk Drive, HDD) and a solid state drive (SSD).
  • a high-density storage device such as a mechanical hard disk (such as a hard disk drive, a Hard Disk Drive, HDD) and a solid state drive (SSD).
  • the erasing server communicates with the disk cluster of the mounted hard disk through the SAS protocol, and performs data erasing operation on the hard disk mounted by the disk cluster.
  • SAS is a disk connection technology that combines the advantages of parallel SCSI and serial connectivity technologies. It uses a SCSI-3 extended instruction set and is compatible with SATA devices. It is a multi-layer storage device connection protocol stack.
  • Disk cluster (JBOD) devices are an important class of storage devices in the storage space.
  • a JBOD device is a storage device with multiple disk drives mounted on a backplane. Also commonly known as Span. Unlike RAID arrays, JBOD has no front-end logic to manage the distribution of data on the disk. Instead, each disk is individually addressed as a separate storage resource, either as part of the host software or as an adapter card for the RAID group.
  • the erasing server is responsible for the faulty hard disk identification (S100), initiating data writing to implement data erasure (S101), read verification (S102), and the like.
  • Step S100 is a preparation step of erasing data, mainly for checking whether all hard disks are started, determining whether there is a problem such as a fault of the hard disk, and being unrecognizable, and informing the engineer to perform hot swap replacement processing for the unrecognized hard disk. It can be understood that S100 is an optional preparation step, which is not necessary, that is, this step can be omitted.
  • Step S101 is a step of completing data erasing.
  • the erasing server sends a data write command to the disk cluster device to initiate a data write operation; according to the data write command, the first type of data is written in parallel to the plurality of hard disks mounted by the disk cluster, thereby overwriting the original data.
  • the first type of data here, for example, may be all 0 data, or random data, as long as the original data is overwritten to achieve data erasure, and the specific form of the first type of data is not limited.
  • SAS Expander is a functional module in the SAS protocol, which is used to connect multiple SAS devices together, including SAS array cards, SAS hard disks, etc., to form a SAS domain.
  • SAS Expander can connect multiple SAS to a limited number of host ports. In the SAS domain, SAS Expander can serve as a central exchange and can directly connect to end devices.
  • a multi-level cascading manner of a multi-layer SAS expander can be adopted.
  • a multi-level cascading mode of a four-layer SAS expander is configured; and a multi-level cascading four-layer SAS expander is used to expand the number and parallelism of the controlled hard disks.
  • the order of starting the SAS expanders and the corresponding hard disks at each level is: multi-layer SAS according to multi-pole cascading
  • the expansion mode of the expander sequentially starts the hard disks corresponding to the SAS expanders of all levels according to the order from the highest-level SAS expander to the first-stage SAS expander. For example, suppose a four-layer SAS expander is used: level1, level2, level3, level4, where level4 is the highest level, then the order of starting is the order of level4, level3, level2 to level1.
  • Step S102 is mainly to verify whether the written data is after the data erasing is completed.
  • the first type of data is predefined. It can be seen that this step is mainly for determining the correctness of data erasure, and is an optional step, not an essential step.
  • a hard disk fault identification panel (such as a software control interface) corresponding to the hard disk array layout may be simulated; the hard disk fault identification panel is used to view the status of each hard disk and locate the hard disk with abnormal status.
  • an operation log may also be generated and saved for each controlled hard disk, and the operation log records commands executed by the hard disk during the operation, task completion, and the like.
  • the user-defined erasure mode can also be supported, and the user can select an appropriate erasure mode according to his business scenario.
  • the user is provided with an erase configuration interface; receiving configuration options input by the user on the erase configuration interface, including: whether to erase the system hard disk, the model of the hard disk to be erased, and/or the erasing mode. .
  • the hard disk in the present invention includes, but is not limited to, a high-density storage device such as a mechanical hard disk or a solid state hard disk.
  • a high-density storage device such as a mechanical hard disk or a solid state hard disk.
  • the present invention writes multiple hard disks in parallel to cover existing content on the disk. Therefore, the selected fixed data mode, such as all zero mode or random number mode, changes the contents of the disk record to meaningless data. This action includes erasing all sectors of the hard disk to avoid any information leakage caused by content residue.
  • the selected fixed data mode such as all zero mode or random number mode
  • FIG. 2 is a schematic diagram showing the principle of writing data of a hard disk in a hard disk data erasing method according to an embodiment of the present invention.
  • the disk surface is covered with a soft magnetic material, which can magnetize the storage medium particles into two different magnetic field directions of N->S or S->N, and respectively indicate that the recorded bit is 0 or 1.
  • the magnetization process achieves magnetic fields in different directions by changing the direction of the current of the energized coil wound on the head in the figure. Therefore, the mechanical hard disk writes data to directly maintain or reverse the correct magnetization direction of the medium and directly overwrite the original data with new data, and the entire process does not need to be erased.
  • hard disk erasure is to rewrite existing data into no real meaning According to, for example, all zero data or random data, it is equivalent to the original information can not be recovered.
  • the hard disk can successfully declare that the data security requirements have been met, and there is no possibility of data leakage.
  • the mechanical hard disk thus treated is equivalent to the entire disk being written once, and there is no bad damage to the hard disk itself, so that the usability can be maintained.
  • FIG. 3 it is a schematic diagram of a top layer structure of data erasing in a hard disk data erasing method according to an embodiment of the present invention.
  • the data erasing top-level architecture provided by the present invention is mainly composed of two parts:
  • Erasing server The erasing server (head) is used as the originating end of data writing, the control end of the erasing operation, the verification management end, and the fault recording end.
  • the invention can adopt only one physical server to realize simultaneous erasure and related work for nearly one thousand mechanical hard disks, and has high resource utilization efficiency.
  • External JBOD device The erasing server is connected to the external JBOD device through the SAS cable, and each JBOD device internally mounts multiple mechanical hard disks. All hard drives are presented in the form of "block" devices on the server head. The server head directly controls each hard disk and performs corresponding operations.
  • two-way structure is installed, and two SAS cards (SAS control modules) are installed inside the erasing server to expand to each of the hard disks in the respective external JBOD devices.
  • the SAS card is connected to the server CPU and memory system through the PCIe bus.
  • the single-channel bandwidth is the PCIe bus bandwidth.
  • PCIe 3.0x 8 can achieve up to 8GB/sec bandwidth.
  • FIG. 4 is a schematic diagram of an extended manner of a SAS control module in a hard disk data erasing method according to an embodiment of the present invention.
  • Figure 4 shows the extended architecture of the present invention.
  • A represents SAS expander A
  • B represents SAS expander B
  • SAS expander B is below. Connected to multiple hard drives.
  • the interconnect of the present invention continues to extend downward.
  • a single SAS control module drives two paths in parallel, each of which is extended in four stages.
  • SAS expander A has N-way SAS 3.0 channels
  • SAS expander B has M-way SAS 3.0 channels, where N>M.
  • the purpose is to increase the number of hard disks that can be connected, thereby increasing the degree of parallelism.
  • FIG. 5 is a schematic diagram of a process of starting an erase in a hard disk data erasing method according to an embodiment of the present invention. Includes the following steps:
  • S501 Start the highest level, that is, the fourth level (level 4) hard disk;
  • S502 Start a secondary advanced, that is, a third level (level 3) hard disk;
  • S504 Start a hard disk of a lowest level, that is, a first level (level 1);
  • S506 Write the first type of data in parallel to all visible hard disks.
  • FIG. 6 is a schematic diagram of a shutdown erasure process in a hard disk data erasing method according to an embodiment of the present invention.
  • S602 Start the highest level, that is, the fourth level (level 4) hard disk;
  • S603 Start the secondary high level, that is, the third level (level 3) hard disk;
  • S605 Start the lowest level, that is, the first level (level 1) hard disk;
  • S606 Start the erasing server.
  • the plug-in JBOD device After the plug-in JBOD device is turned on step by step and the wipe server is started, the first round will detect the unrecognized hard disk in the server. If any disk is inoperable, perform a hot swap replacement to begin writing data to overwrite the original information. The hot-swappable replacement hard disk will also be tested offline, and the calibration is not working properly. Bad disk. Since the write data is all 0 data, the write data is fixed, and therefore, the amount of user data transmission from the server is very low, and the main transmission information is control information such as metadata. Write data can be directly cached in the cache module inside the hard disk.
  • a read verify operation can be performed after the data is written. Specifically, after the data is written, the server initiates a read data operation to directly check whether the data written to the sector is all zeros. The read check is performed synchronously with the write cover, and the two deliberately staggered a certain physical interval. Therefore, after the full disk is written, the read verification will also be completed in a short time. Both write and read check are performed in sequential and sequential read to maximize the throughput of the hard disk being operated, thereby reducing the time for data erasure.
  • an operation log can be generated at the erasure server for each erased hard disk.
  • the operation log can record in detail the commands executed by the nearly one thousand hard disks in the respective erasures and the completion status of the tasks, and ensure that records are retained for each operation.
  • the operation log record will be used in subsequent steps. For example, when the storage disk is taken out of the data center, combined with the serial number of each hard disk, the relevant operation log will be scanned to confirm that the hard disk has been Is erased correctly and effectively.
  • FIG. 7 is a schematic diagram of a hard disk fault identification panel in a hard disk data erasing method according to an embodiment of the present invention.
  • the number of rows Nch represents the number of channels, and the number of columns Ndr represents the number of erased hard disks in each channel.
  • the hard disk is indicated by small dots.
  • the present invention is designed and constructed by applying a relatively stable SAS interconnection technology.
  • This solution can be used for data erasing in data centers.
  • the invention has the advantage of high parallelism.
  • the SAS command is directly sent to the disk cluster device by the erasing server, and the erasing process is controlled by the SAS card, thereby avoiding I/O communication through the operating system and the disk during the erasing process, which greatly saves the economy.
  • the system resources are also the embodiment of the high concurrency mentioned above.
  • the invention has the characteristics of high concurrency and high efficiency, and can write nearly 1000 hard disks in parallel. At the same time, only one ordinary server is needed as the head, and the corresponding functions such as data writing, erasure verification, log analysis and bad disk recording can be completed.
  • the overall investment is controllable, and non-destructive data destruction of nearly one thousand large-capacity hard disks can be completed in a short time.
  • the so-called non-destructive means that the hard disk is non-destructive, and the data is permanently destroyed without any data fragments remaining.
  • the solution of the invention can ensure that the original data is effectively covered, so that the erased mechanical hard disk and the solid state hard disk can still be used.
  • the invention supports the user-defined erasing mode, and the user can select an erasing mode suitable for himself according to his own business scene, such as whether to erase the SDA system disk, the type of the erasing disk, and the erasing mode.
  • An embodiment of the present invention provides a server for hard disk data erasure corresponding to the foregoing method, which controls one or more external disk cluster devices by using a SAS protocol, thereby mounting a plurality of hard disks mounted on the disk cluster device.
  • the data is bulk erased.
  • the server includes:
  • a write operation control module 801 configured to send a data write command to the disk cluster device to initiate a data write operation; and, by using the data write command, to control multiple hard disks mounted to the disk cluster in parallel Write the first type of data to overwrite the original data.
  • the server further includes:
  • the read verification control module 802 is configured to send a verification read command to the disk cluster device. Initiating a read verify operation; reading data from the plurality of hard disks mounted by the disk cluster in parallel according to the check read command; and determining whether the read data is the first type of data, thereby Complete the verification.
  • the server further includes:
  • the hard disk boot recognition module 803 is configured to control a plurality of hard disks mounted on the disk cluster device, and determine whether there is an unrecognizable hard disk; and, for an unrecognizable hard disk, issue an indication for performing hot plug replacement.
  • the server further includes:
  • the operation log module 804 is configured to generate and save an operation log for each controlled hard disk, where the operation log records the command and task completion status of the hard disk being executed during the operation.
  • the server further includes:
  • An erase configuration interface module 805 configured to provide an erase configuration interface to the user; and receive configuration options input by the user on the erase configuration interface, and perform erasure control according to the information of the configuration option; This includes: whether to erase the system hard disk, the model of the hard disk to be erased, and/or the erasing method.
  • the server further includes:
  • One or more SAS control modules 806 respectively corresponding to the one or more disk cluster devices, configured to implement a hard disk array layout of multiple hard disks mounted by the disk cluster device corresponding to the SAS control module by using a SAS expander .
  • the SAS control module 806 is further configured to configure the SAS expander to be a multi-stage cascading mode, and expand the number and parallelism of the controlled hard disks by using a multi-level cascaded multi-layer SAS expander.
  • the SAS control module 806 is further configured to perform multi-layer SAS expansion according to the multi-pole cascade
  • the cascading mode of the expander starts the hard disks corresponding to the SAS expanders of each level in sequence according to the order from the highest-level SAS expander to the first-stage SAS expander.
  • the server further includes:
  • the fault identification module 807 is configured to simulate a hard disk fault identification panel corresponding to the hard disk array layout; and, through the hard disk fault identification panel, view the state of each hard disk and locate the hard disk with an abnormal state.
  • the present invention also provides a hard disk data erasing system, which includes the server and the disk cluster device described in FIG. 8, wherein the server controls one or more externally connected disk cluster devices through a SAS protocol, thereby Bulk erasing data of a plurality of hard disks mounted on the disk cluster device.
  • the present invention can be implemented in software and/or a combination of software and hardware, for example, using an application specific integrated circuit (ASIC), a general purpose computer, or any other similar hardware device.
  • the software program of the present invention may be executed by a processor to implement the steps or functions described above.
  • the software program (including related data structures) of the present invention can be stored in a computer readable recording medium such as a RAM memory, a magnetic or optical drive or a floppy disk and the like.
  • some of the steps or functions of the present invention may be implemented in hardware, for example, as a circuit that cooperates with a processor to perform various steps or functions.
  • a portion of the invention can be applied as a computer program product, such as computer program instructions, which, when executed by a computer, can invoke or provide a method and/or solution in accordance with the present invention.
  • the program instructions for invoking the method of the present invention may be stored in a fixed or removable recording medium and/or transmitted by a data stream in a broadcast or other signal bearing medium, and/or stored in a The working memory of the computer device in which the program instructions are run.
  • an embodiment in accordance with the present invention includes a device including a memory for storing computer program instructions and for performing the process A processor of a sequential instruction, wherein when the computer program instructions are executed by the processor, the apparatus is triggered to operate based on the methods and/or technical solutions described above in accordance with various embodiments of the present invention.

Abstract

A hard disk data wiping method, a server and a system, the method comprising: transmitting a data write command to a disk cluster device; writing first-type data to the plurality of hard disks mounted on the disk cluster to overwrite original data. The method can be used for wiping data from a hard disk in an efficient and non-destructive way.

Description

硬盘数据擦除方法、服务器及系统Hard disk data erasing method, server and system 技术领域Technical field
本发明涉及计算机技术领域,尤其涉及一种硬盘数据擦除方法、服务器及系统。The present invention relates to the field of computer technologies, and in particular, to a hard disk data erasing method, a server, and a system.
背景技术Background technique
机械硬盘(如硬盘驱动器,Hard Disk Drive,HDD)和固态硬盘(Solid State Drive,SSD)是数据中心常使用的存储部件,二者各有优点。比如,固态硬盘在数据读取速度、抗震能力、功耗、运行声音以及发热方面,都较具有优势;而机械硬盘具有容量大、价位低的优点。Mechanical hard drives (such as hard disk drives, Hard Disk Drives, HDDs) and solid state drives (SSDs) are common storage components used in data centers, and each has its own advantages. For example, SSDs have advantages in data read speed, shock resistance, power consumption, operating sound, and heat generation; while mechanical hard disks have the advantages of large capacity and low price.
因各类原因,存储部件需要拿出数据中心。而鉴于数据安全及相关规范,该存储部件上承载的数据必须在拿出数据中心之前有效地破坏,以避免数据泄漏。另外,在故障替换、搬迁等情况下,也需要对数据进行擦除处理。Storage components need to come out of the data center for a variety of reasons. In view of data security and related specifications, the data carried on the storage component must be effectively destroyed before taking out the data center to avoid data leakage. In addition, in the case of fault replacement, relocation, etc., it is also necessary to erase the data.
一些数据中心现行的数据销毁采用的是永久性破坏硬盘的方式,例如对硬盘进行永久性物理损坏。在经过此类物理损坏后,磁盘上的已有数据固然无法恢复,但同时,该盘的使用寿命终结,直接导致硬盘未能被充分利用其全部使用寿命,因而增加了数据中心的维护成本。The current data destruction in some data centers uses a permanent method of destroying the hard disk, such as permanent physical damage to the hard disk. After such physical damage, the existing data on the disk cannot be recovered, but at the same time, the end of the service life of the disk directly leads to the failure of the hard disk to fully utilize its entire service life, thus increasing the maintenance cost of the data center.
发明内容Summary of the invention
本发明解决的技术问题之一是提供一种硬盘数据擦除方法、服务器及系统。One of the technical problems solved by the present invention is to provide a hard disk data erasing method, server and system.
根据本发明一方面的一个实施例,提供了一种硬盘数据擦除方法,所述方法包括:向所述磁盘簇设备发送数据写入命令;通过所述数据写 入命令,向所述磁盘簇所挂载的多个硬盘写入第一类型数据,从而覆盖原有数据。According to an embodiment of an aspect of the present invention, a hard disk data erasing method is provided, the method comprising: transmitting a data write command to the disk cluster device; writing by the data The input command writes the first type of data to the plurality of hard disks mounted by the disk cluster, thereby overwriting the original data.
可选的,在数据写入操作之后,还包括:向所述磁盘簇设备发送校验读出命令,发起读校验操作;根据所述校验读出命令,从所述磁盘簇所挂载的多个硬盘并行读出数据;判断所读出的数据是否为所述重复数据或随机数据,从而完成校验。Optionally, after the data write operation, the method further includes: sending a check read command to the disk cluster device, initiating a read verify operation; and mounting from the disk cluster according to the check read command The plurality of hard disks read data in parallel; and judge whether the read data is the repeated data or random data, thereby completing the verification.
可选的,在发起数据写入操作之前,还包括:控制启动所述磁盘簇设备上所挂载的多个硬盘,并判断是否存在无法识别的硬盘;针对无法识别的硬盘,发出进行热插拔更换的指示。Optionally, before initiating the data writing operation, the method further includes: controlling to start multiple hard disks mounted on the disk cluster device, and determining whether there is an unrecognizable hard disk; and performing hot plugging for the unrecognized hard disk Pull out the replacement instructions.
可选的,还包括:针对每个被控制的硬盘,生成并保存操作日志,所述操作日志记录有该硬盘在操作过程中被执行的命令、任务完成情况。Optionally, the method further includes: generating and saving an operation log for each controlled hard disk, where the operation log records a command executed by the hard disk during the operation, and a task completion condition.
可选的,还包括:向用户提供擦除配置界面;接收用户在所述擦除配置界面上输入的配置选项,根据所述配置选项的信息进行擦除控制;所述配置选项包括:是否擦除系统硬盘、待擦除硬盘的型号,和/或,擦除方式。Optionally, the method further includes: providing an erasure configuration interface to the user; receiving a configuration option input by the user on the erasure configuration interface, and performing erasure control according to the information of the configuration option; the configuration option includes: In addition to the system hard drive, the model of the hard drive to be erased, and/or the erase mode.
可选的,还包括:设置与所述一个或多个磁盘簇设备分别对应的一个或多个SAS控制模块;在所述SAS控制模块中,通过SAS扩展器实现该SAS控制模块对应的磁盘簇设备所挂载的多个硬盘的硬盘阵列布局。Optionally, the method further includes: setting one or more SAS control modules respectively corresponding to the one or more disk cluster devices; and implementing, in the SAS control module, a disk cluster corresponding to the SAS control module by using a SAS expander The layout of the hard disk array of multiple hard disks mounted by the device.
可选的,还包括:在所述SAS控制模块中,配置SAS扩展器为多级级联方式;通过多级级联的多层SAS扩展器,扩展所控制的硬盘数目和并行度。Optionally, the method further includes: configuring, in the SAS control module, the SAS expander to be a multi-stage cascading mode; and expanding the number of the controlled hard disks and the parallelism by using the multi-level cascading multi-layer SAS expander.
可选的,在数据写入操作之前或读校验操作之后,还包括:根据所述多极级联的多层SAS扩展器的级联方式,依据从最高级SAS扩展器向第一级SAS扩展器的顺序,依次启动各级SAS扩展器对应的硬盘。Optionally, before the data write operation or after the read verify operation, the method further includes: according to the cascading manner of the multi-level cascaded multi-layer SAS expander, according to the first-level SAS from the highest-level SAS expander The order of the expanders sequentially activates the hard disks corresponding to the SAS expanders of each level.
可选的,还包括:模拟与硬盘阵列布局对应的硬盘故障识别面板;通过所述硬盘故障识别面板,查看各个硬盘的状态并定位状态异常的硬盘。 Optionally, the method further includes: simulating a hard disk fault identification panel corresponding to the hard disk array layout; and using the hard disk fault identification panel to view the state of each hard disk and locate the hard disk with an abnormal state.
可选的,所述方法通过SAS协议控制一个或多个外挂的磁盘簇设备,向所述磁盘簇所挂载的硬盘并行写入第一类型数据,从而对所述磁盘簇设备上挂载的多个硬盘的数据进行批量擦除。Optionally, the method controls one or more external disk cluster devices by using a SAS protocol, and writes the first type of data to the hard disk mounted by the disk cluster in parallel, thereby mounting the disk cluster device. The data of multiple hard disks is bulk erased.
可选的,所述第一类型数据为预设数据、重复数据、随机数据或者模板类数据。Optionally, the first type of data is preset data, duplicate data, random data, or template type data.
根据本发明另一方面的一个实施例,提供了一种硬盘数据擦除服务器,所述服务器包括:写操作控制模块,用于向所述磁盘簇设备发送数据写入命令;以及,通过所述数据写入命令,控制向所述磁盘簇所挂载的多个硬盘写入第一类型数据,从而覆盖原有数据。According to an embodiment of another aspect of the present invention, a hard disk data erasing server is provided, the server comprising: a write operation control module, configured to send a data write command to the disk cluster device; The data write command controls to write the first type of data to the plurality of hard disks mounted by the disk cluster, thereby overwriting the original data.
可选的,还包括:读校验控制模块,用于向所述磁盘簇设备发送校验读出命令,发起读校验操作;根据所述校验读出命令,从所述磁盘簇所挂载的多个硬盘并行读出数据;以及,判断所读出的数据是否为所述重复数据或随机数据,从而完成校验。Optionally, the method further includes: a read verification control module, configured to send a check read command to the disk cluster device, initiate a read verify operation; and hang from the disk cluster according to the check read command The plurality of hard disks are loaded in parallel to read data; and, whether the read data is the duplicate data or the random data, thereby completing the verification.
可选的,还包括:硬盘启动识别模块,用于控制启动所述磁盘簇设备上所挂载的多个硬盘,并判断是否存在无法识别的硬盘;以及,针对无法识别的硬盘,发出进行热插拔更换的指示。Optionally, the method further includes: a hard disk boot recognition module, configured to control a plurality of hard disks mounted on the disk cluster device, and determine whether there is an unrecognizable hard disk; and, for an unrecognized hard disk, issue heat Insert and remove instructions.
可选的,还包括:操作日志模块,用于针对每个被控制的硬盘,生成并保存操作日志,所述操作日志记录有该硬盘在操作过程中被执行的命令、任务完成情况。Optionally, the method further includes: an operation log module, configured to generate and save an operation log for each controlled hard disk, where the operation log records a command executed by the hard disk during the operation, and a task completion condition.
可选的,还包括:擦除配置界面模块,用于向用户提供擦除配置界面;以及,接收用户在所述擦除配置界面上输入的配置选项,根据所述配置选项的信息进行擦除控制;所述配置选项包括:是否擦除系统硬盘、待擦除硬盘的型号,和/或,擦除方式。Optionally, the method further includes: an erasing configuration interface module, configured to provide an erasing configuration interface to the user; and receiving a configuration option input by the user on the erasing configuration interface, and erasing according to the information of the configuration option Control; the configuration options include: whether to erase the system hard disk, the model of the hard disk to be erased, and/or the erasing mode.
可选的,还包括:一个或多个SAS控制模块,与所述一个或多个磁盘簇设备分别对应的,用于通过SAS扩展器实现该SAS控制模块对应的磁 盘簇设备所挂载的多个硬盘的硬盘阵列布局。Optionally, the method further includes: one or more SAS control modules respectively corresponding to the one or more disk cluster devices, configured to implement a magnetic field corresponding to the SAS control module by using a SAS expander The layout of the hard disk array of multiple hard disks mounted by the cluster device.
可选的,所述SAS控制模块,还用于配置SAS扩展器为多级级联方式,通过多级级联的多层SAS扩展器,扩展所控制的硬盘数目和并行度。Optionally, the SAS control module is further configured to configure the SAS expander to be a multi-stage cascading mode, and expand the number of controlled hard disks and the parallelism by using a multi-level cascaded multi-layer SAS expander.
可选的,所述SAS控制模块,还用于根据所述多极级联的多层SAS扩展器的级联方式,依据从最高级SAS扩展器向第一级SAS扩展器的顺序,依次启动各级SAS扩展器对应的硬盘。Optionally, the SAS control module is further configured to start according to the cascading manner of the multi-level cascaded multi-layer SAS expander according to the sequence from the highest-level SAS expander to the first-level SAS expander. The hard disk corresponding to each level of SAS expander.
可选的,还包括:硬盘故障识别面板模块,用于模拟与硬盘阵列布局对应的硬盘故障识别面板;以及,通过所述硬盘故障识别面板,查看各个硬盘的状态并定位状态异常的硬盘。Optionally, the method further includes: a hard disk fault identification panel module, configured to simulate a hard disk fault identification panel corresponding to the hard disk array layout; and, through the hard disk fault identification panel, view the state of each hard disk and locate the hard disk with an abnormal state.
可选的,所述服务器通过SAS协议控制一个或多个外挂的磁盘簇设备,向所述磁盘簇所挂载的硬盘并行写入第一类型数据,从而对所述磁盘簇设备上挂载的多个硬盘的数据进行批量擦除。Optionally, the server controls one or more external disk cluster devices through the SAS protocol, and writes the first type of data to the hard disks mounted by the disk clusters in parallel, thereby mounting the disk cluster devices. The data of multiple hard disks is bulk erased.
可选的,所述第一类型数据为预设数据、重复数据、随机数据或者模板类数据。Optionally, the first type of data is preset data, duplicate data, random data, or template type data.
根据本发明再一方面的一个实施例,提供了一种硬盘数据擦除系统,该系统包括上述任一项所述的服务器以及磁盘簇设备。According to an embodiment of still another aspect of the present invention, a hard disk data erasing system is provided, the system comprising the server of any of the above, and a disk cluster device.
可见,本发明通过应用较为稳定的SAS互联技术,设计并构建了一套适于硬盘原有数据的并行擦除的方案。该方案可用于数据中心的数据擦除工作。本发明具有高并行度的优势,通过SAS扩展,可并行写入近千块机械硬盘和固态硬盘,从而实现数据的有效快速擦除。具体的,通过擦除服务器对硬盘直接下发SAS命令到磁盘簇设备,通过SAS卡控制擦除过程,避免了在擦除过程中一直通过操作系统与盘进行I/O通信,极大的节约了系统资源,也是前面提到的高并发的体现。It can be seen that the present invention designs and constructs a set of parallel erasure suitable for the original data of the hard disk by applying the relatively stable SAS interconnection technology. This solution can be used for data erasing in data centers. The invention has the advantage of high parallelism. Through the SAS extension, nearly one thousand mechanical hard disks and solid state hard disks can be written in parallel, thereby realizing effective and fast erasing of data. Specifically, the SAS command is directly sent to the disk cluster device by the erasing server, and the erasing process is controlled by the SAS card, thereby avoiding I/O communication through the operating system and the disk during the erasing process, which greatly saves the economy. The system resources are also the embodiment of the high concurrency mentioned above.
本发明只需要一台普通服务器作为机头,即可完成相应的数据写入,擦除校验,日志分析和坏盘记录等相应功能。整体投入可控,且可在短时 间内完成近千块大容量硬盘的非破坏性数据销毁。所谓非破坏是指硬盘的非破坏,而数据是永久销毁,不残留任何数据片段。与现有永久性物理损坏硬盘的方式相比,本发明方案可保证原有数据被有效覆盖,从而使得被擦除的机械硬盘和固态硬盘仍可使用。The invention only needs one ordinary server as the machine head, and can complete corresponding functions such as data writing, erasure verification, log analysis and bad disk recording. The overall investment is controllable and can be used for a short time Non-destructive data destruction of nearly one thousand large-capacity hard disks in the room. The so-called non-destructive means that the hard disk is non-destructive, and the data is permanently destroyed without any data fragments remaining. Compared with the existing permanent physical damage of the hard disk, the solution of the invention can ensure that the original data is effectively covered, so that the erased mechanical hard disk and the solid state hard disk can still be used.
本领域普通技术人员将了解,虽然下面的详细说明将参考图示实施例、附图进行,但本发明并不仅限于这些实施例。而是,本发明的范围是广泛的,且意在仅通过后附的权利要求限定本发明的范围。Those skilled in the art will appreciate that although the following detailed description is made with reference to the illustrated embodiments and drawings, the invention is not limited to these embodiments. Rather, the scope of the invention is intended to be limited the scope of the invention
附图说明DRAWINGS
通过阅读参照以下附图所作的对非限制性实施例所作的详细描述,本发明的其它特征、目的和优点将会变得更明显:Other features, objects, and advantages of the present invention will become more apparent from the Detailed Description of Description
图1是根据本发明实施例的硬盘数据擦除方法的流程图;1 is a flow chart of a hard disk data erasing method according to an embodiment of the present invention;
图2是根据本发明实施例的硬盘数据擦除方法中硬盘写数据原理示意图;2 is a schematic diagram showing the principle of writing data of a hard disk in a hard disk data erasing method according to an embodiment of the present invention;
图3是根据本发明实施例的硬盘数据擦除方法中数据擦除顶层架构示意图;3 is a schematic diagram of a top-level architecture of data erasing in a hard disk data erasing method according to an embodiment of the present invention;
图4是根据本发明实施例的硬盘数据擦除方法中SAS控制模块的扩展方式示意图;4 is a schematic diagram of an extended manner of a SAS control module in a hard disk data erasing method according to an embodiment of the present invention;
图5是根据本发明实施例的硬盘数据擦除方法中启动擦除流程示意图;5 is a schematic diagram of a process of starting an erase in a hard disk data erasing method according to an embodiment of the present invention;
图6是根据本发明实施例的硬盘数据擦除方法中关闭擦除流程示意图;6 is a schematic diagram of a shutdown erase process in a hard disk data erasing method according to an embodiment of the present invention;
图7是根据本发明实施例的硬盘数据擦除方法中硬盘故障识别面板示意图;7 is a schematic diagram of a hard disk fault identification panel in a hard disk data erasing method according to an embodiment of the present invention;
图8是根据本发明实施例的硬盘数据擦除服务器的结构示意图。FIG. 8 is a schematic structural diagram of a hard disk data erasing server according to an embodiment of the present invention.
本领域普通技术人员将了解,虽然下面的详细说明将参考图示实施 例、附图进行,但本发明并不仅限于这些实施例。而是,本发明的范围是广泛的,且意在仅通过后附的权利要求限定本发明的范围。Those of ordinary skill in the art will appreciate that although the following detailed description will be implemented with reference to the drawings The examples and the drawings are carried out, but the present invention is not limited to these embodiments. Rather, the scope of the invention is intended to be limited the scope of the invention
具体实施方式detailed description
在更加详细地讨论示例性实施例之前应当提到的是,一些示例性实施例被描述成作为流程图描绘的处理或方法。虽然流程图将各项操作描述成顺序的处理,但是其中的许多操作可以被并行地、并发地或者同时实施。此外,各项操作的顺序可以被重新安排。当其操作完成时所述处理可以被终止,但是还可以具有未包括在附图中的附加步骤。所述处理可以对应于方法、函数、规程、子例程、子程序等等。Before discussing the exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as a process or method depicted as a flowchart. Although the flowcharts describe various operations as a sequential process, many of the operations can be implemented in parallel, concurrently or concurrently. In addition, the order of operations can be rearranged. The process may be terminated when its operation is completed, but may also have additional steps not included in the figures. The processing may correspond to methods, functions, procedures, subroutines, subroutines, and the like.
所述计算机设备包括用户设备与网络设备。其中,所述用户设备包括但不限于电脑、智能手机、PDA等;所述网络设备包括但不限于单个网络服务器、多个网络服务器组成的服务器组或基于云计算(Cloud Computing)的由大量计算机或网络服务器构成的云,其中,云计算是分布式计算的一种,由一群松散耦合的计算机集组成的一个超级虚拟计算机。其中,所述计算机设备可单独运行来实现本发明,也可接入网络并通过与网络中的其他计算机设备的交互操作来实现本发明。其中,所述计算机设备所处的网络包括但不限于互联网、广域网、城域网、局域网、VPN网络等。The computer device includes a user device and a network device. The user equipment includes, but is not limited to, a computer, a smart phone, a PDA, etc.; the network device includes but is not limited to a single network server, a server group composed of multiple network servers, or a cloud computing based computer Or a cloud composed of a network server, wherein cloud computing is a type of distributed computing, a super virtual computer composed of a group of loosely coupled computers. Wherein, the computer device can be operated separately to implement the present invention, and can also access the network and implement the present invention by interacting with other computer devices in the network. The network in which the computer device is located includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a VPN network, and the like.
需要说明的是,所述用户设备、网络设备和网络等仅为举例,其他现有的或今后可能出现的计算机设备或网络如可适用于本发明,也应包含在本发明保护范围以内,并以引用方式包含于此。It should be noted that the user equipment, the network equipment, the network, and the like are merely examples, and other existing or future possible computer equipment or networks, such as those applicable to the present invention, are also included in the scope of the present invention. It is included here by reference.
后面所讨论的方法(其中一些通过流程图示出)可以通过硬件、软件、固件、中间件、微代码、硬件描述语言或者其任意组合来实施。当用软件、固件、中间件或微代码来实施时,用以实施必要任务的程序代码或代码段可以被存储在机器或计算机可读介质(比如存储介质)中。 (一个或多个)处理器可以实施必要的任务。The methods discussed below, some of which are illustrated by flowcharts, can be implemented in hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. When implemented in software, firmware, middleware or microcode, the program code or code segments to carry out the necessary tasks can be stored in a machine or computer readable medium, such as a storage medium. The processor(s) can perform the necessary tasks.
这里所公开的具体结构和功能细节仅仅是代表性的,并且是用于描述本发明的示例性实施例的目的。但是本发明可以通过许多替换形式来具体实现,并且不应当被解释成仅仅受限于这里所阐述的实施例。The specific structural and functional details disclosed are merely representative and are for the purpose of describing exemplary embodiments of the invention. The present invention may, however, be embodied in many alternative forms and should not be construed as being limited only to the embodiments set forth herein.
应当理解的是,虽然在这里可能使用了术语“第一”、“第二”等等来描述各个单元,但是这些单元不应当受这些术语限制。使用这些术语仅仅是为了将一个单元与另一个单元进行区分。举例来说,在不背离示例性实施例的范围的情况下,第一单元可以被称为第二单元,并且类似地第二单元可以被称为第一单元。这里所使用的术语“和/或”包括其中一个或更多所列出的相关联项目的任意和所有组合。It should be understood that although the terms "first," "second," etc. may be used herein to describe the various elements, these elements should not be limited by these terms. These terms are used only to distinguish one unit from another. For example, a first unit could be termed a second unit, and similarly a second unit could be termed a first unit, without departing from the scope of the exemplary embodiments. The term "and/or" used herein includes any and all combinations of one or more of the associated listed items.
应当理解的是,当一个单元被称为“连接”或“耦合”到另一单元时,其可以直接连接或耦合到所述另一单元,或者可以存在中间单元。与此相对,当一个单元被称为“直接连接”或“直接耦合”到另一单元时,则不存在中间单元。应当按照类似的方式来解释被用于描述单元之间的关系的其他词语(例如“处于...之间”相比于“直接处于...之间”,“与...邻近”相比于“与...直接邻近”等等)。It will be understood that when a unit is referred to as "connected" or "coupled" to another unit, it can be directly connected or coupled to the other unit, or an intermediate unit can be present. In contrast, when a unit is referred to as being "directly connected" or "directly coupled" to another unit, there is no intermediate unit. Other words used to describe the relationship between the units should be interpreted in a similar manner (eg "between" and "directly between" and "adjacent to" Than "directly adjacent to", etc.).
这里所使用的术语仅仅是为了描述具体实施例而不意图限制示例性实施例。除非上下文明确地另有所指,否则这里所使用的单数形式“一个”、“一项”还意图包括复数。还应当理解的是,这里所使用的术语“包括”和/或“包含”规定所陈述的特征、整数、步骤、操作、单元和/或组件的存在,而不排除存在或添加一个或更多其他特征、整数、步骤、操作、单元、组件和/或其组合。The terminology used herein is for the purpose of describing the particular embodiments, The singular forms "a", "an", It is also to be understood that the terms "comprising" and """ Other features, integers, steps, operations, units, components, and/or combinations thereof.
还应当提到的是,在一些替换实现方式中,所提到的功能/动作可以按照不同于附图中标示的顺序发生。举例来说,取决于所涉及的功能/动作,相继示出的两幅图实际上可以基本上同时执行或者有时可以按 照相反的顺序来执行。It should also be noted that, in some alternative implementations, the functions/acts noted may occur in a different order than that illustrated in the drawings. For example, depending on the function/action involved, the two figures shown in succession may in fact be executed substantially simultaneously or sometimes Execute in reverse order.
首先对本发明实施例中出现的专业术语进行说明:First, the technical terms appearing in the embodiments of the present invention are explained:
SAS(Serial Attached SCSI,串行连接SCSI),是一种磁盘连接技术,它总和了并行SCSI和串行连接技术的优势,采用SCSI-3扩展指令集并兼容SATA设备,是多层次的存储设备连接协议栈。SAS (Serial Attached SCSI) is a disk connection technology that combines the advantages of parallel SCSI and serial connection technologies. It uses a SCSI-3 extended instruction set and is compatible with SATA devices. It is a multi-level storage device. Connect to the protocol stack.
SAS扩展器(SAS Expander)是SAS协议中的一个功能模块,其用于将多个SAS设备连接在一起,包括SAS阵列卡、SAS硬盘等,从而形成SAS域。SAS Expander (SAS Expander) is a functional module in the SAS protocol, which is used to connect multiple SAS devices together, including SAS array cards, SAS hard disks, etc., to form a SAS domain.
磁盘文件存储管理的最小单位叫做“簇”,磁盘簇设备(JBOD设备)是在一个底板上安装的带有多个磁盘驱动器的存储设备。The smallest unit of disk file storage management is called "cluster", and a disk cluster device (JBOD device) is a storage device with multiple disk drives installed on one backplane.
第一类型数据,用于覆盖原有数据实现数据擦除,包括但不限于预设数据、重复数据、随机数据或者模板类数据。例如,重复数据可以是全0的数据,随机数据是机器自动随机生成的数据,预设数据是预先设置的数据,模板类数据是根据预置模板生成的数据。第一类型数据一般是无意义数据,只要覆盖掉原有数据实现数据擦除即可,对于数据的具体形式不做限制。The first type of data is used to cover the original data to implement data erasure, including but not limited to preset data, duplicate data, random data or template type data. For example, the repeated data may be all zero data, the random data is data automatically generated by the machine, the preset data is preset data, and the template data is data generated according to the preset template. The first type of data is generally meaningless data, as long as the original data is overwritten to achieve data erasure, and the specific form of the data is not limited.
下面结合附图对本发明的技术方案作进一步详细描述。The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings.
图1是根据本发明实施例的硬盘数据擦除方法的流程图,该方法用于对多个固态硬盘或机械硬盘的数据进行批量擦除,其中,擦除服务器通过SAS(Serial Attached SCSI,串行连接SCSI)协议控制一个或多个外挂的磁盘簇(Just a Bunch Of Disks,JBOD)设备,从而对磁盘簇设备上挂载的多个硬盘的数据进行批量擦除。1 is a flow chart of a method for erasing hard disk data according to an embodiment of the present invention, which is used for bulk erasing data of a plurality of solid state hard disks or mechanical hard disks, wherein the erasing server passes SAS (Serial Attached SCSI, string) The Line Attached SCSI protocol controls one or more Just a Bunch Of Disks (JBOD) devices to bulk erase data from multiple hard disks mounted on a disk cluster device.
本实施例的方法主要包括如下步骤:The method of this embodiment mainly includes the following steps:
S100、擦除服务器控制启动磁盘簇设备上所挂载的多个硬盘,并判断是否存在无法识别的硬盘;针对无法识别的硬盘,发出进行热插拔更 换的指示;S100. The erasing server controls a plurality of hard disks mounted on the disk cluster device, and determines whether there is an unrecognizable hard disk; and performs hot plugging for the unrecognized hard disk. Instructions for change;
S101、擦除服务器向磁盘簇设备发送数据写入命令,通过数据写入命令,向磁盘簇所挂载的多个硬盘并行写入第一类型数据,从而覆盖原有数据;S101. The erasing server sends a data write command to the disk cluster device, and writes the first type data to the plurality of hard disks mounted by the disk cluster in parallel through the data write command, thereby overwriting the original data;
S102、擦除服务器向磁盘簇设备发送校验读出命令,发起读校验操作;根据校验读出命令,从磁盘簇所挂载的多个硬盘并行读出数据;判断所读出的数据是否为第一类型数据,从而完成校验。S102. The erasing server sends a check read command to the disk cluster device to initiate a read verify operation. according to the check read command, data is read out from the plurality of hard disks mounted by the disk cluster in parallel; and the read data is determined. Whether it is the first type of data, thus completing the verification.
本发明实施例中,硬盘包括但不限于机械硬盘(如硬盘驱动器,Hard Disk Drive,HDD)和固态硬盘(Solid State Drive,SSD)等高密度存储设备。In the embodiment of the present invention, the hard disk includes, but is not limited to, a high-density storage device such as a mechanical hard disk (such as a hard disk drive, a Hard Disk Drive, HDD) and a solid state drive (SSD).
本实施例中,擦除服务器通过SAS协议与挂载硬盘的磁盘簇进行通信,实现对磁盘簇所挂载的硬盘进行数据擦除操作。SAS是一种磁盘连接技术,它总和了并行SCSI和串行连接技术的优势,采用SCSI-3扩展指令集并兼容SATA设备,是多层次的存储设备连接协议栈。磁盘簇(JBOD)设备是存储领域中一类重要的存储设备。JBOD设备是在一个底板上安装的带有多个磁盘驱动器的存储设备。通常又称为Span。和RAID阵列不同,JBOD没有前端逻辑来管理磁盘上的数据分布,相反,每个磁盘进行单独寻址,作为分开的存储资源,或者基于主机软件的一部分,或者是RAID组的一个适配器卡。In this embodiment, the erasing server communicates with the disk cluster of the mounted hard disk through the SAS protocol, and performs data erasing operation on the hard disk mounted by the disk cluster. SAS is a disk connection technology that combines the advantages of parallel SCSI and serial connectivity technologies. It uses a SCSI-3 extended instruction set and is compatible with SATA devices. It is a multi-layer storage device connection protocol stack. Disk cluster (JBOD) devices are an important class of storage devices in the storage space. A JBOD device is a storage device with multiple disk drives mounted on a backplane. Also commonly known as Span. Unlike RAID arrays, JBOD has no front-end logic to manage the distribution of data on the disk. Instead, each disk is individually addressed as a separate storage resource, either as part of the host software or as an adapter card for the RAID group.
具体的,擦除服务器负责故障硬盘识别(S100)、发起数据写入从而实现数据擦除(S101)、读校验(S102)等。Specifically, the erasing server is responsible for the faulty hard disk identification (S100), initiating data writing to implement data erasure (S101), read verification (S102), and the like.
步骤S100是擦除数据的准备步骤,主要为了查看所有硬盘是否启动,并确定是否有硬盘存在故障等问题而无法识别,并针对无法识别的硬盘,告知工程师进行热插拔更换处理。可以理解,S100是可选的准备步骤,并不是必须的,也即可以省略此步骤。 Step S100 is a preparation step of erasing data, mainly for checking whether all hard disks are started, determining whether there is a problem such as a fault of the hard disk, and being unrecognizable, and informing the engineer to perform hot swap replacement processing for the unrecognized hard disk. It can be understood that S100 is an optional preparation step, which is not necessary, that is, this step can be omitted.
步骤S101是完成数据擦除的步骤。擦除服务器向磁盘簇设备发送数据写入命令,发起数据写入操作;根据数据写入命令,向磁盘簇所挂载的多个硬盘并行写入第一类型数据,从而覆盖原有数据。这里的第一类型数据,比如可以是全0的数据,或者是随机数据,只要覆盖掉原有数据实现数据擦除即可,对于第一类型数据的具体形式不做限制。Step S101 is a step of completing data erasing. The erasing server sends a data write command to the disk cluster device to initiate a data write operation; according to the data write command, the first type of data is written in parallel to the plurality of hard disks mounted by the disk cluster, thereby overwriting the original data. The first type of data here, for example, may be all 0 data, or random data, as long as the original data is overwritten to achieve data erasure, and the specific form of the first type of data is not limited.
为了实现对硬盘进行第一类型数据的写入控制,可以通过在擦除服务器中设置SAS控制模块来实现。具体的,在擦除服务器中设置与磁盘簇设备数目对应的一个或多个SAS控制模块(即每一个SAS控制模块控制一个磁盘簇设备);在SAS控制模块中,通过SAS扩展器(SAS Expander)实现所对应的磁盘簇设备所挂载的多个硬盘的硬盘阵列布局。其中,SAS Expander是SAS协议中的一个功能模块,其用于将多个SAS设备连接在一起,包括SAS阵列卡、SAS硬盘等,从而形成SAS域。SAS Expander可以将多个SAS连接到有限数量的主机端口上。在SAS域中,SAS Expander可以起到中心交换作用,并可直接连接终端设备。In order to implement write control of the first type of data to the hard disk, it can be implemented by setting a SAS control module in the erasing server. Specifically, one or more SAS control modules corresponding to the number of disk cluster devices are set in the erasure server (ie, each SAS control module controls one disk cluster device); in the SAS control module, through the SAS expander (SAS Expander) The hard disk array layout of multiple hard disks mounted by the corresponding disk cluster device is implemented. Among them, SAS Expander is a functional module in the SAS protocol, which is used to connect multiple SAS devices together, including SAS array cards, SAS hard disks, etc., to form a SAS domain. SAS Expander can connect multiple SAS to a limited number of host ports. In the SAS domain, SAS Expander can serve as a central exchange and can directly connect to end devices.
为了实现对被控硬盘数量和并行度的扩展,可以采取多层SAS扩展器的多级级联方式。例如,在SAS控制模块中,配置四层SAS扩展器的多级级联方式;通过多级级联的四层SAS扩展器,扩展所控制的硬盘数目和并行度。在采取多层SAS扩展器的多级级联方式中,在数据写入操作之前或读校验操作之后,启动各级SAS扩展器及对应硬盘的顺序是:根据多极级联的多层SAS扩展器的级联方式,依据从最高级SAS扩展器向第一级SAS扩展器的顺序,依次启动各级SAS扩展器对应的硬盘。例如,假设采用四层SAS扩展器:level1、level2、level3、level4,其中level4为最高级,那么,启动的顺序就是,level4、level3、level2到level1的顺序。In order to achieve the expansion of the number and parallelism of the controlled hard disks, a multi-level cascading manner of a multi-layer SAS expander can be adopted. For example, in the SAS control module, a multi-level cascading mode of a four-layer SAS expander is configured; and a multi-level cascading four-layer SAS expander is used to expand the number and parallelism of the controlled hard disks. In the multi-stage cascading mode in which the multi-layer SAS expander is adopted, before the data write operation or after the read verify operation, the order of starting the SAS expanders and the corresponding hard disks at each level is: multi-layer SAS according to multi-pole cascading The expansion mode of the expander sequentially starts the hard disks corresponding to the SAS expanders of all levels according to the order from the highest-level SAS expander to the first-stage SAS expander. For example, suppose a four-layer SAS expander is used: level1, level2, level3, level4, where level4 is the highest level, then the order of starting is the order of level4, level3, level2 to level1.
步骤S102主要是在完成数据擦除之后,为了校验写入的数据是否 为预先定义的第一类型数据。可见,该步骤主要为了确定数据擦除的正确性,是可选步骤,而非必须的步骤。Step S102 is mainly to verify whether the written data is after the data erasing is completed. The first type of data is predefined. It can be seen that this step is mainly for determining the correctness of data erasure, and is an optional step, not an essential step.
可选的,还可以模拟出一个与硬盘阵列布局对应的硬盘故障识别面板(例如软件操控界面);通过该硬盘故障识别面板,查看各个硬盘的状态并定位状态异常的硬盘。Optionally, a hard disk fault identification panel (such as a software control interface) corresponding to the hard disk array layout may be simulated; the hard disk fault identification panel is used to view the status of each hard disk and locate the hard disk with abnormal status.
可选的,还可以针对每个被控制的硬盘,生成并保存操作日志,操作日志记录有该硬盘在操作过程中被执行的命令、任务完成情况等。Optionally, an operation log may also be generated and saved for each controlled hard disk, and the operation log records commands executed by the hard disk during the operation, task completion, and the like.
可选的,还可以支持用户自定义擦除模式,用户可以根据自己的业务场景选择适合的擦除模式。具体的,向用户提供擦除配置界面;接收用户在擦除配置界面上输入的配置选项,所述配置选项包括:是否擦除系统硬盘、待擦除硬盘的型号,和/或,擦除方式。Optionally, the user-defined erasure mode can also be supported, and the user can select an appropriate erasure mode according to his business scenario. Specifically, the user is provided with an erase configuration interface; receiving configuration options input by the user on the erase configuration interface, including: whether to erase the system hard disk, the model of the hard disk to be erased, and/or the erasing mode. .
本发明中的硬盘包括但不限于机械硬盘、固态硬盘等高密度存储设备。为了直观,下面以机械硬盘为例子,对本发明方法实施例进行详细介绍。The hard disk in the present invention includes, but is not limited to, a high-density storage device such as a mechanical hard disk or a solid state hard disk. For the sake of intuition, the embodiment of the method of the present invention will be described in detail below by taking a mechanical hard disk as an example.
本发明以并行写入多块硬盘以覆盖盘面上的已有内容。因此,选用的固定的数据模式如全零模式或随机数模式把磁盘记录的内容改变为无意义的数据。而此动作包括被擦除硬盘的所有扇区,以避免任何内容残留而导致的信息泄露。The present invention writes multiple hard disks in parallel to cover existing content on the disk. Therefore, the selected fixed data mode, such as all zero mode or random number mode, changes the contents of the disk record to meaningless data. This action includes erasing all sectors of the hard disk to avoid any information leakage caused by content residue.
参见图2,是根据本发明实施例的硬盘数据擦除方法中硬盘写数据原理示意图。如图2所示,在盘面上覆盖了软磁性材料,该材料可将存储介质颗粒磁化为N->S或者S->N两周不同的磁场走向,并以此分别表示所记录的bit为0或1。磁化过程通过改变图中磁头上所缠绕的通电线圈的电流方向来实现不同方向的磁场。因此,机械硬盘写数据为直接保持或翻转介质合理的磁化方向而直接用新数据来覆盖原有数据,整个过程无需擦除。因此,硬盘擦除就是将现有数据改写为无真实意义数 据,例如全零数据或随机数据,就相当于原有信息无法被恢复。当整个硬盘的全部扇区均被改写后,该硬盘可成功宣告已满足数据安全的要求,不会存在数据泄露的可能。如此处理的机械硬盘,相当于整个盘写满一遍,对于硬盘自身无不良损伤,从而可以保持其可用性。2 is a schematic diagram showing the principle of writing data of a hard disk in a hard disk data erasing method according to an embodiment of the present invention. As shown in FIG. 2, the disk surface is covered with a soft magnetic material, which can magnetize the storage medium particles into two different magnetic field directions of N->S or S->N, and respectively indicate that the recorded bit is 0 or 1. The magnetization process achieves magnetic fields in different directions by changing the direction of the current of the energized coil wound on the head in the figure. Therefore, the mechanical hard disk writes data to directly maintain or reverse the correct magnetization direction of the medium and directly overwrite the original data with new data, and the entire process does not need to be erased. Therefore, hard disk erasure is to rewrite existing data into no real meaning According to, for example, all zero data or random data, it is equivalent to the original information can not be recovered. When all the sectors of the entire hard disk are rewritten, the hard disk can successfully declare that the data security requirements have been met, and there is no possibility of data leakage. The mechanical hard disk thus treated is equivalent to the entire disk being written once, and there is no bad damage to the hard disk itself, so that the usability can be maintained.
参见图3,是根据本发明实施例的硬盘数据擦除方法中数据擦除顶层架构示意图。Referring to FIG. 3, it is a schematic diagram of a top layer structure of data erasing in a hard disk data erasing method according to an embodiment of the present invention.
本发明提供的数据擦除顶层架构,主要由两部分组成:The data erasing top-level architecture provided by the present invention is mainly composed of two parts:
(1)擦除服务器(机头):擦除服务器(机头)作为数据写入的发起端、擦除操作的控制端、校验管理端以及故障记录端。本发明可仅采用一台物理服务器,实现对近千块机械硬盘的同时擦除以及相关工作,具有较高的资源利用效率。(1) Erasing server (head): The erasing server (head) is used as the originating end of data writing, the control end of the erasing operation, the verification management end, and the fault recording end. The invention can adopt only one physical server to realize simultaneous erasure and related work for nearly one thousand mechanical hard disks, and has high resource utilization efficiency.
(2)外挂JBOD设备:擦除服务器通过SAS线缆连接外部的JBOD设备,每个JBOD设备内部挂载多块机械硬盘。所有硬盘均以“块”设备的形式呈现在服务器机头。服务器机头直接控制每一块硬盘并进行相应操作。(2) External JBOD device: The erasing server is connected to the external JBOD device through the SAS cable, and each JBOD device internally mounts multiple mechanical hard disks. All hard drives are presented in the form of "block" devices on the server head. The server head directly controls each hard disk and performs corresponding operations.
在该例子中,采用双路结构,在擦除服务器内部安装了两块SAS卡(SAS控制模块)以并行拓展到各自外挂的JBOD设备中的各级硬盘。SAS卡通过PCIe总线连接到服务器CPU和内存系统,单路的带宽即为PCIe总线带宽,例如,PCIe 3.0x 8可实现最高8GB/秒带宽,对于机械硬盘此类吞吐性能较低的设备,可有效增大并发度来同时写入大量硬盘设备。In this example, two-way structure is installed, and two SAS cards (SAS control modules) are installed inside the erasing server to expand to each of the hard disks in the respective external JBOD devices. The SAS card is connected to the server CPU and memory system through the PCIe bus. The single-channel bandwidth is the PCIe bus bandwidth. For example, PCIe 3.0x 8 can achieve up to 8GB/sec bandwidth. For devices with low throughput such as mechanical hard disks, Effectively increase the degree of concurrency to write to a large number of hard disk devices at the same time.
下面取一路SAS扩展进行介绍。Let's take a look at the SAS extension.
参见图4,是根据本发明实施例的硬盘数据擦除方法中SAS控制模块的扩展方式示意图。图4表示了本发明的拓展架构,图中为了简化,以A代表SAS扩展器A,以B代表SAS扩展器B,SAS扩展器B下面 连接的是多个硬盘。通过SAS expander,本发明的互联不断向下延伸。单个SAS控制模块又并行驱动两条路径,每条路径分四级扩展。SAS expander A具有N路SAS 3.0通道,而SAS expander B带有M路SAS3.0通道,此处,N>M。通过如图4所示的四层SAS expander级联方式,其目的是增大可连接的硬盘数目,从而增大并行度。4 is a schematic diagram of an extended manner of a SAS control module in a hard disk data erasing method according to an embodiment of the present invention. Figure 4 shows the extended architecture of the present invention. For the sake of simplicity, A represents SAS expander A, B represents SAS expander B, and SAS expander B is below. Connected to multiple hard drives. With the SAS expander, the interconnect of the present invention continues to extend downward. A single SAS control module drives two paths in parallel, each of which is extended in four stages. SAS expander A has N-way SAS 3.0 channels, while SAS expander B has M-way SAS 3.0 channels, where N>M. Through the four-layer SAS expander cascading mode as shown in FIG. 4, the purpose is to increase the number of hard disks that can be connected, thereby increasing the degree of parallelism.
参见图5,是根据本发明实施例的硬盘数据擦除方法中启动擦除流程示意图。包括以下步骤:FIG. 5 is a schematic diagram of a process of starting an erase in a hard disk data erasing method according to an embodiment of the present invention. Includes the following steps:
S501:启动最高级即第四级(level4)的硬盘;S501: Start the highest level, that is, the fourth level (level 4) hard disk;
S502:启动次高级即第三级(level3)的硬盘;S502: Start a secondary advanced, that is, a third level (level 3) hard disk;
S503:启动再低一级即第二级(level2)的硬盘;S503: Start a second-level (level 2) hard disk;
S504:启动最低级即第一级(level1)的硬盘;S504: Start a hard disk of a lowest level, that is, a first level (level 1);
S505:启动擦除服务器;S505: Start an erasure server;
S506:并行写入第一类型数据至所有可见的硬盘。S506: Write the first type of data in parallel to all visible hard disks.
参见图6,是根据本发明实施例的硬盘数据擦除方法中关闭擦除流程示意图。Referring to FIG. 6, which is a schematic diagram of a shutdown erasure process in a hard disk data erasing method according to an embodiment of the present invention.
S601:所有硬盘擦除完成且读校验完成;S601: All hard disks are erased and the read verification is completed;
S602:启动最高级即第四级(level4)的硬盘;S602: Start the highest level, that is, the fourth level (level 4) hard disk;
S603:启动次高级即第三级(level3)的硬盘;S603: Start the secondary high level, that is, the third level (level 3) hard disk;
S604:启动再低一级即第二级(level2)的硬盘;S604: Start a second level (level 2) hard disk;
S605:启动最低级即第一级(level1)的硬盘;S605: Start the lowest level, that is, the first level (level 1) hard disk;
S606:启动擦除服务器。S606: Start the erasing server.
在方法实施过程中,还有如下方面需要考虑。逐级开启外挂的JBOD设备并启动擦除服务器后,第一轮将检测服务器中无法识别的硬盘。如有任何盘不可操作,则做热插拔更换,以便开始写入数据以覆盖原有信息。而热插拔替换的硬盘也将做线下复盘测试,标定为不可正常工作的 坏盘。由于写入数据为全0数据,写入数据固定,因而,从服务器的用户数据传输量很低,主要传输信息为元数据等控制信息。写入数据则可直接缓存在硬盘内部的缓存模块。In the implementation of the method, there are also the following aspects to be considered. After the plug-in JBOD device is turned on step by step and the wipe server is started, the first round will detect the unrecognized hard disk in the server. If any disk is inoperable, perform a hot swap replacement to begin writing data to overwrite the original information. The hot-swappable replacement hard disk will also be tested offline, and the calibration is not working properly. Bad disk. Since the write data is all 0 data, the write data is fixed, and therefore, the amount of user data transmission from the server is very low, and the main transmission information is control information such as metadata. Write data can be directly cached in the cache module inside the hard disk.
为确保全零字段顺利写入硬盘的所有扇区以覆盖已有内容,可在写入数据后进行读校验操作。具体的,数据写入后,服务器启动读数据操作,直接检验写入扇区的数据是否为全零。读校验与写覆盖同步进行,二者刻意地错落开一定的物理区间。因此,在写满全盘之后,读校验也将在很短的时间内完成。写覆盖和读校验均采取顺序写入和顺序读出的方式,以最大限度提高被操作硬盘的吞吐,从而缩短数据擦除的时间。To ensure that all zero fields are successfully written to all sectors of the hard disk to overwrite existing content, a read verify operation can be performed after the data is written. Specifically, after the data is written, the server initiates a read data operation to directly check whether the data written to the sector is all zeros. The read check is performed synchronously with the write cover, and the two deliberately staggered a certain physical interval. Therefore, after the full disk is written, the read verification will also be completed in a short time. Both write and read check are performed in sequential and sequential read to maximize the throughput of the hard disk being operated, thereby reducing the time for data erasure.
在数据擦除中,对应每个被擦除的硬盘,在擦除服务器可生成操作日志。操作日志可详细记录近千块硬盘在各自擦除中所执行的命令以及任务完成情况等信息,保证每次操作都保留有记录。而该操作日志记录将在后续多个环节被用到,例如,在存储盘拿出数据中心时,结合每块硬盘的序列号(serial number),相关的操作日志会被扫描以确认该硬盘已被正确有效地擦除。In data erasure, an operation log can be generated at the erasure server for each erased hard disk. The operation log can record in detail the commands executed by the nearly one thousand hard disks in the respective erasures and the completion status of the tasks, and ensure that records are retained for each operation. The operation log record will be used in subsequent steps. For example, when the storage disk is taken out of the data center, combined with the serial number of each hard disk, the relevant operation log will be scanned to confirm that the hard disk has been Is erased correctly and effectively.
为了对擦除过程进行有效监控,特别是识别出擦除过程中出现故障的硬盘,可以通过一个由软件实现的硬盘故障识别面板来观察。参见图7,是根据本发明实施例的硬盘数据擦除方法中硬盘故障识别面板示意图。行数Nch表示通道数,列数Ndr表示每个通道中的被擦除硬盘的数目。硬盘用小圆点表示。在整个数据擦除过程中,因为任何原因在任何时刻发生在任何硬盘上的非正常情况均会通过此面板反应。现场工程师基于清晰明了的指示,可以快速定位到有问题的硬盘,做相应替换。此故障识别面板接收来自于SAS卡及其各级SAS expander所传输的控制信号,并生成相应的动态更新的用户界面。In order to effectively monitor the erasing process, especially to identify the hard disk that has failed during the erasing process, it can be observed through a hard disk fault recognition panel implemented by software. FIG. 7 is a schematic diagram of a hard disk fault identification panel in a hard disk data erasing method according to an embodiment of the present invention. The number of rows Nch represents the number of channels, and the number of columns Ndr represents the number of erased hard disks in each channel. The hard disk is indicated by small dots. During the entire data erasure process, any abnormality that occurs on any hard disk at any time for any reason will be reflected through this panel. Based on clear instructions, the field engineer can quickly locate the faulty hard drive and replace it accordingly. The fault identification panel receives control signals transmitted from the SAS card and its various levels of SAS expanders and generates a corresponding dynamically updated user interface.
可见,本发明通过应用较为稳定的SAS互联技术,设计并构建了 一套适于硬盘原有数据的并行擦除的方案。该方案可用于数据中心的数据擦除工作。本发明具有高并行度的优势,通过SAS扩展,可并行写入近千块机械硬盘和固态硬盘,从而实现数据的有效快速擦除。具体的,通过擦除服务器对硬盘直接下发SAS命令到磁盘簇设备,通过SAS卡控制擦除过程,避免了在擦除过程中一直通过操作系统与盘进行I/O通信,极大的节约了系统资源,也是前面提到的高并发的体现。It can be seen that the present invention is designed and constructed by applying a relatively stable SAS interconnection technology. A set of parallel erasure schemes suitable for the original data of the hard disk. This solution can be used for data erasing in data centers. The invention has the advantage of high parallelism. Through the SAS extension, nearly one thousand mechanical hard disks and solid state hard disks can be written in parallel, thereby realizing effective and fast erasing of data. Specifically, the SAS command is directly sent to the disk cluster device by the erasing server, and the erasing process is controlled by the SAS card, thereby avoiding I/O communication through the operating system and the disk during the erasing process, which greatly saves the economy. The system resources are also the embodiment of the high concurrency mentioned above.
本发明具有高并发高效率的特点,可以并行写入近千块硬盘。同时,只需要一台普通服务器作为机头,即可完成相应的数据写入,擦除校验,日志分析和坏盘记录等相应功能。整体投入可控,且可在短时间内完成近千块大容量硬盘的非破坏性数据销毁。所谓非破坏是指硬盘的非破坏,而数据是永久销毁,不残留任何数据片段。与现有永久性物理损坏硬盘的方式相比,本发明方案可保证原有数据被有效覆盖,从而使得被擦除的机械硬盘和固态硬盘仍可使用。The invention has the characteristics of high concurrency and high efficiency, and can write nearly 1000 hard disks in parallel. At the same time, only one ordinary server is needed as the head, and the corresponding functions such as data writing, erasure verification, log analysis and bad disk recording can be completed. The overall investment is controllable, and non-destructive data destruction of nearly one thousand large-capacity hard disks can be completed in a short time. The so-called non-destructive means that the hard disk is non-destructive, and the data is permanently destroyed without any data fragments remaining. Compared with the existing permanent physical damage of the hard disk, the solution of the invention can ensure that the original data is effectively covered, so that the erased mechanical hard disk and the solid state hard disk can still be used.
本发明支持用户自定义擦除模式,用户可以根据自己的业务场景选择适合自己的擦除模式如:是否擦除SDA系统盘、需要擦除盘的型号、擦除方式等。The invention supports the user-defined erasing mode, and the user can select an erasing mode suitable for himself according to his own business scene, such as whether to erase the SDA system disk, the type of the erasing disk, and the erasing mode.
本发明实施例提供一种与上述方法相对应的一种硬盘数据擦除的服务器,通过SAS协议控制一个或多个外挂的磁盘簇设备,从而对所述磁盘簇设备上挂载的多个硬盘的数据进行批量擦除。An embodiment of the present invention provides a server for hard disk data erasure corresponding to the foregoing method, which controls one or more external disk cluster devices by using a SAS protocol, thereby mounting a plurality of hard disks mounted on the disk cluster device. The data is bulk erased.
参见图8,该服务器包括:Referring to Figure 8, the server includes:
写操作控制模块801,用于向所述磁盘簇设备发送数据写入命令,发起数据写入操作;以及,通过所述数据写入命令,控制向所述磁盘簇所挂载的多个硬盘并行写入第一类型数据,从而覆盖原有数据。a write operation control module 801, configured to send a data write command to the disk cluster device to initiate a data write operation; and, by using the data write command, to control multiple hard disks mounted to the disk cluster in parallel Write the first type of data to overwrite the original data.
可选的,该服务器还包括:Optionally, the server further includes:
读校验控制模块802,用于向所述磁盘簇设备发送校验读出命令, 发起读校验操作;根据所述校验读出命令,从所述磁盘簇所挂载的多个硬盘并行读出数据;以及,判断所读出的数据是否为所述第一类型数据,从而完成校验。The read verification control module 802 is configured to send a verification read command to the disk cluster device. Initiating a read verify operation; reading data from the plurality of hard disks mounted by the disk cluster in parallel according to the check read command; and determining whether the read data is the first type of data, thereby Complete the verification.
可选的,该服务器还包括:Optionally, the server further includes:
硬盘启动识别模块803,用于控制启动所述磁盘簇设备上所挂载的多个硬盘,并判断是否存在无法识别的硬盘;以及,针对无法识别的硬盘,发出进行热插拔更换的指示。The hard disk boot recognition module 803 is configured to control a plurality of hard disks mounted on the disk cluster device, and determine whether there is an unrecognizable hard disk; and, for an unrecognizable hard disk, issue an indication for performing hot plug replacement.
可选的,该服务器还包括:Optionally, the server further includes:
操作日志模块804,用于针对每个被控制的硬盘,生成并保存操作日志,所述操作日志记录有该硬盘在操作过程中被执行的命令、任务完成情况。The operation log module 804 is configured to generate and save an operation log for each controlled hard disk, where the operation log records the command and task completion status of the hard disk being executed during the operation.
可选的,该服务器还包括:Optionally, the server further includes:
擦除配置界面模块805,用于向用户提供擦除配置界面;以及,接收用户在所述擦除配置界面上输入的配置选项,根据所述配置选项的信息进行擦除控制;所述配置选项包括:是否擦除系统硬盘、待擦除硬盘的型号,和/或,擦除方式。An erase configuration interface module 805, configured to provide an erase configuration interface to the user; and receive configuration options input by the user on the erase configuration interface, and perform erasure control according to the information of the configuration option; This includes: whether to erase the system hard disk, the model of the hard disk to be erased, and/or the erasing method.
可选的,该服务器还包括:Optionally, the server further includes:
一个或多个SAS控制模块806,与所述一个或多个磁盘簇设备分别对应的,用于通过SAS扩展器实现该SAS控制模块对应的磁盘簇设备所挂载的多个硬盘的硬盘阵列布局。One or more SAS control modules 806 respectively corresponding to the one or more disk cluster devices, configured to implement a hard disk array layout of multiple hard disks mounted by the disk cluster device corresponding to the SAS control module by using a SAS expander .
可选的,Optional,
所述SAS控制模块806,还用于配置SAS扩展器为多级级联方式,通过多级级联的多层SAS扩展器,扩展所控制的硬盘数目和并行度。The SAS control module 806 is further configured to configure the SAS expander to be a multi-stage cascading mode, and expand the number and parallelism of the controlled hard disks by using a multi-level cascaded multi-layer SAS expander.
可选的,Optional,
所述SAS控制模块806,还用于根据所述多极级联的多层SAS扩 展器的级联方式,依据从最高级SAS扩展器向第一级SAS扩展器的顺序,依次启动各级SAS扩展器对应的硬盘。The SAS control module 806 is further configured to perform multi-layer SAS expansion according to the multi-pole cascade The cascading mode of the expander starts the hard disks corresponding to the SAS expanders of each level in sequence according to the order from the highest-level SAS expander to the first-stage SAS expander.
可选的,该服务器还包括:Optionally, the server further includes:
故障识别模块807,用于模拟与硬盘阵列布局对应的硬盘故障识别面板;以及,通过所述硬盘故障识别面板,查看各个硬盘的状态并定位状态异常的硬盘。The fault identification module 807 is configured to simulate a hard disk fault identification panel corresponding to the hard disk array layout; and, through the hard disk fault identification panel, view the state of each hard disk and locate the hard disk with an abnormal state.
此外,本发明还提供一种硬盘数据擦除系统,该系统包括图8所述的服务器以及磁盘簇设备,其中,所述服务器通过SAS协议控制一个或多个外挂的所述磁盘簇设备,从而对所述磁盘簇设备上挂载的多个硬盘的数据进行批量擦除。In addition, the present invention also provides a hard disk data erasing system, which includes the server and the disk cluster device described in FIG. 8, wherein the server controls one or more externally connected disk cluster devices through a SAS protocol, thereby Bulk erasing data of a plurality of hard disks mounted on the disk cluster device.
需要注意的是,本发明可在软件和/或软件与硬件的组合体中被实施,例如,可采用专用集成电路(ASIC)、通用目的计算机或任何其他类似硬件设备来实现。在一个实施例中,本发明的软件程序可以通过处理器执行以实现上文所述步骤或功能。同样地,本发明的软件程序(包括相关的数据结构)可以被存储到计算机可读记录介质中,例如,RAM存储器,磁或光驱动器或软磁盘及类似设备。另外,本发明的一些步骤或功能可采用硬件来实现,例如,作为与处理器配合从而执行各个步骤或功能的电路。It should be noted that the present invention can be implemented in software and/or a combination of software and hardware, for example, using an application specific integrated circuit (ASIC), a general purpose computer, or any other similar hardware device. In one embodiment, the software program of the present invention may be executed by a processor to implement the steps or functions described above. Likewise, the software program (including related data structures) of the present invention can be stored in a computer readable recording medium such as a RAM memory, a magnetic or optical drive or a floppy disk and the like. Additionally, some of the steps or functions of the present invention may be implemented in hardware, for example, as a circuit that cooperates with a processor to perform various steps or functions.
另外,本发明的一部分可被应用为计算机程序产品,例如计算机程序指令,当其被计算机执行时,通过该计算机的操作,可以调用或提供根据本发明的方法和/或技术方案。而调用本发明的方法的程序指令,可能被存储在固定的或可移动的记录介质中,和/或通过广播或其他信号承载媒体中的数据流而被传输,和/或被存储在根据所述程序指令运行的计算机设备的工作存储器中。在此,根据本发明的一个实施例包括一个装置,该装置包括用于存储计算机程序指令的存储器和用于执行程 序指令的处理器,其中,当该计算机程序指令被该处理器执行时,触发该装置运行基于前述根据本发明的多个实施例的方法和/或技术方案。Additionally, a portion of the invention can be applied as a computer program product, such as computer program instructions, which, when executed by a computer, can invoke or provide a method and/or solution in accordance with the present invention. The program instructions for invoking the method of the present invention may be stored in a fixed or removable recording medium and/or transmitted by a data stream in a broadcast or other signal bearing medium, and/or stored in a The working memory of the computer device in which the program instructions are run. Here, an embodiment in accordance with the present invention includes a device including a memory for storing computer program instructions and for performing the process A processor of a sequential instruction, wherein when the computer program instructions are executed by the processor, the apparatus is triggered to operate based on the methods and/or technical solutions described above in accordance with various embodiments of the present invention.
对于本领域技术人员而言,显然本发明不限于上述示范性实施例的细节,而且在不背离本发明的精神或基本特征的情况下,能够以其他的具体形式实现本发明。因此,无论从哪一点来看,均应将实施例看作是示范性的,而且是非限制性的,本发明的范围由所附权利要求而不是上述说明限定,因此旨在将落在权利要求的等同要件的含义和范围内的所有变化涵括在本发明内。不应将权利要求中的任何附图标记视为限制所涉及的权利要求。此外,显然“包括”一词不排除其他单元或步骤,单数不排除复数。系统权利要求中陈述的多个单元或装置也可以由一个单元或装置通过软件或者硬件来实现。第一,第二等词语用来表示名称,而并不表示任何特定的顺序。 It is apparent to those skilled in the art that the present invention is not limited to the details of the above-described exemplary embodiments, and the present invention can be embodied in other specific forms without departing from the spirit or essential characteristics of the invention. Therefore, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the invention is defined by the appended claims instead All changes in the meaning and scope of equivalent elements are included in the present invention. Any reference signs in the claims should not be construed as limiting the claim. In addition, it is to be understood that the word "comprising" does not exclude other elements or steps. A plurality of units or devices recited in the system claims can also be implemented by a unit or device by software or hardware. The first, second, etc. words are used to denote names and do not denote any particular order.

Claims (23)

  1. 一种硬盘数据擦除方法,其特征在于,包括:A hard disk data erasing method, comprising:
    向磁盘簇设备发送数据写入命令;Send a data write command to the disk cluster device;
    通过所述数据写入命令,向所述磁盘簇所挂载的硬盘写入第一类型数据,从而覆盖原有数据。Through the data write command, the first type of data is written to the hard disk mounted by the disk cluster, thereby overwriting the original data.
  2. 如权利要求1所述的方法,其特征在于,在数据写入操作之后,还包括:The method of claim 1 further comprising, after the data write operation, further comprising:
    向所述磁盘簇设备发送校验读出命令;Sending a check read command to the disk cluster device;
    根据所述校验读出命令,从所述磁盘簇所挂载的多个硬盘并行读出数据;And reading data from the plurality of hard disks mounted by the disk cluster in parallel according to the verify read command;
    判断所读出的数据是否为所述重复数据或随机数据,从而完成校验。It is judged whether the read data is the repeated data or the random data, thereby completing the verification.
  3. 如权利要求1所述的方法,其特征在于,在发起数据写入操作之前,还包括:The method of claim 1 further comprising: before initiating a data write operation, further comprising:
    控制启动所述磁盘簇设备上所挂载的多个硬盘,并判断是否存在无法识别的硬盘;Controlling to start multiple hard disks mounted on the disk cluster device, and determining whether there is an unrecognizable hard disk;
    针对无法识别的硬盘,发出进行热插拔更换的指示。An instruction to perform a hot swap replacement is made for an unrecognized hard disk.
  4. 如权利要求1所述的方法,其特征在于,还包括:The method of claim 1 further comprising:
    针对每个被控制的硬盘,生成并保存操作日志,所述操作日志记录有该硬盘在操作过程中被执行的命令、任务完成情况。An operation log is generated and saved for each controlled hard disk, and the operation log records the command and task completion status that the hard disk is executed during the operation.
  5. 如权利要求1所述的方法,其特征在于,还包括:The method of claim 1 further comprising:
    向用户提供擦除配置界面;Providing the user with an erase configuration interface;
    接收用户在所述擦除配置界面上输入的配置选项,根据所述配置选项的信息进行擦除控制;所述配置选项包括:是否擦除系统硬盘、待擦除硬盘的型号,和/或,擦除方式。Receiving a configuration option input by the user on the erasure configuration interface, and performing erasure control according to the information of the configuration option; the configuration option includes: whether to erase the system hard disk, the model of the hard disk to be erased, and/or, Erase mode.
  6. 如权利要求1-5任一项所述的方法,其特征在于,还包括: The method of any of claims 1-5, further comprising:
    设置与所述一个或多个磁盘簇设备分别对应的一个或多个SAS控制模块;Setting one or more SAS control modules respectively corresponding to the one or more disk cluster devices;
    在所述SAS控制模块中,通过SAS扩展器实现该SAS控制模块对应的磁盘簇设备所挂载的多个硬盘的硬盘阵列布局。In the SAS control module, the hard disk array layout of the plurality of hard disks mounted by the disk cluster device corresponding to the SAS control module is implemented by the SAS expander.
  7. 如权利要求6所述的方法,其特征在于,还包括:The method of claim 6 further comprising:
    在所述SAS控制模块中,配置SAS扩展器为多级级联方式;In the SAS control module, configuring the SAS expander to be a multi-stage cascading mode;
    通过多级级联的多层SAS扩展器,扩展所控制的硬盘数目和并行度。Extend the number and parallelism of the controlled hard disks through a multi-level cascaded multi-layer SAS expander.
  8. 如权利要求7所述的方法,其特征在于,在数据写入操作之前或读校验操作之后,还包括:The method according to claim 7, wherein before or after the data writing operation, the method further comprises:
    根据所述多极级联的多层SAS扩展器的级联方式,依据从最高级SAS扩展器向第一级SAS扩展器的顺序,依次启动各级SAS扩展器对应的硬盘。According to the cascading manner of the multi-level cascaded multi-layer SAS expander, the hard disks corresponding to the SAS expanders of each level are sequentially activated according to the order from the highest-level SAS expander to the first-stage SAS expander.
  9. 如权利要求6所述的方法,其特征在于,还包括:The method of claim 6 further comprising:
    模拟与硬盘阵列布局对应的硬盘故障识别面板;Simulate a hard disk fault identification panel corresponding to the layout of the hard disk array;
    通过所述硬盘故障识别面板,查看各个硬盘的状态并定位状态异常的硬盘。Through the hard disk fault identification panel, view the status of each hard disk and locate the hard disk with abnormal status.
  10. 如权利要求1所述的方法,其特征在于,通过SAS协议控制一个或多个外挂的磁盘簇设备,向所述磁盘簇所挂载的硬盘并行写入第一类型数据,从而对所述磁盘簇设备上挂载的多个硬盘的数据进行批量擦除。The method according to claim 1, wherein one or more external disk cluster devices are controlled by the SAS protocol, and the first type of data is written in parallel to the hard disk mounted by the disk cluster, thereby The data of multiple hard disks mounted on the cluster device is bulk erased.
  11. 如权利要求1所述的方法,其特征在于,所述第一类型数据为预设数据、重复数据、随机数据或者模板类数据。The method according to claim 1, wherein the first type of data is preset data, duplicate data, random data or template type data.
  12. 一种硬盘数据擦除服务器,其特征在于,所述服务器包括:A hard disk data erasing server, characterized in that the server comprises:
    写操作控制模块,用于向磁盘簇设备发送数据写入命令;以及,根据所述数据写入命令,控制向所述磁盘簇所挂载的多个硬盘写入第一类型数据,从而覆盖原有数据。 a write operation control module, configured to send a data write command to the disk cluster device; and, according to the data write command, control to write the first type of data to the plurality of hard disks mounted by the disk cluster, thereby overwriting the original There is data.
  13. 如权利要求12所述的服务器,其特征在于,还包括:The server of claim 12, further comprising:
    读校验控制模块,用于向所述磁盘簇设备发送校验读出命令;根据所述校验读出命令,从所述磁盘簇所挂载的多个硬盘并行读出数据;以及,判断所读出的数据是否为所述重复数据或随机数据,从而完成校验。a read verification control module, configured to send a verify read command to the disk cluster device; and read data from the plurality of hard disks mounted by the disk cluster in parallel according to the check read command; and determine Whether the read data is the repeated data or random data, thereby completing the verification.
  14. 如权利要求12所述的服务器,其特征在于,还包括:The server of claim 12, further comprising:
    硬盘启动识别模块,用于控制启动所述磁盘簇设备上所挂载的多个硬盘,并判断是否存在无法识别的硬盘;以及,针对无法识别的硬盘,发出进行热插拔更换的指示。The hard disk boot recognition module is configured to control the booting of the plurality of hard disks mounted on the disk cluster device, and determine whether there is an unrecognizable hard disk; and, for the unrecognized hard disk, issue an indication for performing hot plug replacement.
  15. 如权利要求12所述的服务器,其特征在于,还包括:The server of claim 12, further comprising:
    操作日志模块,用于针对每个被控制的硬盘,生成并保存操作日志,所述操作日志记录有该硬盘在操作过程中被执行的命令、任务完成情况。An operation log module is configured to generate and save an operation log for each controlled hard disk, where the operation log records a command executed by the hard disk during the operation, and a task completion condition.
  16. 如权利要求12所述的服务器,其特征在于,还包括:The server of claim 12, further comprising:
    擦除配置界面模块,用于向用户提供擦除配置界面;以及,接收用户在所述擦除配置界面上输入的配置选项,根据所述配置选项的信息进行擦除控制;所述配置选项包括:是否擦除系统硬盘、待擦除硬盘的型号,和/或,擦除方式。An erase configuration interface module, configured to provide an erase configuration interface to the user; and receive configuration options input by the user on the erase configuration interface, and perform erasure control according to the information of the configuration option; the configuration option includes : Whether to erase the system hard disk, the model of the hard disk to be erased, and / or erase mode.
  17. 如权利要求12-16任一项所述的服务器,其特征在于,还包括:The server according to any one of claims 12 to 16, further comprising:
    一个或多个SAS控制模块,与所述一个或多个磁盘簇设备分别对应的,用于通过SAS扩展器实现该SAS控制模块对应的磁盘簇设备所挂载的多个硬盘的硬盘阵列布局。The one or more SAS control modules respectively corresponding to the one or more disk cluster devices are configured to implement a hard disk array layout of the plurality of hard disks mounted by the disk cluster device corresponding to the SAS control module by using the SAS expander.
  18. 如权利要求17所述的服务器,其特征在于,The server of claim 17 wherein:
    所述SAS控制模块,还用于配置SAS扩展器为多级级联方式,通过多级级联的多层SAS扩展器,扩展所控制的硬盘数目和并行度。The SAS control module is further configured to configure the SAS expander to be a multi-stage cascading mode, and expand the number of controlled hard disks and the degree of parallelism by multi-level cascading multi-layer SAS expanders.
  19. 如权利要求18所述的服务器,其特征在于,The server of claim 18, wherein:
    所述SAS控制模块,还用于根据所述多极级联的多层SAS扩展器的 级联方式,依据从最高级SAS扩展器向第一级SAS扩展器的顺序,依次启动各级SAS扩展器对应的硬盘。The SAS control module is further configured to be used according to the multi-pole cascaded multi-layer SAS expander In the cascading mode, the hard disks corresponding to the SAS expanders of each level are sequentially activated according to the order from the highest-level SAS expander to the first-stage SAS expander.
  20. 如权利要求17所述的服务器,其特征在于,还包括:The server according to claim 17, further comprising:
    故障识别模块,用于模拟与硬盘阵列布局对应的硬盘故障识别面板;以及,通过所述硬盘故障识别面板,查看各个硬盘的状态并定位状态异常的硬盘。The fault identification module is configured to simulate a hard disk fault identification panel corresponding to the hard disk array layout; and, through the hard disk fault identification panel, view the state of each hard disk and locate the hard disk with an abnormal state.
  21. 如权利要求12所述的服务器,其特征在于,所述服务器通过SAS协议控制一个或多个外挂的磁盘簇设备,向所述磁盘簇所挂载的硬盘并行写入第一类型数据,从而对所述磁盘簇设备上挂载的多个硬盘的数据进行批量擦除。The server according to claim 12, wherein the server controls one or more external disk cluster devices through the SAS protocol, and writes the first type data to the hard disks mounted by the disk clusters in parallel, thereby The data of the plurality of hard disks mounted on the disk cluster device is bulk erased.
  22. 如权利要求12所述的服务器,其特征在于,所述第一类型数据为预设数据、重复数据、随机数据或者模板类数据。The server according to claim 12, wherein the first type of data is preset data, duplicate data, random data, or template type data.
  23. 一种硬盘数据擦除系统,其特征在于,包括磁盘簇设备以及权利要求12-22任一项所述的服务器。 A hard disk data erasing system, comprising: a disk cluster device and the server of any one of claims 12-22.
PCT/CN2017/079863 2016-05-06 2017-04-10 Hard disk data wiping method, server and system WO2017190578A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610299332.3A CN107346210B (en) 2016-05-06 2016-05-06 Hard disk data erasing method, server and system
CN201610299332.3 2016-05-06

Publications (1)

Publication Number Publication Date
WO2017190578A1 true WO2017190578A1 (en) 2017-11-09

Family

ID=60202768

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/079863 WO2017190578A1 (en) 2016-05-06 2017-04-10 Hard disk data wiping method, server and system

Country Status (3)

Country Link
CN (1) CN107346210B (en)
TW (1) TWI738739B (en)
WO (1) WO2017190578A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109213448A (en) * 2018-08-30 2019-01-15 东信和平科技股份有限公司 A kind of method, apparatus, equipment and the storage medium of the erasable data of smart card
CN110321082A (en) * 2019-07-09 2019-10-11 上海悦易网络信息技术有限公司 Data clearing method and equipment for computer
CN113535084A (en) * 2021-06-22 2021-10-22 杭州华澜微电子股份有限公司 Method for realizing large-capacity SAS hard disk

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107943419A (en) * 2017-11-23 2018-04-20 郑州云海信息技术有限公司 A kind of SSD secure erase automated testing methods and device
TWI700636B (en) * 2018-09-07 2020-08-01 神雲科技股份有限公司 Data erasing method for cluster storage system
CN110797052B (en) * 2019-10-21 2021-10-01 北京工业大学 Rapid demagnetization method based on magnetic medium characteristics
CN110989921B (en) * 2019-10-24 2023-05-26 西安艾可萨科技有限公司 Configurable memory array system, control method thereof and communication equipment
CN111158608B (en) * 2019-12-31 2021-11-23 云和恩墨(北京)信息技术有限公司 Hard disk fault processing method and device and distributed system
CN111240800B (en) * 2020-01-03 2022-12-27 华云数据有限公司 Hardware acceleration equipment mounting method and cloud platform
US11379156B2 (en) * 2020-08-19 2022-07-05 Micron Technology, Inc. Write type indication command
CN112181310A (en) * 2020-10-14 2021-01-05 北京安石科技有限公司 Deep erasing/self-destruction method and system for hard disk data

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101465164A (en) * 2009-01-12 2009-06-24 成都市华为赛门铁克科技有限公司 Method, device and system for obliterating data
US20100077159A1 (en) * 2008-09-22 2010-03-25 Samsung Electronics Co., Ltd. Image forming apparatus and method of overwriting for storage unit in image forming apparatus
CN102511044A (en) * 2011-09-06 2012-06-20 华为技术有限公司 Method for deleting the data and device thereof
CN103443757A (en) * 2012-12-31 2013-12-11 华为技术有限公司 Erasing method, erasing device and erasing system
CN103902468A (en) * 2012-12-27 2014-07-02 华为技术有限公司 Data elimination method and device for storage system

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8645636B2 (en) * 2010-09-29 2014-02-04 International Business Machines Corporation Methods for managing ownership of redundant data and systems thereof
US20120078931A1 (en) * 2010-09-29 2012-03-29 International Business Machines Corporation Methods for managing ownership of redundant data and systems thereof
US8943258B2 (en) * 2011-11-04 2015-01-27 Lsi Corporation Server direct attached storage shared through virtual SAS expanders
CN103135669A (en) * 2011-11-28 2013-06-05 鸿富锦精密工业(深圳)有限公司 Storage device and work method and data transmission method thereof
CN103729321B (en) * 2013-12-27 2017-01-18 华为技术有限公司 Management device and multi-expander chip management method
US9575673B2 (en) * 2014-10-29 2017-02-21 Commvault Systems, Inc. Accessing a file system using tiered deduplication
CN104657316B (en) * 2015-03-06 2018-01-19 北京百度网讯科技有限公司 Server
CN105045336A (en) * 2015-06-25 2015-11-11 北京百度网讯科技有限公司 JBOD (Just Bunch of Disks)

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100077159A1 (en) * 2008-09-22 2010-03-25 Samsung Electronics Co., Ltd. Image forming apparatus and method of overwriting for storage unit in image forming apparatus
CN101465164A (en) * 2009-01-12 2009-06-24 成都市华为赛门铁克科技有限公司 Method, device and system for obliterating data
CN102511044A (en) * 2011-09-06 2012-06-20 华为技术有限公司 Method for deleting the data and device thereof
CN103902468A (en) * 2012-12-27 2014-07-02 华为技术有限公司 Data elimination method and device for storage system
CN103443757A (en) * 2012-12-31 2013-12-11 华为技术有限公司 Erasing method, erasing device and erasing system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109213448A (en) * 2018-08-30 2019-01-15 东信和平科技股份有限公司 A kind of method, apparatus, equipment and the storage medium of the erasable data of smart card
CN110321082A (en) * 2019-07-09 2019-10-11 上海悦易网络信息技术有限公司 Data clearing method and equipment for computer
CN110321082B (en) * 2019-07-09 2023-05-30 上海万物新生环保科技集团有限公司 Data clearing method and device for computer
CN113535084A (en) * 2021-06-22 2021-10-22 杭州华澜微电子股份有限公司 Method for realizing large-capacity SAS hard disk

Also Published As

Publication number Publication date
CN107346210A (en) 2017-11-14
CN107346210B (en) 2020-08-14
TWI738739B (en) 2021-09-11
TW201740370A (en) 2017-11-16

Similar Documents

Publication Publication Date Title
WO2017190578A1 (en) Hard disk data wiping method, server and system
US20090204758A1 (en) Systems and methods for asymmetric raid devices
US7653781B2 (en) Automatic RAID disk performance profiling for creating optimal RAID sets
US8959375B2 (en) System and method for power management of storage resources
US20120144110A1 (en) Methods and structure for storage migration using storage array managed server agents
US8631200B2 (en) Method and system for governing an enterprise level green storage system drive technique
JP2007213721A (en) Storage system and control method thereof
TW200540623A (en) System and method for drive recovery following a drive failure
US11137918B1 (en) Administration of control information in a storage system
JP2009205316A (en) Disk array device, disk array control method and disk array controller
US9245613B2 (en) Storage interface apparatus for solid state drive tester
US7451354B2 (en) Apparatus and method to configure, format, and test, a data storage subsystem product
CN105700817A (en) Just Bunch of Discs JBOD apparatus
US7774650B2 (en) Power failure warning in logically partitioned enclosures
US10146452B2 (en) Maintaining intelligent write ordering with asynchronous data replication
Coughlin et al. Digital storage and memory technology (part 1)
US20120215966A1 (en) Disk array unit and control method thereof
US9836359B2 (en) Storage and control method of the same
WO2015196820A1 (en) Method and apparatus for creating jbod file system
CN105827681A (en) Backup data transmission method under SAN (Storage Area Network)
CN103064803A (en) Data read-write method and device of NAND Flash storage device
JP6734058B2 (en) Control device
US20140316539A1 (en) Drivers and controllers
US10445178B2 (en) Methods and systems for controlling redundant array of inexpensive disks (RAID) operations
KR102659829B1 (en) Methods and systems for controlling Redundant Array of Inexpensive Disks (RAID) operations

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17792405

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17792405

Country of ref document: EP

Kind code of ref document: A1