CN109992213B - Data deleting method, system, device and computer readable storage medium - Google Patents

Data deleting method, system, device and computer readable storage medium Download PDF

Info

Publication number
CN109992213B
CN109992213B CN201910285640.4A CN201910285640A CN109992213B CN 109992213 B CN109992213 B CN 109992213B CN 201910285640 A CN201910285640 A CN 201910285640A CN 109992213 B CN109992213 B CN 109992213B
Authority
CN
China
Prior art keywords
data
hdd
journal
ssd
omap
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910285640.4A
Other languages
Chinese (zh)
Other versions
CN109992213A (en
Inventor
刘杰
安祥文
赵赞
罗浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Inspur Intelligent Technology Co Ltd
Original Assignee
Suzhou Inspur Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Inspur Intelligent Technology Co Ltd filed Critical Suzhou Inspur Intelligent Technology Co Ltd
Priority to CN201910285640.4A priority Critical patent/CN109992213B/en
Publication of CN109992213A publication Critical patent/CN109992213A/en
Application granted granted Critical
Publication of CN109992213B publication Critical patent/CN109992213B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608—Saving storage space on storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0652—Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0685—Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The application discloses a data deleting method, which comprises the steps of determining an HDD (hard disk drive) where data to be deleted is located according to a received deleting instruction; migrating the journal and the omap corresponding to the HDD to the SSD through a preset migration script; deleting data to be deleted in the journal and the omap through the SSD; the data deleting method is based on the characteristic that the SSD read-write efficiency is far higher than that of the HDD, journal and omap of data stored in the HDD are migrated to the SSD through the preset migration script, deletion of the data stored in the journal and omap is achieved through the SSD, the data deleting efficiency of the storage system is greatly improved, a storage space can be vacated more efficiently to store new data, the storage space of the system is conveniently integrated and utilized, and the utilization rate of the storage space is effectively improved. The application also discloses a data deleting system, a data deleting device and a computer readable storage medium, which have the beneficial effects.

Description

Data deleting method, system, device and computer readable storage medium
Technical Field
The present application relates to the field of storage technologies, and in particular, to a data deletion method, a data deletion system, a data deletion apparatus, and a computer-readable storage medium.
Background
With the continuous development of information technology, data is gradually regarded as a precious resource, data storage is also in the period of rapid development as one of the core elements of data resources, and for a storage system, the storage media which can be used for storing data are various, such as magnetic disks, hard disks and the like.
Generally, a Storage system corresponds to a plurality of OSDs (Object Storage devices), each OSD corresponds to a group of journal and omap for storing data, and each OSD corresponds to a Hard Disk, which may be an SSD (Solid State Drive) or an HDD (Hard Disk Drive). For a storage system, the number of HDDs is generally much larger than that of SSDs, for example, in the AS13000 distributed storage, each storage node includes 1 SSD and 35 HDDs. However, in practical application scenarios, since a large amount of aged data in the storage system needs to be deleted to make up enough storage space for storing newly generated data, and the read-write rate of the HDD is much lower than that of the SSD, the data deletion efficiency of the storage system is low, and it is difficult to make efficient use of the storage space of the storage system.
Therefore, how to provide a method for effectively improving the data deletion efficiency of a storage system to further improve the utilization rate of the storage space of the system is an urgent problem to be solved by those skilled in the art.
Disclosure of Invention
The data deleting method can effectively improve the data deleting efficiency of a storage system and further improve the utilization rate of a system storage space; another object of the present application is to provide a data deletion system, apparatus and computer-readable storage medium, which also have the above-mentioned advantages.
In order to solve the above technical problem, the present application provides a data deletion method, where the data deletion method includes:
determining the HDD where the data to be deleted is located according to the received deletion instruction;
migrating the journal and omap corresponding to the HDD to the SSD through a preset migration script;
deleting the data to be deleted in the journal and the omap through the SSD.
Preferably, before migrating the journal and the omap corresponding to the HDD to the SSD through a preset migration script, the method further includes:
turning off OSD service of the HDD;
then migrating the journal and the omap corresponding to the HDD to the SSD through the preset migration script, further comprising:
and restarting the OSD service.
Preferably, after the OSD service of the HDD is turned off, the method further includes:
and flushing the journal corresponding to the HDD from the cache to the HDD through a journal flushing script.
Preferably, the migrating the journal and the omap corresponding to the HDD to the SSD through a preset migration script includes:
respectively establishing a journal soft connection and an omap soft connection between the HDD and the SSD;
and respectively migrating the journal and the omap to a preset storage position of the SSD through the journal soft connection and the omap soft connection.
Preferably, the migrating the journal and omap corresponding to the HDD to the SSD through a preset migration script includes:
and migrating the journal and omap corresponding to the HDD to a neighboring SSD or a first SSD of the HDD through the preset migration script.
Preferably, the data deleting method further includes:
acquiring IP information of other nodes in the distributed cluster;
and remotely transmitting the preset migration script to the other nodes according to the IP information.
In order to solve the above technical problem, the present application further provides a data deletion system, where the data deletion system includes:
the receiving module is used for determining the HDD where the data to be deleted is located according to the received deleting instruction;
the migration module is used for migrating the journal and the omap corresponding to the HDD to the SSD through a preset migration script;
and the deleting module is used for deleting the data to be deleted in the journal and the omap through the SSD.
Preferably, the data deleting system further includes:
the remote synchronization module is used for acquiring IP information of other nodes in the distributed cluster; and remotely transmitting the preset migration script to the other nodes according to the IP information.
In order to solve the above technical problem, the present application further provides a data deleting apparatus, including:
a memory for storing a computer program;
a processor for implementing the steps of any of the above data deletion methods when executing the computer program.
In order to solve the above technical problem, the present application further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the computer program implements the steps of any one of the above data deleting methods.
The data deleting method comprises the steps of determining the HDD where data to be deleted is located according to a received deleting instruction; migrating the journal and omap corresponding to the HDD to the SSD through a preset migration script; and deleting the data to be deleted in the journal and the omap through the SSD.
Therefore, the data deleting method provided by the application is based on the characteristic that the SSD read-write efficiency is far higher than that of the HDD, the storage system does not delete corresponding data after receiving a data deleting instruction, the journal and the ompa of the data stored in the HDD are migrated to the SSD through the preset migration script, and the data in the journal and the ompa are deleted through the SSD, so that the data deleting efficiency of the storage system is greatly improved, the storage space can be vacated more efficiently to store new data, the storage space of the system is conveniently integrated and utilized, and the utilization rate of the storage space is effectively improved.
The data deleting system, the data deleting device and the computer-readable storage medium provided by the application all have the beneficial effects, and are not described herein again.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only the embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic flowchart of a data deleting method provided in the present application;
FIG. 2 is a schematic flow chart of another data deletion method provided in the present application;
FIG. 3 is a schematic flow chart of another data deletion method provided in the present application;
fig. 4 is a schematic structural diagram of a data deletion system provided in the present application;
fig. 5 is a schematic structural diagram of a data deleting device provided in the present application.
Detailed Description
The core of the application is to provide a data deleting method, which can effectively improve the data deleting efficiency of a storage system and further improve the utilization rate of the storage space of the system; another core of the present application is to provide a data deleting system, apparatus and computer-readable storage medium, which also have the above beneficial effects.
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
In the prior art, a large amount of aged data in a storage system needs to be deleted to make up enough storage space for storing newly generated data, and the read-write rate of an HDD is much lower than that of an SSD, so that the data deletion efficiency of the storage system is low, and the storage space of the storage system is difficult to be efficiently utilized. Therefore, in order to solve the above problems, the present application provides a data deletion method for deleting data of a storage system, where the data deletion method can effectively improve the data deletion efficiency of the storage system, and further improve the utilization rate of the storage space of the system.
Referring to fig. 1, fig. 1 is a schematic flow chart of a data deleting method provided in the present application, where the data deleting method may include:
s101: determining the HDD where the data to be deleted is located according to the received deletion instruction;
generally speaking, in order to ensure that the storage space in the storage device can be effectively utilized, historical storage data such as expired data and damaged data stored therein can be deleted at regular time or irregular time so as to save the storage space and facilitate storage of newly generated data, at this time, a corresponding deletion instruction can be sent to the storage device so that the storage device can delete subsequent data based on the deletion instruction. Further, in the storage device, data storage is generally performed through the SSD or the HDD, and therefore, a data deletion process of the storage device is a process of deleting the stored data in the SSD or the HDD. In this step, after the storage device receives the deletion instruction, the HDD corresponding to the data to be deleted is determined according to the deletion instruction.
The acquisition of the deletion instruction can be issued by a technician through a corresponding client based on actual needs, or can be automatically responded by the storage device based on certain preset conditions, for example, data deletion operation can be executed once according to a preset time interval, and the deletion instruction is automatically responded when the preset time is reached; and the occupancy rate of the storage space of the mobile terminal can be monitored in real time, and when the storage space is lower than a preset value, the deletion instruction is automatically responded. Certainly, the specific values of the preset time interval and the specific values of the preset storage space value are preset by a technician according to actual conditions, and the method and the device are not limited in the application.
S102: migrating the journal and the omap corresponding to the HDD to the SSD through a preset migration script;
specifically, the data is stored in the HDD or SSD in the form of journal and omp, so that after the determination of the HDD where the data to be deleted is located is completed on the basis of S101, a preset migration script is started, and the journal and omp corresponding to the HDD are migrated to the SSD through the preset migration script, so as to implement the subsequent deletion operation of the data to be deleted.
Preferably, the migrating the journal and omap corresponding to the HDD to the SSD through the preset migration script may include: respectively establishing a journal soft connection and an omap soft connection between the HDD and the SSD; and respectively migrating the journal and the omp to a preset storage position of the SSD through the journal soft connection and the omp soft connection.
For the migration process of journal and omap, a more specific migration mode is provided, namely, the migration is realized by establishing a soft connection. Specifically, a journal soft connection and an omp soft connection may be preferentially established between the HDD and the SSD, and further, the journal corresponding to the HDD is migrated to a corresponding preset storage location in the SSD through the journal soft connection, and the omp corresponding to the HDD is migrated to a corresponding preset storage location in the SSD through the omp soft connection.
For example, in the present application, a 5G file space is created in advance on the SSD through dd, and is used for storing the migrated journal and omap.
In addition, it should be noted that, for one storage device, the number of SSDs therein is not unique, and any SSD in the device can implement the deletion operation of the data to be deleted in the journal and the omap, so that the selection of the SSD is not specifically limited in the present application.
Preferably, the migrating the journal and the omap corresponding to the HDD to the SSD through the preset migration script may include: and migrating the journal and the omap corresponding to the HDD to a neighboring SSD or a first SSD of the HDD through a preset migration script.
The application provides a more specific selection mode of the SSD, namely, the SSD closer to the HDD, namely the adjacent SSD, or the first SSD is used for deleting the data to be deleted in the journal and the omp. The method comprises the steps that journal and omap corresponding to the HDD are migrated to an adjacent SSD closest to the HDD, the migration distance is short, the required time is short, the migration rate can be effectively guaranteed, and the data migration rate is further improved; in addition, the first SSD is an SSD used for storing source data, generally speaking, the storage device stores the source data through the first SSD, and in the whole operation process of the storage device, the source data therein is not deleted, that is, the first SSD in the storage device generally does not delete data, so that when the data to be deleted in journal and omap corresponding to the HDD is sent to the first SSD, the first SSD only needs to delete the HDD data, and does not need to delete its own source data, which is less in load and higher in efficiency.
S103: and deleting the data to be deleted in the journal and the omap through the SSD.
The step aims to delete the data to be deleted in the journal and the omap through the SSD so as to complete the complete data deletion operation, and for the specific deletion process, the prior art is referred to, and the details are not repeated herein.
According to the data deleting method, based on the characteristic that the SSD read-write efficiency is far higher than that of the HDD, after the storage system receives a data deleting instruction, corresponding data is not deleted temporarily, the journal and the omap of the data stored in the HDD are migrated to the SSD through the preset migration script, the data in the journal and the omap are further deleted through the SSD, the data deleting efficiency of the storage system is greatly improved, the storage space can be vacated more efficiently to store new data, the storage space of the system is conveniently integrated and utilized, and the utilization rate of the storage space is effectively improved.
On the basis of the above embodiment, please refer to fig. 2, fig. 2 is a schematic flowchart of another data deleting method provided in the present application, where the data deleting method may include:
s201: determining the HDD where the data to be deleted is located according to the received deletion instruction;
s202: turning off OSD service of the HDD;
s203: migrating the journal and omap corresponding to the HDD to the SSD through a preset migration script;
s204: restarting the OSD service;
s205: and deleting the data to be deleted in the journal and the omap through the SSD.
The method comprises the steps of executing the closing operation of the OSD service before the journal and omp are migrated, and restarting the OSD service again after the completion of the migration, so that the integrity of data in the journal and omp in the migration process can be ensured, and the performance damage of the hard disk is avoided.
Preferably, after the OSD service of the HDD is turned off, the method may further include: and flushing the corresponding journal of the HDD from the cache to the HDD through the journal flushing script.
The method comprises the steps of executing a journal refreshing operation corresponding to the HDD before the migration of the journal and the ompa is carried out, wherein in normal operation of the storage device, the operations such as data transmission and acquisition are involved, the journal may be temporarily stored in a cache due to some reasons, and in order to avoid data omission in the deletion process, all data can be put back to the hard disks corresponding to the journal refreshing operation before the data migration is carried out, namely, the journal in the cache is refreshed to the corresponding HDDs.
Regarding other steps provided in the embodiments of the present application, reference may be made to the previous embodiment, and details of the steps are not repeated herein.
The above embodiments implement data deletion operation of a single storage device, and for a distributed cluster system, a large number of node devices are provided in the system, and in an actual operation process, each node device needs to perform data deletion operation, so that in the data deletion process of the whole cluster system, the number of data to be deleted is large, and the data deletion speed is extremely unsatisfactory.
Therefore, to solve the above problems, on the basis of the above embodiments, the present application provides another data deleting method for a distributed storage system, please refer to fig. 3, where fig. 3 is a schematic flowchart of another data deleting method provided by the present application, where the data deleting method includes:
s301: determining the HDD where the data to be deleted is located according to the received deletion instruction;
s302: turning off OSD service of the HDD;
s303: migrating the journal and the omap corresponding to the HDD to the SSD through a preset migration script;
s304: restarting the OSD service;
s305: deleting data to be deleted in the journal and the omap through the SSD;
s306: acquiring IP information of other nodes in the distributed cluster;
s307: and remotely transmitting the preset migration script to other nodes according to the IP information.
It should be noted that, in the present embodiment, the steps other than S306 and S307 refer to S201 to S205 of the second embodiment, and specific contents thereof only need to refer to the first embodiment and the second embodiment, and the following mainly describes the contents of S306 and S307 specifically.
Specifically, when a storage device in the cluster system receives a delete instruction and starts to execute a delete operation, a preset migration script can be remotely transmitted to other nodes at the same time, and the remote transmission process can be realized based on the IP information of each node in the distributed cluster. First, the IP information, such as an IP list, of each node device in the distributed cluster, except the node device itself, may be obtained, and the preset migration script may be remotely sent to each node device according to the IP information.
It should be noted that, the execution time of the remote transmission operation is not unique, and in order to ensure the efficiency of data deletion, the remote transmission operation may also be directly executed after the storage device receives the deletion instruction.
In addition, the data deletion method of the cluster system is only one implementation method provided by the present application, and the data deletion of the cluster system can also be implemented by deploying a preset migration script to each node of the cluster in advance, directly and remotely deleting a command to other node devices when a certain node device in the cluster receives the deletion command, and responding to the deletion command by each node device.
The embodiment of the application realizes the data deletion operation of the distributed cluster system, greatly improves the deletion efficiency of the cluster system, improves the utilization rate of the storage space, and further ensures the reasonable distribution of the cluster system resources.
On the basis of the foregoing embodiments, the present application provides a more specific data deleting method, which is implemented as follows:
script migration operations for a single storage device:
(1) acquiring OSD on all HDDs in the storage device: hdd _ osd _ list; (2) determining the OSD on the first SSD on the storage device: ssd _ osd; (3) traverse OSD on all HDDs: hdd _ osd _ list; (4) and sequentially turning off OSD service: hdd _ osd; (5) refreshing all journals in the storage device; (6) write 5G file with dd on SSD: journal _ $ { hdd _ osd _ id }; (7) creating a pre-stored location for the OSD of the SSD: make journal; (8) establishing a soft connection of journal; (9) copy omap of OSD on HDD to SSD: omap _ $ { hdd _ osd _ id }; (10) establishing a soft connection of the omap; (11) the OSD service on the HDD is started.
Data deletion operation of the distributed cluster system:
(1) acquiring the IP address of each node device from the distributed cluster: ip _ list; (2) writing the journal and omap migration of the OSD on the HDD as a script function: set _ osd _ journal, namely obtaining a migration script; (3) writing a data deletion script transfer _ osd _ journal, and executing a function set _ osd _ journal when a specific parameter set is input; (4) traversing the IP address in the IP _ list; (5) copying the script transfer _ osd _ journal to the node equipment corresponding to the IP; (6) and the remote node equipment corresponding to the IP executes data deleting operation: sh transfer _ osd _ journal set.
According to the data deleting method provided by the embodiment of the application, based on the characteristic that the SSD read-write efficiency is far higher than that of the HDD, after the storage system receives a data deleting instruction, corresponding data is not deleted temporarily, journal and omap of the data stored in the HDD are migrated to the SSD through a preset migration script, and the data in the journal and omap are further deleted through the SSD, so that the data deleting efficiency of the storage system is greatly improved, the storage space can be vacated more efficiently to store new data, the storage space of the system is conveniently integrated and utilized, and the utilization rate of the storage space is effectively improved.
To solve the above problem, please refer to fig. 4, fig. 4 is a schematic structural diagram of a data deleting system provided in the present application, where the data deleting system may include:
a receiving module 10, configured to determine, according to the received deletion instruction, an HDD where the data to be deleted is located;
a migration module 20, configured to migrate journal and omap corresponding to the HDD to the SSD through a preset migration script;
and the deleting module 30 is configured to delete the data to be deleted in journal and omap by the SSD.
As a preferred embodiment, the data deletion system may further include:
the OSD closing module is used for closing the OSD service of the HDD;
and the OSD restarting module is used for restarting the OSD service.
As a preferred embodiment, the data deletion system may further include:
and the refreshing module is used for refreshing the journal corresponding to the HDD from the cache to the HDD through the journal refreshing script.
As a preferred embodiment, the migration module 20 may be specifically configured to establish a journal soft connection and an omap soft connection between the HDD and the SSD, respectively; and respectively migrating the journal and the omp to a preset storage position of the SSD through the journal soft connection and the omp soft connection.
As a preferred embodiment, the migration module 20 may be specifically configured to migrate the journal and omap corresponding to the HDD to the neighboring SSD or the first SSD of the HDD by using a preset migration script.
As a preferred embodiment, the data deletion system may further include:
the remote synchronization module is used for acquiring IP information of other nodes in the distributed cluster; and remotely transmitting the preset migration script to other nodes according to the IP information.
For the introduction of the system provided in the present application, please refer to the method embodiments described above, which are not described herein again.
To solve the above problem, please refer to fig. 5, fig. 5 is a schematic structural diagram of a data deleting device provided in the present application, where the data deleting device may include:
a memory 1 for storing a computer program;
a processor 2 for implementing the following steps when executing the computer program:
determining the HDD where the data to be deleted is located according to the received deletion instruction; migrating the journal and the omap corresponding to the HDD to the SSD through a preset migration script; and deleting the data to be deleted in the journal and the omap through the SSD.
For the introduction of the apparatus provided in the present application, please refer to the method embodiments described above, which are not described herein again.
To solve the above problem, the present application further provides a computer-readable storage medium having a computer program stored thereon, where the computer program when executed by a processor can implement the following steps:
determining the HDD where the data to be deleted is located according to the received deletion instruction; migrating the journal and the omap corresponding to the HDD to the SSD through a preset migration script; and deleting the data to be deleted in the journal and the omap through the SSD.
The computer-readable storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
For the introduction of the computer-readable storage medium provided in the present application, please refer to the above method embodiments, which are not described herein again.
The embodiments are described in a progressive mode in the specification, the emphasis of each embodiment is on the difference from the other embodiments, and the same and similar parts among the embodiments can be referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the components and steps of the various examples have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The data deleting method, system, device and computer readable storage medium provided by the present application are described in detail above. The principles and embodiments of the present application are explained herein using specific examples, which are provided only to help understand the method and the core idea of the present application. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and these improvements and modifications also fall into the elements of the protection scope of the claims of the present application.

Claims (8)

1. A method for deleting data, comprising:
determining the HDD where the data to be deleted is located according to the received deletion instruction;
migrating the journal and omap corresponding to the HDD to the SSD through a preset migration script;
deleting the data to be deleted in the journal and the omap through the SSD;
the migrating the journal and the omap corresponding to the HDD to the SSD through a preset migration script comprises the following steps:
respectively establishing a journal soft connection and an omap soft connection between the HDD and the SSD;
respectively migrating the journal and the omap to a preset storage position of the SSD through the journal soft connection and the omap soft connection;
and migrating the journal and omap corresponding to the HDD to a neighboring SSD or a first SSD of the HDD through the preset migration script.
2. The data deleting method of claim 1, wherein before migrating the journal and omap corresponding to the HDD to the SSD through a preset migration script, the method further comprises:
turning off OSD service of the HDD;
then, after migrating the journal and omap corresponding to the HDD to the SSD through the preset migration script, the method further includes:
and restarting the OSD service.
3. The data deletion method of claim 2, wherein after the turning off OSD service of the HDD, further comprising:
and flushing the journal corresponding to the HDD from the cache to the HDD through a journal flushing script.
4. A data deletion method according to any one of claims 1 to 3, further comprising:
acquiring IP information of other nodes in the distributed cluster;
and remotely transmitting the preset migration script to the other nodes according to the IP information.
5. A data deletion system, comprising:
the receiving module is used for determining the HDD where the data to be deleted is located according to the received deleting instruction;
the migration module is used for migrating the journal and omap corresponding to the HDD to the SSD through a preset migration script;
a deleting module, configured to delete the data to be deleted in the journal and the omap through the SSD;
the migration module is used for respectively establishing a journal soft connection and an omap soft connection between the HDD and the SSD; respectively migrating the journal and the omap to a preset storage position of the SSD through the journal soft connection and the omap soft connection;
and the migration module is used for migrating the journal and omap corresponding to the HDD to a neighboring SSD or a first SSD of the HDD through a preset migration script.
6. The data deletion system of claim 5, further comprising:
the remote synchronization module is used for acquiring IP information of other nodes in the distributed cluster; and remotely transmitting the preset migration script to the other nodes according to the IP information.
7. A data deletion apparatus, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the data deletion method of any one of claims 1 to 4 when executing said computer program.
8. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the data deletion method according to any one of claims 1 to 4.
CN201910285640.4A 2019-04-10 2019-04-10 Data deleting method, system, device and computer readable storage medium Active CN109992213B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910285640.4A CN109992213B (en) 2019-04-10 2019-04-10 Data deleting method, system, device and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910285640.4A CN109992213B (en) 2019-04-10 2019-04-10 Data deleting method, system, device and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN109992213A CN109992213A (en) 2019-07-09
CN109992213B true CN109992213B (en) 2022-07-22

Family

ID=67132968

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910285640.4A Active CN109992213B (en) 2019-04-10 2019-04-10 Data deleting method, system, device and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN109992213B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110888844B (en) * 2019-11-22 2023-03-21 浪潮电子信息产业股份有限公司 Data deleting method, system, equipment and computer readable storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107967172B (en) * 2017-12-21 2022-01-11 深圳大学 Spark task dynamic migration method and system for heterogeneous storage
CN109388624A (en) * 2018-10-09 2019-02-26 郑州云海信息技术有限公司 Distributed document delet method, device, system and computer readable storage medium

Also Published As

Publication number Publication date
CN109992213A (en) 2019-07-09

Similar Documents

Publication Publication Date Title
CN109428913B (en) Storage capacity expansion method and device
CN111142788B (en) Data migration method and device and computer readable storage medium
US10795579B2 (en) Methods, apparatuses, system and computer program products for reclaiming storage units
WO2021259094A1 (en) Method and apparatus for migration of virtual machine across cloud platform, and storage medium and electronic apparatus
CN109558456A (en) A kind of file migration method, apparatus, equipment and readable storage medium storing program for executing
CN111737212A (en) Method and equipment for improving performance of distributed file system
CN109992213B (en) Data deleting method, system, device and computer readable storage medium
CN106383667B (en) The method and apparatus that LUN is migrated in service operation
CN108205559B (en) Data management method and equipment thereof
CN108646987A (en) A kind of management method of file volume, device, storage medium and terminal
CN112860188A (en) Data migration method, system, device and medium
CN105760114B (en) Parallel file system resource management method, device and system
CN111722909A (en) Virtual machine migration method, system, equipment and storage medium
CN110658993A (en) Snapshot rollback method, device, equipment and storage medium
CN104468674B (en) Data migration method and device
CN111708489B (en) Method and equipment for improving hard disk service quality
WO2021098268A1 (en) Mon service migration method, apparatus, and device, and readable storage medium
CN109828720B (en) Data storage method, device, server and storage medium
CN107728939A (en) I O scheduling method, apparatus, equipment and storage medium based on Linux
CN109189339B (en) Automatic configuration cache acceleration method under storage system
CN104461382A (en) Internal writing method for file server operating multiple file systems and server
CN111176571A (en) Method, device, equipment and medium for managing local object
CN113608686B (en) Remote memory direct access method and related device
CN116069263B (en) File system optimization method, device, server, equipment and storage medium
WO2016177072A1 (en) Network topology display method and device, and network management system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant