WO2016086819A1 - Procédé et appareil pour écrire des données dans un disque dur d'enregistrement magnétique en bardeaux (smr) - Google Patents

Procédé et appareil pour écrire des données dans un disque dur d'enregistrement magnétique en bardeaux (smr) Download PDF

Info

Publication number
WO2016086819A1
WO2016086819A1 PCT/CN2015/095997 CN2015095997W WO2016086819A1 WO 2016086819 A1 WO2016086819 A1 WO 2016086819A1 CN 2015095997 W CN2015095997 W CN 2015095997W WO 2016086819 A1 WO2016086819 A1 WO 2016086819A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
chunk
record
hard disk
mark
Prior art date
Application number
PCT/CN2015/095997
Other languages
English (en)
Chinese (zh)
Inventor
张雷
肖垒
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2016086819A1 publication Critical patent/WO2016086819A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0647—Migration mechanisms
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/0644—Management of space entities, e.g. partitions, extents, pools

Definitions

  • the present invention relates to the field of computer technologies, and in particular, to a method and apparatus for writing data into a stacked magnetic recording SMR hard disk.
  • SMR Silicon Magnetic Record
  • the distributed Key-Value storage system has the advantages of fast query speed, large amount of data storage, and high concurrency support. It is very suitable for querying through the primary key.
  • the inventors have found that the prior art has at least the following problem: since the track of the SMR hard disk is very narrow, data in a certain number of tracks adjacent thereto will be written when data is written into a certain track. Write coverage is generated, causing data in adjacent tracks to fail. Therefore, the Key-Value storage system layout scheme cannot be directly transplanted to the SMR hard disk, resulting in low write performance of the SMR hard disk.
  • the embodiment of the present invention provides a method and device for writing data into the stacked magnetic recording SMR hard disk.
  • the technical solution is as follows:
  • a method for writing data to a shingled magnetic recording SMR hard disk includes a plurality of chunks obtained by virtualizing a track band, the method comprising:
  • the write data instruction including a key, a data, and a mark
  • the key being used to identify the data
  • the mark being a write mark, a delete mark, or a modify mark
  • the write mark being used to indicate that the Data is written into the SMR hard disk
  • the delete flag is used to delete the SMR hard disk.
  • Data having the key, the modified mark being used to indicate that data having the same key and having been written to the SMR hard disk is modified with the data;
  • the address is saved, the tag and the data are written to the address in the chunk being used.
  • the chunk being used includes a data area for storing a data record, and the space is applied to the chunk being used according to the length of the data record, including:
  • a space is requested from the data area in the chunk being used according to the length of the data record.
  • the chunk being used includes an index area for storing an index record, where the key is saved
  • the tag and the data are written to the address in the chunk being used, including:
  • the index record in the first storage area in the memory is stored in the index area in the chunk being used.
  • the method further includes:
  • the method further includes:
  • the used chunk and the chunk being used are determined according to the attributes of the chunk;
  • the reconstruction is obtained
  • the index record includes: a key of data in the data record, a tag corresponding to the data, and an address in which the data is written in the chunk being used.
  • an apparatus for writing data to a shingled magnetic recording SMR hard disk comprising:
  • a receiving module configured to receive a write data instruction, where the write data instruction includes a key, a data, and a mark, wherein the key is used to identify the data, and the mark is a write mark, a delete mark, or a modify mark, and the write mark is used by And indicating that the data is written into the SMR hard disk, the deletion mark is used to indicate deleting data having the key in the SMR hard disk, and the modification mark is used to indicate that the same key is modified by using the data and Data that has been written to the SMR hard disk;
  • An application module configured to apply for a space to a chunk being used according to a length of the data record, where the data record includes the key, the data, and the mark in the write data instruction;
  • a first writing module configured to write the data record into the space of the application
  • a saving module configured to save the key, the mark, and the address in which the data is written in the chunk being used.
  • the chunk being used includes a data area for storing a data record
  • the application module is configured to use the length according to the length of the data record.
  • the data area application space in the chunk.
  • the chunk being used includes an index area for storing an index record
  • Storage module including:
  • a component unit configured to form an index record of the key, the mark, and an address in which the data is written into the chunk being used;
  • a saving unit configured to save the index record to a first storage area in the memory corresponding to the chunk being used; or, the remaining space in the chunk being used is insufficient to allocate a write data instruction to be written And storing, in the data, the index record in the first storage area in the memory to the index area in the chunk being used.
  • the apparatus further includes:
  • a modifying module configured to modify the attribute of the used chunk to be used, and apply an unused chunk as a used chunk for writing data next time;
  • a storage module configured to store the index record in the first storage area to a second storage area in the memory corresponding to the used chunk
  • a clearing module configured to clear the index record in the first storage area.
  • the first possible implementation of the second aspect, the second possible implementation of the second aspect, or the third possible implementation of the second aspect, in a fourth possible implementation further includes:
  • a determining module configured to determine, according to the attribute of the chunk, the used chunk and the chunk being used when the hard disk is restarted;
  • a second writing module configured to write an index record stored in the used chunk to a second storage area in the memory corresponding to the used chunk
  • a reconstruction module configured to reconstruct an index record corresponding to the data record according to the data record stored in the chunk being used, and write the reconstructed index record into the memory to correspond to a chunk being used The first storage area.
  • the reconstruction is obtained
  • the index record includes: a key of data in the data record, a tag corresponding to the data, and an address in which the data is written in the chunk being used.
  • an apparatus for writing data into a stacked magnetic recording SMR hard disk is provided, which is applied to a device including the SMR hard disk, wherein the SMR hard disk includes a plurality of virtual bands according to a track band The resulting chunk, the apparatus comprising: a receiver and a processor, wherein the processor is coupled to the receiver;
  • the receiver is configured to receive a write data instruction, the write data instruction includes a key, a data and a mark, the key is used to identify the data, and the mark is a write mark, a delete mark or a modify mark, and the write Marking is used to indicate that the data is written into the SMR hard disk, and the delete flag is used to delete data having the key in the SMR hard disk, and the modified mark is used to indicate that the data modification has the same Key and data that has been written to the SMR hard disk;
  • the processor configured to apply for a space to a chunk being used according to a length of the data record, where the data record includes the key, the data, and the mark in the write data instruction;
  • the processor is further configured to write the data record into the space of the application
  • the processor is further configured to save the key, the mark, and an address in which the data is written into the chunk being used.
  • the chunk being used includes a data area for storing a data record
  • the processor is further configured to use the length according to the length of the data record The data area application space in the chunk.
  • the chunk being used includes an index area for storing an index record, and the processor further Forming an index record for the address, the mark, and an address in which the data is written into the chunk being used;
  • the processor is further configured to save the index record to a first storage area in a memory corresponding to a chunk being used; or, the remaining space in the chunk being used is insufficient to allocate a write data instruction When the data is written, the index record in the first storage area in the memory is stored to the index area in the chunk being used.
  • the processor is further configured to: The attribute of the chunk being used is modified to be used, and an unused chunk is requested as the used chunk for the next write of the data;
  • the processor is further configured to store the index record in the first storage area to a second storage area in the memory corresponding to a used chunk;
  • the processor is further configured to clear the index record in the first storage area.
  • the processor is further configured to determine, according to an attribute of the chunk, the used Chunk and the chunk being used;
  • the processor is further configured to write an index record stored in the used chunk to a second storage area in the memory corresponding to the used chunk;
  • the processor is further configured to reconstruct an index record corresponding to the data record according to the data record stored in the chunk being used, and write the reconstructed index record into the memory and in use The chunk corresponds to the first storage area.
  • the reconstruction is obtained
  • the index record includes: a key of data in the data record, a tag corresponding to the data, and an address in which the data is written in the chunk being used.
  • FIG. 1 is a schematic diagram showing the spatial layout of an SMR hard disk provided in an embodiment of the present invention
  • FIG. 2 is a flow chart of a method for writing data into a stacked magnetic recording SMR hard disk according to an embodiment of the present invention
  • 3A is a flow chart of a method for writing data into a stacked magnetic recording SMR hard disk according to another embodiment of the present invention.
  • FIG. 3B is a schematic diagram of a process of switching a chunk provided in an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a garbage cleaning process provided in an embodiment of the present invention.
  • FIG. 5 is a flow chart of a method for writing data into a stacked magnetic recording SMR hard disk according to still another embodiment of the present invention.
  • FIG. 6 is a block diagram showing the structure of an apparatus for writing data into a stacked magnetic recording SMR hard disk according to an embodiment of the present invention
  • FIG. 7 is a block diagram showing the structure of an apparatus for writing data into a stacked magnetic recording SMR hard disk according to another embodiment of the present invention.
  • FIG. 8 is a block diagram showing the structure of an apparatus including an SMR hard disk according to an embodiment of the present invention.
  • FIG. 9 is a block diagram showing the structure of an apparatus including an SMR hard disk according to another embodiment of the present invention.
  • FIG. 1 illustrates a spatial layout of an SMR hard disk provided in an embodiment of the present invention.
  • the SMR hard disk may be logically divided into a system metadata area 110 and a recording area 120 .
  • the system metadata area 110 includes at least one super record block 130, and the super record block 130 includes at least one super block 140 for recording attributes and usage information of each chunk 150 in the record area 120.
  • the size of the super block 140 can be determined according to the size of the information in the recording area 120.
  • the number of the super blocks 140 can be determined according to the number of times the super block 140 can be repeatedly written, and the more the super block 140 can be repeatedly written. More, the number of super blocks 140 can be set smaller.
  • the number of super record blocks 130 can be determined according to the number and size of the super blocks 140. In the actual application scenario, the number of super blocks 140 in the super record block 130 and the information contained in the super block 140 may be changed according to the actual use.
  • the super block 140 in the super record block 130 may further include a first global variable, where the first global variable is used to identify the sequential use order of each super block 140. For example, you can apply for each After a super block 140, the first global variable is incremented by 1 as the first global variable of the applied super block 140. For example, currently, after applying to the super block 140, if the first global variable of the super application 140 of the previous application is found to be 100, the first global variable is incremented by 1 to obtain a new first global variable 101. A global variable 101 is taken as the first global variable of the current super block 140. It should be noted that the value added by the first global variable may also be other values, such as 2, 3, etc., only need to ensure that the first global variable of the super-block 140 applied later is greater than that of the super-block 140 of the previous application. The first global variable.
  • the recording area 120 includes at least one chunk 150, and the chunk 150 here is obtained by virtualizing the track band in the SMR hard disk. According to the usage of chunk150, chunk 150 can be divided into used chunks, chunks in use, and unused chunks.
  • the recording area 120 is for storing data records and index records corresponding to the data records.
  • the type of the chunk 150 in the recording area 120 may be changed according to the actual use.
  • the recording area 120 may further include other types of chunks.
  • the chunk 150 in the recording area 120 includes a data area 160 and an index area 170.
  • the data area 160 can be used to store at least one data record, each data record including at least the first two or all of the keys, tags, and data.
  • the type of information contained in the data record can be determined based on the type of tag of the data record. For example, when the mark of the data record is a delete mark, the delete record may include only the key and the mark; when the mark type of the data record is a write mark or a modified mark, the write record or the modified record may include a key and a mark. And data.
  • the data record may further include other information, such as the check information, the key length information, and the data length information.
  • the other information included in the data record is not specifically limited in this embodiment.
  • the data record may further include a second global variable, where the second global variable is used to identify a sequence in which each data record is written. For example, each time a data record is written, the second global variable of the previously written data record can be incremented by one as the second global variable of the currently written data record. For example, when writing the current data record, if the second global variable of the data record written last time is 200, the second global variable is incremented by 1 to obtain a new second global variable 201, and the second The global variable 201 acts as the second global variable of the current data record. It should be noted that the value added by the second global variable may also be other values, such as 2, 3, etc., only need to ensure that the second global variable of the data record written later is greater than the data record of the previous write. The second global variable.
  • the index area 170 is configured to store index records corresponding to the data records one by one, and the index records corresponding to the data records include at least the same keys, tags, and addresses recorded in the data records on the SMR hard disk.
  • the data records in the data area 160 have a one-to-one correspondence with the index records in the index area 170.
  • the data record 1 corresponds to the index record 1
  • the data record 2 corresponds to the index record 2.
  • the relative positions of the data record 1, the data record 2, the index record 1, and the index record 2 in FIG. 1 are only schematic, which is not limited in this embodiment.
  • the index record may further include a second global variable corresponding to the data record.
  • the relative positions of the keys, tags, and addresses in the index record can be changed according to the actual use.
  • the SMR hard disk divideds the SMR hard disk into a system metadata area and a recording area, and the recording area is used for storing data records and index records corresponding to the data records, and the system metadata area is used for recording.
  • the attribute and usage information of each chunk in the recording area since the index record is established for each data record in the SMR hard disk, the solution of the distributed storage system layout cannot be directly transplanted to the SMR hard disk, resulting in the writing of the SMR hard disk.
  • the problem of lower performance is achieved; since the chunk is obtained according to the band virtualization, data can be randomly written between the chunks, thereby achieving the effect of improving the flexibility of writing data on the SMR hard disk.
  • FIG. 2 is a flowchart of a method for writing data into a stacked magnetic recording SMR hard disk according to an embodiment of the present invention.
  • the method for writing data into a stacked magnetic recording SMR hard disk can be used for In a device including an SMR hard disk, the method for writing data into a stacked magnetic recording SMR hard disk may include:
  • Step 201 Receive a write data instruction, where the write data instruction includes a key, a data, and a mark, the key is used to identify the data, and the mark is a write mark, a delete mark, or a modify mark, and the write mark is used to indicate that the data is written into the SMR hard disk, and is deleted.
  • the mark is used to indicate that the data having the key in the SMR hard disk is deleted, and the modification mark is used to indicate that the data having the same key and written to the SMR hard disk is modified by using the data;
  • Step 202 Apply space to the chunk being used according to the length of the data record, and record the data packet. Including the keys, data, and tags in the data instructions;
  • Step 203 writing a data record into the space of the application
  • step 204 the save key, the tag, and the data are written to the address in the chunk being used.
  • the method for writing data into the shingled magnetic recording SMR hard disk is to write the data record containing the key, the data and the mark into the chunk being used; since the data is generated according to the write data instruction.
  • the data record contains keys and data. Therefore, it solves the problem that the distributed storage system layout scheme cannot be directly transplanted to the SMR hard disk, resulting in low write performance of the SMR hard disk; since the chunk is obtained according to the band virtualization, Data can be randomly written between chunks, thus achieving the flexibility of writing data on the SMR hard disk.
  • FIG. 3A shows another embodiment of the present invention.
  • a flow chart of a method of writing data into a stacked magnetic recording SMR hard disk the method of writing data into a stacked magnetic recording SMR hard disk can be used in a device including an SMR hard disk, which writes data into a stacked magnetic field
  • the method of recording the SMR hard disk may include:
  • Step 301 Receive a write data instruction.
  • the write data instructions here include keys, data, and tags.
  • the keys are used to identify data, marked as write marks, delete marks, or modified marks.
  • Write marks are used to indicate that the data is written to the SMR hard disk, and the delete mark is used to indicate that the SMR is deleted.
  • the data in the hard disk has the key, and the modification flag is used to indicate that the data having the same key and written to the SMR hard disk is modified by the data.
  • Step 302 Apply space to the data area in the chunk being used according to the length of the data record
  • Data records include keys, data, and tags in a write data instruction.
  • step 302 it may also generally include generating a data record according to the write data instruction.
  • the device where the SMR is located can generate a data record according to the data record format according to the write data command.
  • the data record may include only keys and tags. For example, when the write data instruction is marked as a delete tag, the write data instruction usually does not include data.
  • the device in which the SMR is located After receiving the write data command, the device in which the SMR is located determines the type of the write data command, and generates a corresponding data record according to the mark type of the write data command. For the specific implementation, refer to the following three implementation manners.
  • the write data instruction when the write data instruction includes a mark as a delete mark, the key and the mark carried in the write data command are combined into one data record according to the format of the data record.
  • the write data instruction when the write data instruction includes a mark as a write mark, the data, keys, and tags carried in the write data command are combined into one data record according to the format of the data record.
  • the write data instruction when the write data instruction includes a mark as a modification mark, the data, the key, and the mark carried in the write data command are combined into one data record according to the format of the data record.
  • the write data instruction when the write data instruction includes a mark as a delete mark, the data record generated according to the write data instruction usually includes a key and a mark; and when the write data instruction includes a mark as a write mark or a modified mark, according to the Data records generated by write data instructions typically contain keys, tags, and data.
  • the device where the SMR is located can calculate the length of the data record, and obtain the attributes of each chunk in the record area through the super block in the system metadata area of the SMR hard disk, and determine the chunk currently being used according to the attributes of each chunk, and in the memory. Finding an index record corresponding to the data record in the chunk being used, determining, according to the address of the last written data in the found index record and the length of the last written data, determining that the chunk being used is finally The location of the write.
  • the last determined position to be written here refers to the last position at which data is last written.
  • the device in which the SMR is located allocates the same space as the length of the generated data record from the last written position in the chunk currently being used, based on the length of the generated data record.
  • Step 303 writing a data record into the space of the application
  • Step 304 forming an index record by combining the key, the tag and the address in which the data is written into the chunk being used;
  • the keys and tags here are the same as the keys and tags in the data record.
  • the device where the SMR is located determines the combination of the keys, tags, and addresses written to the chunks being used as the index record for the data record.
  • Step 305 Save the index record to a first storage area in the memory corresponding to the chunk being used;
  • the first storage area here is used to temporarily store the number of pieces written in the chunk currently being used.
  • the memory here can be the system memory of the device where the SMR is located.
  • the device where the SMR is located needs to persist the index record of the chunk being used, and needs to apply for a new chunk being used for subsequent
  • the data is written, and correspondingly, a new super block needs to be applied to record the corresponding record information.
  • steps 306 to 309 below.
  • Step 306 when the remaining space in the chunk being used is insufficient to allocate the data to be written in the write data instruction, storing the index record in the first storage area in the memory to the index area in the chunk being used;
  • the device in which the SMR is located determines that the space of the chunk being used is allocated. At this time, the device where the SMR is located stores the index record in the first storage area in the memory to the index area in the chunk being used.
  • Step 307 modify the attribute of the chunk being used to be used, and apply for an unused chunk as the used chunk for the next write data
  • the SMR device After the SMR device detects that the space of the chunk being used is allocated, and writes each index record stored in the first storage area to the index area of the chunk being used, the chunk being used is no longer used. The data record continues to be written, so the property of the chunk being used can be changed to used at this time, so that the chunk being used becomes the used chunk.
  • the device where the SMR is located needs to apply for the next super block in the system metadata area, and records the attributes and usage information of each chunk in the current recording area in the applied super block.
  • FIG. 3B is a schematic diagram of a process of switching a chunk provided in an embodiment of the present invention.
  • the device in which the SMR is located records the index corresponding to the data record of the data area 321 of the chunk 320 being used from the memory.
  • a storage area is stored in the index area 322 of the chunk 320 being used, and the attribute of the chunk 320 being used is changed to used, and becomes the used chunk 330.
  • the device in which the SMR is located requests an unused chunk 340, changes the attribute of the unused chunk 340 to be used, becomes the chunk 350 being used, and starts to allocate space in the data area 351 of the chunk 350 being used.
  • the device changes the attributes of the chunk 320 and the unused chunk 340 that are being used, and applies a super block 360, and records the attributes and usage information of each chunk in the current recording area in the newly applied super block 360.
  • Step 308 storing an index record in the first storage area into a second storage area in the memory corresponding to the used chunk;
  • the second storage area here is used to store index records in all used chunks in the SMR hard disk.
  • the device where the SMR is located needs to write the index records after the index records stored in the current first storage area are written to the index area of the chunk being used. Go to the second storage area in memory.
  • the device in which the SMR is located needs to sequentially read the index record to be written into the second storage area from the first storage area, and according to the read The tag in the obtained index record is operated accordingly.
  • the mark in the read index record is a delete mark
  • the same index record in the second storage area as the key in the read index record is deleted, and the read index record is discarded;
  • the mark in the read index record is a modified mark
  • the same index record in the second storage area as the key in the read index record is deleted, and the read index record is written into the first In the second storage area
  • the read index record is written in the second storage area.
  • the device where the SMR is located may determine the proportion of invalid data in the chunk according to an index record in each chunk that is not saved in the second storage area.
  • Step 309 clearing an index record in the first storage area
  • the index record in the first storage area of the memory After the index record in the first storage area of the memory is written to the second storage area in the memory, the index record in the first storage area needs to be cleared to reduce the memory usage.
  • the first storage area After the first storage area is applied, it is usually used to store the index record generated in the chunk currently being used, and if the index record recorded in the first storage area is persisted to the chunk that is being used, the first storage area Index records in a storage area are usually cleared.
  • the first storage area being requested typically corresponds to a chunk being used.
  • the method for writing data into the shingled magnetic recording SMR hard disk is to write the data record containing the key, the data and the mark into the chunk being used;
  • the data record generated by the data instruction contains keys and data. Therefore, the problem that the distributed storage system layout scheme cannot be directly transplanted to the SMR hard disk is solved, resulting in low write performance of the SMR hard disk; since the chunk is obtained according to the band virtualization
  • the data can be randomly written between the various chunks, thus achieving the effect of improving the flexibility of writing data on the SMR hard disk.
  • the index record in the first storage area is stored in the second storage area corresponding to the used chunk in the memory; since the index record of the used chunk in the SMR hard disk is persisted into the memory, the solution is solved.
  • the problem of low reading efficiency when sequentially reading the SMR hard disk is achieved; the effect of improving the reading efficiency of the SMR hard disk is achieved.
  • the super block in the SMR hard disk may further include a first global variable.
  • the first global variable of the super block applied later is greater than the first global variable of the super block that was previously applied. For example, when the device where the SMR is located requests the next super block in the system metadata area, the current first global variable is incremented by 1 and used as the first global variable of the super block obtained by the application.
  • the usage information in the super block may include an occupation ratio of an invalid data record in each used chunk, and the invalid data record is a data record in which the index record is not recorded in the second storage area of the memory.
  • step 308 the detailed acquisition process of the proportion of the invalid data records herein can be referred to step 308 in the corresponding embodiment of FIG. 3A, and is not described here.
  • the device where the SMR is located detects the space usage of the current SMR hard disk.
  • the super block with the largest global variable is searched in the system metadata area of the SMR hard disk. Since the first global variable of the super block applied later is greater than the first global variable of the super block that was previously applied, the maximum chunk of the first global variable records each chunk in the record area of the current SMR hard disk. Properties and usage information.
  • the device where the SMR is located detects that the current SMR hard disk space usage is 90%, and then the SMR hard disk space usage rate is higher than the specified usage threshold.
  • the device where the SMR is located will find the super block with the largest global variable in the system metadata area of the SMR hard disk.
  • the garbage cleaning process may need to be frequently written and read, therefore, in order not to Affects the normal use of the device where the SMR is located.
  • the device where the SMR resides can detect the usage of the system first. When the system is detected to be idle, the garbage cleaning process is performed.
  • the device where the SMR is located can obtain the usage information of each used chunk according to the found super block, and determine the occupation ratio of the invalid data record in each used chunk according to the usage information of each used chunk.
  • the device in which the SMR is located determines the index record in the used chunk after determining that the occupied proportion of the invalid data record reaches the predetermined threshold, and searches for the index record in the second storage area in the memory. If the index record is found, the data record corresponding to the index record is written into the current chunk being used. If the index record is not found, the data record corresponding to the index record is garbage-cleaned.
  • FIG. 4 is a schematic diagram of a garbage cleaning process provided in an embodiment of the present invention.
  • the valid data record in the data area of the used chunk 420 is 0, and the valid data record is recorded. 2 and the valid data record 4 is written in the data area of the chunk 430 being used, and an index record corresponding to the valid data record 0, the valid data record 2, and the valid data record 4 is generated, and these index records are saved to the first storage of the memory. In the area.
  • the SMR device After the SMR device writes all the valid data in the used chunk420 to the chunk430 being used, the attribute of the used chunk420 is changed to unused, and then becomes an unused chunk440, and a super block 450 is applied. The attribute and usage information of each chunk in the current recording area is recorded in the super block 450.
  • FIG. 5 illustrates that it will be provided in another embodiment of the present invention.
  • a flow chart of a method for writing data into a stacked magnetic recording SMR hard disk the method of writing data into a stacked magnetic recording SMR hard disk can be used in a device including an SMR hard disk, which writes data into a stacked magnetic recording
  • the method of the SMR hard disk may include:
  • Step 501 Receive a write data instruction.
  • Step 502 Apply space to the data area in the chunk being used according to the length of the data record
  • Step 503 writing a data record into the space of the application
  • Step 504 forming an index record by combining the key, the tag, and the address in which the data is written into the chunk being used;
  • Step 505 Save the index record to a first storage area in the memory corresponding to the chunk being used;
  • Step 506 when the remaining space in the chunk being used is insufficient to allocate the data to be written in the write data instruction, storing the index record in the first storage area in the memory to the index area in the chunk being used;
  • Step 507 modifying the attribute of the chunk being used to be used, and applying an unused chunk as the used chunk for the next write data
  • Step 508 Store an index record in the first storage area into a second storage area in the memory corresponding to the used chunk;
  • Step 509 Clear an index record in the first storage area.
  • steps 501 to 509 are processes in which the device in which the SMR is located writes a data record to the SMR hard disk and persists the index record of the chunk.
  • the device in which the SMR is located writes a data record to the SMR hard disk and persists the index record of the chunk.
  • the device where the SMR is located needs to rebuild data in the memory. For details, see steps 510 to 512 below.
  • Step 510 when restarting the hard disk, determining the used chunk and the chunk being used according to the attribute of the chunk;
  • the device where the SMR is located can determine the used chunk and the chunk being used according to the attributes of the chunk.
  • the device where the SMR is located can obtain the attributes of each chunk from the latest super block in the system metadata area of the SMR hard disk, thereby determining the used chunk and the chunk being used.
  • the super block may further include a first global variable, and the first global variable of the super block applied later is greater than the first global variable of the super block that was previously applied.
  • the SMR device searches for the super block with the largest global variable in the system metadata area of the SMR hard disk.
  • the first global The super-block with the largest variable records the attributes and usage information of each chunk in the record area of the current SMR hard disk.
  • the device where the SMR is located determines the used chunk and the chunk being used according to the attributes and usage information of each chunk recorded in the superblock.
  • Step 511 Write an index record stored in the used chunk to a second storage area in the memory corresponding to the used chunk;
  • the index record further includes a second global variable uniquely corresponding to the data record, and the second global variable of the index record written later is greater than the second global variable of the previously recorded index record.
  • the SMR After acquiring the index records in the used chunks, the SMR records the index records in the used chunks into the second storage area of the memory according to the second global variable recorded in each index.
  • the tags of each index record are extracted, and corresponding operations are performed according to the types of the tags, which can be classified into the following three cases.
  • the drop key is the same as the key of the extracted index record, and the second global variable is smaller than the index record of the second global variable of the extracted index record.
  • the extracted index record is discarded until all the keys are identical to the extracted index record and the second global variable is smaller than the index record of the second global variable of the extracted index record.
  • the drop key is the same as the key of the extracted index record, and the second global variable is smaller than the index record of the second global variable of the extracted index record.
  • the extracted index record is written to the second storage area until all the keys are identical to the extracted index record and the second global variable is smaller than the index record of the second global variable of the extracted index record.
  • the extracted index record is written into the second storage area.
  • Step 512 Rebuild an index record corresponding to the data record according to the data record stored in the chunk being used, and write the reconstructed index record into the first storage area in the memory corresponding to the chunk being used.
  • the reconstructed index record may include: a key of data in the data record, a tag corresponding to the data, and an address in which the data is written in the chunk being used.
  • the method for writing data into the shingled magnetic recording SMR hard disk is to write the data record containing the key, the data and the mark into the chunk being used;
  • the data record generated by the data instruction contains keys and data. Therefore, the problem that the distributed storage system layout scheme cannot be directly transplanted to the SMR hard disk is solved, resulting in low write performance of the SMR hard disk; since the chunk is obtained according to the band virtualization
  • the data can be randomly written between the various chunks, thus achieving the effect of improving the flexibility of writing data on the SMR hard disk.
  • FIG. 6 is a structural block diagram of an apparatus for writing data into a stacked magnetic recording SMR hard disk according to an embodiment of the present invention.
  • the device for writing data into a stacked magnetic recording SMR hard disk can be used.
  • the device for writing data into the stacked magnetic recording SMR hard disk may include: a receiving module 601, an application module 602, a first writing module 603, and a saving module 604;
  • the receiving module 601 is configured to receive a write data instruction, where the write data instruction includes a key, a data and a mark, the key is used to identify the data, the mark is a write mark, a delete mark or a modify mark, and the write mark is used to indicate that the data is written into the SMR hard disk.
  • the delete flag is used to delete the data having the key in the SMR hard disk
  • the modification mark is used to indicate that the data having the same key and written to the SMR hard disk is modified by using the data;
  • the application module 602 is configured to apply for a space to the chunk being used according to the length of the data record, where the data record includes a key, a data, and a mark in the write data instruction;
  • a first writing module 603, configured to write a data record into the space of the application
  • the save module 604 is configured to save the address of the key, the mark, and the data written in the chunk being used.
  • the device for writing data into the shingled magnetic recording SMR hard disk provided by the embodiment is written into the chunk being used by writing the data record containing the key, the data and the mark;
  • the data record contains keys and data. Therefore, it solves the problem that the distributed storage system layout scheme cannot be directly transplanted to the SMR hard disk, resulting in low write performance of the SMR hard disk; since the chunk is obtained according to the band virtualization, Data can be randomly written between chunks, thus achieving the flexibility of writing data on the SMR hard disk.
  • FIG. 7 illustrates writing data into a tile-like magnetic record according to another embodiment of the present invention.
  • a structural block diagram of a device for writing a SMR hard disk the device for writing data to a stacked magnetic recording SMR hard disk can be used in a device including an SMR hard disk, and the device for writing data into the stacked magnetic recording SMR hard disk can include : receiving module 701, application module 702, first writing module 703 and saving module 704;
  • the receiving module 701 is configured to receive a write data instruction, where the write data instruction includes a key, a data and a mark, the key is used to identify the data, the mark is a write mark, a delete mark or a modify mark, and the write mark is used to indicate that the data is written into the SMR hard disk.
  • the delete flag is used to delete the data having the key in the SMR hard disk
  • the modification mark is used to indicate that the data having the same key and written to the SMR hard disk is modified by using the data;
  • the application module 702 is configured to apply for a space to the chunk being used according to the length of the data record, where the data record includes a key, a data, and a mark in the write data instruction;
  • a first writing module 703, configured to write the data record into the space of the application
  • the save module 704 is configured to save the address of the key, the tag, and the data written in the chunk being used.
  • the application module 702 is configured to apply for a space to a data area in a chunk being used according to the length of the data record.
  • the saving module 704 may include: a component unit 704a and a saving unit 704b;
  • the component unit 704a is configured to form an index record by inserting a key, a tag, and an address in which the data is written into the chunk being used;
  • the saving unit 704b is configured to save the index record to the first storage area in the memory corresponding to the chunk being used; or, when the remaining space in the chunk being used is insufficient to allocate the data to be written in the write data instruction
  • the index record in the first storage area in the memory is stored in the index area in the chunk being used.
  • the apparatus may further include: a modification module 705, a storage module 706, and a clearing module 707.
  • the modifying module 705 is configured to modify the attribute of the chunk being used to be used, and apply an unused chunk as the used chunk for the next data to be written;
  • the storage module 706 is configured to store an index record in the first storage area into a second storage area in the memory corresponding to the used chunk;
  • the clearing module 707 is configured to clear an index record in the first storage area.
  • the apparatus may further include: determining a module 708.
  • the determining module 708 is configured to determine, according to the attribute of the chunk, the used chunk and the chunk being used when the hard disk is restarted;
  • the second writing module 709 is configured to write the index record stored in the used chunk to the second storage area in the memory corresponding to the used chunk;
  • the reconstruction module 710 is configured to reconstruct an index record corresponding to the data record according to the data record stored in the chunk being used, and write the reconstructed index record into the first storage area in the memory corresponding to the chunk being used.
  • the reconstructed index record includes: a key of data in the data record, a mark corresponding to the data, and an address in which the data is written in the chunk being used.
  • the device for writing data into the shingled magnetic recording SMR hard disk provided by the embodiment is written into the chunk being used by writing the data record containing the key, the data and the mark;
  • the data record contains keys and data. Therefore, it solves the problem that the distributed storage system layout scheme cannot be directly transplanted to the SMR hard disk, resulting in low write performance of the SMR hard disk; since the chunk is obtained according to the band virtualization, Data can be randomly written between chunks, thus achieving the flexibility of writing data on the SMR hard disk.
  • the index record in the first storage area is stored in the second storage area corresponding to the used chunk in the memory; since the index record of the used chunk in the SMR hard disk is persisted into the memory, the solution is solved.
  • the problem of low reading efficiency when sequentially reading the SMR hard disk is achieved; the effect of improving the reading efficiency of the SMR hard disk is achieved.
  • the device for writing data into the stacked magnetic recording SMR hard disk provided by the above embodiment is only illustrated by the division of the above functional modules when writing data into the stacked magnetic recording SMR hard disk.
  • the above function assignment can be completed by different functional modules as needed, that is, the internal structure of the device in which the SMR is located is divided into different functional modules to complete the above description. Part or part of the function.
  • the device for writing data to the stacked magnetic recording SMR hard disk provided by the above embodiment belongs to the same concept as the method for writing data into the stacked magnetic recording SMR hard disk. For the specific implementation process, refer to the method embodiment. I won't go into details here.
  • the apparatus may include a receiver 802 and a processor 804, wherein the processor 804 and the receiver 802 are coupled.
  • the receiver 802 is configured to receive a write data instruction, where the write data instruction includes a key, a data and a mark, the key is used to identify the data, the mark is a write mark, a delete mark or a modify mark, and the write mark is used to indicate that the data is written into the SMR hard disk.
  • the delete flag is used to delete the data having the key in the SMR hard disk
  • the modification mark is used to indicate that the data having the same key and written to the SMR hard disk is modified by using the data;
  • the processor 804 is configured to apply for a space to the chunk being used according to the length of the data record, where the data record includes a key, a data, and a mark in the write data instruction;
  • the processor 804 is further configured to write the data record into the space of the application
  • the processor 804 is further configured to save the address of the key, the tag, and the data written in the chunk being used.
  • the device including the SMR hard disk provided in this embodiment writes data records including keys, data, and tags into the chunk being used; since the data record generated according to the write data instruction includes the key and The data, therefore, solves the problem that the distributed storage system layout solution cannot be directly transplanted to the SMR hard disk, resulting in low write performance of the SMR hard disk; since the chunk is obtained according to the band virtualization, it can be randomly written between the chunks. The data thus achieves the effect of increasing the flexibility of writing data on the SMR hard disk.
  • the device may include: a receiver 902, a processor 904, and a memory 906, wherein the processor 904 respectively Receiver 902 is coupled to memory 906, which stores at least one type of computer software, and processor 904 can perform related operations in accordance with computer software stored in memory 906.
  • the receiver 902 is configured to receive a write data instruction, where the write data instruction includes a key, a data and a mark, the key is used to identify the data, the mark is a write mark, a delete mark or a modify mark, and the write mark is used to indicate that the data is written into the SMR hard disk.
  • delete mark is used to delete the data with the key in the SMR hard disk, modify the mark Used to indicate that data having the same key and having been written to the SMR hard disk is modified by using the data;
  • the processor 904 is configured to apply for a space to the chunk being used according to the length of the data record, where the data record includes a key, a data, and a mark in the write data instruction;
  • the processor 904 is further configured to write the data record into the space of the application;
  • the processor 904 is further configured to save the address of the key, the tag, and the data written in the chunk being used.
  • the processor 904 is further configured to apply for a space to the data area in the chunk being used according to the length of the data record.
  • the processor 904 is further configured to form an index record by using an address in which the key, the tag, and the data are written into the chunk being used;
  • the processor 904 is further configured to save the index record to the first storage area in the memory corresponding to the chunk being used; or, when the remaining space in the chunk being used is insufficient to allocate the data to be written in the write data instruction
  • the index record in the first storage area in the memory is stored in the index area in the chunk being used.
  • the processor 904 is further configured to modify the attribute of the chunk being used to be used, and apply for an unused chunk as the next data to be used.
  • the processor 904 is further configured to store the index record in the first storage area into a second storage area in the memory corresponding to the used chunk;
  • the processor 904 is further configured to clear an index record in the first storage area.
  • the processor 904 is further configured to: when restarting the hard disk, determine the used chunk and the chunk being used according to the attribute of the chunk;
  • the processor 904 is further configured to write an index record stored in the used chunk to a second storage area in the memory corresponding to the used chunk;
  • the processor 904 is further configured to reconstruct an index record corresponding to the data record according to the data record stored in the chunk being used, and write the reconstructed index record into the first storage area in the memory corresponding to the chunk being used. .
  • the reconstructed index record includes: a key of data in the data record, a mark corresponding to the data, and an address in which the data is written in the chunk being used.
  • the device including the SMR hard disk provided in this embodiment includes a key and a number. According to the marked data record written in the chunk being used; since the data record generated according to the write data instruction contains keys and data, it solves the problem that the distributed storage system layout scheme cannot be directly transplanted to the SMR hard disk, resulting in SMR The problem of low write performance of the hard disk; since the chunk is obtained according to the band virtualization, data can be randomly written between the chunks, thereby achieving the effect of improving the flexibility of writing data on the SMR hard disk.
  • the index record in the first storage area is stored in the second storage area corresponding to the used chunk in the memory; since the index record of the used chunk in the SMR hard disk is persisted into the memory, the solution is solved.
  • the problem of low reading efficiency when sequentially reading the SMR hard disk is achieved; the effect of improving the reading efficiency of the SMR hard disk is achieved.
  • the disclosed systems, devices, and methods may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit may be only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined. Or it can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated as The components displayed by the unit may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product.
  • the technical solution of the present invention which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including
  • the instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)

Abstract

L'invention concerne un procédé et un appareil pour écrire des données dans un disque dur d'enregistrement magnétique en bardeaux (SMR), lesquels procédé et appareil se rapportent au domaine technique des ordinateurs. Le procédé pour écrire des données dans un disque dur d'enregistrement magnétique en bardeaux (SMR) consiste à : recevoir une instruction de données d'écriture, les données d'écriture comprenant une clé, des données et un drapeau, la clé étant utilisée pour identifier les données, le drapeau étant un drapeau d'écriture, un drapeau de suppression ou un drapeau de modification (201) ; selon la longueur d'un enregistrement de données, demander à un segment qui est utilisé un espace, l'enregistrement de données comprenant la clé, les données et le drapeau dans l'instruction de données d'écriture (202) ; écrire l'enregistrement de données dans l'espace demandé (203) ; et sauvegarder des adresses dans le segment qui est utilisé, dans lequel la clé, le drapeau et les données sont écrits (204). Par écriture de l'enregistrement de données comprenant la clé, les données et le drapeau dans le segment qui est utilisé, le procédé et l'appareil mentionnés ci-dessus résolvent le problème selon lequel le schéma de disposition d'un système de stockage distribué ne peut pas être transplanté directement sur le disque dur SMR ; l'effet d'amélioration de la flexibilité d'écriture de données dans un disque dur SMR est réalisé.
PCT/CN2015/095997 2014-12-05 2015-11-30 Procédé et appareil pour écrire des données dans un disque dur d'enregistrement magnétique en bardeaux (smr) WO2016086819A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410736477.6A CN104461390B (zh) 2014-12-05 2014-12-05 将数据写入叠瓦状磁记录smr硬盘的方法及装置
CN201410736477.6 2014-12-05

Publications (1)

Publication Number Publication Date
WO2016086819A1 true WO2016086819A1 (fr) 2016-06-09

Family

ID=52907519

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/095997 WO2016086819A1 (fr) 2014-12-05 2015-11-30 Procédé et appareil pour écrire des données dans un disque dur d'enregistrement magnétique en bardeaux (smr)

Country Status (2)

Country Link
CN (1) CN104461390B (fr)
WO (1) WO2016086819A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10394493B2 (en) 2017-06-30 2019-08-27 Seagate Technology Llc Managing shingled magnetic recording (SMR) zones in a hybrid storage device
CN111506251A (zh) * 2019-01-30 2020-08-07 杭州海康威视系统技术有限公司 数据处理方法、装置、smr存储系统及存储介质
CN112947856A (zh) * 2021-02-05 2021-06-11 彩讯科技股份有限公司 一种内存数据的管理方法、装置、计算机设备及存储介质
CN113296697A (zh) * 2021-03-17 2021-08-24 阿里巴巴新加坡控股有限公司 数据处理系统、数据处理方法以及装置

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104461390B (zh) * 2014-12-05 2017-10-24 华为技术有限公司 将数据写入叠瓦状磁记录smr硬盘的方法及装置
CN106293497B (zh) * 2015-05-27 2019-03-19 华为技术有限公司 瓦记录感知文件系统中垃圾数据的回收方法和装置
CN105491101B (zh) * 2015-11-17 2018-09-21 华为技术有限公司 数据的处理方法和装置
CN105677243B (zh) * 2015-12-31 2018-12-28 华为技术有限公司 数据写入装置及方法
CN107315533A (zh) * 2016-04-26 2017-11-03 杭州海康威视数字技术股份有限公司 一种数据存储方法及装置
CN107526691B (zh) * 2016-06-21 2020-06-02 深圳市中兴微电子技术有限公司 一种缓存管理方法及装置
CN106201355B (zh) * 2016-07-12 2018-12-11 腾讯科技（深圳）有限公司 数据处理方法和装置以及存储系统
CN106201353A (zh) * 2016-07-12 2016-12-07 曹蕊 一种用于键值存储系统的数据写入装置及方法
CN108021513B (zh) * 2016-11-02 2021-09-10 杭州海康威视数字技术股份有限公司 一种数据存储方法及装置
CN108255408B (zh) * 2016-12-28 2021-03-23 中国电信股份有限公司 数据存储方法以及系统
CN111399762B (zh) 2019-11-27 2021-06-18 杭州海康威视系统技术有限公司 数据存储方法、装置及存储系统
CN111459412B (zh) 2020-03-30 2023-07-04 北京百度网讯科技有限公司 磁盘管理方法、装置以及电子设备
CN113741794B (zh) * 2020-05-29 2024-04-05 浙江宇视科技有限公司 一种smr盘阵列重建方法、系统、设备及计算机介质
CN111651127B (zh) * 2020-06-10 2023-05-02 杭州海康威视数字技术股份有限公司 一种基于叠瓦式磁记录盘的监控数据存储方法及装置
CN114217741A (zh) * 2021-11-30 2022-03-22 浙江大华技术股份有限公司 存储装置的存储方法及存储装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6631478B1 (en) * 1999-06-18 2003-10-07 Cisco Technology, Inc. Technique for implementing high performance stable storage hierarchy in a computer network
CN103955433A (zh) * 2014-05-09 2014-07-30 华为技术有限公司 盖瓦磁记录硬盘、盖瓦磁记录硬盘写数据的方法及装置
CN104049908A (zh) * 2013-03-15 2014-09-17 希捷科技有限公司 基于动态颗粒的中间存储
US20140304525A1 (en) * 2013-04-01 2014-10-09 Nexenta Systems, Inc. Key/value storage device and method
CN104156172A (zh) * 2013-01-17 2014-11-19 西部数据技术公司 数据存储装置的数据管理
CN104461390A (zh) * 2014-12-05 2015-03-25 华为技术有限公司 将数据写入叠瓦状磁记录smr硬盘的方法及装置

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8468374B2 (en) * 2008-07-11 2013-06-18 Marvell World Trade Ltd. Access point rotation for sharing power load

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6631478B1 (en) * 1999-06-18 2003-10-07 Cisco Technology, Inc. Technique for implementing high performance stable storage hierarchy in a computer network
CN104156172A (zh) * 2013-01-17 2014-11-19 西部数据技术公司 数据存储装置的数据管理
CN104049908A (zh) * 2013-03-15 2014-09-17 希捷科技有限公司 基于动态颗粒的中间存储
US20140304525A1 (en) * 2013-04-01 2014-10-09 Nexenta Systems, Inc. Key/value storage device and method
CN103955433A (zh) * 2014-05-09 2014-07-30 华为技术有限公司 盖瓦磁记录硬盘、盖瓦磁记录硬盘写数据的方法及装置
CN104461390A (zh) * 2014-12-05 2015-03-25 华为技术有限公司 将数据写入叠瓦状磁记录smr硬盘的方法及装置

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10394493B2 (en) 2017-06-30 2019-08-27 Seagate Technology Llc Managing shingled magnetic recording (SMR) zones in a hybrid storage device
CN111506251A (zh) * 2019-01-30 2020-08-07 杭州海康威视系统技术有限公司 数据处理方法、装置、smr存储系统及存储介质
CN111506251B (zh) * 2019-01-30 2023-06-02 杭州海康威视系统技术有限公司 数据处理方法、装置、smr存储系统及存储介质
CN112947856A (zh) * 2021-02-05 2021-06-11 彩讯科技股份有限公司 一种内存数据的管理方法、装置、计算机设备及存储介质
CN112947856B (zh) * 2021-02-05 2024-05-03 彩讯科技股份有限公司 一种内存数据的管理方法、装置、计算机设备及存储介质
CN113296697A (zh) * 2021-03-17 2021-08-24 阿里巴巴新加坡控股有限公司 数据处理系统、数据处理方法以及装置
CN113296697B (zh) * 2021-03-17 2024-04-19 阿里巴巴创新公司 数据处理系统、数据处理方法以及装置

Also Published As

Publication number Publication date
CN104461390B (zh) 2017-10-24
CN104461390A (zh) 2015-03-25

Similar Documents

Publication Publication Date Title
WO2016086819A1 (fr) Procédé et appareil pour écrire des données dans un disque dur d'enregistrement magnétique en bardeaux (smr)
US10649910B2 (en) Persistent memory for key-value storage
US10031675B1 (en) Method and system for tiering data
US10628378B2 (en) Replication of snapshots and clones
US20200150890A1 (en) Data Deduplication Method and Apparatus
US10175894B1 (en) Method for populating a cache index on a deduplicated storage system
US8799601B1 (en) Techniques for managing deduplication based on recently written extents
US10466932B2 (en) Cache data placement for compression in data storage systems
KR101813786B1 (ko) Ssd 상의 기록-시-복사를 위한 시스템 및 방법
US8924664B2 (en) Logical object deletion
US10877898B2 (en) Method and system for enhancing flash translation layer mapping flexibility for performance and lifespan improvements
US8112607B2 (en) Method and system for managing large write-once tables in shadow page databases
US10503424B2 (en) Storage system
CN109804359A (zh) 用于将数据回写到存储设备的系统和方法
JP2017079053A (ja) ストレージジャーナリングを改善する方法およびシステム
CN113568582B (zh) 数据管理方法、装置和存储设备
WO2019223377A1 (fr) Procédé, appareil et dispositif de traitement de fichiers, et support de stockage
US11989423B2 (en) Techniques for zoned namespace (ZNS) storage using multiple zones
CN110134551B (zh) 一种持续数据保护方法及装置
US10416901B1 (en) Storage element cloning in presence of data storage pre-mapper with multiple simultaneous instances of volume address using virtual copies
US9798793B1 (en) Method for recovering an index on a deduplicated storage system
US9535796B2 (en) Method, apparatus and computer for data operation
US11163446B1 (en) Systems and methods of amortizing deletion processing of a log structured storage based volume virtualization
CN105930520A (zh) 一种基于集群文件系统的缓存保护方法
US10204002B1 (en) Method for maintaining a cache index on a deduplicated storage system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15865496

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15865496

Country of ref document: EP

Kind code of ref document: A1