WO2023143596A1

WO2023143596A1 - Storage method, storage management device, storage disk, and storage system

Info

Publication number: WO2023143596A1
Application number: PCT/CN2023/073766
Authority: WO
Inventors: 叶茂; 王�锋; 王华强
Original assignee: 华为技术有限公司
Priority date: 2022-01-30
Filing date: 2023-01-30
Publication date: 2023-08-03
Also published as: CN116560561A

Abstract

Provided are a storage method, a storage management device, a storage disk, and a storage system. The storage method comprises: the storage management device updates an attribute tag of target data from a first attribute to a second attribute; and the storage management device sends a first indication to a first storage disk, wherein the first indication is used for instructing the first storage disk to convert a storage mode of the target data from a first storage mode of the first storage disk to a second storage mode of the first storage disk, and a storage medium corresponding to the first storage mode is different from a storage medium corresponding to the second storage mode. The storage method can be applied to an apparatus or system based on a NAND storage medium, and sets the value of the attribute tag of the target data by the storage management device to indicate a storage mode, thereby providing a more matched storage mode for data.

Description

Storage method, storage management device, storage disk and storage system

technical field

Embodiments of the present invention relate to the field of data storage, and in particular, relate to a storage method, a storage management device, a storage disk, and a storage system.

Background technique

When storage disks based on non-flash (not and flash, NAND flash) media store data, the storage performance of different storage media granularity is also different, for example, the storage of single-level cell (single-level cell, SLC) storage particles High performance (fast reading, long life) but small capacity, while quad-level cell (QLC) storage has poor storage performance (slow reading, short life) but large capacity.

However, when storing data, the actual storage requirements of different data may be different, and the storage requirements of the same data at different times (for example, need to be stored in a high-performance manner or need to be stored in a capacity-saving manner) may also be different. Therefore, how to provide a more matching storage method for data according to the storage requirements of the data has become one of the problems that need to be solved at present.

Contents of the invention

Embodiments of the present invention provide a storage method, a storage management device, a storage disk, and a storage system, with the purpose of providing a more matching storage method for data according to the storage requirements of the data.

In a first aspect, a method for managing data in a storage disk is provided, the method comprising: a storage management device updates an attribute label of target data from a first attribute to a second attribute, and the attribute label is used to indicate a storage method of the target data; The storage management device sends a first instruction to the first storage disk, where the first instruction is used to instruct the first storage disk to convert the storage method of the target data from the first storage method of the first storage disk to the storage method of the first storage disk. The second storage method, the storage medium corresponding to the first storage method is different from the storage medium corresponding to the second storage method, wherein the first storage method corresponds to the first attribute, and the second storage method corresponds to the second attribute; The management device saves the address where the target data is stored on the first storage disk, and in response to the command to read the target data, the storage management device sends a read command to the first storage disk according to the address of the target data saved by the storage management device.

Optionally, the first indication may be an attribute label of the target data.

Optionally, the first indication may also be information indicating that the attribute label of the target data is updated from the first attribute to the second attribute.

Optionally, the first indication may also be information directly indicating the second storage manner of the target data.

Optionally, the attribute label of the target data is empty by default. This attribute tag can be assigned later.

Optionally, the first storage disk is a flash disk.

Optionally, the storage management device instructing the first storage disk to convert the storage method of the target data from the first storage method of the first storage disk to the second storage method of the first storage disk may include that the storage management device determines the target data The second storage mode of the data is notified to the first storage disk, or the storage management device may give reference information to the first storage disk. In fact, the storage management device does not directly determine the second storage mode of the target data.

Optionally, the target data can be a PLOG.

Optionally, the first storage manner may be any one of SLC storage, MLC storage, TLC storage, and QLC storage.

Optionally, the second storage method may be any one of SLC storage, MLC storage, TLC storage, and QLC storage but is different from the first storage method.

By setting the first storage method and the second storage method to correspond to different storage granularities, storage methods with different storage performances can be provided for data with different storage requirements.

The storage management device stores various attribute information of the data, and since data access needs to pass through the storage management device, the storage management device can accurately obtain the storage requirements of the data, set attribute tags for the target data through the storage management device, and the attribute tags There is a corresponding relationship with the storage mode, therefore, the storage management device can indicate the storage mode of the target data. In this way, the storage method of the target data can better match the storage requirements.

With reference to the first aspect, in some implementation manners of the first aspect, the storage management device receives the capacity of the first storage disk, and the capacity of the first storage disk includes the capacity corresponding to the first storage mode in the first storage disk and/or the capacity of the first storage disk. The capacity corresponding to the second storage mode.

Optionally, the capacity corresponding to the first storage mode in the first storage disc may include the remaining capacity corresponding to the first storage mode in the first storage disc, or may include the entire capacity corresponding to the first storage mode in the first storage disc.

Optionally, the capacity corresponding to the second storage mode in the first storage disc may include the remaining capacity corresponding to the second storage mode in the first storage disc, or may include the entire capacity corresponding to the second storage mode in the first storage disc.

By receiving the capacity of the first storage disk, the storage management device can better understand the capacity of the first storage disk to better manage the first storage disk.

With reference to the first aspect, in some implementation manners of the first aspect, the storage management device displays the capacity information of the first storage disk on the user interface, or the storage management device sends to the first storage disk a An indication of the corresponding capacity and/or the capacity corresponding to the second storage mode.

With reference to the first aspect, in some implementation manners of the first aspect, before the storage management device updates the attribute label of the target data from the first attribute to the second attribute, the storage management device determines that the attribute label in the first storage disk is consistent with the storage Correspondence between modes: the storage management device sends an indication for indicating the correspondence between attribute tags and storage modes to the first storage disk.

Optionally, the second indication may be a relational table.

By determining the correspondence between the attribute label and the storage method by the storage management device, the storage management device can directly determine the storage method of all data, because the storage management device can accurately obtain the storage requirements of the data and can make the storage method of the data It matches the actual needs more.

With reference to the first aspect, in some implementation manners of the first aspect, the storage management device determines the correspondence between the attribute label and the storage mode in the first storage disk, including: when the first preset condition is met, the storage management device Determine the correspondence between the attribute label and the storage mode in the first storage disk, wherein the first preset condition includes at least one of the following: the storage management device receives an optimization command from the host, and the optimization command is used to instruct the storage management device to update the first A correspondence between attribute tags and storage methods in a storage disk; the storage management device receives an optimization request from the first storage disk, and the optimization request is used to instruct the storage management device to update the attribute tags and storage methods in the first storage disk Correspondence between: the remaining capacity of the first storage disk is less than the first preset threshold.

Optionally, the remaining capacity of the first storage disk being smaller than the first preset threshold may be that the remaining capacity corresponding to the first storage mode in the first storage disk is smaller than the first preset threshold.

By setting the first preset condition so that the storage management device updates the correspondence between the attribute label and the storage manner, it can be more flexibly determined when to adjust the correspondence between the attribute label and the storage manner.

By adjusting the capacity corresponding to different storage modes according to the capacity of the first storage disk, more reasonable configuration can be achieved, and by setting and displaying the capacity of the first storage disk to the user, user experience can be improved.

With reference to the first aspect, in some implementation manners of the first aspect, the storage management device updating the attribute label of the target data from the first attribute to the second attribute includes: the storage management device according to the upper-level statistical information of the target data and/or Inherent attribute information updates the attribute label of the target data from the first attribute to the second attribute, and the upper layer statistical information includes the access frequency information and/or the last time the target data is accessed by the storage management device, and the target data The inherent attribute information of the target data includes one or more of the following information: the type of the target data, the size of the target data, the type of the file to which the target data belongs; or, the storage management device according to the priority of the target data The level updates the attribute label of the target data from the first attribute to the second attribute. The priority level of the target data is determined according to the inherent attribute information of the target data. The priority level is used to determine the priority of the target data to participate in the storage mode conversion degree.

Optionally, the access frequency of the target data may be the access frequency that can be counted by the storage management device within the first detection time range. The first detection time range may be, for example, 2 minutes, that is, the access frequency of the target data is updated every 2 minutes. .

By determining the value of the attribute label of the target data according to the information of the target data, a more accurate reference or indication can be provided for the first storage disc when storing the target data.

It should be understood that for data with different priority levels, when considering upgrading the storage performance of the first storage disk or releasing more capacity of the first storage disk, the results of whether to update the attribute label will also be different. For some data, the storage requirements are always the same , which means that this part of data should not participate in the conversion of storage methods.

By setting the priority level of the target data and updating the attribute label of the target data from the first attribute to the second attribute when the priority level of the target data is within the priority range, it is possible to avoid converting some data that should not participate in the storage mode conversion.

Optionally, the storage management device updating the attribute label of the target data from the first attribute to the second attribute includes: when the second preset condition is met, the storage management device updates the attribute label of the target data from the first attribute to the second attribute Two attributes; wherein the second preset condition includes at least one of the following: when the access frequency is within the first frequency range and/or when the time last accessed is within the first time range; when the priority level of the target data is within the priority within the level range.

Optionally, the first frequency range may be higher than a first access frequency threshold.

Optionally, the first frequency range may also be lower than a second access frequency threshold, wherein the second access frequency threshold is lower than the first access frequency threshold.

Optionally, the first time range may be earlier than the first access time.

Optionally, the first time range may also be later than the second access time, wherein the second access time is later than the first access time.

Optionally, the priority range may be below the first priority threshold. In this way, data below the first priority threshold does not participate in the storage mode conversion.

Optionally, the priority range may be above a second priority threshold. In this way, data higher than the second priority threshold does not participate in the storage mode conversion. in. The second priority threshold is higher than the first priority threshold.

By setting the second preset condition, the value of the attribute label of the target data can be updated more flexibly to indicate the first The storage disk performs in-disk storage mode conversion on the target data.

With reference to the first aspect, in some implementations of the first aspect, before the storage management device updates the attribute label of the target data from the first attribute to the second attribute, the storage management device receives a write request of the target data; in response to For a write request, the storage management device determines that the attribute tag of the target data is the first attribute; the storage management device sends an instruction to the first storage disk to instruct the first storage disk to store the target data in a first storage manner.

With reference to the first aspect, in some implementation manners of the first aspect, before the storage management device updates the attribute label of the target data from the first attribute to the second attribute, the storage management device sends a message indicating the second attribute to the second storage disk. An indication that the second storage disk stores a copy of the target data in the first storage mode; in response to the storage management device updating the attribute label of the target data from the first attribute to the second attribute, the storage management device sends the second storage disk the Instructing the second storage disk to convert the storage mode of the copy of the target data from the first storage mode to the second storage mode.

Optionally, a copy of the target data that is identical to the target data

Optionally, the first storage disk and the second storage disk belong to the same distributed storage system.

By setting a copy of the target data to be stored in the second storage disk and updating the storage mode when the target data updates the storage mode, the storage modes of different copies of the target data can be synchronized.

Setting an attribute tag for the target data and determining the value of the attribute tag when writing the target data can enable the first storage disk to have an accurate indication or reference when storing the target data, thereby providing a more matching storage method for the target data.

In a second aspect, a method for managing data in a storage disk is provided. The method includes: the storage disk receives a first instruction sent by a storage management device; The storage mode is converted to the second storage mode of the storage disk, and the storage medium corresponding to the first storage mode is different from the storage medium corresponding to the second storage mode.

Optionally, the storage disk performs in-disk storage mode conversion on the target data. It should be understood that although the physical storage location of the target data in the storage disk has changed, the storage disk does not need to report the updated target data to the storage management device. The physical storage location on the storage disk. The on-disk storage mode conversion may be performed in units of PLOGs.

By determining the storage method according to the attribute label of the target data, the storage disk can provide a more matching storage method for the target data.

With reference to the second aspect, in some implementation manners of the second aspect, the storage disk converting the storage manner of the target data from the first storage manner of the storage disk to the second storage manner of the storage disk according to the first instruction includes: The attribute label of the target data is updated from the first attribute to the second attribute, and the attribute label is used to indicate the storage method of the target data, wherein the first attribute corresponds to the first storage method, and the second attribute corresponds to the second storage method; The attribute tag converts the storage mode of the target data from the first storage mode of the storage disk to the second storage mode of the storage disk.

By setting the attribute tag on the storage disk, the attribute tag can be updated according to the first indication to be synchronized with the storage management device, and the value of the attribute tag of the target data can be better managed and queried.

With reference to the second aspect, in some implementation manners of the second aspect, before the storage disk receives the first indication sent by the storage management device, the storage disk receives the correspondence between the attribute label and the storage mode sent by the storage management device Indication of relationship.

By setting the second storage method determined according to the storage management device to store the target data, it can be better matched Storage requirements for the target data.

With reference to the second aspect, in some implementation manners of the second aspect, the storage disk sends the capacity of the storage disk to the storage management device, and the capacity of the storage disk includes the capacity corresponding to the first storage mode and/or the second storage mode in the storage disk corresponding capacity.

By sending its own storage information to the storage management device, the storage disk can enable the storage management device to better understand its own storage conditions, so that the storage management device can more flexibly allocate storage space and the like.

Optionally, before the storage disk sends the capacity of the storage disk to the storage management device, the storage disk receives request information sent by the storage management device, where the request information is used to acquire the capacity of the storage disk.

By receiving the request information from the storage management device, the probability that the storage disk sends its own storage information when unnecessary can be reduced, thereby avoiding unnecessary signaling interaction.

With reference to the second aspect, in some implementation manners of the second aspect, before the storage disk receives the first instruction sent by the storage management device, the storage disk receives an instruction for instructing the storage disk to store the target data in a first storage manner .

By determining the first storage manner of the target data according to the instruction sent by the storage management device, the target data can be stored in a more matching storage manner when writing.

Optionally, when the storage disk detects that the remaining capacity in the disk is less than the second preset threshold, the storage disk updates the correspondence between the attribute label and the storage mode.

By setting the storage disk to adjust the corresponding relationship between the attribute label and the storage mode according to its own capacity, the storage of the storage disk can be made more flexible.

In a third aspect, a storage management device is provided, including: a processing unit and a sending unit. The processing unit is used to update the attribute label of the target data from the first attribute to the second attribute, and the attribute label is used to indicate the storage mode of the target data; the sending unit is used to send the first instruction to the first storage disk, and the first instruction uses Instructing the first storage disk to convert the storage method of the target data from the first storage method of the first storage disk to the second storage method of the first storage disk, the storage medium corresponding to the first storage method and the second storage method The storage media corresponding to the modes are different, wherein the first storage mode has a first corresponding relationship with the first attribute, and the second storage mode has a second corresponding relationship with the second attribute; the processing unit is also used to respond to the command to read the target data, A read command is sent to the first storage disk according to the address information of the target data stored by the storage management device.

With reference to the third aspect, in some implementation manners of the third aspect, the storage management device further includes a receiving unit configured to receive the capacity of the first storage disk, where the capacity of the first storage disk includes The capacity corresponding to the first storage mode and/or the capacity corresponding to the second storage mode.

With reference to the third aspect, in some implementation manners of the third aspect, the processing unit is further configured to display the capacity information of the first storage disk on the user interface; the sending unit is configured to send to the first storage disk the An indication of the capacity corresponding to the storage mode and/or the capacity corresponding to the second storage mode.

With reference to the third aspect, in some implementation manners of the third aspect, the processing unit is further configured to determine the correspondence between the attribute label and the storage mode, and the sending unit is further configured to send an indication to the first storage disk An indication of the correspondence between attribute labels and storage methods.

With reference to the third aspect, in some implementations of the third aspect, the processing unit is specifically configured to determine the correspondence between the attribute tag and the storage mode when the first preset condition is met, where the first preset condition includes At least one of the following: the storage management device receives an optimization command from the host, and the optimization command is used to instruct the storage management device to update the correspondence between the attribute label and the storage mode; the storage management device receives an optimization request from the first storage disk, excellent The UL request is used to instruct the storage management device to update the correspondence between the attribute label and the storage mode in the first storage disk; the remaining capacity of the first storage disk is less than a first preset threshold.

With reference to the third aspect, in some implementation manners of the third aspect, the processing unit is specifically configured to: update the attribute label of the target data from the first attribute to the second attribute according to the upper-level statistical information and/or inherent attribute information of the target data. Attributes, the upper-level statistical information includes the access frequency information of the target data stored by the storage management device and/or the time when the target data was last accessed, and the inherent attribute information of the target data includes one or more of the following information: The type of the target data, the size of the target data, the type of the file to which the target data belongs; or, update the attribute label of the target data from the first attribute to the second attribute according to the priority level of the target data, and the target data The priority level is determined according to the inherent attribute information of the target data, and the priority level is used to determine the priority of the target data to participate in the storage mode conversion.

With reference to the third aspect, in some implementations of the third aspect, the receiving unit is further configured to receive a write request of the target data; the processing unit is further configured to respond to the write request, and determine that the attribute label of the target data is the first attribute The sending unit is further configured to send an instruction for instructing the first storage disk to store the target data in the first storage mode to the first storage disk.

With reference to the third aspect, in some implementation manners of the third aspect, the sending unit is further configured to send to the second storage disk an indication for instructing the second storage disk to store a copy of the target data in the first storage manner; The management device updates the attribute label of the target data from the first attribute to the second attribute, and the sending unit is further configured to send to the second storage disk an instruction for the second storage disk to store the copy of the target data by the first storage disk. The first storage mode of the disk is converted into an indication of the second storage mode of the first storage disk.

In conjunction with the third aspect, in some implementations of the third aspect, the first storage disk is a flash disk, and the storage medium corresponding to the first storage method and the second storage method is one of the following storage media: SLC flash memory, MLC flash memory, TLC flash memory, QLC flash memory.

In a fourth aspect, a storage disk is provided, including: a receiving unit and a processing unit. The receiving unit is configured to receive the first instruction sent by the storage management device, and the processing unit is configured to convert the storage method of the target data from the first storage method of the storage disk to the second storage method of the storage disk according to the first instruction. The storage medium corresponding to the storage mode is different from the storage medium corresponding to the second storage mode.

With reference to the fourth aspect, in some implementations of the fourth aspect, the processing unit is specifically configured to update the attribute label of the target data from the first attribute to the second attribute, and the attribute label is used to indicate the storage mode of the target data, the The first attribute corresponds to the first storage method, and the second attribute corresponds to the second storage method; the processing unit is also used to convert the storage method of the target data from the first storage method of the storage disk to the second storage method of the storage disk according to the attribute label Way.

With reference to the fourth aspect, in some implementation manners of the fourth aspect, the receiving unit is further configured to receive an indication sent by the storage management device for indicating the correspondence between the attribute tag and the storage mode.

With reference to the fourth aspect, in some implementation manners of the fourth aspect, the sending unit is further configured to send the capacity of the storage disk to the storage management device, where the capacity of the storage disk includes the capacity corresponding to the first storage mode in the storage disk and/or The capacity corresponding to the second storage mode.

With reference to the fourth aspect, in some implementation manners of the fourth aspect, the receiving unit is further configured to instruct the storage disk to store the target data in the first storage manner.

In conjunction with the fourth aspect, in some implementations of the fourth aspect, the storage disk is a flash disk, and the storage medium corresponding to the first storage mode and the second storage mode is one of the following storage media: SLC flash memory, MLC flash memory , TLC flash memory, QLC flash memory.

A fifth aspect provides a storage system, including the storage management device according to the third aspect and the storage disk according to the fourth aspect.

Description of drawings

Fig. 1 is a schematic structural diagram of a storage system applicable to an embodiment of the present invention.

Fig. 2 is a schematic flowchart of a storage method provided by an embodiment of the present invention.

Fig. 3 is a schematic flowchart of a storage method provided by an embodiment of the present invention.

Fig. 4 is a schematic flowchart of a storage method provided by an embodiment of the present invention.

Fig. 5 is a schematic flowchart of a storage method provided by an embodiment of the present invention.

Fig. 6 is a schematic flowchart of a storage method provided by an embodiment of the present invention.

Fig. 7 is a schematic flowchart of a storage method provided by an embodiment of the present invention.

Fig. 8 is a schematic structural diagram of a storage management device provided by an embodiment of the present invention.

FIG. 9 is a schematic structural diagram of a storage disk provided by an embodiment of the present invention.

FIG. 10 is a schematic structural diagram of a storage system provided by an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be described below with reference to the accompanying drawings.

For ease of understanding, some concepts involved are explained first.

1. NAND flash memory

And non-flash memory (not and flash, NAND flash) medium is a kind of non-volatile storage medium, that is, data can still be saved after power failure. The internal storage structure unit of NAND flash memory is based on metal-oxide-semiconductor field-effect transistor (MOSFET), which is different from ordinary field-effect transistors in that the gate (control gate) and source There is a floating gate between the /drain and by utilizing this floating gate, data can be stored.

2. Flash memory particles

Flash memory particles generally include single-level cells (single-level cells, SLC), multi-level cells (multi-level cells, MLC), triple-level cells (triple-level cells, TLC) and quad-level cells (quad- level cell, QLC).

SLC, fast, long life, expensive. Each unit can only store 1-bit information, and the stored data represents "0" or "1", by comparing the voltage of the SLC flash memory unit with the Vth voltage threshold, which means that the stored value is 0. Below the threshold means a 1 is stored. Since there are only two levels, the voltage gap between the two level voltages can be very high, making it easier to read the memory cell. The large voltage difference also makes the impact of wear relatively small, and the wider distribution of logic levels also helps to program or erase memory cells at lower voltages, further increasing the durability of the cells. Compared to other types of flash memory, SLC can store less data on the same die surfacer.

MLC, can be used to store "00", "01", "10", "11". When reading, the voltage of the flash memory cell needs to be compared with three threshold voltages (a total of 4 voltage bands), because it is compared with multiple threshold voltages, so the read operation needs to be more precise, resulting in a faster read speed than SLC flash memory. slow. The raw bit error rate is also higher due to the lower voltage drop, and the effect of wear is more pronounced. Compared with SLC, it can store more data on the same die surfacer.

TLC, can be used to store "000", "001", "010", "011", "100", "101", "110", "111". When reading, the voltage of the flash memory cell needs to be compared with seven threshold voltages (8 voltage bands in total).

QLC, can be used to store "0000", "0001", "0010", "0011", "0100", "0101", "0010", "0111", "1000", "1001", "1010", " 1011", "1100", "1101", "1010", "1111", when reading, the voltage of the flash memory cell needs to be compared with fifteen threshold voltages (a total of 15 voltage bands).

3. Storage mode conversion

In some embodiments, different threshold voltages can be set to change the storage method. For example, if the threshold voltage number of a QLC particle is set to 1, the QLC particle can be used as an SLC particle, but the number of flash memory particles required is different. For example, data 1 originally occupies 16 QLC particles to store data. If SLC storage is used for up-storage, 64 QLC particles are required.

The two storage systems are described below with reference to FIG. 1 and FIG. 2 .

FIG. 1 is a schematic structural diagram of a storage system 100 .

As shown in FIG. 1 , a storage system 100 includes: a host 110 , a storage management device 120 and a storage disk 130 .

In some embodiments, the host 110 may be a computer or other user equipment. The host 110 may include any computing device known in the art, such as a server, a desktop computer, etc., and an operating system and other application programs are installed in the host 110 . The host 110 can access files of the storage system 100, for example, the host 110 can provide a file access interface to an application program on the host through a file interface module.

The storage management device 120 is used to manage the metadata of the file, and process the metadata query and update request of the file by the host 110 . The metadata of the file may include information such as the starting address of the file, the size of the allocated space, and the actual size of the file.

In some embodiments, the storage management device 120 may include but not limited to: a server, a controller, and a processor. It should be understood that the storage management device 120 may be a device with a computing function for managing the storage disk 130 .

The storage disk 130 is used to store file data and process file access requests. The storage disk 130 may include at least one storage disk. In the embodiment provided by the present invention, the files are stored in the NAND storage disk. The storage disk 130 may receive instructions from the storage management device 120 to perform write/read operations on data.

In some embodiments, the storage disk 130 may include a solid-state disk (Solid-state drive, SSD) such as a standard SSD disk, or a PLOG-based SSD disk (referred to as a PLOG disk), and the PLOG disk may be an SSD disk that provides a PLOG interface. , PLOG is an encapsulation of a section of the PLOG SSD disk that supports additional writing, named, and byte-level address space. One SSD can contain multiple PLOGs.

In some embodiments, the storage system 100 has only one storage node, and the one storage node includes only one storage disk.

In some embodiments, the storage management device 120 and the storage disk 130 may be integrated together, that is, one device may have the functions of the storage management device 120 and the storage disk 130 at the same time.

In the embodiment provided by the present invention, the storage management device 120 may be set independently (as shown in FIG. 1 ), or may be a device having functions of the storage management device 120 and the storage disk 130 at the same time. For the convenience of description, the following takes the storage management device 120 separately configured as an example for description.

In some embodiments, storage system 100 may be a distributed storage system. For example, data 1 in file1 includes not only the part stored in storage disk 1 managed by storage node A, but also the copy 1 stored in storage disk 2 managed by storage node B and the storage disk managed by storage node C. Copy 2 in 3 forms three copies for storage. also That is, the storage system 100 includes at least two storage disks, which belong to different storage nodes. In addition, for data reliability, multiple copies are usually set to be stored in different storage nodes. A storage node may include multiple storage disks. Usually, Different storage nodes correspond to different networks, and a storage node may be a controller, a processor, or a server. The controller, processor or server can be integrated into a storage device with the storage disk it manages.

The difference from a centralized storage system is that multiple storage nodes usually correspond to different network environments. At this time, the storage system may need to use the network to store and access files.

The storage system 100 stores data and accesses the data as follows: the storage management device 120 receives an instruction to store file1, first cuts file1, assumes that an 8K file1 is divided into two data blocks (each block is 4K), and calculates 1 4K redundancy check block.

If it is a plog disk, you need to record that file1 is assigned to:

plog1 of storage disk 1, offset=0, size=4K; plog1 of storage disk 2, offset=0, size=4K; plog1 of storage disk 3, offset=0, size=4K;

If it is a standard disk, the recorded information is as follows: storage disk 1, offset=0, size=4K; storage disk 2, offset=100, size=104K; storage disk 3, offset=200, size=204K;

When the host 110 wants to access file1, the host sends a read command to the storage management device 120 to request access to file1, and the storage management device 120 sends a read command to the storage disk 130 according to the recorded storage location of file1.

In some embodiments, the storage disk 130 may include one or more flash memory granularities, and the one or more flash memory granularities may include one or more of the following flash memory particles: SLC flash memory particles, MLC flash memory particles, TLC flash memory particles , QLC flash memory particles. Different storage methods can be realized by using different flash granules as storage media. For example, using SLC flash granule storage is SLC storage, using MLC flash granule storage is MLC storage, using TLC flash granule storage is TLC storage, and using QLC flash memory Granular storage is QLC storage. In some embodiments, storage mode switching can be implemented in the storage disk 130. Specifically, the storage disk 130 can change the storage mode by updating the threshold voltage, for example, using QLC flash memory particles as SLC flash memory particles. Due to the better storage performance of SLC flash memory particles, it is generally used to store files with high importance and/or high access frequency, while QLC is generally used to store files with large file size (for example, greater than 100MB) and/or low access frequency .

However, when storing data, different data may have different actual storage requirements, and the same data may have different storage requirements at different times (for example, it needs to be stored in a high-performance manner or needs to be stored in a capacity-saving manner) may also be different . Therefore, how to accurately provide data with a matching storage method according to the storage requirements of the data has become one of the current problems.

At present, the storage system 100 determines or updates its storage mode based on the spatial statistical heat information of data, but it is often not accurate and reasonable to determine the actual storage requirements of data based on heat statistics. For example, directory metadata data is used as key data, even if The heat statistics show that the heat is not high, and should not be taken in a low-performance way such as QLC storage.

Therefore, it is necessary to propose a solution that can provide data with a more matching storage method according to the storage requirements of the data.

FIG. 2 is a schematic flowchart of a storage method 200 provided by an embodiment of the present invention.

The storage method may be executed by the storage system 100 shown in FIG. 1 above. For convenience of description, the storage system 100 includes only one storage disk such as the first storage disk as an example. It should be understood that the storage disk 130 is equal to the first storage disk at this time.

S201. The storage management device updates the attribute label of the target data from the first attribute to the second attribute, the attribute Tags are used to indicate how the target data is stored.

The target data may be data that has been cut and whose size is the minimum storage size.

The target data can be any type of data, such as directory metadata, file metadata, etc., which is not limited in the present invention. The target data can also be a collection of multiple data of the same or similar type under the same directory. For example, the target data is a collection of metadata of directory 1, metadata of file 1, and metadata of file 2, where file 1 and file2 said directory as directory1.

In some embodiments, the storage management device 120 saves an attribute tag of the data, and the attribute tag may be an identifier, for example, a flag. Exemplarily, the storage management device 120 updates the attribute label of data 1 to attribute #1.

In some embodiments, the storage management device updates the attribute label of the target data from the first attribute to the second attribute according to the first information. Optionally, the first information may include information about the target data, and optionally, may also include Other information, such as the total capacity of the storage system 100 .

Optionally, the information of the target data may include inherent attribute information of the target data and/or upper-layer statistical information of the target data.

Optionally, the inherent attribute information of the target data includes but not limited to one or more of the following information:

The type of the target data, the size of the target data, the type of the file to which the target data belongs, and so on. The types of files may include, for example, system files, application files, etc., and the types of data may, for example, be verification data, cache data, and the like.

Optionally, the upper-level statistical information of the target data includes the access frequency and/or the last access time of the target data. The access frequency of the target data may be the access frequency that can be counted by the storage management device 120 within the first detection time range. The first detection time range may be, for example, 2 minutes, that is, the access frequency of the target data is updated every 2 minutes. It should be understood that the upper-layer statistical information is the statistics made by the storage management device 120 based on the records of the read target data recorded by itself. The access information of the target data. Compared with the access information of the target data recorded inside the storage disk 130, the access information of the target data acquired by the storage management device 120 is more comprehensive.

Optionally, when the information of the target data changes, the storage management device 120 may record and update the information of the target data, for example, when the access frequency of the target data changes, the storage management device 120 updates the access frequency of the target data.

In some embodiments, the first information includes a first relationship, and the first relationship is a corresponding relationship between the first information and the second attribute, so that the storage management device 120 can determine the attribute label of the target data according to the first information and the first relationship as Second attribute.

In some embodiments, the first information includes relationship #1, and relationship #1 is the relationship between the upper-level statistical information of the target data and the second attribute, and the storage management device 120 can determine the target data according to the upper-level statistical information of the target data and relationship #1 the second attribute of . Relationship #1 may be as shown in Table 1.

Table 1

As shown in Table 1, when the access frequency is within the first access frequency range, it may be determined that the attribute label of the target data is the second attribute. In some embodiments, the first access frequency range may be higher than the first access frequency threshold. For example, if the first access frequency of Data 1 is higher than the first access frequency threshold, then the storage management device 120 determines that the attribute label of Data 1 is Attribute #1. The first access frequency threshold may be, for example, 10 times/day. In some other embodiments, the first access frequency range may be lower than the second access frequency threshold, for example, if the first access frequency of data 2 is lower than the second access frequency threshold, then the storage management device 120 determines the attribute label of data 2 for attribute #3. The second access frequency threshold may be, for example, 1 time/day. The second access frequency threshold is lower than the first access frequency threshold.

As shown in Table 1, when the last accessed time is within the first access time range, it may be determined that the attribute label of the target data is the second attribute. In some embodiments, the first access time range may be earlier than the first access time, for example, the last time data 3 is accessed is earlier than the first access time, then the storage management device 120 determines that the attribute tag of data 3 is an attribute #2, the first access time may be, for example, 20 days. In some other embodiments, the first access time range may be later than the first access time, for example, the last time the data 4 was accessed is later than the first access time, then the storage management device 120 determines that the attribute label of the data 4 is Attribute #1, the first access time may be, for example, 20 days. The second access time is later than the first access time.

As shown in Table 1, the files under some directories may be frequently accessed at a specific time, and the storage management device 120 can analyze its statistical characteristics, and update the value of its attribute label in advance when the file is about to be accessed, so that the first A storage disk converts the storage mode of the data of the file in advance. For example, the access frequency of data 5 in the first time range is higher than the first access frequency threshold, when the time is in the second time range, the second time range includes the first time and the start time of the second time range is earlier than At the start time of the first time range, the value of the attribute tag of data 5 may be updated to attribute #1, and when the time is outside the second time range, the value of the attribute tag of data 5 is attribute #2.

It should be understood that data with a high access frequency and data with a relatively recent access time can be regarded as hot data. Therefore, such data is generally stored in a storage method with better performance. The performance of the storage methods corresponding to attribute 1, attribute 2, and attribute 3 in Table 1 above should range from good to poor. In this way, data with different statistical characteristics can be stored in a more matching manner.

In some embodiments, the first information includes relationship #2, and relationship #2 is the upper-level statistical information of the target data and the relationship between the inherent attribute information of the target data and the second attribute, which can be based on the upper-level statistical information of the target data and the target data. The intrinsic attribute information and relation #2 determine the second attribute of the target data.

Relationship #2 may be as shown in Table 2.

Table 2

As shown in Table 2, the second attribute of the target data can be determined by combining the upper layer statistical information and the intrinsic attribute information at the same time. For example, if the access frequency of data 6 is higher than the first access frequency threshold and data 6 is the data of the directory metafile, then it is determined that the second attribute of data 6 is attribute #1; the access frequency of data 7 is lower than the first access frequency threshold and If the size of the file to which it belongs is less than or equal to 16KB, then it is determined that the second attribute of data 7 is attribute #3; when the last access time of data 8 is earlier than the first access time and data 8 is file attribute metadata, then it is determined that the second attribute of data 8 is The second attribute is attribute #2; the last access time of data 9 is later than the first access time and the size of the file to which data 9 belongs is greater than 100MB, so the second attribute of data 9 is determined to be attribute #2.

In some embodiments, the first information further includes the relationship between the priority level of the target data and the second attribute, and the information of the target data further includes the priority level of the target data. In a possible manner, the priority level of the target data may be determined and recorded by the storage management device 120 . The second attribute of the target data may be determined according to the priority level of the target data and relationship #3, which is the relationship between the priority level of the target data and the second attribute. In some embodiments, when the priority level of the target data is within the priority level range, it may be determined that the attribute label of the target data is the second attribute.

table 3

As shown in Table 3, when the priority level ranges from 1 to 2, the second attribute of the target data is attribute #1; when the priority level ranges from 3 to 6, the second attribute of the target data is attribute #2.

The relationship between the priority level and the second attribute may be preset, and may also be adjusted by the storage management device 120 according to requirements. For example, when more space needs to be released, the second attribute of data whose priority level ranges from 2 to 6 can be set as attribute #2.

It should be understood that when the priority level of the target data does not belong to the priority level range, the second attribute of the target data will not change, that is, the target data will not be converted into a storage mode.

The priority range may be below the first priority threshold. For example, the priority threshold is priority level 2, so that data lower than priority level 2 does not participate in the conversion of the storage mode.

The priority range may be above a second priority threshold. For example, the priority threshold is priority level 3, so that data higher than priority level 3 does not participate in the conversion of the storage mode. in. The second priority threshold is higher than the first priority threshold.

In a possible implementation manner, the priority level of the target data may be determined according to the inherent attribute information of the target data and relationship #4, and the relationship #4 is the relationship between the inherent attribute information of the target data and the priority level of the target data. The priority level of the target data can be determined and recorded when the target data is written. The relationship between priority levels and inherent attributes, ie, relationship #4, can be shown in Table 4.

Table 4

As shown in Table 4, the priority level can be determined according to the inherent attribute information of the target data. For example, if data 16 is the data of the directory metafile, then determine that the priority level of data 16 is 1; if the file size of data 17 is less than or equal to 16KB, then determine that the priority level of data 17 is 2; if data 18 is file attribute metadata, then determine that the data 18 priority level is 3; data 19 layout metadata, then determine the priority level of data 19 is 1.

It should be understood that the types of inherent attributes of the target data are more than the number of priority levels, so that the management overhead of the storage management device 120 can be saved.

In some embodiments, when the second preset condition is satisfied, step S201 is executed.

The second preset condition includes at least one of the following conditions:

When the access frequency is within a first frequency range and/or the last time accessed is within a first time range;

When the priority level of the target data is within the priority range.

It should be understood that when the first information of the target data changes and meets the second preset condition, the storage management device 120 will update the value of its attribute tag.

In some embodiments, storage system 100 may be a multi-replica storage system.

FIG. 3 is a schematic flowchart of a storage method 300 provided by an embodiment of the present invention. FIG. 3 shows steps S301 to S305 of the storage method 300. The following describes the storage method 300 in the multi-copy scenario provided by the present invention in conjunction with FIG. 3 Be explained.

S301. The storage management device updates an attribute label of target data from a first attribute to a second attribute.

This step is the same as the description of S201 above, to avoid redundancy, refer to the above, and will not repeat it here.

S302. The storage management device sends a first instruction to the first storage disk, where the first instruction is used to instruct the first storage disk to convert the storage method of the target data from the first storage method of the first storage disk to the Describe the second storage mode of the first storage disk.

This step is the same as the description of S202 below, to avoid redundancy, refer to the following, and will not be repeated here.

S303. The storage management device sends a third instruction to the second storage disk, where the third instruction is used to instruct the first storage disk to convert the storage method of the copy of the target data from the first storage method of the first storage disk to the second storage method. A second storage mode of a storage disk.

In some embodiments, the storage disk 130 includes not only the first storage disk but also a second storage disk, and the target data is stored in the first storage disk, and a copy of the target data is stored in the second storage disk. should be understood. The storage disk 130 may also include more storage disks, which is not limited in the present invention.

Optionally, before step S303, the storage management device 120 sends an instruction for instructing the second storage disk to store a copy of the target data in the first storage mode to the second storage disk, and the second storage disk stores the copy of the target data according to the instruction. The copy is stored in the first storage mode.

Optionally, the third indication is the same as the first indication.

Optionally, the storage system 100 may further include other storage nodes, and the first storage disk and the second storage disk belong to different storage nodes. It should be understood that the storage system 100 is a distributed storage system at this time, in other words, the method 300 may be applied to a distributed storage system.

S304. The first storage disk converts the storage manner of the target data from the first storage manner of the first storage disk to the second storage manner of the first storage disk according to the first instruction.

Optionally, the first storage disk converting the storage method of the target data from the first storage method of the first storage disk to the second storage method of the first storage disk according to the first instruction includes: the first storage disk converting the attribute of the target data The label is updated from the first attribute to the second attribute. The attribute label is used to indicate the storage method of the target data. The first storage method has a first corresponding relationship with the first attribute, and the second storage method has a second corresponding relationship with the second attribute. ; The first storage disk converts the storage method of the target data from the first storage method of the first storage disk to the second storage method of the first storage disk according to the attribute tag.

S305. The second storage disk converts the storage manner of the copy of the target data from the first storage manner of the second storage disk to the second storage manner of the second storage disk according to the first instruction.

Optionally, the second storage disk converting the storage method of the copy of the target data from the first storage method of the second storage disk to the second storage method of the second storage disk according to the first instruction includes: the second storage disk converting the target data The attribute label of the copy of is updated from the first attribute to the second attribute. The attribute label is used to indicate the storage method of the target data. The first storage method has a first correspondence with the first attribute, and the second storage method has a relationship with the second attribute. The second corresponding relationship: the second storage disk converts the storage method of the target data from the first storage method of the second storage disk to the second storage method of the first storage disk according to the attribute label.

Optionally, the first storage mode of the second storage disk is the same as the first storage mode of the first storage disk, and the second storage mode of the second storage disk is the same as the second storage mode of the first storage disk, and the target data and A copy of the target data is stored in the same storage.

FIG. 4 shows a schematic flowchart of a storage method 400 provided by an embodiment of the present invention.

In some embodiments, the correspondence between attribute tags and storage methods may be determined by the storage management device 120 or updated and sent to the first storage disk through the second instruction.

S401. The storage management device determines a correspondence between an attribute tag and a storage mode in a first storage disk.

It should be understood that the storage management device 120 determining that the attribute label of the target data is the second attribute is equivalent to determining the second storage manner of the target data. In this way, the final storage mode of the target data is actually directly determined by the storage management device 120, so that the target data can be stored in a matching storage mode.

Optionally, the storage management device 120 determining the correspondence between the attribute label and the storage mode includes determining the correspondence between the thermal attribute label and the storage mode according to the capacity of the first storage disk.

S402. The storage management device sends a second indication to the first storage disk, where the second indication is used to indicate a correspondence between an attribute tag and a storage mode.

Optionally, the second indication may be a relational table, for example, attribute #1 corresponds to storage mode 1, and attribute #2 corresponds to storage mode 2.

S403. The storage management device updates the attribute label of the target data from the first attribute to the second attribute.

S404. The storage management device sends a first instruction to the first storage disk, where the first instruction is used to instruct the first storage disk to convert the storage method of the target data from the first storage method of the first storage disk to the Describe the second storage mode of the first storage disk.

S405, the first storage disk converts the storage manner of the target data from the first storage manner of the first storage disk to the second storage manner of the first storage disk according to the first instruction.

This step is the same as the above description of S304, to avoid redundancy, refer to the above, and will not repeat it here.

It should be understood that the purpose of method 400 is to adjust the correspondence between attribute tags and storage methods to meet the requirements when the remaining storage space is limited, or when the remaining storage space is sufficient and storage performance needs to be improved.

In some embodiments, when the first preset condition is satisfied, the storage management device 120 updates the correspondence between the attribute tag and the storage mode in the first storage disk.

The first preset condition includes at least one of the following conditions:

A. When the remaining capacity of the first storage disk is less than a first preset threshold.

B. The storage management device 120 receives an optimization command from the host.

C. The storage management device 120 receives an optimization request of the first storage disk.

FIG. 5 shows a schematic flowchart of a storage method 500 provided by an embodiment of the present invention. The case where the first preset condition is A will be described in conjunction with FIG. 5 .

As shown in FIG. 5 , the storage management device 120 determines the correspondence between the attribute label and the storage mode according to the capacity of the first storage disk.

S501. The storage management device sends request information to the first storage disk, where the request information is used to acquire the capacity of the first storage disk.

The capacity of the first storage disk may include the remaining capacity corresponding to the first storage method or the remaining capacity corresponding to the second storage method in the first storage disk, or, the capacity of the first storage disk may also include the remaining capacity of the entire first storage disk capacity.

S502. After receiving the request information, the first storage disk sends the capacity of the first storage disk to the storage management device 120, where the capacity of the first storage disk includes the capacity corresponding to the first storage mode and/or the capacity corresponding to the second storage mode. way corresponding capacity.

S503. The storage management device determines a correspondence between attribute tags and storage modes in the first storage disk.

In some embodiments, step S503, that is, the storage management device 120 determining the correspondence between the attribute label and the storage mode includes: determining the correspondence between the attribute label and the storage mode according to the capacity of the first storage disk. Determining the correspondence between the attribute label and the storage method according to the capacity of the first storage disk may include: when the remaining capacity of the first storage disk is less than a first preset threshold, the storage management device 120 may update the correspondence between the attribute label and the storage method . Optionally, the remaining capacity of the first storage disk being less than the first preset threshold may be that the remaining capacity corresponding to the first storage mode is lower than threshold #1. For example, attribute #1 and attribute #2 correspond to storage method #1, attribute #3 corresponds to storage method #2, storage method #1 is better than storage method #2, and now the remaining capacity corresponding to storage method #1 in the first storage disk is low Based on threshold #1, storage management device 120 may update attribute #2 to correspond to storage mode #2. It should be understood that in this way, the data stored in the storage mode #1 is reduced, so that more space can be "freed up" on the first storage disk.

In some embodiments, optionally, after receiving the capacity of the first storage disk, the storage management device 120 may re-determine the configured capacity of the first storage disk according to the capacity of the first storage disk. For example, the storage management device 120 knows The used SLC capacity of the first storage disk occupies 90% of the originally configured SLC capacity and the used QLC capacity occupies 30% of the originally configured QLC capacity, and the storage management device 120 can add more SLC capacity to the storage disk 130 , for example by sending an indication to the storage disk 130 instructing it to convert half of the unused QLC capacity to SLC capacity. Optionally, when the storage system is initialized, the storage management device 120 configures capacities corresponding to different storage modes. For example, the storage space of the storage disk 130 may be configured as a 100MB SLC area and a 300MB QLC area.

In some embodiments, optionally, after receiving the capacity of the first storage disk, the storage management device 120 may notify the user of the specific storage information of the storage disk 130 through the display of the user interface, so as to improve user experience.

It should be understood that, in this way, the storage management device 120 may determine capacities corresponding to different storage modes of the first storage disk, so as to better allocate storage space or perform storage optimization.

The case where the first preset condition is B will be described. For example, when the user of the host 110 thinks that the performance of the storage system 100 needs to be converted to a high performance direction, the host 110 can initiate an optimization request to the storage management device 120, and the storage management device 120 reconfirms the storage method of the data according to the optimization request and counts , or select some data to upgrade its storage method to a better storage method, for example, change the data originally stored in storage method 3 to storage method 2. For another example, when the user of the host 110 thinks that the performance of the storage system 100 needs to be converted to a high-capacity direction, the host 110 can initiate an optimization request to the storage management device 120, and the storage management device 120 reconfirms the storage method of the data according to the optimization request and Statistics, or select some data to upgrade its storage method to a storage method that occupies less capacity, for example, change the file originally stored in storage method 1 to storage method 2.

The case where the first preset condition is C will be described. In some embodiments, when the first storage disk detects that the remaining storage capacity in the disk is less than the first preset threshold, an optimization request is sent to the storage management device 120 for requesting to optimize the space of the first storage disk. For example, storage disk A detects that all remaining capacity in the disk is lower than threshold #1, then storage disk A sends an optimization request to storage management device 120 . It should be understood that the difference between condition A and condition C lies in whether the storage management device 120 actively triggers or is triggered by the first storage disk and then reports to the storage management device 120 .

S202. The storage management device sends a first indication to the first storage disk, where the first indication is used to instruct the first storage disk to change the storage mode of the target data from the first storage method of the first storage disk. The method is converted to the second storage method of the first storage disk, wherein the first storage method has a first corresponding relationship with the first attribute, The second storage manner has a second corresponding relationship with the second attribute.

In some embodiments, the first storage mode may be any one of SLC storage, MLC storage, TLC storage, and QLC storage. In some embodiments, the second storage mode may be any one of SLC storage, MLC storage, TLC storage, and QLC storage. But the first storage method is different from the second storage method. For example, the first storage mode is SLC storage, and the second storage mode may be MLC storage. For another example, the first storage mode is SLC storage, and the second storage mode may be QLC storage. It should be understood that the first storage manner and the second storage manner are storage manners for the same file at different times.

The "first instruction" will be described.

In some embodiments, the first indication may be an attribute label of the target data.

In some embodiments, the first indication may also be information indicating that the attribute label of the target data is updated from the first attribute to the second attribute.

In some embodiments, the first indication may also be information directly indicating the second storage manner of the target data.

In some embodiments, there is a first interface between the storage management device 120 and the first storage disk, and the first interface is used to automatically obtain the value of the updated attribute label of the target data when the storage management device 120 updates the attribute label of the target data .

In some embodiments, the first interface can be set on a standard SSD disk to implement the method described in the embodiment of the present invention.

S203, the first storage disk converts the storage manner of the target data from the first storage manner of the first storage disk to the second storage manner of the first storage disk according to the first instruction.

This step is the same as the above S304.

Optionally, the first storage disk may also set an attribute tag for the stored target data, and the attribute tag may be an identifier, such as a flag. For example, the attribute label of the first disk setting data #1 is attribute #2.

Optionally, the first storage disk may determine the second storage manner of the target data according to the value of the attribute tag. For example, the value of the attribute label of data 1 is updated from attribute #1 to attribute #2. Since attribute #1 corresponds to storage mode #1 and attribute #2 corresponds to storage mode #2, the first storage disk will change data 1 from storage mode # 1 converts to storage mode #2.

The target data in the first storage disk is converted from the first storage method of the first storage disk to the second storage method of the first storage disk, and the steps may be: migrating the target data from the first area to the second area, the storage granularity of the first area is different from that of the second area, for example, the storage granularity of the first area is SLC granules, and the storage granularity of the second area is QLC granules. It should be understood that both the first area and the second area are in the first storage disk, so the location where the target data is recorded in the storage management device 120 is still in the first storage disk, only the object recorded in the first storage disk The specific storage location of the data has changed. In other words, the first storage disk only needs to migrate the storage location of the target data according to the second attribute, and does not need to report the specific storage location of the target data to the storage management device 120 .

Optionally, the data is written in PLOG as a unit and the storage mode is converted. For example, if there are file 1 and file 2 under directory 1, the metadata of directory 1, the metadata of file 1, and the metadata of file 2 are stored in In PLOG1, and the attribute label of PLOG1 is attribute #1, since the access frequency of PLOG1 is higher than the first frequency threshold, the attribute label of PLOG1 is updated to attribute #2, then the storage method of all data of PLOG1 should be changed from storage method #1 Change to storage mode #2. The storage area of the first storage disk includes the QLC storage area and the SLC storage area, then storage disk A migrates PLOG1 to the SLC area on the disk, although the actual storage space of PLOG1 in the disk has changed However, since the data corresponding to PLOG1 is still in the first storage disk, and the location of each data in PLOG1 remains unchanged, there is no need to report the specific location of PLOG1 to the storage management device 120 .

FIG. 6 shows a schematic flowchart of a storage method 600 provided by an embodiment of the present invention, and the storage method 600 provided by the present invention will be described with reference to FIG. 6 .

In some embodiments, the correspondence between the attribute tag and the storage mode may be independently determined by the first storage disk.

S601. The first storage disk determines a correspondence between attribute tags and storage modes in the first storage disk.

In some embodiments, this step may, for example, include determining the correspondence between the attribute label and the storage mode according to the capacity of the first storage disk. Optionally, when the capacity of the first storage disk satisfies a third preset condition, the first storage disk modifies the correspondence between the attribute label and the storage mode. The third preset condition may be, for example, the The remaining capacity is less than a second preset threshold. The remaining capacity of the first storage disk being smaller than the second preset threshold may be, for example, that the capacity corresponding to storage mode #1 in the first storage disk is lower than threshold #2, and the threshold #2 may be, for example, 1 GB.

In some embodiments, this step may be that the first storage disk is preset with a correspondence between attribute tags and storage modes. In other words, the correspondence between attribute tags and storage methods can be defined in the protocol.

S602. The storage management device updates an attribute label of the target data from a first attribute to a second attribute, where the attribute label is used to indicate a storage manner of the target data.

The description of this step is the same as that of S201. To avoid redundancy, reference may be made to the foregoing, and details will not be repeated here.

S603. The storage management device sends a first indication to the first storage disk, where the first indication is used to instruct the first storage disk to change the storage mode of the target data from the first storage method of the first storage disk. The mode is converted to the second storage mode of the first storage disk, wherein the first storage mode has a first correspondence with the first attribute, and the second storage mode has a second correspondence with the second attribute. relation.

The description of this step is the same as that of S202, to avoid redundancy, refer to the above, and will not be repeated here.

S604. The first storage disk converts the storage manner of the target data from the first storage manner of the first storage disk to the second storage manner of the first storage disk according to the first instruction. .

The description of this step is the same as that of S203. To avoid redundancy, reference may be made to the foregoing, and details will not be repeated here.

It should be understood that the first storage disk determines the storage method of the target data, and the storage management device 120 only determines the attribute label of the target data for the target data and the first storage disk does not need to inform the storage management device 120 of the final storage method of the target data. This method can enable the first storage disk to independently adjust the storage method of data in the disk, and the storage management device 120 can save the burden of regulation and the signaling overhead of the storage system 100 .

FIG. 7 shows a schematic flowchart of a storage method 700 provided by an embodiment of the present invention.

The storage method 700 provided by the embodiment of the present invention will be described with reference to FIG. 7 .

S701. The storage management device receives a write request of target data.

This step may be, for example, before the target data is written into the first storage disk.

S702. In response to the write request, the storage management device determines that the attribute tag of the target data is the first attribute, where the attribute tag is used to indicate a storage manner of the target data.

Optionally, in response to the write request, the storage management device determines, according to the second information, that the attribute tag of the target data is the first attribute.

Optionally, the second information may include inherent attribute information of the target data.

When writing data for the first time, the storage management device 120 may also determine the first attribute of the target data according to the inherent attribute information of the target data and relationship #5, which is the relationship between the inherent attribute information of the data and the first attribute.

table 5

Relationship #5 may be as shown in Table 5. For example, if data 1 is a directory metafile, the storage management device 120 determines that the attribute tag of data 1 is attribute #1. For another example, if the data 2 is data of a large file (size greater than or equal to 100MB), the storage management device 120 determines that the attribute label of the data 2 is attribute #2.

In some embodiments, the size of the target data may be the smallest unit stored on the storage disk, for example, it may be 8kb. In other embodiments, the first storage disk is a PLOG SSD disk, and the target data can be a PLOG. A PLOG disk can be an SSD disk that provides a PLOG interface. A PLOG is an encapsulation of a section of the PLOG SSD disk that supports additional writing, named, and byte-level address space. One SSD can contain multiple PLOGs. When adding a new PLOG to the PLOG SSD disk, the ID and attribute of the PLOG can be specified. For example, the attribute label of the PLOG whose ID is PLOG1 is indicated as attribute #2.

Optionally, multiple data of the same or similar type in the same directory can be placed in the same PLOG. For example, if there are file 1 and file 2 in directory 1, then the metadata of directory 1, the metadata of file 1, and file 2 metadata is stored in PLOG1. In this way, when the subsequent storage mode is converted, the PLOG can be converted as a unit. It should be understood that since the files in the same directory are generally read at the same time, their statistical characteristics are generally the same, and the same or similar types of data are generally stored in the same way, so signaling interactions can be reduced and The management cost of the storage management device 120 .

S703. The storage management device sends a fourth indication to the first storage disk, where the fourth indication is used to instruct the first storage disk to store the target data in a first storage manner, where the first The storage mode has a first corresponding relationship with the first attribute.

Optionally, the fourth indication may be an attribute label of the target data.

Optionally, the fourth indication may also be information indicating that the attribute label of the target data is updated from null to the first attribute.

Optionally, the fourth indication may also be information directly indicating the first storage mode of the target data.

S704. The first storage disk receives the fourth indication, and stores the target data in the first storage manner according to the fourth indication.

The description of this step is similar to that of S203. To avoid redundancy, reference may be made to the foregoing, and details will not be repeated here.

S705. The storage management device updates the attribute label of the target data from the first attribute to the second attribute, where the attribute label is used to indicate a storage manner of the target data.

S706. The storage management device sends a first indication to the first storage disk, where the first indication is used to instruct the first storage disk to change the storage mode of the target data from the first storage method of the first storage disk. The mode is converted to the second storage mode of the first storage disk, wherein the first storage mode has a first correspondence with the first attribute, and the second storage mode has a second correspondence with the second attribute. relation.

The description of this step is the same as that of S202. To avoid redundancy, reference may be made to the foregoing, and details will not be repeated here.

S707. According to the first instruction, the first storage disk changes the storage mode of the target data from the first storage method of the first storage disk to format to the second storage mode of the first storage disk. The description of this step is the same as that of S203. To avoid redundancy, reference may be made to the foregoing, and details will not be repeated here.

The method embodiment of the embodiment of the present invention is described in detail above with reference to FIG. 1 to FIG. 7 , and the device embodiment of the embodiment of the present invention is described in detail below with reference to FIG. 8 to FIG. 10 . It should be understood that the descriptions of the method embodiments correspond to the descriptions of the device embodiments, therefore, for parts not described in detail, reference may be made to the foregoing method embodiments.

FIG. 8 is a schematic structural diagram of a storage management device 800 provided by an embodiment of the present invention. The storage management device 800 in FIG. 8 may be a specific example of the storage management device 120 in FIG. 1 . The storage management device 800 shown in FIG. 8 can be used to execute the methods shown in FIGS. 2 to 7 , and can specifically implement the embodiments shown in FIGS. 1 to 7 . To avoid redundancy, the description will not be repeated.

The storage management device 800 shown in FIG. 8 includes a processing unit 801 and a sending unit 802 .

The processing unit 801 may execute step S201 in the method shown in FIG. 2 .

The processing unit 801 may also execute step S301 in the method shown in FIG. 3 .

The processing unit 801 may also execute steps S401 and S403 in the method shown in FIG. 4 .

The processing unit 801 may also execute step S503 in the method shown in FIG. 5 .

The processing unit 801 may also execute step S602 in the method shown in FIG. 6 .

The processing unit 801 may also execute steps S701, S702, and S705 in the method shown in FIG. 7 .

The sending unit 802 may execute step S202 in the method shown in FIG. 2 .

The sending unit 802 may execute steps S302 and S303 in the method shown in FIG. 3 .

The sending unit 802 may execute steps S402 and S404 in the method shown in FIG. 4 .

The sending unit 802 may execute step S501 in the method shown in FIG. 5 .

The sending unit 802 may execute step S603 in the method shown in FIG. 6 .

The sending unit 802 may execute steps S703 and S706 in the method shown in FIG. 7 .

In some embodiments, the storage management device 800 further includes a receiving unit (not shown in the figure), and the receiving unit can execute step S502 in the method shown in FIG. 5 .

FIG. 9 is a schematic structural diagram of a storage disk 900 provided by an embodiment of the present invention. The storage disk 900 in FIG. 9 may be a specific example of the storage node in FIG. 1 . The storage management device 900 shown in FIG. 9 can be used to execute the methods shown in FIGS. 2 to 7 , and can specifically implement the embodiments shown in FIGS. 1 to 7 . To avoid redundancy, the description will not be repeated.

The storage disk 900 shown in FIG. 9 includes a receiving unit 901 and a processing unit 902 .

The receiving unit 901 may execute step S202 in the method shown in FIG. 2 .

The receiving unit 901 may also execute step S302 in the method shown in FIG. 3 .

The receiving unit 901 may also execute steps S402 and S404 in the method shown in FIG. 4 .

The receiving unit 901 may also execute step S501 in the method shown in FIG. 5 .

The receiving unit 901 may also execute step S603 in the method shown in FIG. 6 .

The receiving unit 901 may also execute steps S703 and S706 in the method shown in FIG. 6 .

The processing unit 902 may execute step S203 in the method shown in FIG. 2 .

The processing unit 902 may execute step S304 in the method shown in FIG. 3 .

The processing unit 902 may execute step S405 in the method shown in FIG. 4 .

The processing unit 902 may execute steps S601 and S604 in the method shown in FIG. 6 .

The processing unit 902 may execute steps S704 and S707 in the method shown in FIG. 7 .

In some embodiments, the storage disk 900 further includes a sending unit (not shown in the figure), and the sending unit can execute step S502 in the method shown in FIG. 2 .

FIG. 10 is a schematic structural diagram of a storage system 1000 provided by an embodiment of the present invention. The storage system 1000 includes a storage management device 1001 and a storage disk 1002 . The storage management device 1001 may be the storage management device 800 described above, and the storage disk 1002 may be the storage disk 900 described above. To avoid redundancy, the description will not be repeated.

It should be understood that in the embodiments of the present invention, the term "and/or" is only an association relationship describing associated objects, indicating that there may be three relationships. For example, A and/or B may mean: A exists alone, B exists alone, or both A and B exist simultaneously. In addition, the character "/" in this article generally indicates that the contextual objects are an "or" relationship.

Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, and to avoid redundancy, refer to the preceding , which will not be repeated here.

In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention. Should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be determined by the protection scope of the claims.

Claims

A method for managing data in a storage disk, comprising:

The storage management device updates the attribute label of the target data from the first attribute to the second attribute, and the attribute label is used to indicate the storage mode of the target data;

The storage management device sends a first instruction to the first storage disk, where the first instruction is used to instruct the first storage disk to convert the storage method of the target data from the first storage method of the first storage disk is the second storage method of the first storage disk, wherein the first storage method corresponds to the first attribute, the second storage method corresponds to the second attribute, and the first storage method corresponds to The storage medium is different from the storage medium corresponding to the second storage manner.
The method according to claim 1, further comprising:

The storage management device receives the capacity of the first storage disk, and the capacity of the first storage disk includes a capacity corresponding to the first storage mode in the first storage disk and/or a capacity corresponding to the second storage mode. capacity.
The method according to claim 2, further comprising:

The storage management device displays the capacity information of the first storage disk on a user interface, or,

The storage management device sends an instruction for adjusting the capacity corresponding to the first storage mode and/or the capacity corresponding to the second storage mode to the first storage disk.
The method according to any one of claims 1 to 3, wherein before the storage management device updates the attribute label of the target data from the first attribute to the second attribute, the method further comprises:

The storage management device determines the correspondence between the attribute tag and the storage mode in the first storage disk;

The storage management device sends an indication to the first storage disk to indicate the correspondence between the attribute tag and the storage mode in the first storage disk.
The method according to claim 4, wherein the storage management device determines the correspondence between the attribute label and the storage mode in the first storage disk, comprising:

When the first preset condition is met, the storage management device determines the correspondence between the attribute tag and the storage mode in the first storage disk,

Wherein the first preset condition includes at least one of the following:

The storage management device receives an optimization command from the host, where the optimization command is used to instruct the storage management device to update the correspondence between the attribute label and the storage mode in the first storage disk;

The storage management device receives an optimization request from the first storage disk, where the optimization request is used to instruct the storage management device to update the relationship between the attribute label and the storage mode in the first storage disk. Correspondence;

The remaining capacity of the first storage disk is less than a first preset threshold.
The method according to any one of claims 1 to 5, wherein the storage management device updates the attribute label of the target data from the first attribute to the second attribute, comprising:

The storage management device updates the attribute label of the target data from the first attribute to the second attribute according to upper-level statistical information and/or inherent attribute information of the target data, the upper-level statistical information including The access frequency information of the target data stored by the storage management device and/or the time when the target data was last accessed, the intrinsic attribute information of the target data includes one or more of the following information: the target data type, the size of the target data, the type of the file to which the target data belongs;

Or, the storage management device updates the attribute label of the target data from the first attribute to the second attribute according to the priority level of the target data, and the priority level of the target data is based on Determined by the inherent attribute information of the target data, the priority level is used to determine the priority of the target data to participate in storage mode conversion.
The method according to any one of claims 1 to 6, wherein before the storage management device updates the attribute label of the target data from the first attribute to the second attribute, the method further comprises:

The storage management device receives a write request of the target data;

In response to the write request, the storage management device determines that the attribute tag of the target data is the first attribute;

The storage management device sends an instruction for instructing the first storage disk to store the target data in the first storage manner to the first storage disk.
The method according to claim 7, wherein before the storage management device updates the attribute label of the target data from the first attribute to the second attribute, the method further comprises:

The storage management device sends an instruction for instructing the second storage disk to store a copy of the target data in the first storage manner to the second storage disk;

In response to the storage management device updating the attribute label of the target data from the first attribute to the second attribute, the storage management device sends a message to the second storage disk for instructing the second storage disk to update the target data An indication that the storage mode of the copy of the copy is converted from the first storage mode to the second storage mode.
A method for managing data in a storage disk, comprising:

The storage disk receives the first instruction sent by the storage management device;

The storage disk converts the storage method of the target data from the first storage method of the storage disk to the second storage method of the storage disk according to the first instruction, and the storage medium corresponding to the first storage method It is different from the storage medium corresponding to the second storage manner.
The method according to claim 9, wherein the storage disk converts the storage mode of the target data from the first storage mode of the storage disc to the second storage mode of the storage disc according to the first instruction. Storage methods include:

The storage disk updates the attribute label of the target data from a first attribute to a second attribute, and the attribute label is used to indicate a storage mode of the target data, wherein the first attribute is the same as the first storage mode Correspondingly, the second attribute corresponds to the second storage mode;

The storage disk converts the storage manner of the target data from the first storage manner of the storage disk to the second storage manner of the storage disk according to the attribute tag.
The method according to claim 10, wherein before the storage disk receives the first instruction sent by the storage management device, the method further comprises:

The storage disk receives the indication sent by the storage management device for indicating the correspondence between the attribute tag and the storage mode in the storage disk.
The method according to claim 10 or 11, wherein the method further comprises:

The storage disk sends the capacity of the storage disk to the storage management device, and the capacity of the storage disk includes a capacity corresponding to the first storage mode and/or a capacity corresponding to the second storage mode in the storage disk. capacity.
The method according to any one of claims 9 to 12, characterized in that receiving the stored Before the first instruction sent by the storage management device, the method further includes:

The storage disk receives an indication for instructing the storage disk to store the target data in the first storage manner.
A storage management device, characterized in that it includes:

a processing unit, configured to update the attribute label of the target data from the first attribute to the second attribute, the attribute label being used to indicate the storage mode of the target data;

a sending unit, configured to send a first instruction to the first storage disk, the first instruction is used to instruct the first storage disk to convert the storage method of the target data from the first storage method of the first storage disk is a second storage mode of the first storage disk, wherein the first storage mode has a first corresponding relationship with the first attribute, and the second storage mode has a second corresponding relationship with the second attribute, The storage medium corresponding to the first storage manner is different from the storage medium corresponding to the second storage manner.
The storage management device according to claim 14, further comprising a receiving unit configured to receive the capacity of the first storage disk, and the capacity of the first storage disk includes the first The capacity corresponding to the first storage mode and/or the capacity corresponding to the second storage mode in the storage disk.
The storage management device according to claim 14 or 15, characterized in that,

The processing unit is further configured to display the capacity information of the first storage disk on a user interface; or,

The sending unit is configured to send an instruction for adjusting the capacity corresponding to the first storage mode and/or the capacity corresponding to the second storage mode to the first storage disk.
The storage management device according to any one of claims 14 to 16, wherein the processing unit is further configured to determine the correspondence between the attribute label and the storage mode in the first storage disk ,

The sending unit is further configured to send, to the first storage disk, an indication for indicating a correspondence between the attribute tag and the storage mode in the first storage disk.
The storage management device according to claim 17, wherein the processing unit is specifically configured to determine the relationship between the attribute label and the storage mode in the first storage disk when the first preset condition is met. corresponding relationship,

Wherein the first preset condition includes at least one of the following:

The storage management device receives an optimization command from the host, where the optimization command is used to instruct the storage management device to update the correspondence between the attribute label and the storage mode in the first storage disk;

The storage management device receives an optimization request from the first storage disk, where the optimization request is used to instruct the storage management device to update the relationship between the attribute label and the storage mode in the first storage disk. Correspondence;

The remaining capacity of the first storage disk is less than a first preset threshold.
According to the storage management device according to any one of claims 14 to 18, the processing unit is specifically configured to:

The attribute label of the target data is updated from the first attribute to the second attribute according to the upper-level statistical information and/or inherent attribute information of the target data, the upper-level statistical information includes information managed by the storage The access frequency information of the target data stored in the device and/or the time when the target data was last accessed, the inherent attribute information of the target data includes one or more of the following information: the type of the target data, the The size of the target data, the type of the file to which the target data belongs;

Or, update the attribute label of the target data from the first attribute to the second attribute according to the priority level of the target data, and the priority level of the target data is based on the priority level of the target data Determined by the inherent attribute information, the priority level is used to determine the priority of the target data to participate in the storage mode conversion.
The storage management device according to any one of claims 14 to 19, wherein the receiving unit is further configured to receive a write request of the target data;

The processing unit is further configured to determine that the attribute label of the target data is the first attribute in response to the write request;

The sending unit is further configured to send an indication to the first storage disk to instruct the first storage disk to store the target data in the first storage manner.
The storage management device according to any one of claims 14 to 20, wherein the sending unit is further configured to send to the second storage disk a message indicating that the second storage disk uses the first storage mode storing an indication of a copy of said target data;

Responsive to the processing unit updating the attribute label of the target data from the first attribute to the second attribute, the sending unit is further configured to send to the second storage disk a An indication that the storage mode of the copy of the data is converted from the first storage mode to the second storage mode.
The storage management device according to any one of claims 14 to 21, wherein the first storage disk is a flash disk, the storage medium corresponding to the first storage mode, and the storage medium corresponding to the second storage mode The storage medium is one of the following storage media: SLC flash memory, MLC flash memory, TLC flash memory, and QLC flash memory.
A storage disk, characterized in that, comprising:

a receiving unit, configured to receive the first indication sent by the storage management device;

a processing unit, configured to convert the storage mode of the target data from the first storage mode of the storage disk to the second storage mode of the storage disk according to the first instruction, and the storage media corresponding to the first storage mode are different A storage medium corresponding to the second storage manner.
The storage disk according to claim 23, wherein the processing unit is specifically configured to update the attribute label of the target data from a first attribute to a second attribute, and the attribute label is used to indicate that the target data storage method, wherein the first attribute corresponds to the first storage method, and the second attribute corresponds to the second storage method;

The processing unit is further configured to convert the storage mode of the target data from the first storage mode of the storage disk to the second storage mode of the storage disk according to the attribute tag.
The storage disk according to claim 23 or 24, wherein the receiving unit is further configured to receive information sent by the storage management device for indicating the difference between the attribute label and the storage method in the storage disk. indication of the corresponding relationship.
The storage disk according to any one of claims 23 to 25, wherein the storage disk further comprises a sending unit configured to send the capacity of the storage disk to the storage management device, so The capacity of the storage disk includes the capacity corresponding to the first storage mode and/or the capacity corresponding to the second storage mode in the storage disc.
The storage disk according to any one of claims 23 to 26, wherein the receiving unit is further configured to receive an instruction instructing the storage disk to store the target data in the first storage manner.
The storage disk according to any one of claims 23 to 27, wherein the storage disk is a flash disk, and the storage medium corresponding to the first storage mode and the storage medium corresponding to the second storage mode are One of the following storage media: SLC flash memory, MLC flash memory, TLC flash memory, QLC flash memory.
A storage system, characterized by comprising: the storage tube according to any one of claims 14-22 management device and the storage disk according to any one of claims 23-28.