WO2023029417A1

WO2023029417A1 - Data storage method and device

Info

Publication number: WO2023029417A1
Application number: PCT/CN2022/078858
Authority: WO
Inventors: 蒲贵友
Original assignee: 华为技术有限公司
Priority date: 2021-08-31
Filing date: 2022-03-02
Publication date: 2023-03-09
Also published as: CN115729846A

Abstract

A data storage method, comprising: determining a first physical address corresponding to first data, the first physical address being used for indicating at least one storage block of a first storage space; writing the first data into the first physical address; recording the mapping from a first virtual address to the first physical address in a forward mapping table, a virtual address of the first data being the first virtual address, and the first physical address comprising an identifier of the first storage space and an offset address of the first physical address in the first storage space; and recording the first physical address in a meta information table corresponding to the first storage space, and recording the first virtual address corresponding to the first physical address in the meta information table. Also discloses is a data storage device.

Description

A data storage method and device

This application claims the priority of a Chinese patent application filed with the State Intellectual Property Office on August 31, 2021, with application number 202111017305.X and application name "A Data Storage Method and Device", the entire contents of which are incorporated by reference in In this application.

technical field

The embodiments of the present application relate to the field of storage technologies, and in particular, to a data storage method and device.

Background technique

As we all know, when writing the second data into a certain hard disk, if the second data is exactly the same as the first data stored in the hard disk, the second data will not be repeatedly written in the hard disk, but will be repeated. The data deletion technology points the virtual address corresponding to the second data to the physical address corresponding to the first data, thereby avoiding repeated writing of the same data in the hard disk and saving the storage space of the hard disk. Subsequently, the data (that is, the first data) may be read according to the pointing relationship between the virtual address corresponding to the second data and the physical address corresponding to the first data.

An existing data storage method based on deduplication technology is: in the process of writing data to the hard disk, if the data corresponding to multiple virtual addresses is the same (for example, all are data A), then the multiple virtual addresses All point to the physical address of the storage block storing data A, and record the physical address, the virtual address corresponding to the physical address, and the number of virtual addresses in the reverse mapping table (the number of the virtual addresses is called a reference count).

When garbage collection is performed on the storage block (physical address 1 of the storage block) storing data A in the data storage system, data A can be migrated to the storage block corresponding to physical address 2, and the physical address can be queried in the reverse mapping table. The reference count corresponding to address 1 and the virtual address set corresponding to physical address 1, update the physical address 1 in this record to physical address 2, that is to say, the reference count corresponding to physical address 1 and the virtual address set in the reverse mapping table The address set is updated to the reference count and virtual address set corresponding to physical address 2; however, in the above process of querying the reference count and virtual address set pointing to the physical address 1 in the reverse mapping table, since the reverse mapping table includes hard disk The reverse mapping relationship of all storage blocks, that is, the content of the reverse mapping table is large, so it takes a long time to query the reference count and virtual address set pointing to the physical address 1 from the reverse mapping table, which leads to obtaining the physical address 1 Reference counting of addresses and collection of virtual addresses are less efficient.

Contents of the invention

Embodiments of the present application provide a data storage method and device capable of efficiently obtaining reference counts and virtual address sets corresponding to storage blocks.

In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:

In a first aspect, an embodiment of the present application provides a data storage method, the method including: determining a first physical address corresponding to the first data, where the first physical address is used to indicate at least one storage block in the first storage space; The above-mentioned first data is written into the first physical address; the mapping from the above-mentioned first virtual address to the above-mentioned first physical address is recorded in the forward mapping table, wherein the virtual address of the first data is the first virtual address, and the above-mentioned first physical address The address includes the identifier of the first storage space and the offset address of the first physical address in the first storage space; then, record the first physical address in the meta-information table corresponding to the first storage space, and record the first physical address in the meta-information table A first virtual address corresponding to the first physical address is recorded.

In the data storage method provided by the embodiment of the present application, the first data is written into the first physical address indicating at least one storage block in the first storage space, and the first data is recorded in the meta information table corresponding to the first storage space. A virtual address (such as a first virtual address) corresponding to a physical address, wherein the first physical address includes an identifier of the first storage space and an offset address of the first physical address in the first storage space; so when it is necessary to obtain the first For all virtual addresses corresponding to the physical address, obtain the meta-information table corresponding to the first storage space according to the identifier of the first storage space in the first physical address, and then query the first physical address in the meta-information table according to the first physical address The virtual address corresponding to the physical address, and count the number of virtual addresses. Since only the virtual address corresponding to the physical address of the storage block in the first storage space is stored in the meta-information table corresponding to the first storage space, it is only necessary to traverse the meta-information table corresponding to the identification information of the first storage space. The physical address-related records in a storage space do not need to traverse the physical address-related records in the entire hard disk. Therefore, it takes less time to query the meta-information table corresponding to the first storage space, which can improve the reference count and Efficiency of virtual address collection.

In a possible implementation manner, the above data storage method further includes: determining whether the second data is the same as the above first data, and the second data is data to be written; if the second data is the same as the above first data Next, record the mapping from the second virtual address to the first physical address in the forward mapping table; and record the second virtual address corresponding to the first physical address in the meta information table.

In the data storage method provided by the embodiment of the present application, when the data storage device writes data to the hard disk, it first determines whether the data is already written data, and if the data is already written data, then the A mapping relationship is established between the virtual address and the physical address corresponding to the data, and the data is not repeatedly written on the hard disk, thus saving the storage space of the hard disk.

In a possible implementation manner, the meta information table includes a virtual address set corresponding to the first physical address; the first virtual address and the second virtual address are added to the virtual address set.

In a possible implementation, the data storage method further includes: when performing garbage collection on the first storage space, writing the first data in the first physical address into the second physical address; Record the second physical address in the meta information table corresponding to the second storage space of the second physical address, and add the above-mentioned first virtual address and second virtual address to the virtual address set corresponding to the second physical address; record the second virtual address in the forward mapping table A mapping from the first virtual address to a second physical address and a mapping from the second virtual address to the second physical address; then, deleting the first data in the first physical address; and deleting the meta information of the first storage space The first physical address in the table and the first virtual address and the second virtual address in the virtual address set corresponding to the first physical address; and delete the mapping from the first virtual address to the first physical address in the forward mapping table and A mapping of the second virtual address to the first physical address.

In a possible implementation manner, the storage space in the embodiment of the present application (including the first storage space and the second storage space) may be a persistent log (Plog) storage space, and the persistent log storage space supports additional writing way to write data.

In a second aspect, the embodiment of the present application provides a data storage device, including: a determination module, a data writing module, and an information recording module. Wherein, the determination module is used to determine the first physical address corresponding to the first data, and the first physical address is used to indicate at least one storage block in the first storage space; the write data module is used to write the first data into the first physical address ; The information recording module is used to record the mapping from the first virtual address to the first physical address in the forward mapping table, wherein the virtual address of the first data is the first virtual address, and the first physical address includes the identifier of the first storage space and the offset address of the first physical address in the first storage space; the information recording module is also used to record the first physical address in the meta-information table corresponding to the first storage space, and record the first physical address in the meta-information table The corresponding first virtual address.

In a possible implementation manner, the above determination module is also used to determine whether the second data is the same as the first data, and the second data is data to be written; the information recording module is also used to compare the second data with the first In the case of the same data, record the mapping from the second virtual address to the first physical address in the forward mapping table; the information recording module is also used to record the second virtual address corresponding to the first physical address in the meta information table. address.

In a possible implementation manner, the data storage device further includes: a deletion module. The above-mentioned writing data module is also used for writing the first data in the first physical address into the second physical address when performing garbage collection on the first storage space; Record the second physical address in the meta information table corresponding to the second storage space, and add the first virtual address and the second virtual address in the virtual address set corresponding to the second physical address; the information recording module is also used for forward mapping table Record the mapping from the first virtual address to the second physical address and the mapping from the second virtual address to the second physical address; the deletion module is used to delete the first data in the first physical address, and delete the meta information of the first storage space The first physical address in the table and the first virtual address and the second virtual address in the virtual address set corresponding to the first physical address; and delete the mapping from the first virtual address to the first physical address and the first virtual address in the forward mapping table Mapping of the second virtual address to the first physical address.

In a third aspect, the embodiment of the present application provides a storage device, wherein the memory is coupled to the processor; the memory is used to store computer program codes, wherein the computer program codes include computer instructions; when the computer instructions are executed by the processor, the storage The device executes the method described in any one of the first aspect and possible implementations thereof.

In a fourth aspect, an embodiment of the present application provides a computer storage medium, including computer instructions. When the computer instructions are run on the computing device, the computing device is made to execute the above-mentioned method described in any one of the first aspect and its possible implementations. method.

In the fifth aspect, the embodiments of the present application provide a computer program product, which, when run on a computer, causes the computer to execute the method described in any one of the above first aspect and possible implementations thereof.

Description of drawings

FIG. 1 is a first schematic diagram of the relationship between a virtual address and a physical address provided by an embodiment of the present application;

FIG. 2 is a first schematic diagram of a storage system provided by an embodiment of the present application;

FIG. 3 is a schematic diagram 1 of a data storage method provided by an embodiment of the present application;

FIG. 4 is a schematic diagram of a hard disk structure provided by an embodiment of the present application;

Fig. 5a is a schematic diagram 1 of writing data provided by the embodiment of the present application;

Figure 5b is a second schematic diagram of writing data provided by the embodiment of the present application;

Fig. 5c is a schematic diagram 1 of garbage collection provided by the embodiment of the present application;

Fig. 5d is a schematic diagram 1 of data deletion provided by the embodiment of the present application;

FIG. 6 is a second schematic diagram of a data storage method provided by an embodiment of the present application;

FIG. 7 is a third schematic diagram of a data storage method provided by the embodiment of the present application;

Fig. 8 is a schematic diagram 4 of a data storage method provided by the embodiment of the present application;

FIG. 9 is a first schematic diagram of a data storage device provided by an embodiment of the present application;

FIG. 10 is a second schematic diagram of a data storage device provided by an embodiment of the present application.

Detailed ways

The term "and/or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and/or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations.

The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects, rather than to describe a specific order of objects. For example, the first physical address and the second physical address are used to distinguish different physical addresses, rather than describing a specific sequence of physical addresses.

In the embodiments of the present application, words such as "exemplary" or "for example" are used as examples, illustrations or illustrations. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of the present application shall not be interpreted as being more preferred or more advantageous than other embodiments or design schemes. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete manner.

In the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

With the development of Internet technology, the demand for information and data storage of major enterprises is also increasing rapidly. Data deduplication technology, as a conventional data storage method, is favored by major enterprises.

The existing data storage method based on de-duplication technology is: when writing data in the hard disk (hereinafter the data to be written is referred to as target data A), the processor in the data storage system judges whether the hard disk has Storing the target data A, if there is no target data A in the hard disk, storing the target data A in the storage block corresponding to the physical address 1, and pointing the virtual address 1 corresponding to the target data to the physical address 1, At the same time, the mapping relationship between virtual address 1 and physical address 1 is recorded in the forward mapping table, specifically as shown in the first row of Table 1 below, wherein the forward mapping table includes at least fields: virtual address and physical address, and "virtual address The "address" field is used to store the virtual address corresponding to the specific data, and the "physical address" field is used to store the physical address pointed to by the virtual address; and the number of virtual addresses pointing to the physical address 1 is recorded in the reverse mapping table (abbreviated as reference count) and a virtual address set pointing to the physical address 1, the virtual address set is used to record all virtual addresses pointing to the physical address 1, specifically as shown in the following table 2, wherein the reverse mapping table includes at least the field: physical Addresses, reference counts, and virtual address collections, the "physical address" field is used to store the physical address corresponding to the data, the "reference count" field is used to store the number of virtual addresses corresponding to the physical address, and the "virtual address" field is used to store All virtual addresses pointing to that physical address.

Table 1

Table 2

In the case of stored target data A in the hard disk, as shown in FIG. In the storage block A in), there is no need to store the target data A again in the hard disk, and at the same time record the mapping relationship between virtual address 1 and physical address 1 in the forward mapping table, as shown in Table 3, and in the reverse mapping table Update the virtual address pointing to the physical address and the reference count of the virtual address, as shown in Table 4.

table 3

虚拟地址virtual address	物理地址physical address
虚拟地址1 virtual address 1	物理地址1 physical address 1
虚拟地址2virtual address 2	物理地址1 physical address 1
虚拟地址3virtual address 3	物理地址1 physical address 1

Table 4

When garbage collection is performed on the hard disk of the data storage system, the target data A is migrated from physical address 1 to physical address 2; at the same time, the reference count and virtual address set pointing to the physical address 1 are queried in the reverse mapping table, and The reference count and virtual address set corresponding to physical address 1 are updated to the reference count and virtual address set corresponding to physical address 2, and then, the virtual address in the virtual address set corresponding to physical address 1 in the reverse mapping table is redirected to the physical address 2. Finally, update the mapping relationship between the virtual address and physical address 1 to the mapping relationship between the virtual address and physical address 2 in the forward mapping table.

However, in the above-mentioned process of querying the reference count and virtual address set pointing to the physical address 1 in the reverse mapping table, since the amount of data stored in the reverse mapping table is relatively large, the query pointing to the physical address 1 from the reverse mapping table The reference count and virtual address set of address 1 take a long time, which leads to low efficiency in obtaining the reference count and virtual address set corresponding to the physical address.

Based on the problem of low efficiency in obtaining the reference count and virtual address set corresponding to the physical address in the prior art, the embodiment of the present application provides a data storage method and device, specifically implemented as: determining the first physical address corresponding to the first data address, the first physical address is used to indicate at least one storage block in the first storage space; writing the first data into the first physical address; recording the mapping from the first virtual address to the first physical address in the forward mapping table, The virtual address of the first data is the first virtual address, and the first physical address includes the identifier of the first storage space and the offset address of the first physical address in the first storage space; in the meta information table corresponding to the first storage space The first physical address is recorded, and the first virtual address corresponding to the first physical address is recorded in the meta information table.

Through the technical solution provided by the embodiment of the present application, the reference count and virtual address set corresponding to the storage block can be obtained efficiently.

The data storage method and device provided by the embodiments of the present application can be applied to the storage system shown in FIG. 2, and the storage system can be a storage system of a solid-state hard disk. As shown in FIG. 2, the data storage device includes a main controller (referred to as: main control) 201 and a plurality of flash memory chips 205, wherein the main control 201 includes: a processor 202, a host interface 204, and n (n>0) channel controllers 203.

The above-mentioned master control 201 is used to issue executable commands to multiple flash memory chips 205 , so as to realize the process of reading or writing data on the flash memory chips 205 .

The above-mentioned host interface 204 is used to communicate with the host, and then receive the command request sent by the host, and forward the command request to the processor 202, wherein the above-mentioned host is not limited to any device such as a server, a personal computer, or an array controller

The processor 202 sends executable commands to the plurality of flash memory particles 205 according to the command request forwarded by the host interface 204, and the processor 202 includes one or more CPUs. The CPU may be a single-core CPU (single-CPU) or a multi-core CPU (multi-CPU).

The channel controller 203 is used to carry the executable commands issued by the processor 202 to the plurality of chips 205 .

Optionally, the storage device further includes a bus 206, and the processor 202, the channel controller 203, the host interface 204, and the flash memory chip 205 are generally connected to each other through the bus 206, or are connected to each other in other ways.

When the above-mentioned storage system receives the data writing request of the service layer, the host interface 204 in the main control 201 forwards the data writing request to the processor 202 in the main control 201, and the processor 202 writes the request according to the data and passes The channel controller 203 issues a data writing instruction to the flash memory chip 205 , and the writing of data into the flash memory chip 205 has been implemented.

Optionally, the device for executing the data storage method provided by the embodiment of the present application may be the processor in the main controller in the storage system shown in FIG. 2 above. As shown in FIG. 3 , the method may include S310-S340.

S310. The data storage device determines a first physical address corresponding to the first data.

It should be understood that the above-mentioned first data is data not yet stored in the hard disk.

In the embodiment of the present application, the above-mentioned first physical address is used to indicate at least one storage block in the first storage space, wherein the first storage space is to divide the hard disk into blocks with larger granularity, as shown in FIG. 4 , A hard disk is divided into 3 storage spaces, each row is a storage space, and each storage space includes N storage blocks, where N is greater than or equal to 2 and less than the total number of storage blocks in the hard disk.

It should be understood that the above-mentioned flash memory chip 205 in FIG. 2 is composed of multiple storage spaces, or the above-mentioned multiple flash memory chips 205 constitute one storage space, and the size division method of the storage space is not limited in this application.

Optionally, the storage space may be a persistent log storage space (persistent log, Plog), where the Plog supports writing data in an append writing manner.

Exemplarily, taking the log type storage mode as an example, the hard disk is divided into multiple Plogs, and each of the above storage spaces is equivalent to one Plog.

It should be noted that, in the subsequent descriptions of the embodiments of the present application, one storage space is taken as one Plog as an example for illustration.

The above-mentioned first physical address may be calculated by the data storage device according to the first data, or may be randomly allocated by the memory, which is not limited in this embodiment of the present application.

S320. The data storage device writes the first data into the first physical address.

It should be understood that the above-mentioned first data may be stored on one storage block in the first storage space, or may be stored on multiple storage blocks in the first storage space, depending on the size of the first data and availability of the storage blocks. The amount of storage is determined.

In this embodiment of the present application, the above-mentioned first physical address includes the identifier of the first storage space and the offset address of the first physical address in the first storage space (that is, the storage block used to store the first data is in the first storage space The corresponding offset address in the space). Exemplary, based on the above example, taking the first storage space as the above-mentioned Plog as an example, the first physical address is Plog id+offset, wherein, Plog id is the id corresponding to the Plog on the hard disk, and offset is used in the Plog The offset address of the storage block storing the first data. For example, the 100th storage block in the Plog is used to store the first data. At this time, the offset is 100.

The above-mentioned writing of the first data into at least one storage block in the first storage space indicated by the first physical address may specifically be: determine the first storage block according to the unique identifier (i.e. Plog id) of the first storage space in the first physical address A storage space, then, according to the offset address corresponding to the storage block in the first storage space in the first physical address, determine the storage block storing the first data; finally, write the first data into the storage block.

Exemplarily, based on the above example, assuming that the identifier of the first storage space contained in the first physical address and the corresponding offset address stored in the first storage space are Plog3_100, the data storage device finds the Plog id according to the first physical address The Plog is 3, and then the 100th storage block is found from left to right in the Plog, and finally, the first data is written into the 100th storage block in the Plog.

Optionally, the above-mentioned first physical address may also be a specific address on the hard disk consisting of multiple hexadecimal characters, and the storage location corresponding to the address is one or more storage blocks in the first storage space

S330. The data storage device records the mapping from the first virtual address to the first physical address in the forward mapping table.

The above-mentioned first virtual address is the virtual address corresponding to the first data, and the above-mentioned forward mapping table is used to record the mapping relationship between the virtual address and the physical address, wherein the virtual address points to the physical address, and the records of the forward mapping table can refer to Contents of Table 1 above.

Optionally, in the forward mapping table, a physical address has a mapping relationship with at least one virtual address, that is to say, in the forward mapping table, the relationship between the physical address and the virtual address can be one-to-many, or it can be One-to-one relationship.

It should be noted that when the data storage device reads data corresponding to a certain virtual address, the physical address corresponding to the virtual address is searched in the forward mapping table, and then the data is read from the storage block corresponding to the physical address. data.

S340. The data storage device records the first physical address in the meta information table corresponding to the first storage space, and records the first virtual address corresponding to the first physical address in the meta information table.

It should be understood that the above-mentioned meta information table is in one-to-one correspondence with the first storage space, that is, one storage space corresponds to one meta information table, and the identifier of the meta information table is the identifier of the storage space corresponding to the meta information table, that is to say According to the identification of the storage space, the meta information table corresponding to the storage space can be obtained; the above meta information table is used to record the physical address and the virtual address set pointing to the physical address, wherein the physical address and the virtual address set pointing to the physical address can be It is stored in the form of a key-value pair (key-value). In the meta information table, the key is used to record the physical address, and the value corresponding to the key is used to record all virtual addresses pointing to the physical address.

As shown in Figure 5a, virtual address 1 points to physical address 1, and virtual address 10 points to physical address 10, wherein both physical address 1 and physical address 10 belong to the first storage space, and further, the meta information table corresponding to the first storage space is as follows As shown in Table 5, physical address 1 corresponds to virtual address 1, and physical address 10 corresponds to virtual address 10.

table 5

It should be noted that the present application does not limit the execution sequence of S330 and S340 above, that is, the data storage device may execute S330 first and then S340, and the data storage device may also execute S340 first and then S330.

In the data storage method provided by the embodiment of the present application, the first data is stored in at least one storage block in the first storage space indicated by the first physical address, and the first physical address is recorded in the meta information table corresponding to the first storage space. address and the virtual address corresponding to the first physical address, wherein the first physical address includes the identifier of the first storage space and the offset address of the storage block storing the first data in the first storage space; so when it is necessary to obtain the first For all virtual addresses corresponding to the physical address, obtain the meta information table corresponding to the first storage space according to the identifier of the first storage space in the first physical address, and then query the first physical address in the meta information table according to the first physical address address, and count the number of virtual addresses in the virtual address set to obtain the number of virtual addresses pointing to the first physical address. Since only the mapping relationship between the physical address of the storage block in the first storage space and the virtual address corresponding to the physical address is stored in the meta information table corresponding to the first storage space, only the identification information corresponding to the first storage space needs to be Traversing the records related to the physical address in the first storage space in the meta information table does not need to traverse the records related to the physical address in the entire hard disk. Therefore, it takes less time to query the meta information table corresponding to the first storage space, which can improve the acquisition time. The efficiency of the reference count and virtual address set corresponding to the storage block.

Optionally, after the first data is successfully written into the hard disk, when the data storage device writes the second data into the hard disk, as shown in FIG. 6 in conjunction with FIG. 3 , the data storage method provided by the embodiment of the present application further includes: S610 -S630.

S610. The data storage device determines whether the second data is the same as the first data.

The above-mentioned method for determining whether the second data is the same as the first data may be as follows: the data storage device calculates the fingerprint information corresponding to the second data (for example: the hash value corresponding to the second data) according to the second data, and then converts the second data to The corresponding fingerprint information is compared with the fingerprint information corresponding to the first data, if the fingerprint information corresponding to the second data is completely the same as the fingerprint information corresponding to the first data, then the second data is the same as the first data; If the fingerprint information is not completely the same as the fingerprint information corresponding to the first data, then the second data is different from the first data.

Optionally, other methods may also be used to compare the second data with the first data. In this embodiment of the present application, the method for determining whether the second data is the same as the first data is not limited.

When the above-mentioned second data is data that has not been written on the hard disk, write the second data into the storage block in the hard disk, and the method of writing the second data can refer to the writing described in S310-S340 in the above-mentioned embodiment. The process of inputting the first data; when the above-mentioned second data is the same as the above-mentioned first data, execute S620.

S620. If the second data is the same as the first data, the data storage device records the mapping from the second virtual address to the first physical address in the forward mapping table.

It should be understood that the second virtual address is a virtual address corresponding to the second data, and the second virtual address points to the first physical address.

The above-mentioned recording of the second virtual address and the first physical address in the forward mapping table is shown in Table 3. For the specific implementation process, refer to the detailed description of S330 above, which will not be repeated here.

S630. The data storage device records the second virtual address corresponding to the first physical address in the meta information table.

Optionally, the aforementioned recording of the second virtual address corresponding to the first physical address in the meta information table may be adding the second virtual address to the set of virtual addresses corresponding to the first physical address in the meta information table.

As shown in Figure 5b, virtual address 1 points to physical address 1, virtual address 2 also points to physical address 1, and virtual address 10 points to physical address 10, wherein both physical address 1 and physical address 10 belong to the first storage space, thus, the first The meta information table corresponding to a storage space may be shown in Table 6 below, where physical address 1 corresponds to virtual address 1 and virtual address 2, and physical address 10 corresponds to virtual address 10.

Table 6

In the data storage method provided by the embodiment of the present application, when the data storage device writes data to the hard disk, it is determined whether the data is written data, and if the data is written data, the virtual address corresponding to the data is compared with The physical address corresponding to the data establishes a mapping relationship, and the data is not repeatedly written on the hard disk, so that the storage space of the hard disk can be saved.

Optionally, the data storage method provided in the embodiment of the present application is based on FIG. 6 , and as shown in FIG. 7 , the data storage method further includes: S710-S770.

S710. When performing garbage collection on the first storage space, the data storage device writes the first data in the first physical address into the second physical address.

At least one storage block in the second storage space indicated by the above-mentioned second physical address, wherein the second physical address includes an identifier of the second storage space and an offset address of the second physical address in the second storage space;

It should be noted that the above-mentioned first storage space and the second storage space are different storage spaces, that is to say, the above-mentioned second storage space is other storage spaces on the hard disk except the first storage space, which is not limited in this application. .

In the embodiment of the present application, the method for writing the first data in the first physical address into at least one storage block in the second storage space indicated by the second physical address is as follows: according to the storage space in the first physical address The identification information determines the storage space corresponding to the first physical address (that is, the first storage space), and then, in the first storage space, determines the storage block storing the first data according to the offset address in the first physical address, and in the first storage space reading the first data from the storage block; finally, writing the read first data into at least one storage block in the second storage space indicated by the second physical address.

The above-mentioned method of writing the first data into the second physical address is similar to the method of writing the first data into the first physical address in S320 , for details, refer to the above detailed description, and details will not be repeated here.

S720. The data storage device records the second physical address in the meta information table corresponding to the second storage space where the second physical address is located, and adds the first virtual address and the second virtual address to a virtual address set corresponding to the second physical address.

In the embodiment of the present application, the meta information table corresponding to the first storage space is obtained according to the first physical address, and then the virtual address set pointing to the first physical address is obtained in the meta information table according to the first physical address, and then, in A method for recording the second physical address in the meta information table of the second storage space, and adding the first virtual address and the second virtual address to the virtual address set corresponding to the second physical address.

S730. The data storage device records the mapping from the first virtual address to the second physical address in the forward mapping table.

The above method of recording the first virtual address and the second physical address in the forward mapping table can be similar to the method of recording the first virtual address and the first physical address in the forward mapping table in S330 above, and specifically refer to the above-mentioned embodiment Detailed description will not be repeated here.

S740. The data storage device records the mapping from the second virtual address to the second physical address in the forward mapping table.

For the above method of recording the second virtual address and the second physical address in the forward mapping table, refer to the detailed description of S330 above, which will not be repeated here.

S750. The data storage device deletes the first data in the first physical address.

S760. The data storage device deletes the first virtual address and the second virtual address in the virtual address set corresponding to the first physical address in the meta information table of the first storage space and the first physical address.

It should be understood that the above deletion of the first virtual address and the second virtual address in the virtual address set corresponding to the first physical address means deleting all virtual addresses in the virtual address set corresponding to the first physical address.

S770. The data storage device deletes the mapping from the first virtual address to the first physical address and the mapping from the second virtual address to the first physical address in the forward mapping table.

As shown in Figure 5c, after performing garbage collection on the first storage space corresponding to physical address 1, write all virtual addresses in the virtual address set corresponding to physical address 1 in the meta information table of the first storage space corresponding to physical address 1 to The virtual address set corresponding to physical address 2 in the meta information table of the second storage space, the meta information table corresponding to the second storage space is shown in Table 7 below, where virtual address 1 and virtual address 2 are respectively mapped to physical address 2 relation. In addition, delete the physical address 1 in the meta-information table corresponding to the first storage space and the virtual address set corresponding to the physical address 1, as shown in Table 8, there will be no physical address 1 in the meta-information table corresponding to the first storage space The associated virtual address.

Table 7

Table 8

Based on FIG. 6 , as shown in FIG. 8 , the data storage method provided by the embodiment of the present application further includes: S810-S830.

S810. The data storage device deletes the mapping from the first virtual address to the first physical address and the mapping from the second virtual address to the first physical address in the forward mapping table.

S820. The data storage device deletes the first virtual address and the second virtual address in the virtual address set corresponding to the first physical address in the meta information table of the first storage space and the first physical address.

The above method of deleting the first physical address in the meta information table of the first storage space and the first virtual address and the second virtual address in the virtual address set corresponding to the first physical address is the same as the method of deleting the first storage space in S760 above. The first physical address in the meta-information table is similar to the first virtual address and the second virtual address in the virtual address set corresponding to the first physical address. For details, please refer to the above detailed description, which will not be repeated here.

S830. The data storage device deletes the first data in the first physical address.

As shown in FIG. 5d, after the data storage device deletes the first data in the first physical address, delete physical address 1 and the virtual address set corresponding to physical address 1 in the meta information table corresponding to the first storage space, as shown in Table 8 As shown, there is no data related to the physical address in the meta information table corresponding to the first storage space.

Correspondingly, the embodiment of the present application provides a data storage device, the data storage device is used to execute the steps in the above data storage method, and the embodiment of the present application can divide the functional modules of the data storage device according to the above method example, For example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. The division of modules in the embodiment of this application is schematic, and is only a logical function division, and there may be other division methods in actual implementation.

In the case of dividing each functional module corresponding to each function, FIG. 9 shows a possible structural diagram of the data storage device involved in the above embodiment. As shown in FIG. 9 , the data storage device includes: a determination module 901 , a data writing module 902 and an information recording module 903 .

The determining module 901 is configured to determine the first physical address corresponding to the first data, for example, execute step S310 in the above method embodiment.

The data writing module 902 is configured to write the first data into the first physical address, for example, execute step S320 in the above method embodiment.

The information recording module 903 is configured to record the mapping from the first virtual address to the first physical address in the forward mapping table, for example, execute step S330 in the above method embodiment.

The information recording module 903 is further configured to record the first physical address in the meta information table corresponding to the first storage space, and record the first virtual address corresponding to the first physical address in the meta information table corresponding to the first storage space, for example, execute Step S340 in the above method embodiment.

Optionally, the determination module 901 is configured to determine whether the second data is the same as the first data, for example, execute step S610 in the above method embodiment.

The above information recording module 903 is also configured to record the mapping from the second virtual address to the first physical address in the forward mapping table when the second data is the same as the first data, for example, perform step S620 in the above method embodiment .

The above information recording module 903 is configured to record the second virtual address corresponding to the first physical address in the meta information table, for example, execute step S630 in the above method embodiment.

Optionally, the embodiment of the present application provides a data storage device that further includes: a deletion module 904;

The data writing module 902 is further configured to write the first data in the first physical address into the second physical address when performing garbage collection on the first storage space, for example, execute step S710 in the above method embodiment.

The above-mentioned information recording module 903 is further configured to record the second physical address in the meta information table corresponding to the second storage space where the second physical address is located, and add the first virtual address and the first virtual address to the virtual address set corresponding to the second physical address. Two virtual addresses, for example, execute step S720 in the above method embodiment.

The above-mentioned information recording module 903 is also configured to record the mapping from the first virtual address to the second physical address and the mapping from the second virtual address to the second physical address in the forward mapping table, for example, execute steps S730, Step S740.

The deletion module 904 is configured to delete the first data in the first physical address, for example, execute step S750 in the above method embodiment.

The deletion module 904 is further configured to delete the first physical address in the meta information table of the first storage space and the first virtual address and the second virtual address in the virtual address set corresponding to the first physical address, for example, perform Step S760.

The deletion module 904 is also used to delete the mapping from the first virtual address to the first physical address and the mapping from the second virtual address to the first physical address in the forward mapping table, for example, execute step S770 and step S810 in the above method embodiment .

Each module of the above-mentioned data storage device can also be used to perform other actions in the above-mentioned method embodiment. All relevant content of each step involved in the above-mentioned method embodiment can be referred to the function description of the corresponding functional module, and will not be repeated here.

In the case of using an integrated unit, a schematic structural diagram of the data storage device provided in the embodiment of the present application is shown in FIG. 10 . In FIG. 10 , the data storage device includes: a processing module 1001 and a communication module 1002 . The processing module 1001 is used to control and manage the actions of the data storage device, for example, to execute the steps performed by the determination module 901, the write data module 902, the information recording module 903 and the deletion module 904, and/or to execute the techniques described herein other processes. The communication module 1002 is used to support the interaction between the data storage device and other devices. As shown in FIG. data and second data etc.

Wherein, the processing module 1001 may be a processor or a controller, for example, the processor 202 in the main controller 201 in FIG. 2 . The communication module 1002 may be a transceiver, an RF circuit, or a communication interface, etc., such as the host interface 204 in the main controller 201 and/or the channel controller 203 in the main controller 201 in FIG. 2 . The storage module 1003 may be a memory, such as the memory chip 205 in FIG. 2 .

In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using a software program, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on the computer, all or part of the processes or functions according to the embodiments of the present application will be generated. The computer can be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored on or transmitted from one computer-readable disk to another computer-readable disk, for example, the computer instructions may be transmitted from a website site, computer, server, or data center by wire (such as Coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (such as infrared, wireless, microwave, etc.) to another website site, computer, server or data center. The computer-readable hard disk may be any available medium that can be accessed by a computer, or a data storage device such as a server or a data center integrated with one or more available media. The available medium may be a magnetic medium (for example, a floppy disk, a magnetic disk, a magnetic tape), an optical medium (for example, a digital video disc (digital video disc, DVD)), or a semiconductor medium (for example, a solid state drive (solid state drives, SSD)), etc. .

Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of the description, only the division of the above-mentioned functional modules is used as an example for illustration. In practical applications, the above-mentioned functions can be allocated according to needs It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. For the specific working process of the above-described system, device, and unit, reference may be made to the corresponding process in the foregoing method embodiments, and details are not repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be Incorporation may either be integrated into another system, or some features may be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to realize the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable hard disk. Based on this understanding, the essence of the technical solution of this application or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a hard disk. Several instructions are included to make a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned hard disks include: various media capable of storing program codes such as flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk.

The above is only a specific implementation of the application, but the protection scope of the application is not limited thereto, and any changes or replacements within the technical scope disclosed in the application should be covered within the protection scope of the application . Therefore, the protection scope of the present application should be determined by the protection scope of the claims.

Claims

A data storage method, characterized in that, comprising:

determining a first physical address corresponding to the first data, where the first physical address is used to indicate at least one storage block in the first storage space; writing the first data into the first physical address;

Recording the mapping from the first virtual address to the first physical address in the forward mapping table, the virtual address of the first data is the first virtual address, and the first physical address includes an identifier of the first storage space and an offset address of the first physical address in the first storage space;

Recording the first physical address in a meta information table corresponding to the first storage space, and recording the first virtual address corresponding to the first physical address in the meta information table.
The method according to claim 1, further comprising:

determining whether the second data is the same as the first data, the second data is data to be written;

In the case that the second data is the same as the first data, recording the mapping from the second virtual address to the first physical address in the forward mapping table, the virtual address of the second data is the the second virtual address;

Recording the second virtual address corresponding to the first physical address in the meta information table.
The method according to claim 2, wherein the meta-information table includes a virtual address set corresponding to the first physical address; the first virtual address and the second virtual address are added to the virtual address set Two virtual addresses.
The method according to claim 3, further comprising:

When performing garbage collection on the first storage space, writing the first data in the first physical address into a second physical address;

Record the second physical address in the meta information table corresponding to the second storage space where the second physical address is located, and add the first virtual address and the set of virtual addresses corresponding to the second physical address the second virtual address;

Recording the mapping from the first virtual address to the second physical address and the mapping from the second virtual address to the second physical address in the forward mapping table;

deleting the first data in the first physical address;

deleting the first virtual address and the second virtual address in the virtual address set corresponding to the first physical address in the meta information table of the first storage space and the first physical address;

deleting the mapping from the first virtual address to the first physical address and the mapping from the second virtual address to the first physical address in the forward mapping table.
The method according to any one of claims 1-4, characterized in that,

The storage space is a persistent log storage space, and the persistent log storage space supports writing data in an append writing manner.
A data storage device, characterized by comprising: a determination module, a data writing module and an information recording module;

The determination module is configured to determine a first physical address corresponding to the first data, and the first physical address is used to indicate at least one storage block in the first storage space;

The data writing module is configured to write the first data into the first physical address;

The information recording module is configured to record the mapping from the first virtual address to the first physical address in a forward mapping table, wherein the virtual address of the first data is the first virtual address, and the first A physical address includes an identifier of the first storage space and an offset address of the first physical address in the first storage space;

The information recording module is further configured to record the first physical address in the meta information table corresponding to the first storage space, and record the first physical address corresponding to the first physical address in the meta information table. a virtual address.
The data storage device according to claim 6, characterized in that,

The determination module is also used to determine whether the second data is the same as the first data, and the second data is data to be written;

The information recording module is further configured to record the mapping from the second virtual address to the first physical address in the forward mapping table when the second data is the same as the first data ;

The information recording module is further configured to record the second virtual address corresponding to the first physical address in the meta information table.
The data storage device according to claim 7, wherein the meta information table includes a virtual address set corresponding to the first physical address; the virtual address set is added with the first virtual address and the the second virtual address.
The data storage device according to claim 8, further comprising: a deletion module;

The data writing module is further configured to write the first data in the first physical address into a second physical address when performing garbage collection on the first storage space;

The information recording module is further configured to record the second physical address in the meta information table corresponding to the second storage space where the second physical address is located, and record the second physical address in the virtual address set corresponding to the second physical address adding said first virtual address and said second virtual address;

The information recording module is further configured to record the mapping from the first virtual address to the second physical address and the mapping from the second virtual address to the second physical address in the forward mapping table;

The deletion module is configured to delete the first data in the first physical address, and delete the correspondence between the first physical address and the first physical address in the meta information table of the first storage space the first virtual address and the second virtual address in the virtual address set; and delete the mapping from the first virtual address to the first physical address and the second virtual address in the forward mapping table A mapping from a virtual address to the first physical address.
The data storage device according to any one of claims 6-9, characterized in that,

The storage space is a persistent log storage space, and the persistent log storage space supports writing data in an append writing manner.
A storage device, characterized in that it includes a memory and a processor, the memory is coupled to the processor; the memory is used to store computer program codes, and the computer program codes include computer instructions; when the computer instructions are When the processor is executed, the processor is made to execute the method according to any one of claims 1-5.
A computer storage medium, characterized by comprising computer instructions, and when the computer instructions are run on a computing device, the computing device is made to execute the method according to any one of claims 1 to 5.