CN114741326A - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN114741326A CN114741326A CN202210278389.0A CN202210278389A CN114741326A CN 114741326 A CN114741326 A CN 114741326A CN 202210278389 A CN202210278389 A CN 202210278389A CN 114741326 A CN114741326 A CN 114741326A
- Authority
- CN
- China
- Prior art keywords
- data
- storage
- space
- partitions
- target storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 40
- 238000005192 partition Methods 0.000 claims abstract description 383
- 238000011084 recovery Methods 0.000 claims abstract description 117
- 238000000034 method Methods 0.000 claims description 11
- 238000004064 recycling Methods 0.000 claims description 10
- 238000004590 computer program Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 11
- 239000007787 solid Substances 0.000 description 8
- 238000013500 data storage Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000007792 addition Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
- G06F12/023—Free address space management
- G06F12/0253—Garbage collection, i.e. reclamation of unreferenced memory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0652—Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
An embodiment of the present specification provides a data processing method and an apparatus, wherein the data processing method includes: determining at least two storage partitions of a target storage space and data volume stored in the at least two storage partitions, determining space utilization rate of the target storage space according to the data volume, determining storage partition utilization rate of the target storage space according to the use states of the at least two storage partitions, determining data recovery speed of first type data in the target storage partition according to the space utilization rate and the storage partition utilization rate, and performing recovery processing on the first type data according to the data recovery speed, wherein the target storage partition is one of the at least two storage partitions, and the use state of the target storage partition is adjusted according to a recovery result.
Description
Technical Field
The embodiment of the specification relates to the technical field of computers, in particular to a data processing method.
Background
A partitioned Namespace Solid State Disk (ZNS SSD), as a novel nvme (nvm express) SSD, has been adapted and applied by various internet vendors by virtue of efficient protocol interaction and good performance. The partition namespace solid state disk has the great advantages that an interaction protocol with upper-layer application is standardized, the solid state disk is divided into partitions, partition information is opened to the upper-layer application, the application combines with self projects to carry out partition storage, project data with the same life cycle are written into the same partition, and meanwhile an end-to-end fusion garbage recycling strategy is matched, so that the high performance and the low cost of a storage system are achieved.
The solid state disk of the partition name space provides a recycle bin function, and is beneficial to recovering partial data under emergency conditions of mistakenly deleting data by a user, software bugs and the like, and the disaster tolerance capability of the system is improved. However, if the recovery speed of the recycle bin data cannot be reasonably controlled at present, the system may cause idle and waste of the storage space of the hard disk, and therefore, an effective method is urgently needed to solve the problem.
Disclosure of Invention
In view of this, the embodiments of the present specification provide a data processing method. One or more embodiments of the present specification also relate to a data processing apparatus, a computing device, a computer-readable storage medium, and a computer program, so as to solve the technical deficiencies of the prior art.
According to a first aspect of embodiments herein, there is provided a data processing method including:
determining at least two storage partitions of a target storage space and data quantity stored in the at least two storage partitions, and determining the space utilization rate of the target storage space according to the data quantity;
determining the utilization rate of the storage partitions of the target storage space according to the use states of the at least two storage partitions;
determining the data recovery speed of first type data in a target storage partition according to the space utilization rate and the storage partition utilization rate, and performing recovery processing on the first type data according to the data recovery speed, wherein the target storage partition is one of the at least two storage partitions;
and adjusting the use state of the target storage partition according to the recovery result.
Optionally, the determining at least two memory partitions of the target memory space and the amount of data stored in the at least two memory partitions includes:
determining at least two memory partitions of a target memory space;
a first amount of data of a first type of data stored within the at least two memory partitions and a second amount of data of a second type of data are determined.
Optionally, the determining the space utilization of the target storage space according to the data amount includes:
adding a first data volume of the first type of data stored in the at least two storage partitions and a second data volume of the second type of data;
and determining the ratio of the summation processing result to the space capacity of the target storage space, and determining the ratio as the space utilization rate of the target storage space.
Optionally, the determining a first data amount of a first type of data and a second data amount of a second type of data stored in the at least two memory partitions includes:
scanning the storage partition table of the target storage space to obtain a first data length of first type data in different storage partitions and a second data length of second type data;
and determining a first data volume of the first type of data and a second data volume of the second type of data stored in the at least two memory partitions according to the first data length and the second data length.
Optionally, the determining the storage partition usage rate of the target storage space according to the usage states of the at least two storage partitions includes:
determining a first number of storage partitions in an idle state and a second number of storage partitions in a reclaimable state of the at least two storage partitions;
and determining the utilization rate of the storage partitions of the target storage space according to the first quantity, the second quantity and the total quantity of the storage partitions contained in the target storage space.
Optionally, the determining the usage rate of the memory partitions in the target memory space according to the first number, the second number, and the total amount of the memory partitions included in the target memory space includes:
adding the first number and the second number;
and determining the utilization rate of the storage partitions of the target storage space according to the ratio of the addition processing result to the total amount of the storage partitions contained in the target storage space.
Optionally, the determining a data recovery speed of the first type of data in the target storage partition according to the space utilization and the storage partition utilization includes:
if the space utilization rate is larger than or equal to a first preset threshold value, determining that the data recovery speed of the first type of data in the target storage partition is a first recovery speed;
and if the space utilization rate is smaller than the first preset threshold and is larger than or equal to a second preset threshold, determining that the data recovery speed of the first type of data in the target storage partition is a second recovery speed, wherein the first recovery speed is larger than the second recovery speed.
Optionally, the data processing method further includes:
if the space utilization rate is smaller than the second preset threshold, judging whether the storage partition utilization rate is larger than or equal to a first preset threshold;
if so, determining the data recovery speed of the first type of data in the target storage partition as a first recovery speed;
and if not, determining that the data recovery speed of the first type data in the target storage partition is the second recovery speed.
Optionally, the first type of data is recycle bin data;
correspondingly, the recovering the first type data according to the data recovering speed includes:
and converting the first type data in the target storage partition into third type data according to the data recovery speed, wherein the third type data is invalid data.
Optionally, the adjusting the use state of the target storage partition according to the recycling result includes:
under the condition that the data contained in the target storage partition is determined to be the third type data, erasing the data in the target storage partition;
and adjusting the use state of the target storage partition to be an idle state under the condition that the erasing is completed.
According to a second aspect of embodiments herein, there is provided a data processing apparatus comprising:
the device comprises a first determination module, a second determination module and a third determination module, wherein the first determination module is configured to determine at least two storage partitions of a target storage space and data quantity stored in the at least two storage partitions, and determine the space utilization rate of the target storage space according to the data quantity;
a second determination module configured to determine the storage partition usage rate of the target storage space according to the usage states of the at least two storage partitions;
the recovery module is configured to determine a data recovery speed of first type data in a target storage partition according to the space utilization rate and the storage partition utilization rate, and recover the first type data according to the data recovery speed, wherein the target storage partition is one of the at least two storage partitions;
and the adjusting module is configured to adjust the use state of the target storage partition according to the recycling result.
According to a third aspect of embodiments herein, there is provided a computing device comprising:
a memory and a processor;
the memory is configured to store computer-executable instructions, and the processor is configured to execute the computer-executable instructions to implement the steps of any of the data processing methods.
According to a fourth aspect of embodiments herein, there is provided a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the steps of any one of the data processing methods.
According to a fifth aspect of embodiments herein, there is provided a computer program, wherein the computer program, when executed in a computer, causes the computer to perform the steps of the above-mentioned data processing method.
In an embodiment of the present specification, at least two storage partitions of a target storage space and data volumes stored in the at least two storage partitions are determined, a space utilization rate of the target storage space is determined according to the data volumes, a storage partition utilization rate of the target storage space is determined according to usage states of the at least two storage partitions, a data recovery speed of a first type of data in the target storage partition is determined according to the space utilization rate and the storage partition utilization rate, and the first type of data is recovered according to the data recovery speed, where the target storage partition is one of the at least two storage partitions, and the usage state of the target storage partition is adjusted according to a recovery result.
In the embodiment of the description, the data recovery speed of the first type data in the target storage partition is determined comprehensively through the space utilization rate and the storage partition utilization rate, so that the first type data in the target storage partition is recovered according to the data recovery speed, recovery processing of the first type data in the target storage partition according to a reasonable data recovery speed is facilitated, the target storage partition can be released in time, and the utilization rate of the storage partition in the target storage space is ensured.
Drawings
FIG. 1 is a flow chart of a data processing method provided by an embodiment of the present description;
FIG. 2a is a diagrammatic representation of a storage partition table in accordance with an embodiment of the present specification;
FIG. 2b is a schematic diagram of a statistical process provided by one embodiment of the present description;
FIG. 3a is a diagram illustrating a data storage ratio of a first target storage space according to an embodiment of the present disclosure;
FIG. 3b is a diagram illustrating a data storage ratio of a second target storage space provided in an embodiment of the present disclosure;
FIG. 4 is a flowchart illustrating a data processing method according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present specification;
fig. 6 is a block diagram of a computing device according to an embodiment of the present disclosure.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present description. This description may be implemented in many ways other than those specifically set forth herein, and those skilled in the art will appreciate that the present description is susceptible to similar generalizations without departing from the scope of the description, and thus is not limited to the specific implementations disclosed below.
The terminology used in the description of the one or more embodiments is for the purpose of describing the particular embodiments only and is not intended to be limiting of the description of the one or more embodiments. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present specification refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It will be understood that, although the terms first, second, etc. may be used herein in one or more embodiments to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first can also be referred to as a second and, similarly, a second can also be referred to as a first without departing from the scope of one or more embodiments of the present description. The word "if," as used herein, may be interpreted as "at … …" or "when … …" or "in response to a determination," depending on the context.
First, the noun terms to which one or more embodiments of the present specification relate are explained.
A stand-alone storage engine: in a distributed storage system, a functional node responsible for managing the storage of user data on a storage medium. Typically, a storage server has a storage node process that is responsible for managing multiple disks on the server.
ZNS disk: the disk provides a standard Zoned Namespace (ZNS) protocol, and the ZNS protocol is characterized in that the logical address space of the Namespace is divided into a plurality of zones, so that an interface for reading, writing and zone management is provided for users.
A Zone: the minimum management unit on the ZNS disk supports operations such as additional writing, random reading and the like, does not need to be erased integrally, and cannot be erased locally to be overwritten.
A recycle bin: after the user deletes the data, the user data is kept for a period of time under the condition that the storage space is sufficient, and the data is recovered for the user under the condition that the user deletes the data by mistake and the software bug is detected.
Data type: valid data, recycle bin data, invalid data.
In the present specification, a data processing method is provided, and the present specification relates to a data processing apparatus, a computing device, a computer-readable storage medium, and a computer program, which are described in detail one by one in the following embodiments.
Fig. 1 shows a flowchart of a data processing method according to an embodiment of the present specification, which specifically includes the following steps.
Specifically, the target storage space is a partitioned Namespace Solid State Disk (ZNS SSD). A storage partition, i.e., Zone; the data in the partition namespace solid state disk is stored in a partition mode, the partition namespace solid state disk can be divided into a plurality of storage partitions (zones), partition information is opened to an upper layer application, the upper layer application performs partition storage on the data by combining self requirements, and the data in the same life cycle are written into the same storage partitions.
The memory partition supports operations such as additional writing and random reading, but the data in the memory partition needs to be erased in whole and cannot be erased locally to be overwritten. Therefore, when there is recoverable data in a storage partition, if the recoverable data is not recovered, the data in the storage partition cannot be erased, so that the storage partition cannot be released, that is, the storage partition cannot be reused, and thus, space is left unused and wasted.
Based on this, the embodiments of the present specification may determine the space utilization rate of the target storage space according to the data amount stored in different storage partitions in the target storage space, so as to determine the recovery speed of the recoverable data in each storage partition according to the space utilization rate, thereby preventing the available Zone resources in the target storage space from being exhausted.
In specific implementation, determining at least two memory partitions of the target memory space and the amount of data stored in the at least two memory partitions includes:
determining at least two memory partitions of a target memory space;
a first amount of data of a first type of data stored within the at least two memory partitions and a second amount of data of a second type of data are determined.
Further, determining the space utilization rate of the target storage space according to the data volume includes:
adding a first data volume of the first type of data stored in the at least two storage partitions and a second data volume of the second type of data;
and determining the ratio of the sum processing result to the space capacity of the target storage space, and determining the ratio as the space utilization rate of the target storage space.
Specifically, each storage partition in the target storage space can store three types of data, namely valid data, recycle bin data and invalid data. After the user deletes the valid data, the valid data is converted into recycle bin data, the recycle bin data is recycled, and the recycle bin data is converted into invalid data.
The first type data is recycle bin data, and the second type data is valid data.
In practical application, a data water level driving strategy can be adopted to determine the recovery speed of the recycle bin data, the data water level consists of two parts of valid data and recycle bin data, and whether to trigger the recovery of the recycle bin data and the recovery speed can be determined by judging the proportion of the sum of the two parts of data and the whole disc capacity of the solid state hard disc in the partition name space.
Therefore, at least two storage partitions of the target storage space may be determined, then the data amount of the recycle bin data stored in each storage partition and the data amount of the valid data in the at least two storage partitions are determined, then the sum of the data amount of the recycle bin data in each storage partition and the data amount of the valid data is calculated to obtain a first summation result corresponding to each storage partition, and then the sum of the first summation results corresponding to each storage partition in the target storage space is calculated to obtain a second summation result; and finally, calculating the ratio of the second summation result to the space capacity of the target storage space to obtain the space utilization rate of the target storage space.
In specific implementation, determining a first data size of the first type of data and a second data size of the second type of data stored in the at least two memory partitions includes:
scanning the storage partition table of the target storage space to obtain a first data length of first type data in different storage partitions and a second data length of second type data;
and determining a first data volume of the first type of data and a second data volume of the second type of data stored in the at least two memory partitions according to the first data length and the second data length.
Specifically, a partition Table, i.e., Chunk Table, is stored.
A schematic diagram of a storage partition table provided in an embodiment of the present specification is shown in fig. 2 a. Since each storage partition includes a plurality of storage blocks, i.e., Chunk, the storage partition table includes the storage partitions in the target storage space, and the data type and data length stored in each storage block in each storage partition. Therefore, the data length of the valid data stored in different storage partitions in the target storage space and the data length of the recycle bin data can be obtained by scanning and counting the storage partition table, a specific counting process is shown as a schematic diagram in fig. 2b, a background counting task is received firstly, the storage partition table is traversed, whether the data obtained by traversing is valid data or not is determined, and if the data is valid data, the data length of the valid data is accumulated; if the effective data is not valid data, determining whether the effective data is the recycle bin data, if the effective data is the recycle bin data, accumulating the data length of the recycle bin data, if the effective data is not the recycle bin data or accumulating the data length of the recycle bin data of the valid data, judging whether traversal is finished, if the traversal is finished, outputting the total length of the valid data and/or the total length of the recycle bin data, and determining the data volume of the valid data in the target storage space and the data volume of the recycle bin data according to the total length.
In practical applications, the data amount may be determined according to the storage type of the data in the storage partition and the data length, for example, int type represents 4 bytes (Byte), and 1 Byte is 8 bits, that is, 1B is 8B.
And 104, determining the utilization rate of the storage partitions of the target storage space according to the use states of the at least two storage partitions.
Specifically, after the space utilization rate of the target storage space is determined through the foregoing process, the recovery speed of the recycle bin data can be determined based on the space utilization rate, but if the space utilization rate is only used as a determination standard for driving the recycle bin data recovery, the invalid data occupation ratio is too high, and the valid data and the recycle bin data occupation ratio are low, which results in a situation that the storage partition cannot be recovered in time, thereby causing waste of the storage partition.
Therefore, the embodiment of the present specification further determines the usage state of each storage partition in the target storage space, so as to determine the storage partition usage rate of the target storage space according to the usage state, and comprehensively determine the recycle rate of the recycle bin data according to the storage partition usage rate, that is, the aforementioned space usage rate, so that the recycle bin data of each storage partition can be recycled in time, and the partial storage partitions are subjected to data erasure and space release based on the recycle result, which is beneficial to ensuring the usage rate of the storage partitions in the target storage space.
In practical applications, the usage status of the storage partition includes, but is not limited to, an idle status, an open status, a closed status, an offline status, a recoverable status, a reserved status, and the like.
Wherein, the idle state, i.e. the unused state, can open the write; open state, i.e. Zone in open state, can write additionally; the closing state, namely after the Zone is full, the Zone can be closed, and after the Zone is closed, random reading and non-writing can be provided; the off-line state can be entered after the Zone is damaged, and the Zone can not be reused; the recoverable state means that the data stored in the representation storage partition are all invalid data, and the data can be erased integrally and can be recovered; the reserved state, that is, the storage partition is characterized as a standby state, and is only available if a preset condition is met, and is not available currently.
Therefore, if the storage partition is in an idle state, an open state or a recoverable state, the storage partition is available; and if the storage partition is in a closed state, an offline state or a reserved state, the storage partition is not available.
Therefore, determining the storage partition utilization rate of the target storage space according to the use state of each storage partition in the target storage space can be specifically realized by the following modes:
determining a first number of storage partitions in an idle state and a second number of storage partitions in a reclaimable state of the at least two storage partitions;
and determining the utilization rate of the storage partitions of the target storage space according to the first quantity, the second quantity and the total quantity of the storage partitions contained in the target storage space.
Further, determining the storage partition utilization rate of the target storage space according to the first quantity, the second quantity and the total storage partition amount contained in the target storage space, includes:
adding the first number and the second number;
and determining the utilization rate of the storage partitions of the target storage space according to the ratio of the addition processing result to the total amount of the storage partitions contained in the target storage space.
Specifically, the storage partition utilization rate of the target storage space is calculated, that is, the ratio of the number of used (unusable) storage partitions in the target storage space to the total number of storage partitions in the target storage space is calculated. The embodiment of the specification determines the number of the storage partitions in the target storage space in the usable state, then calculates the ratio of the number to the total number of the storage partitions in the target storage space, and takes the difference value between 1 and the ratio as the storage partition utilization rate of the target storage space.
In practical applications, as mentioned above, if a storage partition is in an idle state or a recoverable state, it represents that the storage partition is usable, i.e. in a usable state; and when the storage partition is in a closed state, an offline state or a reserved state, the storage partition is not usable, that is, is in an unusable state.
Therefore, the number of the storage partitions in the target storage space in the usable state, specifically, the first number of the storage partitions in the target storage space in the free state and the second number of the storage partitions in the recyclable state are determined, and then the storage partition usage of the target storage space can be determined by formula (1).
Storage partition utilization rate 1- (first number + second number)/storage partition total formula (1)
And the total amount of the storage partitions is the total amount of the storage partitions in the target storage space.
Or, if there is a storage partition in the open state in the target storage space, the storage partition is also in a usable state. Therefore, when determining the number of storage partitions in the target storage space in the usable state, in addition to determining the first number of storage partitions in the target storage space in the free state and the second number of storage partitions in the recyclable state, the third number of storage partitions in the open state may be determined, and then the first number, the second number, and the third number are summed, and then the ratio of the sum to the total number of storage partitions in the target storage space is determined, and the difference between 1 and the ratio is used as the storage partition usage rate of the target storage space.
Or, when the storage partition is in a closed state, an offline state or a reserved state, it represents that the storage partition is not usable. Therefore, the storage partition utilization rate of the target storage space is determined, the fourth number of the storage partitions in the target storage space in the closed state, the fifth number of the storage partitions in the offline state and the sixth number of the storage partitions in the reserved state can be determined, the fourth number, the fifth number and the sixth number are summed, the ratio of the summed result to the total number of the storage partitions in the target storage space is determined, and the ratio is determined as the storage partition utilization rate of the target storage space.
And 106, determining a data recovery speed of first type data in a target storage partition according to the space utilization rate and the storage partition utilization rate, and performing recovery processing on the first type data according to the data recovery speed, wherein the target storage partition is one of the at least two storage partitions.
Specifically, after the space utilization rate and the storage partition utilization rate are determined, the data recovery speed of recycle bin data in each storage partition can be comprehensively determined according to the space utilization rate and the storage partition utilization rate, so that the accuracy of the determination result of the data recovery speed is ensured.
After the data recovery speed of the recycle bin data is determined, the recycle bin data in each storage partition can be recovered according to the data recovery speed, and data in partial storage partitions can be erased integrally in time according to the recovery result, so that the partial storage partitions are released, and the utilization rate of the storage partitions in the target storage space is improved.
In specific implementation, determining the data recovery speed of the first type of data in the target storage partition according to the space utilization rate and the storage partition utilization rate includes:
if the space utilization rate is larger than or equal to a first preset threshold value, determining that the data recovery speed of the first type of data in the target storage partition is a first recovery speed;
if the space utilization rate is smaller than the first preset threshold and is larger than or equal to a second preset threshold, determining that the data recovery speed of the first type data in the target storage partition is a second recovery speed, wherein the first recovery speed is larger than the second recovery speed;
if the space utilization rate is smaller than the second preset threshold, judging whether the storage partition utilization rate is larger than or equal to a first preset threshold;
if so, determining the data recovery speed of the first type of data in the target storage partition as a first recovery speed;
and if not, determining that the data recovery speed of the first type data in the target storage partition is the second recovery speed.
Specifically, the first type of data is recycle bin data.
Since the memory partition in the target memory space stores data in the form of memory blocks, the data reclamation speed, i.e. the number of memory blocks reclaimed per unit time, for example, if the data reclamation speed is 3, it indicates that the reclamation station data stored in 3 memory blocks needs to be reclaimed per unit time. Further, since the recycle bin data is recycled, that is, the recycle bin data is converted into the invalid data, if the data recycling rate is 3, it indicates that the recycle bin data stored in the 3 storage blocks needs to be converted into the invalid data per unit time.
The storage partition only supports integral erasing, namely the data in the storage partition can be integrally erased under the condition that the data stored in the storage partition are all invalid data so as to release the storage partition, so that the storage partition can be reused, and the utilization rate of the storage partition of the target storage space is improved. The data reclamation speed of the data of the recycle bin determines whether the storage partitions can be released in time and reused.
Therefore, after determining the space usage rate and the storage partition usage rate, the embodiments of the present disclosure may determine the data reclamation rate of the recycle bin data in the target storage partition based on the two parameters. The space utilization rate is higher, it indicates that the data quantity stored in the target storage space is more, and indicates that the storage space usable in the target storage space is less, that is, a part of the storage partitions needs to be released in time for data storage; the storage partition utilization rate represents a ratio of the number of unusable storage partitions in the target storage space to the total number of storage partitions, and a larger storage partition utilization rate indicates that less usable storage partitions are in the target storage space.
Based on this, the embodiments of the present disclosure may compare the space usage rate with a first preset threshold to determine a magnitude relationship between the space usage rate and the first preset threshold. If the space utilization rate is determined to be greater than or equal to the first preset threshold, it is indicated that the space utilization rate is high, a part of the storage partitions need to be released in time, and the condition that the storage partitions can be released is that all data stored in the storage partitions are invalid data, so that under the condition that the recycle bin data is stored in the storage partitions, the recycling speed of the recycle bin data needs to be increased, specifically, the speed of converting the recycle bin data into the invalid data (fast recycling) needs to be increased. The embodiment of the specification designates the speed of accelerating the recovery as a first recovery speed.
If the space utilization rate is determined to be less than the first preset threshold, whether the space utilization rate is greater than or equal to a second preset threshold can be further determined, if so, it can be determined that the space utilization rate in the target storage space is low, that is, enough storage partitions in a usable state exist in the target storage space, in this case, the used storage partitions do not need to be released quickly, and therefore, the recycle bin data can be converted into invalid data (slow recycle) according to a second recycle speed, wherein the first recycle speed is greater than the second recycle speed.
If the space utilization rate is determined to be smaller than the second preset threshold, whether the storage partition utilization rate is larger than or equal to the first preset threshold needs to be further determined, if so, the storage partition utilization rate is indicated to be larger, and a part of the storage partitions need to be released in time, so that the recovery station data can be converted into invalid data at the first recovery speed (quick recovery).
If the storage partition utilization rate is determined to be less than the first preset threshold, it may be determined that the storage partition utilization rate in the target storage space is small, that is, there are enough storage partitions in the target storage space in a usable state, in this case, it is not necessary to quickly release the used storage partitions, and therefore, the recycle bin data may be converted into invalid data according to the second recycle speed (slow recycle).
In the embodiment of the description, the recovery speed of the recycle bin data in the target storage partition is determined comprehensively through the space utilization rate and the storage partition utilization rate, which is favorable for the accuracy of the determination result of the recovery speed.
In specific implementation, the first type data is recycle bin data; and recovering the first type data according to the data recovery speed, specifically, converting the first type data in the target storage partition into third type data according to the data recovery speed, wherein the third type data is invalid data.
Specifically, the first type of data is recycle bin data, and the third type of data is invalid data.
And recovering the recycle bin data according to the data recovery speed, specifically converting the recycle bin data into invalid data according to the data recovery speed.
After the recycle bin data in the target storage partition are all converted into invalid data, if valid data still exist in the target storage partition, the valid data can be moved to other storage partitions, so that the invalid data of the target storage partition can be erased integrally, and the target storage partition can be released in time.
And step 108, adjusting the use state of the target storage partition according to the recovery result.
When the method is implemented specifically, the adjusting the use state of the target storage partition according to the recovery result comprises the following steps:
under the condition that the data contained in the target storage partition is determined to be the third type data, erasing the data in the target storage partition;
and adjusting the use state of the target storage partition to be an idle state under the condition that the erasing is completed.
Specifically, as described above, when the data in the target storage partition is all invalid data, the data in the target storage partition may be erased as a whole, and after the erasure, because the data is not stored in the target storage partition, the target storage partition may be released and its state may be adjusted to an idle state, so as to indicate that the target storage partition is usable.
A first schematic diagram of a data storage ratio of a target storage space provided by an embodiment of the present specification is shown in fig. 3a, invalid data stored in the target storage space occupies 10% of the total amount of the space, recycle bin data occupies 60% of the total amount of the space, valid data occupies 20% of the total amount of the space, and a storage partition utilization rate of the target storage space is 90%.
A second example of a data storage ratio of a target storage space provided by the embodiment of this specification is shown in fig. 3b, and the ratio of the storage partition utilization rate and the data amount of different types of data to the total space amount shown in fig. 3b is changed relative to fig. 3a, where the recycle bin data to the total space amount has a value of 55%, the invalid data to the total space amount has a value of 5%, and the storage partition utilization rate has a value of 80%. The reason for the change is that the invalid data in the partial memory partition is erased in its entirety and the partial memory partition is released, so that the usage rate of the memory partition, the invalid data and the data volume of the recycle bin data in the whole target memory space are all reduced.
In the embodiment of the present disclosure, if the recycle rate of the recycle bin data is determined only by referring to the space usage rate, an invalid data hole may occur in the storage partition, so that the storage partition cannot be released. Therefore, the embodiment of the present specification considers not only the space utilization factor but also the storage partition utilization rate as one of the factors for driving the recycle bin data recycle. The difference between the utilization rate of the storage partitions and the utilization rate of the space reflects the occupation rate of the invalid data, so that the occupation rate of the invalid data can be considered as one of the factors for driving the recovery of the data of the recovery station by considering the utilization rate of the storage partitions, the utilization rate of the space of the target storage space is reflected more truly, and the problem that the storage partitions cannot be released in time when the invalid data occupy a large number of storage partitions due to excessive invalid data can be solved.
In an embodiment of the present specification, at least two storage partitions of a target storage space and data volumes stored in the at least two storage partitions are determined, a space utilization rate of the target storage space is determined according to the data volumes, a storage partition utilization rate of the target storage space is determined according to usage states of the at least two storage partitions, a data recovery speed of a first type of data in the target storage partition is determined according to the space utilization rate and the storage partition utilization rate, and the first type of data is recovered according to the data recovery speed, where the target storage partition is one of the at least two storage partitions, and the usage state of the target storage partition is adjusted according to a recovery result.
In the embodiment of the description, the data recovery speed of the first type data in the target storage partition is determined comprehensively through the space utilization rate and the storage partition utilization rate, so that the first type data in the target storage partition is recovered according to the data recovery speed, recovery processing of the first type data in the target storage partition according to a reasonable data recovery speed is facilitated, the target storage partition can be released in time, and the utilization rate of the storage partition in the target storage space is ensured.
The following describes the data processing method further by taking an application of the data processing method provided in this specification in an actual scene as an example, with reference to fig. 4. Fig. 4 shows a flowchart of a processing procedure of a data processing method according to an embodiment of the present specification, which specifically includes the following steps.
At step 402, at least two memory partitions of a target memory space are determined.
In step 404, a first amount of valid data stored in the at least two storage partitions and a second amount of recycle bin data are determined.
In step 410, a first number of storage partitions in an idle state and a second number of storage partitions in a reclaimable state are determined for at least two storage partitions.
And step 414, determining the utilization rate of the storage partition of the target storage space according to the ratio of the summation processing result to the total amount of the storage partition contained in the target storage space.
In step 416, it is determined whether the space utilization is greater than or equal to a first predetermined threshold.
If yes, go to step 418; if not, go to step 420.
In step 418, the data reclamation rate for the recycle bin data in the target storage partition is determined to be the first reclamation rate.
In step 420, it is determined whether the space utilization is greater than or equal to a second predetermined threshold.
If yes, go to step 422; if not, go to step 424.
If yes, go to step 418; if not, go to step 422.
At step 428, if the data contained in the target memory partition is determined to be invalid data, the data in the target memory partition is erased.
And step 430, adjusting the use state of the target storage partition to be an idle state under the condition that the erasing is completed.
In the embodiment of the description, the data recovery speed of the recycle bin data in the target storage partition is determined comprehensively through the space utilization rate and the storage partition utilization rate, so that the recycle bin data in the target storage partition is recovered according to the data recovery speed, recovery processing of the recycle bin data in the target storage partition according to a reasonable data recovery speed is facilitated, the target storage partition can be released in time, and the utilization rate of the storage partition in the target storage space is ensured.
Corresponding to the above method embodiment, the present specification further provides an embodiment of a data processing apparatus, and fig. 5 shows a schematic structural diagram of a data processing apparatus provided in an embodiment of the present specification. As shown in fig. 5, the apparatus includes:
a first determining module 502 configured to determine at least two memory partitions of a target memory space and data amounts stored in the at least two memory partitions, and determine a space usage rate of the target memory space according to the data amounts;
a second determining module 504, configured to determine the usage rate of the storage partition of the target storage space according to the usage states of the at least two storage partitions;
a recovery module 506, configured to determine a data recovery speed of a first type of data in a target storage partition according to the space utilization rate and the storage partition utilization rate, and perform recovery processing on the first type of data according to the data recovery speed, where the target storage partition is one of the at least two storage partitions;
an adjusting module 508 configured to adjust the usage status of the target storage partition according to the reclamation result.
Optionally, the first determining module 502 is further configured to:
determining at least two memory partitions of a target memory space;
a first amount of data of a first type of data stored within the at least two memory partitions and a second amount of data of a second type of data are determined.
Optionally, the first determining module 502 is further configured to:
adding a first data volume of the first type data stored in the at least two storage partitions and a second data volume of the second type data;
and determining the ratio of the summation processing result to the space capacity of the target storage space, and determining the ratio as the space utilization rate of the target storage space.
Optionally, the first determining module 502 is further configured to:
scanning the storage partition table of the target storage space to obtain a first data length of first type data in different storage partitions and a second data length of second type data;
and determining a first data volume of the first type of data and a second data volume of the second type of data stored in the at least two memory partitions according to the first data length and the second data length.
Optionally, the second determining module 504 is further configured to:
determining a first number of storage partitions in an idle state and a second number of storage partitions in a reclaimable state of the at least two storage partitions;
and determining the utilization rate of the storage partitions in the target storage space according to the first quantity, the second quantity and the total quantity of the storage partitions in the target storage space.
Optionally, the second determining module 504 is further configured to:
adding the first number and the second number;
and determining the utilization rate of the storage partitions of the target storage space according to the ratio of the addition processing result to the total amount of the storage partitions contained in the target storage space.
Optionally, the recycling module 506 is further configured to:
if the space utilization rate is larger than or equal to a first preset threshold value, determining that the data recovery speed of the first type of data in the target storage partition is a first recovery speed;
and if the space utilization rate is smaller than the first preset threshold and is larger than or equal to a second preset threshold, determining that the data recovery speed of the first type of data in the target storage partition is a second recovery speed, wherein the first recovery speed is larger than the second recovery speed.
Optionally, the recycling module 506 is further configured to:
if the space utilization rate is smaller than the second preset threshold, judging whether the storage partition utilization rate is larger than or equal to a first preset threshold;
if so, determining the data recovery speed of the first type of data in the target storage partition as a first recovery speed;
and if not, determining that the data recovery speed of the first type data in the target storage partition is the second recovery speed.
Optionally, the first type of data is recycle bin data;
accordingly, the recycling module 506 is further configured to:
and converting the first type data in the target storage partition into third type data according to the data recovery speed, wherein the third type data is invalid data.
Optionally, the adjusting module 508 is further configured to:
under the condition that the data contained in the target storage partition is determined to be the third type data, erasing the data in the target storage partition;
and adjusting the use state of the target storage partition to be an idle state under the condition that the erasing is completed.
The above is a schematic configuration of a data processing apparatus of the present embodiment. It should be noted that the technical solution of the data processing apparatus and the technical solution of the data processing method belong to the same concept, and details that are not described in detail in the technical solution of the data processing apparatus can be referred to the description of the technical solution of the data processing method.
FIG. 6 illustrates a block diagram of a computing device 600 provided in accordance with one embodiment of the present description. The components of the computing device 600 include, but are not limited to, a memory 610 and a processor 620. The processor 620 is coupled to the memory 610 via a bus 630 and a database 650 is used to store data.
Computing device 600 also includes access device 640, access device 640 enabling computing device 600 to communicate via one or more networks 660. Examples of such networks include the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the internet. Access device 640 may include one or more of any type of network interface (e.g., a Network Interface Card (NIC)) whether wired or wireless, such as an IEEE802.11 Wireless Local Area Network (WLAN) wireless interface, a worldwide interoperability for microwave access (Wi-MAX) interface, an ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a bluetooth interface, a Near Field Communication (NFC) interface, and so forth.
In one embodiment of the present description, the above-described components of computing device 600, as well as other components not shown in FIG. 6, may also be connected to each other, such as by a bus. It should be understood that the block diagram of the computing device architecture shown in FIG. 6 is for purposes of example only and is not limiting as to the scope of the present description. Those skilled in the art may add or replace other components as desired.
Computing device 600 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., tablet computer, personal digital assistant, laptop computer, notebook computer, netbook, etc.), mobile phone (e.g., smartphone), wearable computing device (e.g., smartwatch, smart glasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or PC. Computing device 600 may also be a mobile or stationary server.
Wherein the processor 620 is configured to execute computer-executable instructions that, when executed by the processor, implement the steps of the data processing method described above.
The above is an illustrative scheme of a computing device of the present embodiment. It should be noted that the technical solution of the computing device and the technical solution of the data processing method belong to the same concept, and details that are not described in detail in the technical solution of the computing device can be referred to the description of the technical solution of the data processing method.
An embodiment of the present specification also provides a computer-readable storage medium storing computer-executable instructions, which when executed by a processor, implement the steps of the data processing method described above.
The above is an illustrative scheme of a computer-readable storage medium of the present embodiment. It should be noted that the technical solution of the storage medium belongs to the same concept as the technical solution of the data processing method, and details that are not described in detail in the technical solution of the storage medium can be referred to the description of the technical solution of the data processing method.
An embodiment of the present specification further provides a computer program, wherein when the computer program is executed in a computer, the computer is caused to execute the steps of the data processing method.
The above is an illustrative scheme of a computer program of the present embodiment. It should be noted that the technical solution of the computer program and the technical solution of the data processing method belong to the same concept, and details that are not described in detail in the technical solution of the computer program can be referred to the description of the technical solution of the data processing method.
The foregoing description of specific embodiments has been presented for purposes of illustration and description. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The computer instructions comprise computer program code which may be in the form of source code, object code, an executable file or some intermediate form, or the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer-readable medium may contain suitable additions or subtractions depending on the requirements of legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer-readable media may not include electrical carrier signals or telecommunication signals in accordance with legislation and patent practice.
It should be noted that, for the sake of simplicity, the foregoing method embodiments are described as a series of acts, but those skilled in the art should understand that the present embodiment is not limited by the described acts, because some steps may be performed in other sequences or simultaneously according to the present embodiment. Further, those skilled in the art should also appreciate that the embodiments described in this specification are preferred embodiments and that acts and modules referred to are not necessarily required for an embodiment of the specification.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
The preferred embodiments of the present specification disclosed above are intended only to aid in the description of the specification. Alternative embodiments are not exhaustive and do not limit the invention to the precise embodiments described. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the embodiments and the practical application, to thereby enable others skilled in the art to best understand and utilize the embodiments. The specification is limited only by the claims and their full scope and equivalents.
Claims (13)
1. A method of data processing, comprising:
determining at least two storage partitions of a target storage space and data quantity stored in the at least two storage partitions, and determining the space utilization rate of the target storage space according to the data quantity;
determining the utilization rate of the storage partitions of the target storage space according to the use states of the at least two storage partitions;
determining the data recovery speed of first type data in a target storage partition according to the space utilization rate and the storage partition utilization rate, and performing recovery processing on the first type data according to the data recovery speed, wherein the target storage partition is one of the at least two storage partitions;
and adjusting the use state of the target storage partition according to the recovery result.
2. The data processing method of claim 1, the determining at least two memory partitions of the target memory space and an amount of data stored within the at least two memory partitions, comprising:
determining at least two memory partitions of a target memory space;
a first amount of data of a first type of data stored within the at least two memory partitions and a second amount of data of a second type of data are determined.
3. The data processing method of claim 2, the determining the space usage of the target storage space according to the amount of data, comprising:
adding a first data volume of the first type of data stored in the at least two storage partitions and a second data volume of the second type of data;
and determining the ratio of the summation processing result to the space capacity of the target storage space, and determining the ratio as the space utilization rate of the target storage space.
4. The data processing method of claim 2, the determining a first amount of data of a first type of data and a second amount of data of a second type of data stored within the at least two memory partitions, comprising:
scanning the storage partition table of the target storage space to obtain a first data length of first type data in different storage partitions and a second data length of second type data;
and determining a first data volume of the first type of data and a second data volume of the second type of data stored in the at least two memory partitions according to the first data length and the second data length.
5. The data processing method according to claim 1, wherein determining the storage partition utilization rate of the target storage space according to the usage states of the at least two storage partitions comprises:
determining a first number of storage partitions in an idle state and a second number of storage partitions in a reclaimable state of the at least two storage partitions;
and determining the utilization rate of the storage partitions of the target storage space according to the first quantity, the second quantity and the total quantity of the storage partitions contained in the target storage space.
6. The data processing method according to claim 5, wherein the determining the usage rate of the memory partition in the target memory space according to the first number, the second number, and the total amount of the memory partitions in the target memory space comprises:
adding the first number and the second number;
and determining the utilization rate of the storage partitions of the target storage space according to the ratio of the addition processing result to the total amount of the storage partitions contained in the target storage space.
7. The data processing method according to claim 1, wherein determining a data reclamation rate for a first type of data in a target storage partition according to the space usage rate and the storage partition usage rate comprises:
if the space utilization rate is larger than or equal to a first preset threshold value, determining that the data recovery speed of the first type of data in the target storage partition is a first recovery speed;
and if the space utilization rate is smaller than the first preset threshold and is larger than or equal to a second preset threshold, determining that the data recovery speed of the first type of data in the target storage partition is a second recovery speed, wherein the first recovery speed is larger than the second recovery speed.
8. The data processing method of claim 7, further comprising:
if the space utilization rate is smaller than the second preset threshold, judging whether the storage partition utilization rate is larger than or equal to a first preset threshold or not;
if so, determining the data recovery speed of the first type of data in the target storage partition as a first recovery speed;
if not, determining that the data recovery speed of the first type data in the target storage partition is the second recovery speed.
9. The data processing method of claim 1, the first type of data being recycle bin data;
correspondingly, the recovering the first type data according to the data recovering speed includes:
and converting the first type data in the target storage partition into third type data according to the data recovery speed, wherein the third type data is invalid data.
10. The data processing method according to claim 1 or 9, wherein said adjusting the usage status of the target storage partition according to the reclamation result comprises:
under the condition that the data contained in the target storage partition is determined to be the third type data, erasing the data in the target storage partition;
and adjusting the use state of the target storage partition to be an idle state under the condition that the erasing is completed.
11. A data processing apparatus comprising:
the device comprises a first determination module, a second determination module and a third determination module, wherein the first determination module is configured to determine at least two storage partitions of a target storage space and data quantity stored in the at least two storage partitions, and determine the space utilization rate of the target storage space according to the data quantity;
a second determination module configured to determine the storage partition usage rate of the target storage space according to the usage states of the at least two storage partitions;
the recovery module is configured to determine a data recovery speed of first type data in a target storage partition according to the space utilization rate and the storage partition utilization rate, and recover the first type data according to the data recovery speed, wherein the target storage partition is one of the at least two storage partitions;
and the adjusting module is configured to adjust the use state of the target storage partition according to the recycling result.
12. A computing device, comprising:
a memory and a processor;
the memory is for storing computer-executable instructions and the processor is for executing the computer-executable instructions, which when executed by the processor implement the steps of the data processing method of any one of claims 1 to 10.
13. A computer-readable storage medium storing computer-executable instructions which, when executed by a processor, implement the steps of the data processing method of any one of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210278389.0A CN114741326A (en) | 2022-03-21 | 2022-03-21 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210278389.0A CN114741326A (en) | 2022-03-21 | 2022-03-21 | Data processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114741326A true CN114741326A (en) | 2022-07-12 |
Family
ID=82278044
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210278389.0A Pending CN114741326A (en) | 2022-03-21 | 2022-03-21 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114741326A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070130442A1 (en) * | 2004-12-21 | 2007-06-07 | Samsung Electronics Co. Ltd. | Apparatus and Methods Using Invalidity Indicators for Buffered Memory |
| CN107506136A (en) * | 2017-08-07 | 2017-12-22 | 成都华为技术有限公司 | A kind of method and apparatus of garbage reclamation |
| CN110764704A (en) * | 2019-10-18 | 2020-02-07 | 浙江大华技术股份有限公司 | Environment variable writing method, storage medium and electronic device |
| CN111813343A (en) * | 2020-07-16 | 2020-10-23 | 济南浪潮数据技术有限公司 | Solid state disk garbage recovery method, system and related components |
-
2022
- 2022-03-21 CN CN202210278389.0A patent/CN114741326A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070130442A1 (en) * | 2004-12-21 | 2007-06-07 | Samsung Electronics Co. Ltd. | Apparatus and Methods Using Invalidity Indicators for Buffered Memory |
| CN107506136A (en) * | 2017-08-07 | 2017-12-22 | 成都华为技术有限公司 | A kind of method and apparatus of garbage reclamation |
| CN110764704A (en) * | 2019-10-18 | 2020-02-07 | 浙江大华技术股份有限公司 | Environment variable writing method, storage medium and electronic device |
| CN111813343A (en) * | 2020-07-16 | 2020-10-23 | 济南浪潮数据技术有限公司 | Solid state disk garbage recovery method, system and related components |
Non-Patent Citations (1)
| Title |
|---|
| 孟晓烜;司成祥;那文武;许鲁: "一种针对存储系统设计的应用级缓存回收策略", 《小型微型计算机系统》, 15 March 2010 (2010-03-15), pages 456 - 459 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2288975B1 (en) | Method for optimizing cleaning of maps in flashcopy cascades containing incremental maps | |
| US6622226B1 (en) | Method and system for using a mark-list for garbage collection | |
| CN101673243B (en) | Data storage device and method | |
| US20080082727A1 (en) | Header blocks for flash memory writes | |
| CN111007985B (en) | Compatible processing method, system and equipment for space recovery of storage system | |
| Luojie et al. | An improved analytic expression for write amplification in NAND flash | |
| CN103995855A (en) | Method and device for storing data | |
| CN103914360B (en) | Electronic device and data backup restoring method | |
| CN114138193B (en) | Data writing method, device and equipment for partition naming space solid state disk | |
| CN107665098B (en) | Information processing method, storage device, and computer storage medium | |
| CN103678337A (en) | Data eliminating method, device and system | |
| CN115421651A (en) | Data processing method of solid state disk, electronic device and medium | |
| CN105204783A (en) | Solid-state disk garbage recycling method based on data life cycle | |
| CN103914410B (en) | Storage device, electronic apparatus, and data access method | |
| CN104408126B (en) | A kind of persistence wiring method of database, device and system | |
| CN104246716B (en) | The processing method and equipment of memory space object | |
| CN114741326A (en) | Data processing method and device | |
| CN107688442B (en) | Virtual block management method for solid state disk | |
| WO2023124423A1 (en) | Storage space allocation method and apparatus, and terminal device and storage medium | |
| CN114625321A (en) | Data writing method and device | |
| CN113535086B (en) | Acceleration method for reconstruction in solid state disk | |
| CN114995756A (en) | Virtual disk space recovery method, device and medium | |
| CN115268767A (en) | Data processing method and device | |
| CN114579050A (en) | Method and device for processing compressed data | |
| CN113590032A (en) | Method, device and equipment for creating name space of solid state disk and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |