CN112783448A - Data storage method and system - Google Patents
Data storage method and system Download PDFInfo
- Publication number
- CN112783448A CN112783448A CN202110092469.2A CN202110092469A CN112783448A CN 112783448 A CN112783448 A CN 112783448A CN 202110092469 A CN202110092469 A CN 202110092469A CN 112783448 A CN112783448 A CN 112783448A
- Authority
- CN
- China
- Prior art keywords
- data
- flash memory
- solid state
- cold
- state disk
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 238000013500 data storage Methods 0.000 title claims abstract description 23
- 239000007787 solid Substances 0.000 claims abstract description 83
- 230000004044 response Effects 0.000 claims abstract description 47
- 230000008859 change Effects 0.000 claims description 31
- 238000004458 analytical method Methods 0.000 claims description 5
- 230000004048 modification Effects 0.000 claims description 5
- 238000012986 modification Methods 0.000 claims description 5
- 230000000903 blocking effect Effects 0.000 abstract description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000013403 standard screening design Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0607—Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Techniques For Improving Reliability Of Storages (AREA)
Abstract
The invention discloses a data storage method and a system, wherein the method comprises the following steps: receiving data written in the solid state disk, and acquiring the heat of the data from a host or determining the heat of the data by the solid state disk based on internal logic of firmware; reading the proportion configuration of cold and hot data of the solid state disk, and determining the data as hot data, temperature data or cold data based on the heat of the data and the proportion configuration of the cold and hot data; writing the hot data into a high-performance flash memory medium of the solid state disk, and writing the hot data into a balance flash memory medium of the solid state disk in response to the fact that the high-performance flash memory medium is full or a write request is blocked; and writing cold data into the high-capacity flash memory medium of the solid state disk, and writing the cold data into the balance flash memory medium of the solid state disk in response to the full high-capacity flash memory medium or the blocking of the write request. The invention can selectively store different data by using different types of flash memory media, and simultaneously improve the capacity and the performance of the hard disk.
Description
Technical Field
The present invention relates to the field of data storage, and more particularly, to a data storage method and system.
Background
With the development and wide application of technologies such as internet, cloud computing, internet of things, big data and the like, in human life, massive data can be generated at any time and any time, the massive data needs to be processed and stored, and the high-speed development of information technology puts higher requirements on the performance of a storage system. Solid state disks are widely used because of their fast read/write speed and low energy consumption.
The current Solid State Disk (SSD) is used more and more widely, and has higher requirements on the performance and capacity of the solid state disk, and the related technologies of the solid state disk are continuously updated along with the development of the flash memory technology and the improvement of the performance of the main control chip, so that the application requirements can be satisfied as much as possible.
In SSD applications, the lifetime, capacity and performance limitations of SSDs using NAND (flash media) are severe, resulting in very limited SSD applications. Currently, SLC NAND has high performance, long life, and low capacity, QLC NAND has high capacity, low performance, and low life, TLC NAND has no outstanding advantage between the two, and since its defect is not obvious, flash memory media used by mainstream products around TLC NAND are adopted by various large SSD manufacturers currently. TLC by itself is not sufficient to meet all practical requirements.
Aiming at the problems that the flash memory medium of the SSD in the prior art is not outstanding in capacity and performance and cannot meet the actual requirements, no effective solution is available at present.
Disclosure of Invention
In view of the above, an object of the embodiments of the present invention is to provide a data storage method and system, which can selectively store different data using different types of flash memory media, and improve the capacity and performance of a hard disk.
In view of the above object, a first aspect of the embodiments of the present invention provides a data storage method, including the following steps:
receiving data written in the solid state disk, and acquiring the heat of the data from a host or determining the heat of the data by the solid state disk based on internal logic of firmware;
reading the proportion configuration of cold and hot data of the solid state disk, and determining the data as hot data, temperature data or cold data based on the heat of the data and the proportion configuration of the cold and hot data;
writing the hot data into a high-performance flash memory medium of the solid state disk, and writing the hot data into a balance flash memory medium of the solid state disk in response to the fact that the high-performance flash memory medium is full or a write request is blocked;
and writing cold data into the high-capacity flash memory medium of the solid state disk, and writing the cold data into the balance flash memory medium of the solid state disk in response to the full high-capacity flash memory medium or the blocking of the write request.
In some embodiments, obtaining the heat of the data from the host comprises: directly acquiring the heat of data from a host through a host interface;
the method further comprises the following steps: and receiving an instruction for modifying the proportion configuration of the cold data and the hot data from the host through the host interface and carrying out corresponding modification.
In some embodiments, determining, by the solid state disk, the heat of the data based on the firmware internal logic comprises: in response to failing to obtain the heat from the host, internal analysis is performed on the data using firmware internal logic to determine the heat.
In some embodiments, the method further comprises: when the hot data is written into the equilibrium flash memory medium of the solid state disk, the equilibrium flash memory medium occupied by the hot data simulates a high-performance flash memory medium until the hot data is released; and when the cold data is written into the equilibrium flash memory medium of the solid state disk, the equilibrium flash memory medium occupied by the cold data simulates a high-capacity flash memory medium until the cold data is released.
In some embodiments, the method further comprises: performing garbage collection in response to the high performance flash media being full to re-determine the heat of the data in the high performance flash media and transferring the data determined to be warm data or cold data to the leveling flash media.
In some embodiments, the method further comprises: performing garbage collection in response to the leveling flash medium being full to re-determine the heat of the data in the leveling flash medium, and transferring the data determined to be cold data in two consecutive garbage collections to the high-capacity flash medium as changed data.
In some embodiments, the method further comprises: in response to the change data being overwritten, overwriting the change data into the balance flash memory medium and re-determining the heat of the change data; in response to the change data being determined to be warm data and the overwrite occurring again, the change data is overwritten as warm data to the high performance flash media.
A second aspect of an embodiment of the present invention provides a data storage system, including:
a processor; and
a memory storing program code executable by the processor, the program code when executed performing the steps of:
receiving data written in the solid state disk, and acquiring the heat of the data from a host or determining the heat of the data by the solid state disk based on internal logic of firmware;
reading the proportion configuration of cold and hot data of the solid state disk, and determining the data as hot data, temperature data or cold data based on the heat of the data and the proportion configuration of the cold and hot data;
writing the hot data into a high-performance flash memory medium of the solid state disk, and writing the hot data into a balance flash memory medium of the solid state disk in response to the fact that the high-performance flash memory medium is full or a write request is blocked;
and writing cold data into the high-capacity flash memory medium of the solid state disk, and writing the cold data into the balance flash memory medium of the solid state disk in response to the full high-capacity flash memory medium or the blocking of the write request.
In some embodiments, the steps further comprise: performing garbage collection in response to the high performance flash media being full to re-determine the heat of the data in the high performance flash media and transferring the data determined to be warm data or cold data to the leveling flash media.
In some embodiments, the steps further comprise: performing garbage collection in response to the leveling flash medium being full to re-determine the heat of the data in the leveling flash medium and transferring the data determined to be cold data in both consecutive garbage collections as changed data to the high-capacity flash medium; in response to the change data being overwritten, overwriting the change data into the balance flash memory medium and re-determining the heat of the change data; in response to the change data being determined to be warm data and the overwrite occurring again, the change data is overwritten as warm data to the high performance flash media.
The invention has the following beneficial technical effects: according to the data storage method and system provided by the embodiment of the invention, the data written in the solid state disk is received, and the heat degree of the data is acquired from the host or determined by the solid state disk based on the internal logic of the firmware; reading the proportion configuration of cold and hot data of the solid state disk, and determining the data as hot data, temperature data or cold data based on the heat of the data and the proportion configuration of the cold and hot data; writing the hot data into a high-performance flash memory medium of the solid state disk, and writing the hot data into a balance flash memory medium of the solid state disk in response to the fact that the high-performance flash memory medium is full or a write request is blocked; the technical scheme of writing cold data into the high-capacity flash memory medium of the solid state disk and writing the cold data into the balanced flash memory medium of the solid state disk in response to the fact that the high-capacity flash memory medium is full or a write request is blocked can selectively store different data by using different types of flash memory media and improve the capacity and performance of the hard disk at the same time.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flow chart of a data storage method provided by the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.
In view of the above, a first aspect of the embodiments of the present invention provides an embodiment of a data storage method for simultaneously improving the capacity and performance of a hard disk. Fig. 1 is a schematic flow chart of a data storage method provided by the present invention.
The data storage method, as shown in fig. 1, includes the following steps:
step S101, receiving data written in a solid state disk, and acquiring the heat of the data from a host or determining the heat of the data by the solid state disk based on internal logic of firmware;
step S103, reading the proportion configuration of cold and hot data of the solid state disk, and determining the data as hot data, temperature data or cold data based on the heat of the data and the proportion configuration of the cold and hot data;
step S105, writing the thermal data into a high-performance flash memory medium of the solid state disk, and writing the thermal data into a balance flash memory medium of the solid state disk in response to the fact that the high-performance flash memory medium is full or a write request is blocked;
and step S107, writing the cold data into the high-capacity flash memory medium of the solid state disk, and writing the cold data into the balance flash memory medium of the solid state disk in response to the fact that the high-capacity flash memory medium is full or the writing request is blocked.
The invention mainly aims at the requirements that the SSD uses different NAND flash memory media in the design and different types of NAND are used for storing different types of data, the writing performance and the large capacity and the long service life can be ensured, and the purpose is realized by combining the characteristics of different types of NAND through a cold-hot separation algorithm.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a Random Access Memory (RAM), or the like. Embodiments of the computer program may achieve the same or similar effects as any of the preceding method embodiments to which it corresponds.
In some embodiments, obtaining the heat of the data from the host comprises: the heat of the data is directly collected from the host through the host interface. The method further comprises the following steps: and receiving an instruction for modifying the proportion configuration of the cold data and the hot data from the host through the host interface and carrying out corresponding modification.
In some embodiments, determining, by the solid state disk, the heat of the data based on the firmware internal logic comprises: in response to failing to obtain the heat from the host, internal analysis is performed on the data using firmware internal logic to determine the heat.
In some embodiments, the method further comprises: when the hot data is written into the equilibrium flash memory medium of the solid state disk, the equilibrium flash memory medium occupied by the hot data simulates a high-performance flash memory medium until the hot data is released; and when the cold data is written into the equilibrium flash memory medium of the solid state disk, the equilibrium flash memory medium occupied by the cold data simulates a high-capacity flash memory medium until the cold data is released.
In some embodiments, the method further comprises: performing garbage collection in response to the high performance flash media being full to re-determine the heat of the data in the high performance flash media and transferring the data determined to be warm data or cold data to the leveling flash media.
In some embodiments, the method further comprises: performing garbage collection in response to the leveling flash medium being full to re-determine the heat of the data in the leveling flash medium, and transferring the data determined to be cold data in two consecutive garbage collections to the high-capacity flash medium as changed data.
In some embodiments, the method further comprises: in response to the change data being overwritten, overwriting the change data into the balance flash memory medium and re-determining the heat of the change data; in response to the change data being determined to be warm data and the overwrite occurring again, the change data is overwritten as warm data to the high performance flash media.
The following further illustrates embodiments of the invention in terms of specific examples.
In the design and implementation of the SSD, instead of simply mounting one kind of NAND, a plurality of kinds of NAND need to be mounted, and currently, SLC NAND (high performance), TLC NAND (equalization), and QLC NAND (high capacity) are commonly used. The user data with different attributes (heat) are stored by using different types of NAND, the advantages of the various types of NAND are brought into play, and the defects are made up by coordinating the storage of the data in the different types of NAND through the processing of SSD firmware.
Regarding the distinction of cold and hot data, the embodiment of the invention comprises a mode of sending the cold and hot degrees based on host and a mode of judging logic in SSD firmware; the cold and hot degree of the user data is divided into a plurality of grades and cold and hot proportions in the SSD, and the grade and the proportion can be set according to actual needs or an automatic adjustment strategy is started.
In the host mode, the SSD provides a necessary interface for the host, and also provides a hot and cold data ratio setting interface, that is, the hot and cold data information known by the host is communicated with the SSD in a user interface mode, so that the host can use the obtained hot and cold data information conveniently. In the internal processing mode, the SSD is automatically adjusted when the host is not configured, and the cold and hot information of the data is acquired through the internal analysis of the SSD. Thus, the SSD can obtain the heat (cold/hot information) of the user data, whether by host configuration or internal analysis.
With the acquired data cold and hot information, part of QLC NAND may need to be simulated to be TLC NAND or SLC NAND for use, because the data cold and hot information is variable, but the proportion of various NAND is determined in SSD production, and dynamic NAND type conversion is needed inside the SSD in order to be able to dynamically change the cold and hot information.
The NAND type conversion is carried out when a user modifies data cold and hot information or information collected by the SSD is greatly changed, and the writing position is determined again according to the heat.
When the SSD receives the hot data write, the hot data write into the SLC NAND, wherein the hot data generally has the characteristics of less total amount, rapidness and frequent writing, and all the hot data are stored by using the SLC NAND with high performance and long service life; when warm data is written, it is written into the TLC NAND, and the warm data generally has the characteristics of medium-amount, low-frequency writing, so it is saved into the TLC NAND; when cold data is written, the data is written into the QLC NAND, and the QLC NAND usually has a large amount of data and an extremely low write frequency, so that the characteristic of a large capacity of the QLC NAND is fully exhibited.
In addition, the frequency of writing cold data is very low, but a large number of writes may occur in a short time, and high-performance support is also required, and when a write request is blocked when SSD handles cold data storage, an open portion TLC NAND is used to store cold data to increase the writing speed.
In the process of automatically detecting the cold and hot attributes of the data by the SSD, the data with unknown attributes are written into the SLC NAND preferentially, and due to the continuous writing of the data, the SLC NAND triggers garbage collection due to insufficient capacity. And analyzing the cold and hot properties of the data again in the garbage recovery process, and putting the data into TLC NAND after the cold and hot properties are temporarily determined as cold data or warm data.
Further, in the garbage collection of TLC NAND, data is written into QLC data when it is determined to be cold data two consecutive times, and the cold-hot property is determined; when such data is overwritten again, it is necessary to write it into the TLC NAND first, and to make a decision of warm data to cold data again. If the data is judged to be the warm data and the TLC NAND is written, the data is written into the SLC NAND and marked as the warm data.
As can be seen from the foregoing embodiments, in the data storage method provided in the embodiments of the present invention, data written in the solid state disk is received, and the heat of the data is obtained from the host or determined by the solid state disk based on internal logic of firmware; reading the proportion configuration of cold and hot data of the solid state disk, and determining the data as hot data, temperature data or cold data based on the heat of the data and the proportion configuration of the cold and hot data; writing the hot data into a high-performance flash memory medium of the solid state disk, and writing the hot data into a balance flash memory medium of the solid state disk in response to the fact that the high-performance flash memory medium is full or a write request is blocked; the technical scheme of writing cold data into the high-capacity flash memory medium of the solid state disk and writing the cold data into the balanced flash memory medium of the solid state disk in response to the fact that the high-capacity flash memory medium is full or a write request is blocked can selectively store different data by using different types of flash memory media and improve the capacity and performance of the hard disk at the same time.
It should be particularly noted that, the steps in the embodiments of the data storage method described above can be mutually intersected, replaced, added, or deleted, and therefore, the data storage method with these reasonable permutation and combination transformations shall also belong to the scope of the present invention, and shall not limit the scope of the present invention to the described embodiments.
In view of the above objects, a second aspect of the embodiments of the present invention provides an embodiment of a data storage system that improves both the capacity and the performance of a hard disk. The data storage system includes:
a processor; and
a memory storing program code executable by the processor, the program code when executed performing the steps of:
receiving data written in the solid state disk, and acquiring the heat of the data from a host or determining the heat of the data by the solid state disk based on internal logic of firmware;
reading the proportion configuration of cold and hot data of the solid state disk, and determining the data as hot data, temperature data or cold data based on the heat of the data and the proportion configuration of the cold and hot data;
writing the hot data into a high-performance flash memory medium of the solid state disk, and writing the hot data into a balance flash memory medium of the solid state disk in response to the fact that the high-performance flash memory medium is full or a write request is blocked;
and writing cold data into the high-capacity flash memory medium of the solid state disk, and writing the cold data into the balance flash memory medium of the solid state disk in response to the full high-capacity flash memory medium or the blocking of the write request.
In some embodiments, the steps further comprise: performing garbage collection in response to the high performance flash media being full to re-determine the heat of the data in the high performance flash media and transferring the data determined to be warm data or cold data to the leveling flash media.
In some embodiments, the steps further comprise: performing garbage collection in response to the leveling flash medium being full to re-determine the heat of the data in the leveling flash medium and transferring the data determined to be cold data in both consecutive garbage collections as changed data to the high-capacity flash medium; in response to the change data being overwritten, overwriting the change data into the balance flash memory medium and re-determining the heat of the change data; in response to the change data being determined to be warm data and the overwrite occurring again, the change data is overwritten as warm data to the high performance flash media.
As can be seen from the foregoing embodiments, in the system provided in the embodiments of the present invention, data written in the solid state disk is received, and the heat of the data is obtained from the host or determined by the solid state disk based on the internal logic of the firmware; reading the proportion configuration of cold and hot data of the solid state disk, and determining the data as hot data, temperature data or cold data based on the heat of the data and the proportion configuration of the cold and hot data; writing the hot data into a high-performance flash memory medium of the solid state disk, and writing the hot data into a balance flash memory medium of the solid state disk in response to the fact that the high-performance flash memory medium is full or a write request is blocked; the technical scheme of writing cold data into the high-capacity flash memory medium of the solid state disk and writing the cold data into the balanced flash memory medium of the solid state disk in response to the fact that the high-capacity flash memory medium is full or a write request is blocked can selectively store different data by using different types of flash memory media and improve the capacity and performance of the hard disk at the same time.
It should be particularly noted that the embodiment of the system described above employs the embodiment of the data storage method to specifically describe the working process of each module, and those skilled in the art can easily think that these modules are applied to other embodiments of the data storage method. Of course, since the steps in the embodiments of the data storage method may be mutually intersected, replaced, added, or deleted, these reasonable permutations and combinations should also fall within the scope of the present invention, and should not limit the scope of the present invention to the embodiments.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of an embodiment of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.
Claims (10)
1. A method of storing data, comprising performing the steps of:
receiving data written in a solid state disk, and acquiring the heat of the data from a host or determining the heat of the data by the solid state disk based on internal logic of firmware;
reading the proportion configuration of cold and hot data of the solid state disk, and determining the data as hot data, temperature data or cold data based on the heat of the data and the proportion configuration of the cold and hot data;
writing the hot data into a high-performance flash memory medium of the solid state disk, and writing the hot data into a balance flash memory medium of the solid state disk in response to the high-performance flash memory medium being full or a write request being blocked;
and writing the cold data into a high-capacity flash memory medium of the solid state disk, and writing the cold data into a balance flash memory medium of the solid state disk in response to the fact that the high-capacity flash memory medium is full or a write request is blocked.
2. The method of claim 1, wherein obtaining the heat of the data from a host comprises: directly acquiring the heat of the data from a host through a host interface;
the method further comprises the following steps: and receiving an instruction for modifying the proportion configuration of the cold and hot data from the host through the host interface and carrying out corresponding modification.
3. The method of claim 1, wherein determining, by the solid state disk, the heat of the data based on firmware internal logic comprises:
in response to failing to obtain the heat from a host, performing an internal analysis on the data using the firmware internal logic to determine the heat.
4. The method of claim 1, further comprising: when the hot data is written into the equilibrium flash memory medium of the solid state disk, the equilibrium flash memory medium occupied by the hot data simulates the high-performance flash memory medium until the hot data is released; and when the cold data is written into the equilibrium flash memory medium of the solid state disk, the equilibrium flash memory medium occupied by the cold data simulates the high-capacity flash memory medium until the cold data is released.
5. The method of claim 1, further comprising: performing garbage collection in response to the high performance flash media being full to re-determine the heat of the data in the high performance flash media and transferring the data determined to be warm or cold data to the equalized flash media.
6. The method of claim 1, further comprising: performing garbage collection in response to the leveling flash medium being full to re-determine the heat of the data in the leveling flash medium, and transferring the data determined to be cold data in two consecutive garbage collections to the high capacity flash medium as changed data.
7. The method of claim 6, further comprising: in response to the change data being overwritten, overwriting the change data into the flash equalization medium and re-determining the heat of the change data; in response to the change data being determined to be warm data and the overwrite occurring again, writing the change data to the high performance flash media as warm data.
8. A data storage system, comprising:
a processor; and
a memory storing program code executable by the processor, the program code when executed performing the steps of:
receiving data written in a solid state disk, and acquiring the heat of the data from a host or determining the heat of the data by the solid state disk based on internal logic of firmware;
reading the proportion configuration of cold and hot data of the solid state disk, and determining the data as hot data, temperature data or cold data based on the heat of the data and the proportion configuration of the cold and hot data;
writing the hot data into a high-performance flash memory medium of the solid state disk, and writing the hot data into a balance flash memory medium of the solid state disk in response to the high-performance flash memory medium being full or a write request being blocked;
and writing the cold data into a high-capacity flash memory medium of the solid state disk, and writing the cold data into a balance flash memory medium of the solid state disk in response to the fact that the high-capacity flash memory medium is full or a write request is blocked.
9. The system of claim 8, wherein the steps further comprise: performing garbage collection in response to the high performance flash media being full to re-determine the heat of the data in the high performance flash media and transferring the data determined to be warm or cold data to the equalized flash media.
10. The system of claim 8, wherein the steps further comprise: performing garbage collection in response to the leveling flash medium being full to re-determine the heat of the data in the leveling flash medium and transferring the data determined to be cold data in both consecutive garbage collections as changed data to the high capacity flash medium; in response to the change data being overwritten, overwriting the change data into the flash equalization medium and re-determining the heat of the change data; in response to the change data being determined to be warm data and the overwrite occurring again, writing the change data to the high performance flash media as warm data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110092469.2A CN112783448B (en) | 2021-01-24 | 2021-01-24 | Data storage method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110092469.2A CN112783448B (en) | 2021-01-24 | 2021-01-24 | Data storage method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112783448A true CN112783448A (en) | 2021-05-11 |
| CN112783448B CN112783448B (en) | 2022-07-08 |
Family
ID=75758739
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110092469.2A Active CN112783448B (en) | 2021-01-24 | 2021-01-24 | Data storage method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112783448B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107908367A (en) * | 2017-11-16 | 2018-04-13 | 郑州云海信息技术有限公司 | Method, apparatus, equipment and the storage medium that data store in storage system |
| CN107967121A (en) * | 2017-10-25 | 2018-04-27 | 华为技术有限公司 | Method for writing data and storage device |
| CN109542358A (en) * | 2018-12-03 | 2019-03-29 | 浪潮电子信息产业股份有限公司 | A kind of cold and hot data separation method of solid state hard disk, device and equipment |
-
2021
- 2021-01-24 CN CN202110092469.2A patent/CN112783448B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107967121A (en) * | 2017-10-25 | 2018-04-27 | 华为技术有限公司 | Method for writing data and storage device |
| CN107908367A (en) * | 2017-11-16 | 2018-04-13 | 郑州云海信息技术有限公司 | Method, apparatus, equipment and the storage medium that data store in storage system |
| CN109542358A (en) * | 2018-12-03 | 2019-03-29 | 浪潮电子信息产业股份有限公司 | A kind of cold and hot data separation method of solid state hard disk, device and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112783448B (en) | 2022-07-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9798472B1 (en) | Extent level cache destaging | |
| CN103777905B (en) | Software-defined fusion storage method for solid-state disc | |
| US20180307413A1 (en) | Control of storage of data in a hybrid storage system | |
| CN102012791B (en) | Flash based PCIE (peripheral component interface express) board for data storage | |
| CN109753443B (en) | Data processing method and device and electronic equipment | |
| CN101777026B (en) | Memory management method, hard disk and memory system | |
| CN105930282B (en) | A kind of data cache method for NAND FLASH | |
| US10740251B2 (en) | Hybrid drive translation layer | |
| CN107391398B (en) | Management method and system for flash memory cache region | |
| CN106874213B (en) | Solid state disk hot data identification method fusing multiple machine learning algorithms | |
| TWI525430B (en) | Cache memory device and data processing method of the device | |
| US9223694B2 (en) | Data storage device and operating method thereof | |
| CN109952565B (en) | Memory access techniques | |
| US8572321B2 (en) | Apparatus and method for segmented cache utilization | |
| CN108595110B (en) | Method for improving reading performance by using Nand characteristic and solid state disk | |
| CN103838676B (en) | Data-storage system, date storage method and PCM bridges | |
| CN104899154B (en) | The page management method hosted is mixed based on embedded system | |
| CN105117180A (en) | Data storing method and device and solid state disc | |
| CN109669888A (en) | A kind of configurable and efficient embedded Nor-Flash controller and control method | |
| CN110377233B (en) | SSD (solid State disk) reading performance optimization method and device, computer equipment and storage medium | |
| CN113282249B (en) | Data processing method, system, device and medium | |
| CN111581126A (en) | Method, device, equipment and medium for saving log data based on SSD | |
| CN109799959A (en) | A method of it improving open channel solid-state disk and writes concurrency | |
| CN104298615B (en) | Method for equalizing swap partition loss of memory | |
| CN112783448B (en) | Data storage method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |