CN105677242B - The separation method and device of cold and hot data - Google Patents
The separation method and device of cold and hot data Download PDFInfo
- Publication number
- CN105677242B CN105677242B CN201511029711.2A CN201511029711A CN105677242B CN 105677242 B CN105677242 B CN 105677242B CN 201511029711 A CN201511029711 A CN 201511029711A CN 105677242 B CN105677242 B CN 105677242B
- Authority
- CN
- China
- Prior art keywords
- data
- cold data
- cold
- physical
- equipment end
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0652—Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
Abstract
The invention discloses the separation method and device of a kind of cold and hot data, this method includes：The logical address for the cold data that the host side that the equipment end of mobile terminal receives the mobile terminal is sent；The equipment end determines the physical address of the cold data according to the logical address and logical address of the cold data and the mapping relations of physical address；The equipment end determines the Physical Page that the cold data occupies in the flash memory of the mobile terminal according to the physical address of the cold data；The Physical Page that the equipment end occupies in the flash memory of the mobile terminal according to the cold data determines the cold data of the physical block in the flash memory and the mixability of dsc data；If the mixability belongs to preset mobility threshold section, which migrates out the physical block for the cold data in the physical block.The separation method and device of the cold and hot data of the embodiment of the present invention, can improve the working efficiency of GC.
Description
Technical field
The present embodiments relate to the communications field more particularly to the separation methods and device of cold and hot data.
Background technique
Current most of mobile phones using embedded multi-media card (Embedded Multi Media Card, eMMC) or
Solid state hard disk (Solid State Disk, SSD) is used as built in memory device.The core memory chip of the two is all flash memory
(Flash Memory).One characteristic of flash memory is to need first to wipe original data, and in flash memory before data are written
The unit of middle read-write data is Physical Page, and the unit for wiping data is physical block.
Another characteristic of flash memory is in the data updated storage, and flash memory is not local update, that is to say, that the sudden strain of a muscle
Deposit directly is updated on the physical address where former data.In flash memory more new data, equipment end is to update
Data redistribute physical space to store, the occupied Physical Page of data of the update is set to effectively, shared by former data
Physical Page is set in vain, and the corresponding physical address of the occupied Physical Page of the data that logical address is directed toward the update.
The only encapsulation of flash translation layer (FTL) (Flash Translation Layer, FTL) of this process Jing Guo equipment end, to user
Invisible, so the same with disk, user still uses logical address as unique address data storage and searched, and is indifferent to
The real physical storage locations of data.
Above-mentioned characteristic based on flash memory, in order to recycle memory space, is needed to the sudden strain of a muscle when the memory space inadequate of flash memory
Deposit into row garbage reclamation (Garbage Collection, GC) operation.The purpose of GC operation has been set in recycling physical block
For invalid Physical Page, re-using is set to invalid Physical Page storing data.Firstly, equipment end (Device) needs to select
Effective Physical Page copies new memory space in fixed physical block, then again wipes the data in entire physical block.This
Sample, the quantity of effectively Physical Page directly affects the efficiency of GC operation in physical block.
In the prior art, in order to guarantee GC operation efficiency, host side (Host) is based on different data in file system
Different update frequency, splits data into cold data and dsc data.Wherein, cold data may include the lower data of renewal frequency,
Dsc data may include the higher data of renewal frequency.Since host side can not know the physical storage structure of equipment end, so
Can only logic-based address to cold and hot data carry out partitioned storage.However, in host side logic-based address to cold and hot data point
Area stores and then logical address is mapped to physical address by FTL floor, and cold and hot data may be still in a physical block
In, that is to say, that the above method may not achieve the purpose that the amount of migration of active page in physical block when reduction GC, be unable to improve
The working efficiency of GC.
Summary of the invention
The purpose of the application is to provide the separation scheme of improved cold and hot data, to improve the working efficiency of GC.
In a first aspect, the application provides a kind of separation method of cold and hot data, including：The equipment end of mobile terminal receives institute
State the logical address of the cold data of the host side transmission of mobile terminal；The equipment end according to the logical address of the cold data,
And the mapping relations of logical address and physical address, determine the physical address of the cold data；The equipment end is according to
The physical address of cold data determines the Physical Page that the cold data occupies in the flash memory of the mobile terminal；The equipment end
According to the Physical Page that the cold data occupies in the flash memory of the mobile terminal, the cold number of the physical block in the flash memory is determined
According to the mixability with dsc data；If the mixability belongs to preset mobility threshold section, the equipment end is by the object
Cold data in reason block migrates out the physical block.
The separation method of the cold and hot data of the embodiment of the present invention, can be according to the cold data that host side is sent logically
Cold data in effective Physical Page is first moved to independent memory block before GC, and when system is in idle by location
In, cold and hot information of the equipment end because that can not know data is avoided, causes the cold and hot degree of mixing in physical block than more serious, thus
Realize equipment end cold and hot data separating, reduce GC when physical block in active page the amount of migration, improve the working efficiency of GC.
With reference to first aspect, in the first implementation of first aspect, the mixability is the cold data institute
The ratio of Physical Page sum in physical block where the quantity of the Physical Page of occupancy and the cold data.
With reference to first aspect or the first implementation of first aspect, in second of implementation of first aspect,
The method also includes：If the mixability is not belonging to the preset mobility threshold section, the equipment end determination is not moved
Move the cold data in the physical block.
With reference to first aspect or its above-mentioned implementation it is any, the equipment end includes embedded multi-media card
EMMC, the host side include file system.
With reference to first aspect or its above-mentioned implementation it is any, equipment end receiving host end send cold data
Logical address, including：The control instruction that equipment end receiving host end is sent, the control instruction include the cold data
Logical address.
Second aspect, the application provide a kind of separator of cold and hot data, including：Receiving module, it is described for receiving
The logical address for the cold data that the host side of mobile terminal is sent；First determining module, for being received according to the receiving module
The cold data logical address and logical address and physical address mapping relations, determine the physics of the cold data
Address；Second determining module, for according to first determining module determine the cold data physical address, determine described in
The Physical Page that cold data occupies in the flash memory of the mobile terminal；Third determining module, for determining mould according to described second
The Physical Page that the cold data that block determines occupies in the flash memory of the mobile terminal, determines the physical block in the flash memory
The mixability of cold data and dsc data；4th determining module, if the mixability category that the third determining module determines
In preset mobility threshold section, the 4th determining module is used to the cold data in the physical block migrating out the physics
Block.
In conjunction with second aspect, in the first implementation of second aspect, the mixability is the cold data institute
The ratio of Physical Page sum in physical block where the quantity of the Physical Page of occupancy and the cold data.
In conjunction with second aspect, in second of implementation of second aspect, described device further includes：5th determines mould
Block, if the mixability is not belonging to the preset mobility threshold section, the 5th determining module is not migrated for determination
The cold data in the physical block.
In conjunction with any of second aspect or its above-mentioned implementation, the equipment end includes embedded multi-media card
EMMC, the host side include file system.
In conjunction with second aspect or any, cold data that equipment end receiving host end is sent of its above-mentioned implementation
Logical address, including：The control instruction that equipment end receiving host end is sent, the control instruction include the cold data
Logical address.
The third aspect, the application provide a kind of computer readable storage medium, and the computer storage medium is for storing
The program code of cold and hot data separating, said program code include the instruction for executing the method in first aspect.
In some implementations, which can be determined based on the renewal frequency of file where data.
In some implementations, the logical address of the cold data can be the logical address of carrying cold data mark.
In some implementations, which can instruct for the equipment identification that host side is sent to equipment end.
The cold and hot data separation method and device of the embodiment of the present invention, the logic for the cold data that can be sent according to host side
Cold data in effective Physical Page is first moved to independent memory block before GC, and when system is in idle by address
In, reduce GC when physical block in active page the amount of migration, improve the working efficiency of GC.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, will make below to required in the embodiment of the present invention
Attached drawing is briefly described, it should be apparent that, drawings described below is only some embodiments of the present invention, for
For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other
Attached drawing.
Fig. 1 is the schematic diagram of the hardware structure of the separation method of cold and hot data.
Fig. 2 is the schematic flow chart of the separation method of the cold and hot data of the embodiment of the present invention.
Fig. 3 is the schematic block diagram of the separator of the cold and hot data of the embodiment of the present invention.
Fig. 4 is the schematic block diagram of the separator of the cold and hot data of the embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair
Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts
Example, shall fall within the protection scope of the present invention.
It should be understood that technical solution of the present invention, can be applied to various communication systems, such as：Global system for mobile communications
(Global System of Mobile communication, GSM), CDMA (Code Division Multiple
Access, CDMA) system, wideband code division multiple access (Wideband Code Division Multiple Access
Wireless, WCDMA), General Packet Radio Service (General Packet Radio Service, GPRS), long term evolution
(Long Term Evolution, LTE) etc..
It should also be understood that user equipment (User Equipment, UE), also referred to as mobile terminal (Mobile
Terminal), mobile subscriber equipment etc., can be through wireless access network (for example, Radio Access Network, RAN) and one
A or multiple cores net is communicated, and user equipment can be mobile terminal, such as mobile phone (or be " honeycomb " phone) and
Computer with mobile terminal, for example, it may be portable, pocket, hand-held, built-in computer or vehicle-mounted shifting
Dynamic device, they exchange language and/or data with wireless access network.
In order to make it easy to understand, first combining Fig. 1, the hardware structure of the separation method of cold and hot data is simply introduced.It is shown in FIG. 1
In the schematic diagram of the hardware structure of the separation method of cold and hot data, user equipment includes host side and equipment end.The host side can
To include topmost paper system, which may include bottom storage equipment.Fig. 1 stores equipment using eMMC as bottom
Example, is illustrated the scene.It should be understood that lower layer's storage equipment can also be SSD.User equipment can pass through the control in eMMC
Device processed is written and read the data in flash memory.Specifically, it when program process needs to read and write data, accesses first
Page cache memory (page cache), if the data for not having the application process to need to read and write in page cache, that
The application process needs to access flash memory.At this moment Virtual File System (Virtual File System, VSF) can call read-write
Order, by the specific file system of carry, obtains logical block address (Logical Block Address, LBA), access tool
The storage equipment of body.On the basis of hardware structure shown in Fig. 1, below with reference to Fig. 2, describes in detail and implement according to the present invention
The separation method of the cold and hot data of example.
Fig. 2 shows the schematic flow charts of the separation method of cold and hot data according to an embodiment of the present invention.This method packet
It includes：
210, the logical address for the cold data that the host side that the equipment end of mobile terminal receives the mobile terminal is sent.
Specifically, logical address can determine the logic as host side according to the renewal frequency of the file where the data
Whether the corresponding data in address are cold data.For example, the type of file where the data is multimedia, digital audio format
(audio), picture (image), when the read-only files such as executable program (exe), due to such read-only file belongs to will not be by more
Newly, so host side can be assumed that the data in the class file are cold data.
For non-read-only class file, host side can determine this article according to the renewal frequency of this document whithin a period of time
Whether the data in part are cold data.For example, host side can be based on formulaDetermine the renewal frequency of file,
Wherein, HfIndicate the renewal frequency of this document,Indicate the renewal time of this document last time, T indicates current time, Wf
Indicate that this document is arrived in TThe sum of the physical block updated in period.When the renewal frequency of file is higher than preset update threshold
When value, host side can determine that the data in this document are dsc data；When file renewal frequency less than or equal to it is preset more
When new threshold value, host side can determine that the data in this document are cold data.
It should be understood that preset update the lower of threshold value setting, it is lower to be identified as the frequency that the data of cold data are updated,
The effect of logical address of the equipment end based on the cold data, the cold and hot data separating of progress is better.
220, the equipment end is closed according to the logical address and logical address of the cold data and the mapping of physical address
System, determines the physical address of the cold data.
It should be understood that above-mentioned logical address and the mapping relations of physical address can be the logical address-based on the mapping of page grade
Physical address mapping table includes the mapping relations between each logical page (LPAGE) and Physical Page in the table；Above-mentioned logical address and physics
The mapping relations of address can also be logical address-physical address mapping table based on the mapping of block grade, include each to patrol in the table
The mapping relations between block and physical block are collected, the present invention is not especially limited above-mentioned mapping relations.
230, the equipment end determines the cold data in the mobile terminal according to the physical address of the cold data
The Physical Page occupied in flash memory.
240, the Physical Page that the equipment end occupies in the flash memory of the mobile terminal according to the cold data determines institute
State the cold data of the physical block in flash memory and the mixability of dsc data.
250, if the mixability belongs to preset mobility threshold section, the equipment end will be cold in the physical block
Data Migration goes out the physical block.
For example, above-mentioned mobility threshold section can be set to [48%, 60%], preset moved if the mixability belongs to this
Move threshold interval, that is to say, that in the corresponding physical block of the mixability, the mixing situation of cold data and dsc data is tighter
Weight, equipment end need the cold data in the physical block migrating out the physical block.
It should be understood that above equipment end can be by cold data page migration to independent storage region.For example, equipment end can incite somebody to action
Cold data is stored in identical physical block.
The logical address of the cold data that equipment end can be sent according to host side in the system free time of the embodiment of the present invention,
Before GC, and when system is in idle, first the cold data in effective Physical Page is moved in independent memory block, is avoided
Cold and hot information of the equipment end because that can not know data, causes the cold and hot degree of mixing in physical block than more serious, sets to realize
The cold and hot data separating at standby end, when reducing GC in physical block active page the amount of migration, improve the working efficiency of GC.
Optionally, as one embodiment, the mixability be the occupied Physical Page of the cold data quantity with
The ratio of Physical Page sum in physical block where the cold data.
Optionally, as one embodiment, the method also includes：If the mixability is not belonging to described preset move
Threshold interval is moved, the equipment end determines the cold data not migrated in the physical block.
Optionally, as one embodiment, the equipment end includes embedded multi-media card eMMC, and the host side includes
File system.
Optionally, the logical address of the cold data sent as one embodiment, equipment end receiving host end, packet
It includes：The control instruction that equipment end receiving host end is sent, the control instruction includes the logical address of the cold data.
It should be understood that the control instruction can be the control instruction based on eMMC, it may include initialization and equipment identification etc.
Elementary instruction, the control instruction can also be that other control instructions that storage equipment is supported, the present invention are not specifically limited in this embodiment.
It should be understood that the cold data in the above-mentioned migration physical block, can carry out when system is in idle, in this way, neither
It will affect the operational efficiency of system, and the waste of memory space can be reduced.
The separation method that the cold and hot data of the embodiment of the present invention are described in detail above in association with Fig. 1 and Fig. 2, below with reference to
The separator of cold and hot data according to an embodiment of the present invention is described in detail in Fig. 3 and Fig. 4.It should be understood that Fig. 3 and dress shown in Fig. 4
The each step that can be realized in Fig. 2 is set, in order to avoid repeating, this will not be detailed here.
Fig. 3 is the schematic block diagram of the separator of the cold and hot data of the embodiment of the present invention.Device 300 shown in Fig. 3 wraps
Include receiving module 310, the first determining module 320, the second determining module 330, third determining module 340, the 4th determining module
350。
Receiving module 310, the logical address for the cold data that the host side for receiving the mobile terminal is sent；
First determining module 320 for the logical address according to the received cold data of the receiving module, and is patrolled
The mapping relations for collecting address and physical address, determine the physical address of the cold data；
Second determining module 330, the physical address of the cold data for being determined according to first determining module, really
The Physical Page that the fixed cold data occupies in the flash memory of the mobile terminal；
Third determining module 340, the cold data for being determined according to second determining module is described mobile whole
The Physical Page occupied in the flash memory at end determines the cold data of the physical block in the flash memory and the mixability of dsc data；
4th determining module 350, if the mixability that the third determining module determines belongs to preset migration threshold
It is worth section, the 4th determining module is used to the cold data in the physical block migrating out the physical block.
The separator of the cold and hot data of the embodiment of the present invention, can be according to the cold data that host side is sent logically
Cold data in effective Physical Page is first moved to independent memory block before GC, and when system is in idle by location
In, cold and hot information of the equipment end because that can not know data is avoided, causes the cold and hot degree of mixing in physical block than more serious, thus
Realize equipment end cold and hot data separating, reduce GC when physical block in active page the amount of migration, improve the working efficiency of GC.
Optionally, as one embodiment, the mixability be the occupied Physical Page of the cold data quantity with
The ratio of Physical Page sum in physical block where the cold data.
Optionally, as one embodiment, device shown in Fig. 3 further includes：5th determining module, if the mixability
It is not belonging to the preset mobility threshold section, the 5th determining module does not migrate described in the physical block for determination
Cold data.
Optionally, as one embodiment, the equipment end includes embedded multi-media card eMMC, and the host side includes
File system.
Optionally, the logical address of the cold data sent as one embodiment, equipment end receiving host end, packet
It includes：The control instruction that equipment end receiving host end is sent, the control instruction include the logical address of the cold data.
Fig. 4 is the schematic block diagram of the separator of the cold and hot data of the embodiment of the present invention.Device 400 shown in Fig. 4 wraps
Include memory 410, processor 420, input/output interface 430, communication interface 440 and bus system 450.Wherein, memory
410, processor 420, input/output interface 430 and communication interface 440 are connected by bus system 450, which uses
In store instruction, which is used to execute the instruction of the memory 410 storage, is connect with controlling input/output interface 430
The data and information of input, the data such as output operating result are received, and controls communication interface 440 and sends signal.
Communication interface 440, the logical address for the cold data that the host side for receiving the mobile terminal is sent；
Processor 420, for the logical address and logical address according to the received cold data of the receiving module
With the mapping relations of physical address, the physical address of the cold data is determined；According to the physical address of the cold data, institute is determined
State the Physical Page that cold data occupies in the flash memory of the mobile terminal；For according to the cold data in the mobile terminal
The Physical Page occupied in flash memory determines the cold data of the physical block in the flash memory and the mixability of dsc data；If described mixed
Conjunction degree belongs to preset mobility threshold section, and the cold data in the physical block is migrated out the physical block.
It should be understood that in embodiments of the present invention, which can use general central processing unit (Central
Processing Unit, CPU), microprocessor, application specific integrated circuit (Application Specific
Integrated Circuit, ASIC), or one or more integrated circuits, for executing relative program, to realize the present invention
Technical solution provided by embodiment.
It should also be understood that communication interface 440 carrys out realization device using the R-T unit for being such as, but not limited to transceiver one kind
Communication between 400 and other equipment or communication network.
The memory 410 may include read-only memory and random access memory, and to processor 420 provide instruction and
Data.The a part of of processor 420 can also include nonvolatile RAM.For example, processor 420 can also be deposited
Store up the information of device type.
The bus system 450 can also include power bus, control bus and status signal in addition to including data/address bus
Bus etc..But for the sake of clear explanation, various buses are all designated as bus system 450 in figure.
During realization, each step of the above method can pass through the integrated logic circuit of the hardware in processor 420
Or the instruction of software form is completed.It can be straight the step of the method for cold and hot data separating in conjunction with disclosed in the embodiment of the present invention
Connect and be presented as that hardware processor executes completion, or in processor hardware and software module combination execute completion.Software mould
Block can be located at random access memory, flash memory, read-only memory, programmable read only memory or electrically erasable programmable storage
In the storage medium of this fields such as device, register maturation.The storage medium is located at memory 430, and processor 420 reads memory
Information in 430, in conjunction with the step of its hardware completion above method.To avoid repeating, it is not detailed herein.
It should be understood that in embodiments of the present invention, " B corresponding with A " indicates that B is associated with A, B can be determined according to A.But
It should also be understood that determining that B is not meant to determine B only according to A according to A, B can also be determined according to A and/or other information.
It should be understood that the terms "and/or", only a kind of incidence relation for describing affiliated partner, expression can deposit
In three kinds of relationships, for example, A and/or B, can indicate：Individualism A exists simultaneously A and B, these three situations of individualism B.
In addition, character "/" herein, typicallys represent the relationship that forward-backward correlation object is a kind of "or".
It should be understood that in various embodiments of the present invention, magnitude of the sequence numbers of the above procedures are not meant to execute suitable
Sequence it is successive, the execution of each process sequence should be determined by its function and internal logic, the implementation without coping with the embodiment of the present invention
Process constitutes any restriction.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician
Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed
The scope of the present invention.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, it can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit
It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components
It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or
The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit
It closes or communicates to connect, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product
It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words
The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention.
And storage medium above-mentioned includes：USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), arbitrary access are deposited
The various media that can store program code such as reservoir (Random Access Memory, RAM), magnetic or disk.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain
Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.
Claims (10)
1. a kind of separation method of cold and hot data, which is characterized in that including：
The logical address for the cold data that the host side that the equipment end of mobile terminal receives the mobile terminal is sent；
The equipment end is determined according to the logical address and logical address of the cold data and the mapping relations of physical address
The physical address of the cold data；
The equipment end determines that the cold data accounts in the flash memory of the mobile terminal according to the physical address of the cold data
Physical Page；
The Physical Page that the equipment end occupies in the flash memory of the mobile terminal according to the cold data determines in the flash memory
Physical block cold data and dsc data mixability；
If the mixability belongs to preset mobility threshold section, the equipment end migrates the cold data in the physical block
The physical block out.
2. the method as described in claim 1, which is characterized in that the mixability is the occupied Physical Page of the cold data
Quantity and the cold data where physical block in Physical Page sum ratio.
3. method according to claim 1 or 2, which is characterized in that the method also includes：
If the mixability is not belonging to the preset mobility threshold section, the equipment end determination does not migrate the physical block
In the cold data.
4. the method as described in claim 1, which is characterized in that the equipment end includes embedded multi-media card eMMC, described
Host side includes file system.
5. method as claimed in claim 4, which is characterized in that the logic for the cold data that equipment end receiving host end is sent
Address, including：
The control instruction that equipment end receiving host end is sent, the control instruction include the logical address of the cold data.
6. a kind of separator of cold and hot data, which is characterized in that including：
Receiving module, the logical address for the cold data that the host side for receiving mobile terminal is sent；
First determining module, for the logical address and logical address according to the received cold data of the receiving module
With the mapping relations of physical address, the physical address of the cold data is determined；
Second determining module, for according to first determining module determine the cold data physical address, determine described in
The Physical Page that cold data occupies in the flash memory of the mobile terminal；
Third determining module, for according to second determining module determine the cold data the mobile terminal flash memory
The Physical Page of middle occupancy determines the cold data of the physical block in the flash memory and the mixability of dsc data；
4th determining module, if the mixability that the third determining module determines belongs to preset mobility threshold section,
4th determining module is used to the cold data in the physical block migrating out the physical block.
7. device as claimed in claim 6, which is characterized in that the mixability is the occupied Physical Page of the cold data
Quantity and the cold data where physical block in Physical Page sum ratio.
8. device as claimed in claims 6 or 7, which is characterized in that described device further includes：
5th determining module, if the mixability is not belonging to the preset mobility threshold section, the 5th determining module
For determining the cold data not migrated in the physical block.
9. device as claimed in claim 6, which is characterized in that described device includes embedded multi-media card eMMC, the master
Generator terminal includes file system.
10. device as claimed in claim 9, which is characterized in that the receiving module is also used to：
The control instruction that the host side is sent is received, the control instruction includes the logical address of the cold data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511029711.2A CN105677242B (en) | 2015-12-31 | 2015-12-31 | The separation method and device of cold and hot data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511029711.2A CN105677242B (en) | 2015-12-31 | 2015-12-31 | The separation method and device of cold and hot data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105677242A CN105677242A (en) | 2016-06-15 |
| CN105677242B true CN105677242B (en) | 2018-11-30 |
Family
ID=56298336
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201511029711.2A Active CN105677242B (en) | 2015-12-31 | 2015-12-31 | The separation method and device of cold and hot data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105677242B (en) |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106201906B (en) * | 2016-07-11 | 2019-01-18 | 浪潮(北京)电子信息产业有限公司 | A kind of cold and hot data separation method and system for flash memory |
| CN106406753B (en) * | 2016-08-30 | 2019-07-09 | 深圳芯邦科技股份有限公司 | A kind of date storage method and data storage device |
| CN107590021B (en) * | 2017-08-22 | 2020-01-03 | 华中科技大学 | Encoder and decoder for reducing error rate of flash memory and encoding and decoding methods |
| CN108363553A (en) * | 2018-01-31 | 2018-08-03 | 北京兰云科技有限公司 | A kind of data processing method, apparatus and system |
| KR102634631B1 (en) * | 2018-07-11 | 2024-02-08 | 에스케이하이닉스 주식회사 | Memory system and operating method thereof |
| CN108920107B (en) * | 2018-07-13 | 2022-02-01 | 深圳忆联信息系统有限公司 | Method and device for screening cold data, computer equipment and storage medium |
| CN108920108B (en) * | 2018-07-13 | 2022-02-01 | 深圳忆联信息系统有限公司 | Cold data screening method and device, computer equipment and storage medium |
| CN109344095B (en) * | 2018-09-18 | 2021-05-04 | 深圳市德明利技术股份有限公司 | Flash memory thermal data identification method |
| CN109669641B (en) * | 2018-12-24 | 2022-03-29 | 深圳忆联信息系统有限公司 | Data storage method and device for reducing SSD bit error rate |
| CN110442531B (en) * | 2019-08-08 | 2021-10-26 | 深圳忆联信息系统有限公司 | Method and device for improving reading performance based on solid state disk and computer equipment |
| CN111240887A (en) * | 2020-01-07 | 2020-06-05 | 苏州大学 | Error page identification method based on three-dimensional flash memory storage structure |
| CN111522512B (en) * | 2020-04-22 | 2023-08-08 | 深圳忆联信息系统有限公司 | Optimized cold and hot data separation method, device, computer equipment and storage medium |
| CN113064551B (en) * | 2020-05-15 | 2023-09-01 | 华为技术有限公司 | Data writing, moving and cleaning information sending method and device and file system |
| CN111831228A (en) * | 2020-07-06 | 2020-10-27 | 山东华芯半导体有限公司 | SSD (solid State disk) cold and hot data separation method based on out-of-band interaction |
| CN113094004B (en) * | 2021-05-13 | 2023-11-03 | 得一微电子股份有限公司 | Data mirror image mapping optimization processing method aiming at specific rule in storage equipment |
| CN116009761A (en) * | 2021-10-21 | 2023-04-25 | 华为技术有限公司 | Data writing method and related equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102902628A (en) * | 2012-09-18 | 2013-01-30 | 记忆科技(深圳)有限公司 | Flash memory and method and system for automatically separating cold and hot data based on same |
| CN103246609A (en) * | 2013-04-24 | 2013-08-14 | 深圳市江波龙电子有限公司 | Method and device for cold-hot data discrimination management in flash memory device |
| CN103688246A (en) * | 2011-05-17 | 2014-03-26 | 桑迪士克科技股份有限公司 | A non-volatile memory and a method with small logical groups distributed among active SLC and MLC memory partitions |
| CN104850500A (en) * | 2014-02-14 | 2015-08-19 | 腾讯科技（深圳）有限公司 | Data processing method and device used for data storage |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9176864B2 (en) * | 2011-05-17 | 2015-11-03 | SanDisk Technologies, Inc. | Non-volatile memory and method having block management with hot/cold data sorting |
-
2015
- 2015-12-31 CN CN201511029711.2A patent/CN105677242B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103688246A (en) * | 2011-05-17 | 2014-03-26 | 桑迪士克科技股份有限公司 | A non-volatile memory and a method with small logical groups distributed among active SLC and MLC memory partitions |
| CN102902628A (en) * | 2012-09-18 | 2013-01-30 | 记忆科技(深圳)有限公司 | Flash memory and method and system for automatically separating cold and hot data based on same |
| CN103246609A (en) * | 2013-04-24 | 2013-08-14 | 深圳市江波龙电子有限公司 | Method and device for cold-hot data discrimination management in flash memory device |
| CN104850500A (en) * | 2014-02-14 | 2015-08-19 | 腾讯科技（深圳）有限公司 | Data processing method and device used for data storage |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105677242A (en) | 2016-06-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105677242B (en) | The separation method and device of cold and hot data | |
| US20180173620A1 (en) | Data erasure method for solid state drive, and apparatus | |
| CN109815162A (en) | EMS memory management process, device, mobile terminal and storage medium | |
| EP2195739B1 (en) | System and method to improve memory usage in virtual machines running as hypervisor guests | |
| JP5510556B2 (en) | Method and system for managing virtual machine storage space and physical hosts | |
| CN105593828B (en) | Manage method, distributed memory system and the management node of file | |
| CN108205473B (en) | Memory processing method and device, computer device and computer readable storage medium | |
| CN106527963B (en) | Storage system and host apparatus | |
| EP3220275A1 (en) | Array controller, solid state disk and data writing control method for solid state disk | |
| CN106406756B (en) | A kind of space allocation method and device of file system | |
| CN105511806B (en) | The method and mobile terminal of processing write requests | |
| WO2011095516A1 (en) | Method and system for mass storage on flash memory | |
| KR102077149B1 (en) | Method for managing memory and apparatus thereof | |
| CN106708968A (en) | Distributed database system and data processing method in distributed database system | |
| CN107209716B (en) | Memory management device and method | |
| EP3304317B1 (en) | Method and apparatus for managing memory | |
| CN110457235A (en) | Memory compression methods, device, terminal and storage medium | |
| CN103874987B (en) | Embedded multi-media card partitioned storage space allocation method and terminal | |
| US20230153236A1 (en) | Data writing method and apparatus | |
| CN105468538B (en) | A kind of internal memory migration method and apparatus | |
| CN108228339B (en) | Memory recovery method and device, terminal equipment and computer readable storage medium | |
| CN104375944B (en) | A kind of date storage method and device | |
| CN105320543B (en) | The method and apparatus for loading software module | |
| CN107912063A (en) | A kind of method for recovering internal storage and device | |
| CN113138941A (en) | Memory exchange method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200420 Address after: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee after: HUAWEI TECHNOLOGIES Co.,Ltd. Address before: 301, A building, room 3, building 301, foreshore Road, No. 310052, Binjiang District, Zhejiang, Hangzhou Patentee before: Huawei Technologies Co.,Ltd. |
|
| TR01 | Transfer of patent right |