CN108920108A - Screening technique, device, computer equipment and the storage medium of cold data - Google Patents
Screening technique, device, computer equipment and the storage medium of cold data Download PDFInfo
- Publication number
- CN108920108A CN108920108A CN201810771853.3A CN201810771853A CN108920108A CN 108920108 A CN108920108 A CN 108920108A CN 201810771853 A CN201810771853 A CN 201810771853A CN 108920108 A CN108920108 A CN 108920108A
- Authority
- CN
- China
- Prior art keywords
- data
- page
- moving
- cold
- hash table
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
- G06F3/0616—Improving the reliability of storage systems in relation to life time, e.g. increasing Mean Time Between Failures [MTBF]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
- G06F3/0649—Lifecycle management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Techniques For Improving Reliability Of Storages (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to the screening technique of cold data, device, computer equipment and storage mediums, wherein this method includes establishing number registration Hash table；The data-moving number that each page data is recorded in page is corresponded in number registration Hash table；Move whether number is less than threshold value described in judgement；If so, will move data markers of the number not less than threshold value is cold data.The present invention passes through using page as unit, establish number registration Hash table, the data-moving number of corresponding page is registered in the page of number registration Hash table, Hash number in comparison number registration Hash table moves number and threshold value, filter out the page met or exceeded where the data-moving number of threshold value, it is addressed to the data of corresponding page, it is cold data by the data markers, it stores in cold data block, so that after last cold data precipitates, cold data is contained only inside block, the invalid data contained is fewer, promotes the performance of solid state hard disk and guarantees the service life.
Description
Technical field
The present invention relates to the methods of garbled data, more specifically refer to that the screening technique, device, computer of cold data are set
Standby and storage medium.
Background technique
In solid state hard disk, needs to distinguish the data in write-in flash memory (NAND), mark off cold data and hot number
According to, wherein the data being not used for a long time after write-in are known as cold data, and the data being frequently used are known as dsc data；
Rationally cold data is correctly distinguished all to have an impact to the performance of flash memory and service life.
Currently, as shown in Figure 1, carrying out screening to data is each piece by being successively identified to block by the write time
The mark with temporal meaning can be distributed when being written into data, this mark is strictly increasing, a general integer
It stores, during constantly writing data into block, the number of blocks for carrying valid data is increasing always, and mark is always
Increasing, when the mark that block A is currently written subtracts the difference that the mark of block B obtains and is more than or equal to threshold value, is containing valid data
Block B be considered the only cold data block containing cold data and invalid data.The method of this screening is granularity in blocks
Bigger, the invalid data that the cold data block screened contains may be more, and will cause may be simultaneously present inside a block
No longer there is dsc data inside block, block contains only cold data at this time finally when cold data precipitates in the case where cold and hot data
And invalid data, but will appear the situation more containing invalid data, cause the performance of solid state hard disk and service life to be affected.
Therefore, it is necessary to a kind of new method be designed, so that containing only inside block after last cold data precipitates
Cold data, the invalid data contained is fewer, promotes the performance of solid state hard disk and guarantees the service life.
Summary of the invention
It is an object of the invention to overcome the deficiencies of existing technologies, the screening technique, device, computer for providing cold data are set
Standby and storage medium.
To achieve the above object, the present invention uses following technical scheme：The screening technique of cold data, including：
Establish number registration Hash table；
The data-moving number that each page data is recorded in page is corresponded in number registration Hash table；
Judge whether the data-moving number is not less than threshold value；
If so, being cold data by the data markers that data-moving number is not less than threshold value.
Its further technical solution is：Described correspond in number registration Hash table records the data of each page data and removes in page
It moves before number step, further includes：
It writes data into the flash memory of solid state hard disk.
Its further technical solution is：After judging the step of whether the data-moving number is not less than threshold value, also wrap
It includes：
If it is not, writing data into step in the flash memory of solid state hard disk described in then returning.
Its further technical solution is：Described correspond in number registration Hash table records the data of each page data and removes in page
Move number step, including step in detail below：
Judge whether data are to be written in the flash memory of solid state hard disk for the first time；
If so, data-moving number is labeled as zero, it is recorded in the corresponding page of number Hash table, and enters in next step
Suddenly, if it is not, then entering next step；
Judge whether trigger data moves operation to solid state hard disk；
If so, moving the data in the flash memory of write-in solid state hard disk；
Data-moving number is added one, and corresponds to the data-moving number in page in update times registration Hash table；
And enter the step of whether the data-moving number is not less than threshold value judged；
If it is not, then returning to the step write data into the flash memory of solid state hard disk.
Its further technical solution is：
The number that will move is not less than the data markers of threshold value to further include after cold data step：
Cold data is stored in cold data block.
The present invention also provides the screening plants of cold data, including：
Hash table establishes unit, for establishing number registration Hash table；
Recording unit, for corresponding to the data-moving number for recording each page data in page in number registration Hash table；
Frequency judging unit, for judging whether the data-moving number is not less than threshold value；
Marking unit, for if so, being cold data by the data markers that data-moving number is not less than threshold value.
Its further technical solution is：Described device further includes：
Data write unit, for writing data into the flash memory of solid state hard disk.
Its further technical solution is：The recording unit includes：
Judgment module is written in data, for judging whether data are to be written in the flash memory of solid state hard disk for the first time；
Initialization module is used for if so, being recorded in the corresponding page of number Hash table by data-moving number labeled as zero
It is interior；
Trigger module is moved, for judging whether trigger data moves operation to solid state hard disk；
Moving module, for if so, moving the data in the flash memory of write-in solid state hard disk；
Number update module for data-moving number to be added one, and corresponds in page in update times registration Hash table
Data-moving number.
The present invention also provides a kind of computer equipments, which is characterized in that the computer equipment includes memory and place
Device is managed, is stored with computer program on the memory, the processor is realized above-mentioned cold when executing the computer program
The screening technique of data.
The present invention provides a kind of storage mediums, which is characterized in that the storage medium is stored with computer program, described
Computer program includes program instruction, and described program instructs the screening side that can realize above-mentioned cold data when being executed by a processor
Method.
Compared with the prior art, the invention has the advantages that：The present invention is breathed out by using page as unit, establishing number registration
Uncommon table registers the data-moving number of corresponding page in the page of number registration Hash table, to the Hash in number registration Hash table
Number is moved number and is compared with threshold value, filters out the page met or exceeded where the data-moving number of threshold value, is addressed to
The data markers are cold data by the data of corresponding page, and storage is arrived in cold data block, so that when under last cold data precipitating
After coming, cold data is contained only inside block, the invalid data contained is fewer, promotes the performance of solid state hard disk and guarantees the service life.
The invention will be further described in the following with reference to the drawings and specific embodiments.
Detailed description of the invention
Fig. 1 is the schematic flow diagram of the screening cold data method of available data；
Fig. 2 is the application scenario diagram of the screening technique for the cold data that a specific embodiment of the invention provides；
Fig. 3 is the schematic flow diagram one of the screening technique for the cold data that a specific embodiment of the invention provides；
Fig. 4 is the sub-step schematic flow diagram of the screening technique for the cold data that a specific embodiment of the invention provides；
Fig. 5 is the schematic flow diagram two of the screening technique for the cold data that a specific embodiment of the invention provides；
Fig. 6 is the schematic flow diagram of the screening technique for the cold data that another specific embodiment of the present invention provides；
Fig. 7 is the schematic block diagram of the screening plant for the cold data that a specific embodiment of the invention provides；
Fig. 8 is the schematic block diagram for the recording unit that a specific embodiment of the invention provides；
Fig. 9 is the schematic block diagram of the screening plant for the cold data that another specific embodiment of the present invention provides；
Figure 10 is a kind of schematic block diagram for computer equipment that a specific embodiment of the invention provides.
Specific embodiment
In order to more fully understand technology contents of the invention, combined with specific embodiments below to technical solution of the present invention into
One step introduction and explanation, but not limited to this.
It should be appreciated that ought use in this specification and in the appended claims, term " includes " and "comprising" instruction
Described feature, entirety, step, operation, the presence of element and/or component, but one or more of the other feature, whole is not precluded
Body, step, operation, the presence or addition of element, component and/or its set.
It is also understood that mesh of the term used in this present specification merely for the sake of description specific embodiment
And be not intended to limit the application.As present specification and it is used in the attached claims, unless on
Other situations are hereafter clearly indicated, otherwise " one " of singular, "one" and "the" are intended to include plural form.
It will be further appreciated that the term "and/or" used in present specification and the appended claims is
Refer to any combination and all possible combinations of one or more of associated item listed, and including these combinations.
Fig. 2 and Fig. 3 are please referred to, Fig. 2 is the applied field of the screening technique for the cold data that a specific embodiment of the invention provides
Jing Tu；Fig. 3 is the schematic flow diagram of the screening technique for the cold data that a specific embodiment of the invention provides, and this method is applied to clothes
Business device, exists in the form of Screening Platform, which can carry out data interaction with user terminal, wherein the user of user terminal
The usually data management staff of enterprise can initiate garbled data demand, clothes to server by the screening APP in user terminal
Business device feeds back data corresponding with demand to mobile terminal.
As shown in figure 3, the method comprising the steps of S110~S140.
S110, number registration Hash table is established；
In the present embodiment, number registration Hash table refers to dedicated for recording the table of the data-moving time of corresponding page.
The number of pages that the number registers Hash table is equal with the number of pages of data, that is, using page as unit, by the data in every page
Regard an entirety as, number registration Hash table allows for registering all pages of data-moving number, the data-moving of a page
Number is recorded in the correspondence page of number registration Hash table.
Specifically, the number registration Hash table an of directly addressing is built in memory to record the data-moving of each page
The page of number registration Hash table is replaced the address where data, for example, the position where data in the present embodiment by number
For page 0, then data-moving number is written on to the page 0 of number registration Hash table, can be directly obtained the position where data with
And it is corresponding move number, and for example, if a total of data of page 10 need to be written in the flash memory of solid state hard disk, number registration
Number of pages in Hash table is also page 10, and the data-moving number of page 0 is recorded in the page 0 of number registration Hash table, successively class
It pushes away.
S120, it writes data into the flash memory of solid state hard disk.
As unit of page, the data of a page are written in the flash memory of solid state hard disk, page is that the minimum of data-moving is single
Position, screening cold data is the most flexible as unit of page, and after cold data precipitates, the data in entire block are substantially contained only
Cold data, that is, the block being made of several pages for being marked as cold data can promote the performance of solid state hard disk and guarantee it
Service life.
S130, the data-moving number that each page data is recorded in page is corresponded in number registration Hash table.
Assuming that page is the minimum unit of data-moving, screening cold data is the most flexible as unit of page, establishes in memory
One number registers Hash table, and the data-moving number of corresponding page, after last cold data precipitates, block are recorded to each page
Inside substantially contains only cold data, and the invalid data contained is fewer.
It is of course also possible to multiple pages of data-moving number be registered in page, now it is necessary to by each data-moving
The problem of data registration which page number belongs to is clear, avoids the occurrence of entanglement generation.
In one embodiment, as shown in figure 4, above-mentioned S130 may include having S131~S135.
S131, judge whether data are to be written in the flash memory of solid state hard disk for the first time；
S132, if so, by data-moving number be labeled as zero, be recorded in the corresponding page of number Hash table, and enter
S133, if it is not, then entering S133；
S133, judge whether trigger data moves operation to solid state hard disk；
S134, if so, move write-in solid state hard disk flash memory in data；
S135, data-moving number is added to one, and corresponds to the data-moving number in page in update times registration Hash table；
And enter S140；
If it is not, then returning to S120.
When for being for the first time written to the data of certain one page in the flash memory of solid state hard disk, the data of this page are moved into number
It labeled as 0, is recorded in the correspondence page of number registration Hash table, for example, the sudden strain of a muscle of solid state hard disk is written in the data in page 0 for the first time
In depositing, then record data-moving number is 0 in the page 0 of number registration Hash table.
In the flash memory that the data of several pages are written to solid state hard disk, so that solid state hard disk trigger data moves mechanism,
Data are moved, move every time all can the data-moving number to the page moved carry out plus one, and update times registration is breathed out
Xi Biaonei corresponds to the data-moving number in page.For example：The data of page 0 have been moved once, then by the data-moving number of page 0
It is changed to 1, and updates the data-moving number recorded into the page 0 of number registration Hash table, hereafter, if the data-moving of page 0
Once, then add one on original data-moving number, update times register the data-moving recorded in the page 0 of Hash table
Number.
S140, judge whether the data-moving number is not less than threshold value.
If it is not, then returning to the step S120；
S150, if so, by data-moving number not less than threshold value data markers be cold data.
In the present embodiment, the data being not used for a long time after the flash memory of solid state hard disk are written and are known as cold data.
Reach threshold value when recording to exist in data-moving number in all pages of number registration Hash table, can exist from the data-moving number
Number registers page corresponding to Hash table, traces back to the page where data, is cold data by the data markers in this page.For example：
The data-moving number that number registration Hash table page 0 records meets or exceeds threshold value, and the data of page 0 are exactly cold data.
Referring to Fig. 6, Fig. 6 is the exemplary flow of the screening technique for the cold data that another specific embodiment of the present invention provides
Figure；In this embodiment, the method comprising the steps of S210~S260.The wherein step in step S210-S250 and above-described embodiment
Rapid S110-S150 is similar, and details are not described herein.The following detailed description of in the present embodiment increase step S260.
S260, cold data is stored in cold data block.
In the present embodiment, above-mentioned cold data block is a block dedicated for storing cold data.By above-mentioned label be
Cold data is stored as unit of page into the correspondence page of cold data block, and cold data block storage is all cold data, can be promoted
The performance of solid state hard disk and the service life for guaranteeing solid state hard disk.
The screening technique of above-mentioned cold data registers Hash table by using page as unit, establishing number, registers and breathe out in number
The data-moving number that corresponding page is registered in the page of uncommon table moves number and threshold value to the Hash number in number registration Hash table
It compares, filters out the page met or exceeded where the data-moving number of threshold value, be addressed to the data of corresponding page, by this
Data markers are cold data, in storage to cold data block, so that containing only inside block cold after last cold data precipitates
Data, the invalid data contained is fewer, promotes the performance of solid state hard disk and guarantees the service life.
Referring to Fig. 7, Fig. 7 is the schematic frame of the screening plant 300 for the cold data that a specific embodiment of the invention provides
Figure；As shown in fig. 7, corresponding to the screening technique of the above cold data, the present invention also provides a kind of screening plants 300 of cold data.
The screening plant 300 of the cold data includes the unit for executing the screening technique of above-mentioned cold data, which can be configured
In server.Specifically, referring to Fig. 7, the screening plant 300 of the cold data includes：
Hash table establishes unit 310, for establishing number registration Hash table.
Recording unit 330, for corresponding to the data-moving number for recording each page data in page in number registration Hash table.
Frequency judging unit 340, for judging whether the data-moving number is not less than threshold value.
Marking unit 350, the data markers for data-moving number to be not less than to threshold value are cold data.
In one embodiment, above-mentioned device further includes：
Data write unit 320, for writing data into the flash memory of solid state hard disk.
In one embodiment, as shown in figure 8, recording unit 330 includes：
Judgment module 331 is written in data, for judging whether data are to be written in the flash memory of solid state hard disk for the first time.
Initialization module 332 is used for if so, it is corresponding to be recorded in number Hash table by data-moving number labeled as zero
Page in.
Trigger module 333 is moved, for judging whether trigger data moves operation to solid state hard disk.
Moving module 334, for if so, moving the data in the flash memory of write-in solid state hard disk.
Number update module 335 for data-moving number to be added one, and corresponds in page in update times registration Hash table
Data-moving number.
Fig. 9 be another embodiment of the present invention provides a kind of cold data screening plant 300 schematic block diagram.Such as Fig. 9
Shown, the screening plant 300 of the cold data of the present embodiment is to increase storage unit 360 on the basis of above-described embodiment.
Storage unit 360, for cold data to be stored in cold data block.
It should be noted that it is apparent to those skilled in the art that, the screening plant of above-mentioned cold data
300 and each unit specific implementation process, can with reference to the corresponding description in preceding method embodiment, for convenience of description and
Succinctly, details are not described herein.
The screening plant 300 of above-mentioned cold data can be implemented as a kind of form of computer program, which can
To be run in computer equipment as shown in Figure 10.
Referring to Fig. 10, Figure 10 is a kind of schematic block diagram of computer equipment provided by the embodiments of the present application.The calculating
Machine equipment 500 can be terminal, be also possible to server, wherein terminal can be smart phone, tablet computer, notebook electricity
Brain, desktop computer, personal digital assistant and wearable device etc. have the electronic equipment of communication function.Server can be independence
Server, be also possible to the server cluster of multiple servers composition.
Refering to fig. 10, which includes processor 502, memory and the net connected by system bus 501
Network interface 505, wherein memory may include non-volatile memory medium 503 and built-in storage 504.
The non-volatile memory medium 503 can storage program area 5031 and computer program 5032.The computer program
5032 include program instruction, which is performed, and processor 502 may make to execute a kind of screening technique of cold data.
The processor 502 is for providing calculating and control ability, to support the operation of entire computer equipment 500.
The built-in storage 504 provides environment for the operation of the computer program 5032 in non-volatile memory medium 503, should
When computer program 5032 is executed by processor 502, processor 502 may make to execute a kind of screening technique of cold data.
The network interface 505 is used to carry out network communication with other equipment.It will be understood by those skilled in the art that in Figure 10
The structure shown, only the block diagram of part-structure relevant to application scheme, does not constitute and is applied to application scheme
The restriction of computer equipment 500 thereon, specific computer equipment 500 may include more more or fewer than as shown in the figure
Component perhaps combines certain components or with different component layouts.
Wherein, the processor 502 is for running computer program 5032 stored in memory, to realize following step
Suddenly：
Establish number registration Hash table；
The data-moving number that each page data is recorded in page is corresponded in number registration Hash table；
Judge whether the data-moving number is less than threshold value；
If so, being cold data by the data markers that data-moving number is not less than threshold value.
In one embodiment, processor 502 records each number of pages in realization described correspond in number registration Hash table in page
According to data-moving number step before, also realization following steps：
It writes data into the flash memory of solid state hard disk.
In one embodiment, processor 502 is realizing the step for judging the data-moving number and whether being less than threshold value
After rapid, following steps are also realized：
If it is not, writing data into step in the flash memory of solid state hard disk described in then returning.
In one embodiment, processor 502 records each number of pages in realization described correspond in number registration Hash table in page
According to data-moving number step when, be implemented as follows step：
Judge whether data are to be written in the flash memory of solid state hard disk for the first time；
If so, data-moving number is labeled as zero, it is recorded in the corresponding page of number Hash table, and enters in next step
Suddenly, if it is not, then entering next step；
Judge whether trigger data moves operation to solid state hard disk；
If so, moving the data in the flash memory of write-in solid state hard disk；
Data-moving number is added one, and corresponds to the data-moving number in page in update times registration Hash table；
And enter the step of whether the data-moving number is less than threshold value judged；
If it is not, then returning to the step write data into the flash memory of solid state hard disk.
In one embodiment, processor 502 is in the realization data markers by data-moving number not less than threshold value
After cold data step, following steps are also realized：
Cold data is stored in cold data block.
It should be appreciated that in the embodiment of the present application, processor 502 can be central processing unit
(CentralProcessing Unit, CPU), which can also be other general processors, digital signal processor
(Digital Signal Processor, DSP), specific integrated circuit (Application Specific
IntegratedCircuit, ASIC), ready-made programmable gate array (Field-Programmable Gate Array, FPGA)
Either other programmable logic device, discrete gate or transistor logic, discrete hardware components etc..Wherein, general procedure
Device can be microprocessor or the processor is also possible to any conventional processor etc..
Those of ordinary skill in the art will appreciate that be realize above-described embodiment method in all or part of the process,
It is that relevant hardware can be instructed to complete by computer program.The computer program includes program instruction, computer journey
Sequence can be stored in a storage medium, which is computer readable storage medium.The program instruction is by the department of computer science
At least one processor in system executes, to realize the process step of the embodiment of the above method.
Therefore, the present invention also provides a kind of storage mediums.The storage medium can be computer readable storage medium.This is deposited
Storage media is stored with computer program, and wherein computer program includes program instruction.The program instruction makes when being executed by processor
Processor executes following steps：
Establish number registration Hash table；
The data-moving number that each page data is recorded in page is corresponded in number registration Hash table；
Judge whether the data-moving number is less than threshold value；
If so, being cold data by the data markers that data-moving number is not less than threshold value.
In one embodiment, the processor is realized described in number registration Hash table pair in the instruction of execution described program
Before answering the data-moving number step for recording each page data in page, following steps are also realized：
It writes data into the flash memory of solid state hard disk.
In one embodiment, the processor realizes the judgement data-moving executing described program instruction
After the step of whether number is less than threshold value, following steps are also realized：
If it is not, writing data into step in the flash memory of solid state hard disk described in then returning.
In one embodiment, the processor realizes that registering Hash table in number corresponds to page executing described program instruction
When inside recording the data-moving number of each page data, it is implemented as follows step：
Judge whether data are to be written in the flash memory of solid state hard disk for the first time；
If so, data-moving number is labeled as zero, it is recorded in the corresponding page of number Hash table, and enters in next step
Suddenly, if it is not, then entering next step；
Judge whether trigger data moves operation to solid state hard disk；
If so, moving the data in the flash memory of write-in solid state hard disk；
Data-moving number is added one, and corresponds to the data-moving number in page in update times registration Hash table；
And enter the step of whether the data-moving number is less than threshold value judged；
If it is not, then returning to the step write data into the flash memory of solid state hard disk.
In one embodiment, the processor is realized described that data-moving number is not small in the instruction of execution described program
In threshold value data markers be cold data step after, also realization following steps：
Cold data is stored in cold data block.
The storage medium can be USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), magnetic disk
Or the various computer readable storage mediums that can store program code such as CD.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware
With the interchangeability of software, each exemplary composition and step are generally described according to function in the above description.This
A little functions are implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Specially
Industry technical staff can use different methods to achieve the described function each specific application, but this realization is not
It is considered as beyond the scope of this invention.
In several embodiments provided by the present invention, it should be understood that disclosed device and method can pass through it
Its mode is realized.For example, the apparatus embodiments described above are merely exemplary.For example, the division of each unit, only
Only a kind of logical function partition, there may be another division manner in actual implementation.Such as multiple units or components can be tied
Another system is closed or is desirably integrated into, or some features can be ignored or not executed.
The steps in the embodiment of the present invention can be sequentially adjusted, merged and deleted according to actual needs.This hair
Unit in bright embodiment device can be combined, divided and deleted according to actual needs.In addition, in each implementation of the present invention
Each functional unit in example can integrate in one processing unit, is also possible to each unit and physically exists alone, can also be with
It is that two or more units are integrated in one unit.
If the integrated unit is realized in the form of SFU software functional unit and when sold or used as an independent product,
It can store in one storage medium.Based on this understanding, technical solution of the present invention is substantially in other words to existing skill
The all or part of part or the technical solution that art contributes can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, terminal or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention.
It is above-mentioned that technology contents of the invention are only further illustrated with embodiment, in order to which reader is easier to understand, but not
It represents embodiments of the present invention and is only limitted to this, any technology done according to the present invention extends or recreation, by of the invention
Protection.Protection scope of the present invention is subject to claims.
Claims (10)
1. the screening technique of cold data, which is characterized in that including：
Establish number registration Hash table；
The data-moving number that each page data is recorded in page is corresponded in number registration Hash table；
Judge whether the data-moving number is not less than threshold value；
If so, being cold data by the data markers that data-moving number is not less than threshold value.
2. the screening technique of cold data according to claim 1, which is characterized in that described corresponding in number registration Hash table
Before the data-moving number step for recording each page data in page, further include：
It writes data into the flash memory of solid state hard disk.
3. the screening technique of cold data according to claim 2, which is characterized in that whether judge the data-moving number
After threshold step, further include：
If it is not, writing data into step in the flash memory of solid state hard disk described in then returning.
4. the screening technique of cold data according to claim 2, which is characterized in that described corresponding in number registration Hash table
The data-moving number step of each page data, including step in detail below are recorded in page：
Judge whether data are to be written in the flash memory of solid state hard disk for the first time；
If so, data-moving number is labeled as zero, it is recorded in the corresponding page of number Hash table, and enters next step,
If it is not, then entering next step；
Judge whether trigger data moves operation to solid state hard disk；
If so, moving the data in the flash memory of write-in solid state hard disk；
Data-moving number is added one, and corresponds to the data-moving number in page in update times registration Hash table；
And enter the step of whether the data-moving number is not less than threshold value judged；
If it is not, then returning to the step write data into the flash memory of solid state hard disk.
5. the screening technique of cold data according to claim 1, which is characterized in that the number that will move is not less than threshold value
Data markers be cold data step after, further include：
Cold data is stored in cold data block.
6. the screening plant of cold data, which is characterized in that including：
Hash table establishes unit, for establishing number registration Hash table；
Recording unit, for corresponding to the data-moving number for recording each page data in page in number registration Hash table；
Frequency judging unit, for judging whether the data-moving number is not less than threshold value；
Marking unit, for if so, being cold data by the data markers that data-moving number is not less than threshold value.
7. the screening plant of cold data according to claim 6, which is characterized in that described device further includes：
Data write unit, for writing data into the flash memory of solid state hard disk.
8. the screening plant of cold data according to claim 7, which is characterized in that the recording unit includes：
Judgment module is written in data, for judging whether data are to be written in the flash memory of solid state hard disk for the first time；
Initialization module is used for if so, being recorded in the corresponding page of number Hash table by data-moving number labeled as zero；
Trigger module is moved, for judging whether trigger data moves operation to solid state hard disk；
Moving module, for if so, moving the data in the flash memory of write-in solid state hard disk；
Number update module for data-moving number to be added one, and corresponds to the data in page in update times registration Hash table
Move number.
9. a kind of computer equipment, which is characterized in that the computer equipment includes memory and processor, on the memory
It is stored with computer program, the processor is realized as described in any one of claims 1 to 5 when executing the computer program
Cold data screening technique.
10. a kind of storage medium, which is characterized in that the storage medium is stored with computer program, the computer program packet
Program instruction is included, described program instruction can realize the cold number as described in any one of claims 1 to 5 when being executed by a processor
According to screening technique.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810771853.3A CN108920108B (en) | 2018-07-13 | 2018-07-13 | Cold data screening method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810771853.3A CN108920108B (en) | 2018-07-13 | 2018-07-13 | Cold data screening method and device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108920108A true CN108920108A (en) | 2018-11-30 |
| CN108920108B CN108920108B (en) | 2022-02-01 |
Family
ID=64412843
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810771853.3A Active CN108920108B (en) | 2018-07-13 | 2018-07-13 | Cold data screening method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108920108B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111081198A (en) * | 2019-11-29 | 2020-04-28 | Tcl移动通信科技（宁波）有限公司 | Data control method, data control device, storage medium and terminal device |
| CN111273867A (en) * | 2020-01-18 | 2020-06-12 | 苏州浪潮智能科技有限公司 | Block-based data relocation method, system, terminal and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103092618A (en) * | 2013-01-15 | 2013-05-08 | 东南大学 | Dalvik virtual machine just-in-time compilation (JIT) acceleration method based on software Cache |
| CN103238145A (en) * | 2010-12-03 | 2013-08-07 | 华为技术有限公司 | Method and apparatus for high performance, updatable, and deterministic hash table for network equipment |
| US20140337566A1 (en) * | 2007-08-14 | 2014-11-13 | Samsung Electronics Co., Ltd. | Solid state memory (ssm), computer system including an ssm, and method of operating an ssm |
| CN104375944A (en) * | 2013-08-14 | 2015-02-25 | 联想(北京)有限公司 | Method and device for storing data |
| CN105677242A (en) * | 2015-12-31 | 2016-06-15 | 杭州华为数字技术有限公司 | Hot and cold data separation method and device |
| CN105917303A (en) * | 2014-12-23 | 2016-08-31 | 华为技术有限公司 | Controller, method for identifying data block stability and storage system |
| CN106610790A (en) * | 2015-10-26 | 2017-05-03 | 华为技术有限公司 | Repeated data deleting method and device |
-
2018
- 2018-07-13 CN CN201810771853.3A patent/CN108920108B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140337566A1 (en) * | 2007-08-14 | 2014-11-13 | Samsung Electronics Co., Ltd. | Solid state memory (ssm), computer system including an ssm, and method of operating an ssm |
| CN103238145A (en) * | 2010-12-03 | 2013-08-07 | 华为技术有限公司 | Method and apparatus for high performance, updatable, and deterministic hash table for network equipment |
| CN103092618A (en) * | 2013-01-15 | 2013-05-08 | 东南大学 | Dalvik virtual machine just-in-time compilation (JIT) acceleration method based on software Cache |
| CN104375944A (en) * | 2013-08-14 | 2015-02-25 | 联想(北京)有限公司 | Method and device for storing data |
| CN105917303A (en) * | 2014-12-23 | 2016-08-31 | 华为技术有限公司 | Controller, method for identifying data block stability and storage system |
| CN106610790A (en) * | 2015-10-26 | 2017-05-03 | 华为技术有限公司 | Repeated data deleting method and device |
| CN105677242A (en) * | 2015-12-31 | 2016-06-15 | 杭州华为数字技术有限公司 | Hot and cold data separation method and device |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111081198A (en) * | 2019-11-29 | 2020-04-28 | Tcl移动通信科技（宁波）有限公司 | Data control method, data control device, storage medium and terminal device |
| CN111273867A (en) * | 2020-01-18 | 2020-06-12 | 苏州浪潮智能科技有限公司 | Block-based data relocation method, system, terminal and storage medium |
| CN111273867B (en) * | 2020-01-18 | 2023-01-10 | 苏州浪潮智能科技有限公司 | Block-based data relocation method, system, terminal and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108920108B (en) | 2022-02-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104040516B (en) | Method, apparatus and system for data deduplication | |
| CN108200008A (en) | The recognition methods and device that abnormal data accesses | |
| CN106844108A (en) | A kind of date storage method, server and storage system | |
| CN108920108A (en) | Screening technique, device, computer equipment and the storage medium of cold data | |
| CN109685336A (en) | Collection task distribution method, device, computer equipment and storage medium | |
| CN110941514A (en) | Data backup method, data recovery method, computer equipment and storage medium | |
| CN108920107A (en) | Screen method, apparatus, computer equipment and the storage medium of cold data | |
| CN104731626B (en) | The installation method and device of application | |
| CN105573757B (en) | The language update method and device of android system | |
| CN109741038A (en) | Token processing method, computer readable storage medium and electronic equipment based on block chain account | |
| CN108694672A (en) | Order processing method, apparatus, computer equipment and storage medium | |
| CN110535476A (en) | LDPC soft decoder Soft Inform ation storage optimization method, device, computer equipment and storage medium | |
| CN108984124A (en) | Reduce the method, apparatus, computer equipment and storage medium for writing amplification | |
| US20160239420A1 (en) | System and method for managing a cache pool | |
| CN113687949A (en) | Server deployment method, device, deployment equipment and storage medium | |
| CN110471625B (en) | Bad block information protection method and device, computer equipment and storage medium | |
| CN106663053A (en) | Data Operation Method And Electronic Device | |
| CN109325073A (en) | The implementation method and device of distributed transaction | |
| CN107644020A (en) | Data storage and the method and device called | |
| CN110471896A (en) | A kind of data processing method, system and server | |
| CN109710187A (en) | Read command accelerated method, device, computer equipment and the storage medium of NVMe SSD main control chip | |
| CN102143614A (en) | Updating method and home gateway equipment | |
| CN102202129B (en) | Method for loading mobile phone operating system | |
| CN106325821B (en) | A kind of pointer management method and device | |
| CN106503511A (en) | A kind of method and device for improving mobile phone removal of home cryptographic check security |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |