CN110442309A - A kind of cold and hot method for interchanging data and system based on optical storage - Google Patents
A kind of cold and hot method for interchanging data and system based on optical storage Download PDFInfo
- Publication number
- CN110442309A CN110442309A CN201910671678.5A CN201910671678A CN110442309A CN 110442309 A CN110442309 A CN 110442309A CN 201910671678 A CN201910671678 A CN 201910671678A CN 110442309 A CN110442309 A CN 110442309A
- Authority
- CN
- China
- Prior art keywords
- data
- buffer area
- cold
- temperature parameter
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003287 optical effect Effects 0.000 title claims abstract description 43
- 238000000034 method Methods 0.000 title claims abstract description 27
- 230000005012 migration Effects 0.000 claims abstract description 20
- 238000013508 migration Methods 0.000 claims abstract description 20
- 241000208340 Araliaceae Species 0.000 claims description 2
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 claims description 2
- 235000003140 Panax quinquefolius Nutrition 0.000 claims description 2
- 235000008434 ginseng Nutrition 0.000 claims description 2
- 230000015654 memory Effects 0.000 description 17
- 230000006399 behavior Effects 0.000 description 9
- 230000008569 process Effects 0.000 description 8
- 238000012423 maintenance Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000007726 management method Methods 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000002360 explosive Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0611—Improving I/O performance in relation to response time
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
- G06F3/0649—Lifecycle management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0656—Data buffering arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0674—Disk device
- G06F3/0677—Optical disk device, e.g. CD-ROM, DVD
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to a kind of cold and hot method for interchanging data and system based on optical storage, the following steps are included: when the size that request data is located at cold data area and request data is greater than the remaining permission storage size of buffer area, the temperature parameter of request data is compared with the temperature parameter of the stored data of buffer area, determines whether to migrate request data to buffer area and by the stored Data Migration of part or all of buffer area to cold data area according to comparison result；The temperature parameter of request data is updated according to real-time request of data；The buffer area is a part in dsc data area, and the cold data area uses optical storage.The present invention can reduce the time of user's read requests data, promote user to the usage experience of optical storage.
Description
Technical field
The present invention relates to technical field of data storage, more particularly, to a kind of cold and hot data exchange based on optical storage
Method and system.
Background technique
In big data era, data volume is in explosive growth, however these data will soon be by " heat " change " cold ".For
Network social intercourse platform, data are generally to generate the frequency that accesses in 24 hours very high, and hereafter access frequency is just increasingly
It is low, gradually become cold data.But these cold datas can not be abandoned directly, and cold data is critically important number for big data analysis
According to source, need for a long time to save cold data.
Since optical storage system belongs to off-line type storage, when reading data, need first to be loaded into CD after CD-ROM drive
Readable data can be caused to open the slow experience of file to user, and be limited under certain scene by CD-ROM drive quantity, so that together
Walk the limited amount read.It and is effective method for promoting data read rates using caching mechanism.
The data for being put into caching are carried out serializing management by existing data cache method, judge that accessed data are
It is no to deposit in the buffer, if otherwise by the head of accessed data deposit buffer queue, when buffer queue is full, by buffer queue
The data of tail portion remove buffer queue.This simply serializing management does not fully consider the accessed situation of data, and
Data cached removal and shift-in cannot be optimized.
Summary of the invention
The present invention is directed to overcome at least one defect (deficiency) of the above-mentioned prior art, provide a kind of based on the cold of optical storage
Dsc data exchanges method and system, it is possible to reduce the time of user's read requests data promotes user and uses body to optical storage
It tests.
The technical solution adopted by the present invention is that:
A kind of cold and hot method for interchanging data based on optical storage, comprising the following steps:
When the size that request data is located at cold data area and request data is greater than the remaining permission storage size of buffer area,
The temperature parameter of request data is compared with the temperature parameter of the stored data of buffer area, is according to comparison result determination
It is no to migrate request data to buffer area and by the stored Data Migration of part or all of buffer area to cold data area；
The temperature parameter of request data is updated according to real-time request of data；
The buffer area is a part in dsc data area, and the cold data area uses optical storage.
In dsc data Division a part as buffer area, which is the exchange area of cold data and dsc data.Pass through
Real-time update records the temperature parameter of data, can more fully, accurately be compared in storage system not according to temperature parameter
With the relatively cold and hot degree between data, allow the cold data that relatively hot data are slower from reading speed by comparing
Area is migrated to the faster buffer area of reading speed, and relatively cold data can be migrated from the faster buffer area of reading speed to reading
Slow cold data area is taken, thus realize the exchange between cold and hot data, to reduce the waiting time that user reads data,
User is promoted to the usage experience of optical storage.
Further, when the type of temperature parameter is multiple, the temperature parameter to request data and buffer area are
The temperature parameter of the data of storage is compared, specifically: according to the priority orders of the temperature parameter of multiple types by height to
Low land is compared the temperature parameter of request data with the temperature parameter of the stored data of buffer area.
In order to more fully measure the cold and hot degree of data, the temperature parameter type of data can be multiple.At this point it is possible to
The priority orders for presetting multiple temperature parameters, in the temperature parameter of relatively request data and the stored data of buffer area,
It can according to priority sequence sequentially more each temperature parameter from high to low.
Further, the method also includes following steps:
According to the type and/or priority orders of the input configuration temperature parameter of user.
Different user has different reading data behaviors and different data requirements habits.The type of temperature parameter and preferential
Grade sequence can voluntarily be configured by user, and user's compactness can be improved, and further promote user for the usage experience of optical storage.
Further, the type of the temperature parameter includes access frequency, access time, data type, size of data, number
According to a variety of there are the time in buffer area.
Further, the priority orders of the temperature parameter are from high to low are as follows: when access frequency, data type, access
Between, there are the times in buffer area for size of data, data.
A kind of cold and hot data exchange system based on optical storage, including；
Comparison module, the size for being located at cold data area and request data when request data allow to deposit greater than buffer area is remaining
When storing up the size in space, the temperature parameter of request data is compared with the temperature parameter of the stored data of buffer area, root
Determine whether to migrate request data to buffer area and by the stored Data Migration of part or all of buffer area according to comparison result
To cold data area；Update module, for updating the temperature parameter of request data according to real-time request of data；
The buffer area is a part in dsc data area, and the cold data area uses optical storage.
In dsc data Division a part as buffer area, which is the exchange area of cold data and dsc data.Pass through
Update module real-time update records the temperature parameter of data, and comparison module can be according to temperature parameter more fully, accurately
Compare the relatively cold and hot degree in storage system between different data, allows relatively hot data from reading by comparing
Slow cold data area is migrated to the faster buffer area of reading speed, and relatively cold data can be very fast from reading speed
Buffer area migrate the cold data area slower to reading speed, so that the exchange between cold and hot data is realized, to reduce user's reading
The waiting time for evidence of fetching promotes user to the usage experience of optical storage.
Further, the system also includes:
Priority Determination module, for determining the preferential of the temperature parameter of multiple types when the type of temperature parameter is multiple
Grade sequence；The comparison module is used to carry out the temperature parameter of request data and the temperature parameter of the stored data of buffer area
The step of comparing, specifically: according to the priority orders of the temperature parameter of multiple types from high to low to the heat of request data
Degree parameter is compared with the temperature parameter of the stored data of buffer area.
In order to more fully measure the cold and hot degree of data, the temperature parameter type of data can be multiple.At this point it is possible to
The priority orders that multiple temperature parameters are preset by Priority Determination module compare request data and buffer area in comparison module
It, can according to priority sequence sequentially more each temperature parameter from high to low when the temperature parameter of stored data.
Further, the system also includes:
User configuration module configures the type and/or priority orders of temperature parameter for the input according to user.
Different user has different reading data behaviors and different data requirements habits.The type of temperature parameter and preferential
Grade sequence can voluntarily be configured by user configuration module by user, user's compactness can be improved, further promoted user for
The usage experience of optical storage.
Further, the type of the temperature parameter includes access frequency, access time, data type, size of data, number
According to a variety of there are the time in buffer area.
Further, the priority orders of the temperature parameter are from high to low are as follows: when access frequency, data type, access
Between, there are the times in buffer area for size of data, data.
Compared with prior art, the invention has the benefit that
(1) by recording the temperature parameter of more new data in real time, cold data and hot number are realized in buffer area according to temperature parameter
Exchange between, falling into a long wait when user being avoided to read data greatly promote the experience that user uses optical storage；
(2) by the way that the temperature parameter of multiple types and the priority orders of the multiple type temperature parameters of setting are arranged, can make
The relatively cold and hot degree between data can more comprehensively, more accurately be judged by obtaining temperature parameter；
(3) type of temperature parameter and priority orders can freely be customized by user, and optical storage is more bonded
User is accustomed to the usage behavior of data, further promotes the experience that user uses optical storage.
Detailed description of the invention
Fig. 1 is the method flow diagram of the embodiment of the present invention 1.
Fig. 2 is that the system of the embodiment of the present invention 2 forms figure one.
Fig. 3 is that the system of the embodiment of the present invention 2 forms figure two.
Fig. 4 is that the system of the embodiment of the present invention 2 forms figure three.
Specific embodiment
Attached drawing of the present invention only for illustration, is not considered as limiting the invention.It is following in order to more preferably illustrate
Embodiment, the certain components of attached drawing have omission, zoom in or out, and do not represent the size of actual product；For art technology
For personnel, the omitting of some known structures and their instructions in the attached drawings are understandable.
Embodiment 1
As shown in Figure 1, the present embodiment provides a kind of cold and hot method for interchanging data based on optical storage, comprising the following steps:
When the size that request data is located at cold data area and request data is greater than the remaining permission storage size of buffer area,
The temperature parameter of request data is compared with the temperature parameter of the stored data of buffer area, is according to comparison result determination
It is no to migrate request data to buffer area and by the stored Data Migration of part or all of buffer area to cold data area；
The temperature parameter of request data is updated according to real-time request of data；
The buffer area is a part in dsc data area, and the cold data area uses optical storage.
Based on optical storage reading speed compared with the slow but higher feature of memory reliability, by storage system be divided into dsc data area and
Cold data area, cold data area use optical storage, and the faster storage form of reading speed can be used in dsc data area, such as RAM (Random
Access Memory, random access memory), flash, disk storage etc..In dsc data Division a part as slow
Area is deposited, which is the exchange area of cold data and dsc data.The temperature parameter that data are recorded by real-time update, can basis
Temperature parameter more fully, accurately compares the relatively cold and hot degree in storage system between different data, makes by comparing
Relatively hot data can be migrated from the slower cold data area of reading speed to the faster buffer area of reading speed, relatively
Cold data can migrate the cold data area slower to reading speed from the faster buffer area of reading speed, to realize cold and hot number
Exchange between promotes user to the usage experience of optical storage to reduce the waiting time that user reads data.
Specifically, when user proposes access request data, first judge that request data is to be located at dsc data area or cold number
According to area.When user needs the request data that accesses to be located at dsc data area, can directly from dsc data area read requests data
To the user for issuing request of data；When user needs the request data accessed to be located at cold data area, CD-ROM drive read requests are loaded
Data will also judge whether the size of request data is greater than that buffer area is remaining to be allowed to deposit to issuing the user of request of data
Space size is stored up, if otherwise request data directly can be migrated the buffer area into dsc data area from cold data area, if
It needs to compare the temperature parameter of storing data in request data and buffer area, namely compares and deposited in request data and buffer area
Store up the relatively cold and hot degree between data.If comparison result is request data than storing data is cold in buffer area, request
Data are still stored in cold data area, and the data of cache bank memories storage also remain unchanged；If comparison result is request data than slow
Stored part or all of data heat in area is deposited, then request data is migrated and is stored into buffer area, ratio in buffer area is asked
The Data Migration for asking data cold is stored into cold data area.
When the requested access of request data, request data can be promoted relative to its temperature of other data, be needed at this time pair
The temperature parameter of request data is updated maintenance, to continue to carry out the ratio of the cold and hot degree of data according to temperature parameter in real time
Compared with.The form that database can be used in temperature parameter is updated and safeguards.
The remaining storage size for allowing storage size to can be buffer area of buffer area subtracts buffer area and has deposited
The space size for storing up data, the permission maximum memory space size for being also possible to buffer area subtract the sky of buffer area storing data
Between size, wherein the permission maximum memory space size of buffer area be less than buffer area storage size.The permission of buffer area
Maximum memory space size can be set to storage size (such as 90% buffer area storage sky of a certain proportion of buffer area
Between size) or be set as a definite value (such as 100G).
It, can be in the temperature parameter to request data to the updating maintenance of request data temperature parameter in specific implementation process
Carry out before being compared with the temperature parameter of the stored data of buffer area, can also to request data temperature parameter with
The temperature parameter of the stored data of buffer area carries out after being compared.
In specific implementation process, total data colder than request data in buffer area can all be migrated into cold data area
Storage.Partial data colder than request data in buffer area can also be migrated into cold data area and be stored.
Preferably, the method also includes following steps:
Request data is migrated to buffer area and by the stored Data Migration of part or all of buffer area to cold data when determining
Qu Shi is moved when choosing in the total data colder than request data of buffer area storage according to the remaining space size of buffer area
Move to the data in cold data area.
The remaining space size according to buffer area is selected in the cold total data of the ratio request data of buffer area storage
The data that migrate to cold data area are taken, specifically includes the following steps:
The cold total data of the ratio request data that buffer area is stored treats selection number according to temperature parameter as access evidence to be selected
According to being ranked up, sequentially choosing in from access to be selected by the sequence by being as cold as heat will be migrated to the data in cold data area；
The remaining space size of buffer area is calculated to the data in cold data area according to migrating of having chosen；
Judge whether the remaining space size of buffer area is greater than preset remaining space threshold value or judge buffer area has deposited sky
Between size whether be less than it is preset deposited capacity-threshold, according to judging result decide whether stop choose to migrate to cold data area
Data.
The remaining space size of buffer area will be moved plus determination before the remaining space size of above-mentioned buffer area can be migration
The space size for the data for moving to cold data area subtracts the space size of request data, can not also consider that request data can migrate
It is directly that the remaining space size of buffer area will be migrated plus determination to the number in cold data area before migrating to the influence in cold data area
According to space size.
In specific implementation process, if according to comparison result determine need to migrate request data to buffer area and will part or
Whole stored Data Migrations of buffer area can first migrate the request data in cold data area to buffer area to cold data area
It, can also be first by the Data Migration to be migrated in buffer area to cold again by the Data Migration to be migrated in buffer area to cold data area
Data field again migrates the request data in cold data area to buffer area.
If non-caching area's memory space inadequate in dsc data area, data can be moved some or all of in non-caching area
Move to cold data area；It, can also be by the part in non-caching area when the remaining permission storage size of buffer area is sufficiently large
Or total data synchronous migration is to buffer area.
In the present embodiment, when the type of temperature parameter is multiple, the temperature parameter to request data and caching
The temperature parameter of the stored data in area is compared, specifically: according to the priority orders of the temperature parameter of multiple types by
The temperature parameter of request data is compared with the temperature parameter of the stored data of buffer area high to Lowly.
In order to more fully measure the cold and hot degree of data, the temperature parameter type of data can be multiple.At this point it is possible to
The priority orders for presetting multiple temperature parameters, in the temperature parameter of relatively request data and the stored data of buffer area,
It can according to priority sequence sequentially more each temperature parameter from high to low.
Specifically, first compare the temperature parameter that priority orders are first, if judging number of request according to the temperature parameter
It is inconsistent according to the cold and hot degree with the most cold data in buffer area storing data, namely just according to first temperature parameter
It may determine that the relatively cold and hot degree of request data and buffer area between storing data, then stop comparing；If according to the heat
Degree parameter judges that request data and the cold and hot degree of the most cold data in buffer area storing data are consistent, namely according to
First temperature parameter fails to judge the relatively cold and hot degree of request data and buffer area between storing data, then continues to compare
Compared with priority orders be second temperature parameter, and so on.
In the present embodiment, the method also includes following steps:
According to the type and/or priority orders of the input configuration temperature parameter of user.
Different user has different reading data behaviors and different data requirements habits.The type of temperature parameter and preferential
Grade sequence can voluntarily be configured by user, and user's compactness can be improved, and further promote user for the usage experience of optical storage.
In the present embodiment, the type of the temperature parameter includes that access frequency, access time, data type, data are big
Small, data are a variety of there are the time in buffer area.
Access frequency refers to the total degree being accessed by the user after data enter cold data area, and access frequency is higher to be shown to count
It is on the contrary then colder according to hotter.
Access time refers to the data last time accessed time, and access time is more early to show that data are hotter, it is on the contrary then
It is colder.
Data type can refer to the type of record data, such as picture category, video class, document class, document class data can
It can be the summary of picture category data or video class data, it at this time can be with definition document class data than picture category data and video class number
According to heat, picture category data may occupy little space than the storage of video class data, deposit in order to which buffer area can vacate more spaces
The more relatively hot data of storage can define picture category data than video class data heat at this time.
Data type may also mean that user assigns the type of data, such as occurrences in human life class, financial category, publicity class, routine work
Class etc. only may just need requested access for occurrences in human life class data when change of personnel or collective's tune firewood, and daily
Service class data are the requested access of daily need, can define the relatively cold and hot degree of different types of data at this time as finance
Class data are equal with publicity class temperature, and occurrences in human life analogy financial category, publicity class temperature are low, and routine work class data are than financial category, a surname
It is high to pass class temperature.
Size of data refers to the occupied storage size of storing data.It is deposited in order to which buffer area can vacate more spaces
The more relatively hot data of storage, it is hotter to define the smaller data of size of data, on the contrary then colder.
There are the times in buffer area to refer to data Zi migrating to buffer area to the duration for migrating out buffer area, if should for data
Data do not migrate out buffer area also, then refer to data from the duration migrated to buffer area till now.Data exist in buffer area
Time is longer, shows that the temperature of the data is always held at higher level, therefore data are longer there are the time in buffer area
Show that data are hotter, it is on the contrary then colder.
In the present embodiment, the priority orders of the temperature parameter are from high to low are as follows: access frequency, data type, visit
Ask that there are the times in buffer area for time, size of data, data.
Access frequency is most directly to reflect a temperature parameter of the cold and hot degree of data, therefore the priority of access frequency
It is highest in 5 temperature parameters.
Data type and access time are all the temperature parameters for being bonded user and being accustomed to data usage behavior, and data
Type also reflects the size of data indirectly simultaneously, therefore the priority ratio access time of data type is high.
Size of data is accustomed to usage behavior of the user to data without very big connection based on the considerations of memory space
System can not be well reflected user to the requirements for access temperature of data, thus the priority of size of data should than access frequency,
Data type, access time are low.
When comparing there are the time as the cold and hot degree between a temperature parameter progress data in data buffer storage, if data
Longer there are the time in caching, then the probability that data remain in buffer area can be bigger and leads in data buffer storage that there are the times
It increasingly grows and generates locking phenomenon, therefore it is minimum that there are the priority of time in 5 temperature parameters in data buffer storage.
In specific implementation process, every class temperature parameter is respectively equipped with enabled switch.User can be by controlling enabled switch
Opening and closing, configuration using which kind or which type temperature parameter.
For example, user opens the enabled switch of access frequency and the two temperature parameters of access time, data are closed
There is the enabled switch of time in type, size of data, data, then two heat of access frequency and access time are used only in the buffer
Spend parameter.Need to compare the temperature parameter of request data and the temperature of buffer area storing data in buffer area memory space inadequate
When parameter, if the access frequency of the access frequency of request data storing data than buffer area is high, which has been stored
Data Migration migrates request data to buffer area to cold data area；If the access frequency of request data has been stored with buffer area
The access frequency of data is the same, then continues to compare access time, if the access time of request data storing data than buffer area
Access time it is early, then by the buffer area, storing data is migrated to cold data area, and request data is migrated to buffer area.
Embodiment 2
As shown in Fig. 2, the present embodiment provides a kind of cold and hot data exchange system based on optical storage, including；
Comparison module 10, the size for being located at cold data area and request data when request data are greater than the remaining permission of buffer area
When the size of memory space, the temperature parameter of request data is compared with the temperature parameter of the stored data of buffer area,
Determined whether to migrate request data according to comparison result to buffer area and moves the stored data of part or all of buffer area
Move to cold data area；Update module 20, for updating the temperature parameter of request data according to real-time request of data；
The buffer area is a part in dsc data area, and the cold data area uses optical storage.
Based on optical storage reading speed compared with the slow but higher feature of memory reliability, by storage system be divided into dsc data area and
Cold data area, cold data area use optical storage, and the faster storage form of reading speed can be used in dsc data area, such as RAM (Random
Access Memory, random access memory), flash, disk storage etc..In dsc data Division a part as slow
Area is deposited, which is the exchange area of cold data and dsc data.The temperature ginseng of data is recorded by 20 real-time update of update module
Number, comparison module 10 can more fully, accurately compare the phase in storage system between different data according to temperature parameter
To cold and hot degree, migrate relatively hot data from the slower cold data area of reading speed fast to reading
Spend faster buffer area, relatively cold data can be migrated from the faster buffer area of reading speed to slower cold of reading speed
Data field, to reduce the waiting time that user reads data, promotes user and deposits to light to realize the exchange between cold and hot data
The usage experience of storage.
As shown in figure 3, specifically, the system also includes first judgment modules 31, the second judgment module 32, transferring module
40, when user propose access request data when, the first judgment module 31 judge request data be located at dsc data area or
Cold data area.When first judgment module 31 judges that user needs the request data accessed to be located at dsc data area, transferring module 40
Read requests data the user for issuing request of data can be given directly from dsc data area；When first judgment module 31 judges user
When the request data for needing to access is located at cold data area, load CD-ROM drive read requests data are to the user for issuing request of data, together
When the second judgment module 32 judge whether the size of request data is greater than the remaining permission storage size of buffer area.If second
Judgment module 32 judges that the size of request data no more than the remaining permission storage size of buffer area, then will can be asked directly
Data are asked to migrate the buffer area into dsc data area from cold data area；If the second judgment module 32 judges that the size of request data is big
In the remaining permission storage size of buffer area, then needs to compare by comparing module 10 and deposited in request data and buffer area
The temperature parameter of data is stored up, namely compares in request data and buffer area the relatively cold and hot degree between storing data.If
Comparison result is request data than storing data is cold in buffer area, then request data is still stored in cold data area, in buffer area
The data of storage also remain unchanged；If comparison result be request data than in buffer area stored part or all of data
Request data is then migrated and is stored into buffer area by heat, by Data Migration colder than request data in buffer area to cold data area
Middle storage.
When the requested access of request data, request data can be promoted relative to its temperature of other data, by updating mould
Block 20 is updated maintenance to the temperature parameter of request data, to continue to carry out the cold and hot degree of data according to temperature parameter in real time
Comparison.
The form that database can be used in temperature parameter is updated and safeguards that update module 20 is according to real-time request of data
The temperature parameter of request data is updated in temperature parameter database.
The remaining storage size for allowing storage size to can be buffer area of buffer area subtracts buffer area and has deposited
The space size for storing up data, the permission maximum memory space size for being also possible to buffer area subtract the sky of buffer area storing data
Between size, wherein the permission maximum memory space size of buffer area be less than buffer area storage size.The permission of buffer area
Maximum memory space size can be set to storage size (such as 90% buffer area storage sky of a certain proportion of buffer area
Between size) or be set as a definite value (such as 100G).
In specific implementation process, update module 20 can be in comparison module 10 to the updating maintenance of request data temperature parameter
Carried out before being compared to the temperature parameter of request data with the temperature parameter of the stored data of buffer area, can also than
It is carried out after being compared to the temperature parameter of request data with the temperature parameter of the stored data of buffer area compared with module 10.
In specific implementation process, total data colder than request data in buffer area can all be migrated into cold data area
Storage.Partial data colder than request data in buffer area can also be migrated into cold data area and be stored, such as when part number
After migrating into cold data area storage, the size of request data has been less than the remaining permission storage size of buffer area, then
It can stop Data Migration to cold data area.
As shown in Figure 4, it is preferable that the system also includes:
Module 50 is chosen, for migrating request data to buffer area and by the stored number of part or all of buffer area when determining
When according to migrating to cold data area, according to the remaining space size of buffer area, in the whole that the ratio request data of buffer area storage is cold
Choosing in data will migrate to the data in cold data area.
The selection module 50, specifically includes:
Sorting module 51, the cold total data of ratio request data for storing buffer area is as access evidence to be selected, according to heat
Degree parameter is treated selection data and is ranked up, and sequentially choosing in from access to be selected by the sequence by being as cold as heat will migrate to cold number
According to the data in area；
Computing module 52, the remaining space for calculating buffer area to the data in cold data area according to migrating of having chosen are big
It is small；Third judgment module 53, for judge the remaining space size of buffer area whether be greater than preset remaining space threshold value or
Judge buffer area deposited space size whether be less than it is preset deposited capacity-threshold, according to judging result decide whether stop choosing
Take the data that migrate to cold data area.
The remaining space size of buffer area will be moved plus determination before the remaining space size of above-mentioned buffer area can be migration
The space size for the data for moving to cold data area subtracts the space size of request data, can not also consider that request data can migrate
It is directly that the remaining space size of buffer area will be migrated plus determination to the number in cold data area before migrating to the influence in cold data area
According to space size.
In specific implementation process, if comparison module 10 needs to migrate request data to buffer area according to comparison result determination
And by the stored Data Migration of part or all of buffer area to cold data area, first the request data in cold data area can be moved
Move to buffer area again for the Data Migration to be migrated in buffer area to cold data area, it can also the number will first be migrated in buffer area
The request data in cold data area is migrated to buffer area again according to migrating to cold data area.
As shown in figure 4, in the present embodiment, the system also includes:
Priority Determination module 60, for determining the excellent of the temperature parameter of multiple types when the type of temperature parameter is multiple
First grade sequence；
The comparison module 10 is used to carry out the temperature parameter of request data and the temperature parameter of the stored data of buffer area
The step of comparing, specifically: according to the priority orders of the temperature parameter of multiple types from high to low to the heat of request data
Degree parameter is compared with the temperature parameter of the stored data of buffer area.
In order to more fully measure the cold and hot degree of data, the temperature parameter type of data can be multiple.At this point it is possible to
The priority orders that multiple temperature parameters are preset by Priority Determination module 60 compare request data in comparison module 10 and delay
It, can according to priority sequence sequentially more each temperature parameter from high to low when depositing the temperature parameter of the stored data in area.
Specifically, comparison module 10 first compares the temperature parameter that priority orders are first, if being sentenced according to the temperature parameter
The cold and hot degree of disconnected request data out and the most cold data in buffer area storing data is inconsistent, namely according to first
Temperature parameter then stops comparing it may determine that request data and the buffer area relatively cold and hot degree between storing data out；
If being judged according to the temperature parameter, the cold and hot degree of request data and the most cold data in buffer area storing data is consistent
, namely fail to judge the relatively cold and hot journey of request data and buffer area between storing data according to first temperature parameter
Degree, then comparison module 10 continues to compare the temperature parameter that priority orders are second, and so on.
In the present embodiment, the system also includes:
User configuration module configures the type and/or priority orders of temperature parameter for the input according to user.
Different user has different reading data behaviors and different data requirements habits.The type of temperature parameter and preferential
Grade sequence can voluntarily be configured by user configuration module by user, user's compactness can be improved, further promoted user for
The usage experience of optical storage.
In the present embodiment, the type of the temperature parameter includes that access frequency, access time, data type, data are big
Small, data are a variety of there are the time in buffer area.
Access frequency refers to the total degree being accessed by the user after data enter cold data area, and access frequency is higher to be shown to count
It is on the contrary then colder according to hotter.
Access time refers to the data last time accessed time, and access time is more early to show that data are hotter, it is on the contrary then
It is colder.
Data type can refer to the type of record data, such as picture category, video class, document class, document class data can
It can be the summary of picture category data or video class data, it at this time can be with definition document class data than picture category data and video class number
According to heat, picture category data may occupy little space than the storage of video class data, deposit in order to which buffer area can vacate more spaces
The more relatively hot data of storage can define picture category data than video class data heat at this time.
Data type may also mean that user assigns the type of data, such as occurrences in human life class, financial category, publicity class, routine work
Class etc. only may just need requested access for occurrences in human life class data when change of personnel or collective's tune firewood, and daily
Service class data are the requested access of daily need, can define the relatively cold and hot degree of different types of data at this time as finance
Class data are equal with publicity class temperature, and occurrences in human life analogy financial category, publicity class temperature are low, and routine work class data are than financial category, a surname
It is high to pass class temperature.
Size of data refers to the occupied storage size of storing data.It is deposited in order to which buffer area can vacate more spaces
The more relatively hot data of storage, it is hotter to define the smaller data of size of data, on the contrary then colder.
There are the times in buffer area to refer to data Zi migrating to buffer area to the duration for migrating out buffer area, if should for data
Data do not migrate out buffer area also, then refer to data from the duration migrated to buffer area till now.Data exist in buffer area
Time is longer, shows that the temperature of the data is always held at higher level, therefore data are longer there are the time in buffer area
Show that data are hotter, it is on the contrary then colder.
In the present embodiment, the priority orders of the temperature parameter are from high to low are as follows: access frequency, data type, visit
Ask that there are the times in buffer area for time, size of data, data.
Access frequency is most directly to reflect a temperature parameter of the cold and hot degree of data, therefore the priority of access frequency
It is highest in 5 temperature parameters.
Data type and access time are all the temperature parameters for being bonded user and being accustomed to data usage behavior, and data
Type also reflects the size of data indirectly simultaneously, therefore the priority ratio access time of data type is high.
Size of data is accustomed to usage behavior of the user to data without very big connection based on the considerations of memory space
System can not be well reflected user to the requirements for access temperature of data, thus the priority of size of data should than access frequency,
Data type, access time are low.
When comparing there are the time as the cold and hot degree between a temperature parameter progress data in data buffer storage, if data
Longer there are the time in caching, then the probability that data remain in buffer area can be bigger and leads in data buffer storage that there are the times
It increasingly grows and generates locking phenomenon, therefore it is minimum that there are the priority of time in 5 temperature parameters in data buffer storage.
In specific implementation process, every class temperature parameter is respectively equipped with enabled switch.User configuration module is according to user to making
The control of opening and closing can be switched, configuration is using the temperature parameter of which kind or which type.
For example, user opens the enabled switch of access frequency and the two temperature parameters of access time, data are closed
There is the enabled switch of time in type, size of data, data, then two heat of access frequency and access time are used only in the buffer
Spend parameter.In buffer area memory space inadequate, request data is located at cold data area, needs to compare the temperature parameter of request data
With buffer area the temperature parameter of storing data when, if the access frequency of request data than buffer area storing data access frequency
Rate is high, then by the buffer area, storing data is migrated to cold data area, and request data is migrated to buffer area；If request data
Access frequency then continues to compare access time as the buffer area access frequency of storing data, if the access of request data
The access time of time storing data than buffer area is early, then by the buffer area, storing data is migrated to cold data area, will be asked
Ask Data Migration to buffer area.
Obviously, the above embodiment of the present invention is only intended to clearly illustrate technical solution of the present invention example, and
It is not the restriction to a specific embodiment of the invention.It is all made within the spirit and principle of claims of the present invention
Any modifications, equivalent replacements, and improvements etc., should all be included in the scope of protection of the claims of the present invention.
Claims (10)
1. a kind of cold and hot method for interchanging data based on optical storage, which comprises the following steps:
When the size that request data is located at cold data area and request data is greater than the remaining permission storage size of buffer area,
The temperature parameter of request data is compared with the temperature parameter of the stored data of buffer area, is according to comparison result determination
It is no to migrate request data to buffer area and by the stored Data Migration of part or all of buffer area to cold data area；
The temperature parameter of request data is updated according to real-time request of data；
The buffer area is a part in dsc data area, and the cold data area uses optical storage.
2. a kind of cold and hot method for interchanging data based on optical storage according to claim 1, which is characterized in that when temperature is joined
When several types is multiple, the temperature parameter of the temperature parameter to request data and the stored data of buffer area compares
Compared with, specifically: according to the priority orders of the temperature parameter of multiple types from high to low to the temperature parameter of request data with
The temperature parameter of the stored data of buffer area is compared.
3. a kind of cold and hot method for interchanging data based on optical storage according to claim 2, which is characterized in that further include with
Lower step:
According to the type and/or priority orders of the input configuration temperature parameter of user.
4. a kind of cold and hot method for interchanging data based on optical storage according to claim 2 or 3, which is characterized in that described
The type of temperature parameter includes access frequency, access time, data type, size of data, there are the times in buffer area for data
It is a variety of.
5. a kind of cold and hot method for interchanging data based on optical storage according to claim 4, which is characterized in that the temperature
The priority orders of parameter are from high to low are as follows: access frequency, data type, access time, size of data, data are in buffer area
There are the times.
6. a kind of cold and hot data exchange system based on optical storage, which is characterized in that including；
Comparison module, the size for being located at cold data area and request data when request data allow to deposit greater than buffer area is remaining
When storing up the size in space, the temperature parameter of request data is compared with the temperature parameter of the stored data of buffer area, root
Determine whether to migrate request data to buffer area and by the stored Data Migration of part or all of buffer area according to comparison result
To cold data area；
Update module, for updating the temperature parameter of request data according to real-time request of data；
The buffer area is a part in dsc data area, and the cold data area uses optical storage.
7. the cold and hot data exchange system according to claim 6 based on optical storage, which is characterized in that further include:
Priority Determination module, for determining the preferential of the temperature parameter of multiple types when the type of temperature parameter is multiple
Grade sequence；
The comparison module is for comparing the temperature parameter and the temperature parameter of the stored data of buffer area of request data
Compared with the step of, specifically: according to the priority orders of the temperature parameter of multiple types from high to low to the temperature of request data
Parameter is compared with the temperature parameter of the stored data of buffer area.
8. the cold and hot data exchange system according to claim 7 based on optical storage, which is characterized in that further include:
User configuration module configures the type and/or priority orders of temperature parameter for the input according to user.
9. the cold and hot data exchange system according to claim 7 or 8 based on optical storage, which is characterized in that the temperature
The type of parameter includes that access frequency, access time, data type, size of data, data are more there are the time in buffer area
Kind.
10. the cold and hot data exchange system according to claim 9 based on optical storage, which is characterized in that the temperature ginseng
Several priority orders are from high to low are as follows: access frequency, data type, access time, size of data, data are deposited in buffer area
In the time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910671678.5A CN110442309A (en) | 2019-07-24 | 2019-07-24 | A kind of cold and hot method for interchanging data and system based on optical storage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910671678.5A CN110442309A (en) | 2019-07-24 | 2019-07-24 | A kind of cold and hot method for interchanging data and system based on optical storage |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110442309A true CN110442309A (en) | 2019-11-12 |
Family
ID=68431406
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910671678.5A Pending CN110442309A (en) | 2019-07-24 | 2019-07-24 | A kind of cold and hot method for interchanging data and system based on optical storage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110442309A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113485642A (en) * | 2021-07-01 | 2021-10-08 | 维沃移动通信有限公司 | Data caching method and device |
| CN113590699A (en) * | 2021-07-14 | 2021-11-02 | 车智互联（北京）科技有限公司 | Interface request processing method and system and computing equipment |
| CN113805805A (en) * | 2021-05-06 | 2021-12-17 | 北京奥星贝斯科技有限公司 | Method and device for eliminating cache memory block and electronic equipment |
| CN114741336A (en) * | 2022-06-09 | 2022-07-12 | 荣耀终端有限公司 | Method for adjusting Host side cache region in memory, electronic equipment and chip system |
| CN114924696A (en) * | 2022-07-18 | 2022-08-19 | 上海有孚数迅科技有限公司 | Method, apparatus, medium, and program product for storage management |
| CN115334158A (en) * | 2022-07-29 | 2022-11-11 | 重庆蚂蚁消费金融有限公司 | Cache management method and device, storage medium and electronic equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060004957A1 (en) * | 2002-09-16 | 2006-01-05 | Hand Leroy C Iii | Storage system architectures and multiple caching arrangements |
| US20130246561A1 (en) * | 2012-03-14 | 2013-09-19 | Microsoft Corporation | High density hosting for messaging service |
| US20150356078A1 (en) * | 2014-06-06 | 2015-12-10 | Hitachi, Ltd. | Storage system, computer system and data migration method |
| WO2016107390A1 (en) * | 2014-12-31 | 2016-07-07 | 华为技术有限公司 | Method and device for managing magnetic disk file |
| WO2016165441A1 (en) * | 2015-09-06 | 2016-10-20 | 中兴通讯股份有限公司 | Migration policy adjustment method, capacity-change suggestion method and device |
| WO2017195943A1 (en) * | 2016-05-10 | 2017-11-16 | 한양대학교 에리카산학협력단 | Method and device for identifying data of storage server for service having high temporality with human relationship |
| CN107526546A (en) * | 2017-08-25 | 2017-12-29 | 深圳大学 | A kind of Spark distributed computational datas processing method and system |
| CN109344092A (en) * | 2018-09-11 | 2019-02-15 | 天津易华录信息技术有限公司 | A kind of method and system improving cold storing data reading speed |
| WO2019057209A1 (en) * | 2017-09-25 | 2019-03-28 | 中兴通讯股份有限公司 | Local content caching method and apparatus, storage medium and electronic apparatus |
-
2019
- 2019-07-24 CN CN201910671678.5A patent/CN110442309A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060004957A1 (en) * | 2002-09-16 | 2006-01-05 | Hand Leroy C Iii | Storage system architectures and multiple caching arrangements |
| US20130246561A1 (en) * | 2012-03-14 | 2013-09-19 | Microsoft Corporation | High density hosting for messaging service |
| US20150356078A1 (en) * | 2014-06-06 | 2015-12-10 | Hitachi, Ltd. | Storage system, computer system and data migration method |
| WO2016107390A1 (en) * | 2014-12-31 | 2016-07-07 | 华为技术有限公司 | Method and device for managing magnetic disk file |
| WO2016165441A1 (en) * | 2015-09-06 | 2016-10-20 | 中兴通讯股份有限公司 | Migration policy adjustment method, capacity-change suggestion method and device |
| WO2017195943A1 (en) * | 2016-05-10 | 2017-11-16 | 한양대학교 에리카산학협력단 | Method and device for identifying data of storage server for service having high temporality with human relationship |
| CN107526546A (en) * | 2017-08-25 | 2017-12-29 | 深圳大学 | A kind of Spark distributed computational datas processing method and system |
| WO2019057209A1 (en) * | 2017-09-25 | 2019-03-28 | 中兴通讯股份有限公司 | Local content caching method and apparatus, storage medium and electronic apparatus |
| CN109344092A (en) * | 2018-09-11 | 2019-02-15 | 天津易华录信息技术有限公司 | A kind of method and system improving cold storing data reading speed |
Non-Patent Citations (2)
| Title |
|---|
| 任涛等: "云存储中副本自适应一致性研究", 《计算机工程与应用》 * |
| 饶磊等: "基于热度分析的动态副本创建算法", 《计算机应用》 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113805805A (en) * | 2021-05-06 | 2021-12-17 | 北京奥星贝斯科技有限公司 | Method and device for eliminating cache memory block and electronic equipment |
| CN113805805B (en) * | 2021-05-06 | 2023-10-13 | 北京奥星贝斯科技有限公司 | Method and device for eliminating cache memory block and electronic equipment |
| CN113485642A (en) * | 2021-07-01 | 2021-10-08 | 维沃移动通信有限公司 | Data caching method and device |
| CN113590699A (en) * | 2021-07-14 | 2021-11-02 | 车智互联（北京）科技有限公司 | Interface request processing method and system and computing equipment |
| CN113590699B (en) * | 2021-07-14 | 2023-12-01 | 车智互联（北京）科技有限公司 | Interface request processing method, system and computing device |
| CN114741336A (en) * | 2022-06-09 | 2022-07-12 | 荣耀终端有限公司 | Method for adjusting Host side cache region in memory, electronic equipment and chip system |
| CN114741336B (en) * | 2022-06-09 | 2022-11-25 | 荣耀终端有限公司 | Method for adjusting Host side cache region in memory, electronic equipment and chip system |
| CN114924696A (en) * | 2022-07-18 | 2022-08-19 | 上海有孚数迅科技有限公司 | Method, apparatus, medium, and program product for storage management |
| CN115334158A (en) * | 2022-07-29 | 2022-11-11 | 重庆蚂蚁消费金融有限公司 | Cache management method and device, storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110442309A (en) | A kind of cold and hot method for interchanging data and system based on optical storage | |
| CN104969170B (en) | Hierarchical storage system, storage control and the method for replacing the data movement between level | |
| CN103885728B (en) | A kind of disk buffering system based on solid-state disk | |
| CN107247675B (en) | A kind of caching selection method and system based on classification prediction | |
| CN105447059B (en) | A kind of data processing method and device | |
| CN103942157B (en) | Method and system for calculating the data processing in storage environment | |
| US6415372B1 (en) | Rolling back storage subsystem reconfigurations | |
| JP6870246B2 (en) | Storage device and storage control device | |
| CN104090852B (en) | The method and apparatus of management hybrid cache | |
| CN104571954B (en) | A kind of date storage method and device | |
| US20030005243A1 (en) | Mailbox for controlling storage subsystem reconfigurations | |
| CN106547476A (en) | For the method and apparatus of data-storage system | |
| CN109344092A (en) | A kind of method and system improving cold storing data reading speed | |
| CN106484330A (en) | A kind of hybrid magnetic disc individual-layer data optimization method and device | |
| CN106528451B (en) | The cloud storage frame and construction method prefetched for the L2 cache of small documents | |
| CN106502587A (en) | Data in magnetic disk management method and magnetic disk control unit | |
| CN103150245B (en) | Determine method and the storage controller of the access characteristics of data entity | |
| US5568638A (en) | Split control system for a page/page group in a data processing system a pre-split process using a temporary overflow area | |
| CN103688249A (en) | Adaptive record caching for solid state disks | |
| CN103902260A (en) | Pre-fetch method of object file system | |
| JPH05303528A (en) | Write-back disk cache device | |
| CN110532200A (en) | A kind of memory system based on mixing memory architecture | |
| CN110287152A (en) | A kind of method and relevant apparatus of data management | |
| JPH10124396A (en) | Buffer exchanging method | |
| CN109542339A (en) | Data hierarchy access method, device, multi-layered memory apparatus and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20191112 |