CN103548004A - Method and device for realizing multilevel storage in file system - Google Patents

Method and device for realizing multilevel storage in file system Download PDF

Info

Publication number
CN103548004A
CN103548004A CN201180003291.4A CN201180003291A CN103548004A CN 103548004 A CN103548004 A CN 103548004A CN 201180003291 A CN201180003291 A CN 201180003291A CN 103548004 A CN103548004 A CN 103548004A
Authority
CN
China
Prior art keywords
file
storage device
sorting out
value
value list
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201180003291.4A
Other languages
Chinese (zh)
Other versions
CN103548004B (en
Inventor
陆海翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Cloud Computing Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN103548004A publication Critical patent/CN103548004A/en
Application granted granted Critical
Publication of CN103548004B publication Critical patent/CN103548004B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/185Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0647Migration mechanisms

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

Provided is a method for realizing multilevel storage in a file system. In a file system, a primary storage device and a secondary storage device are used to store files respectively to acquire the value of each file stored in the primary storage device and the secondary storage device; a first file value rank list is established and managed according to the order of the value of each file stored in the primary storage device, and a second file value rank list is established and managed according to the order of the value of each file stored in the secondary storage device; and file transfer is performed in the primary storage device and the secondary storage device according to a preset transfer policy in accordance with the first file value rank list and the second file value rank list. The embodiments of the present invention can store files with high value in a storage medium with higher performance and store files with low value in a slow storage medium, thus making the best of the overall performance of the system.

Description

The method and apparatus that multistage storage is realized in file system
Technical field
The present invention relates to electronic technology field, more particularly to a kind of method and apparatus that multistage storage is realized in file system.
Background of invention
Along with the development of memory technology, new storage medium and memory interface is continued to bring out out outside the conventional storage medias such as tape, mechanical disk, these new storage mediums and memory interface generally mean that higher transmission rate, wherein, SSD(Solid State Disk, solid state hard disc)It is exactly a kind of typical technology.
SSD is also referred to as electronic hard disc or solid-state electronic disk, and it is made up of control unit and solid state storage elements, and the function of its interface, form and application method are identical with magnetic hard disk.Current SSD major applications are on notebook computer, and in order to match with existing notebook, most products appearance and size is consistent with traditional notebook hard disk, the product for also having other specifications.Due to SSD inner inorganic tool structures, read and rotated without motor, so all advantageous in terms of shock resistance and noise, SSD chip can be in very wide temperature range in addition(- 40~85 DEG C)Interior work.Therefore, SSD is widely used at present in the every field such as military affairs, electric power, medical treatment, aviation, vehicle-mounted, industry control, video monitoring, network monitoring, the network terminal, navigation equipment.
With the continuous maturation of SSD technology, user begins to use SSD to build storage system, considers for performance, cost and protects existing investment, user has the demand that mixing storage system is built using new storage medium and original storage medium.Using the SSD of expensive high speed as one-level storage system, using Large Copacity, cheap low-speed machinery disk as rear end secondary storage system, high-performance, Large Copacity, inexpensive overall best configuration are finally reached.
In mixing storage system, typically the data often accessed are stored on speedy storage equipment, the data infrequently accessed are stored on slow storage device, therefore can just systematic entirety is optimal using less high-speed processing apparatus.
A kind of constructing plan of multilevel memory system of the prior art is:SSD is added to tradition machinery HDD(Hard Disk Drive, hard disk drive)In the storage system of composition, a mixing storage pool is formed, is cached SSD as the second level in system, the data being accessed frequently on disk is cached on SSD automatically, after SSD is fully written, these are data cached to be eliminated according to ARC algorithms.
Above-mentioned shortcoming of the prior art is:Using SSD as the L2 cache of system, the performance of system is improved on the whole, but the effect of SSD as just caching is present, its memory space is wasted.Above-mentioned multilevel memory system is only applicable to the system that hotspot's distribution is concentrated very much, such as 1/99 temperature model system.But for the relatively low system of hotspot's distribution intensity, such as 30/70 model(30% data provide 70% visit capacity)The most dsc data by 30% is needed to be buffered in SSD, then system needs the SSD memory spaces of optional equipment just to account for the 30% of total memory capacity, this part of memory space is for that should be used to say that what is do not perceived, it can not be embodied in system total memory capacity, undoubtedly a huge waste.
The content of the invention
The embodiment provides a kind of method and apparatus that multistage storage is realized in file system, to realize that the multistage of the value based on file stores in file system.
The purpose of the present invention is achieved through the following technical solutions:
A kind of method that multistage storage is realized in file system, including:
Carry out storage file using primary storage device and secondary storage devices respectively in file system, obtain the value of each file stored in the primary storage device and secondary storage devices;
According to the first file sorting out value list of foundation and management that puts in order of the value of each file stored in the primary storage device, according to the second file sorting out value list of foundation and management that puts in order of the value of each file stored in the secondary storage devices;
According to the first file sorting out value list and the second file sorting out value list, moved according to strategy progress file in the primary storage device and secondary storage devices of moving of setting.
A kind of device that multistage storage is realized in file system, including:
File storage module, for carrying out storage file using primary storage device and secondary storage devices respectively in file system;
File is worth processing module, value for obtaining each file stored in the primary storage device and secondary storage devices, according to the first file sorting out value list of foundation and management that puts in order of the value of each file stored in the primary storage device, according to the second file sorting out value list of foundation and management that puts in order of the value of each file stored in the secondary storage devices;
Processing module is moved, for according to the first file sorting out value list and the second file sorting out value list, being moved according to strategy progress file in the primary storage device and secondary storage devices of moving of setting.
The technical scheme provided by embodiments of the invention described above can be seen that, the embodiment of the present invention by file system respectively using primary storage device and secondary storage devices come storage file, and value based on each file and file is carried out in the primary storage device and secondary storage devices move according to the strategy of moving of setting, it is possible to achieve costly file is stored in the high storage medium of performance(That is primary storage device)On, the file for being worth low is stored in storage medium at a slow speed(That is secondary storage devices)On, system is reached that overall performance is optimal.
Brief Description Of Drawings
Fig. 1 is a kind of specific process chart for method that multistage storage is realized in file system that the embodiment of the present invention one is provided;
Fig. 2 is the field schematic diagram in a kind of metadata information of file provided in an embodiment of the present invention;
Fig. 3 is a kind of when only determining the value of file according to the last access time of file, the specific process chart of the method for the multistage storage of realization in file system that the embodiment of the present invention two is provided;
Fig. 4 is a kind of concrete structure diagram for device that multistage storage is realized in file system that the embodiment of the present invention three is provided.
Implement the mode of the present invention
Describe the embodiment of the present invention in detail below with reference to the accompanying drawings.
Embodiment one
This embodiment offers a kind of method that multistage storage is realized in file system, the specific handling process of this method is as shown in figure 1, including following process step:
Step 11, in file system carry out storage file using primary storage device and secondary storage devices respectively, obtain the value of each file stored in the primary storage device and secondary storage devices.
Such as, can be using SSD as primary storage device, using mechanical disk as secondary storage devices, above-mentioned primary storage device and secondary storage devices are all used for storage file, constitute the multistage global storage space of file system.
The embodiment of the present invention needs to calculate the value of each file stored in above-mentioned primary storage device and secondary storage devices, and circular is as follows:
According to the file value renewal time interval of setting(Such as 30 minutes)At least one of, in the access times in the last access time of file, setting time section, the content of file, system configuration information, calculate the value of each file stored in the primary storage device and secondary storage devices according to the algorithm of setting.
Such as, when only determining the value of file according to the last access time of file, then the Maximum Value of the nearest file of access time.
Again such as, when simultaneously according to value of the access times in the last access time of file, setting time section to determine file, the last access time of file can be multiplied by after corresponding weight, the value of each file is calculated along with the access times in setting time section are multiplied by corresponding weight.
Again such as, system manager can carry out directly to set the value of some or multiple files according to actual needs.
Field schematic diagram in a kind of metadata information for file that the embodiment is provided is as shown in Figure 2, in actual applications, can be using the information recorded in the existing part field and other optional extended fields in the metadata information of each file come the value of calculation document, and the storage location information of the value information, sequencing information and file of file is stored in the optional extended field in metadata information.Such as, after file is accessed, after system is updated to the metadata information of above-mentioned file, using the last access time of the file recorded in timestamp field in Fig. 2 come the value of calculation document;Or simultaneously using at least one in the information recorded in the nearest and history access time of the file recorded in timestamp field in Fig. 2, file length field, blocks of files digital section come the value of calculation document.Then, original value of the file stored in file value field in Fig. 2 is deleted, the value of the file just calculated is stored in file value field, and sequencing information field is updated accordingly.
Storage file is stored in the information in the primary storage device or secondary storage devices, above-mentioned Fig. 2 the ordering scenario in the first file sorting out value list or the second file sorting out value list that storage file is described below in sequencing information field in storage location field in above-mentioned Fig. 2.Sequencing information field, storage location field and file value field are the extended fields in metadata information in above-mentioned Fig. 2.
Because above-mentioned primary storage device is fast hard disk, and above-mentioned secondary storage devices are hard disks at a slow speed, therefore, and the higher file of value ratio is stored in above-mentioned primary storage device, and the relatively low file of value ratio is stored in above-mentioned mechanical hard disk.In the ideal case, the value of any one file stored in above-mentioned primary storage device is both greater than the value of the All Files stored in above-mentioned mechanical hard disk.
Step 12, according to each file stored in the primary storage device value put in order foundation and management the first file sorting out value list, according to each file stored in the secondary storage devices value put in order foundation and management the second file sorting out value list.
Each file stored in the primary storage device is sorted from big to small according to the size of value and sets up the first file sorting out value list.When being worth renewal time interval according to the file of setting, after the value of each file to storing in the primary storage device is updated, then need to update the first file sorting out value list accordingly.
Each file stored in the secondary storage devices is sorted from big to small according to the size of value and sets up the second file sorting out value list.When being worth renewal time interval according to the file of setting, after the value of each file to storing in the secondary storage devices is updated, then need to update the second file sorting out value list accordingly.
What is arranged in above-mentioned first file sorting out value list and the second file sorting out value list is the mark of each file.
Step 13, according to the first file sorting out value list and the second file sorting out value list, file carried out in the primary storage device and secondary storage devices move according to the strategy of moving of setting.
It is set in advance in the primary storage device and secondary storage devices and carries out the time interval that file is moved, and start the timing of the time interval, after the timing of the time interval terminates, file is then carried out in the primary storage device and secondary storage devices and moves processing, the process that specific file moves processing can be:
If the value for having overbalanced at least one file in the first file sorting out value list of one or more file in the second file sorting out value list, one or more file in the second file sorting out value list is moved from secondary storage devices into the primary storage device, then, the first file sorting out value list and the second file sorting out value list are updated;Or
If the space availability ratio of the primary storage device has exceeded the threshold value of setting, one or more file arranged rearward in the first file sorting out value list is moved from the primary storage device into the secondary storage devices, until the space availability ratio of the primary storage device is not above the threshold value of setting, then, the first file sorting out value list and the second file sorting out value list are updated.
It should be further stated that, if the space availability ratio of the secondary storage devices has exceeded the threshold value of setting, then one or more file arranged in the second file sorting out value list rearward is deleted from the secondary storage devices, until the space availability ratio of the secondary storage devices is not above the threshold value of setting, then, the second file sorting out value list is updated.
Embodiment two
When only determining the value of file according to the last access time of file, this embodiment offers a kind of specific handling process for the method that multistage storage is realized in file system as shown in figure 3, including following process step:
Some file in step 31, file system is accessed, and above-mentioned file can be the file that is stored in primary storage device or secondary storage devices.
The value highest of step 32, the value due to only determining file according to the last access time of file, currently accessed above-mentioned file, maximum is set to by the value of above-mentioned file.
Step 33, judge whether above-mentioned file is stored in primary storage device, if it is, performing step 34;Otherwise, step 35 is performed.
Step 34, the most prostatitis being arranged in the mark of above-mentioned file in the first file sorting out value list in primary storage device.
Step 35, above-mentioned file is added to the moving in listed files of the secondary storage devices, after the timing for the time interval that file set in advance is moved terminates, the file moved in list of the secondary storage devices is moved into primary storage device from secondary storage devices.
Embodiment three
The embodiment of the present invention additionally provides a kind of device that multistage storage is realized in file system, and its concrete structure is as shown in figure 4, including following module:
File storage module 41, for carrying out storage file using primary storage device and secondary storage devices respectively in file system, such as, can regard mechanical disk as secondary storage devices using SSD as primary storage device;
File is worth processing module 42, value for obtaining each file stored in the primary storage device and secondary storage devices, according to the first file sorting out value list of foundation and management that puts in order of the value of each file stored in the primary storage device, according to the second file sorting out value list of foundation and management that puts in order of the value of each file stored in the secondary storage devices;
Processing module 43 is moved, for according to the first file sorting out value list and the second file sorting out value list, being moved according to strategy progress file in the primary storage device and secondary storage devices of moving of setting.
Specifically, described file value processing module 42 can include:
File value calculation module 421, for being worth renewal time interval according to the file of setting, the value of each file stored at least one described primary storage device of determination and secondary storage devices in the access times in the last access time of file, setting time section, the content of file, system configuration information.Such as, after file is accessed, after system is updated to the metadata information of the file, the value of the file is calculated using the last access time of the file recorded in the timestamp field in the metadata information of the file;Or, after file is accessed, after system is updated to the metadata information of the file, using the nearest and history access time of the file recorded in the timestamp field in the metadata information of the file, and in the information recorded in file length field, blocks of files digital section at least one of carry out the value of calculation document.
Module 422 is set up in file ordering list, the first file sorting out value list is set up for each file stored in the primary storage device to be sorted from big to small according to the size of value, the first file sorting out value list is updated according to the renewal result of the value of each file stored in the primary storage device;
Each file stored in the secondary storage devices is sorted from big to small according to the size of value and sets up the second file sorting out value list, the second file sorting out value list is updated according to the renewal result of the value of each file stored in the secondary storage devices.
Specifically, described moves processing module 43:It is additionally operable to be set in advance in the primary storage device and secondary storage devices and carries out the time interval that file is moved, and starts the timing of the time interval, after the timing of the time interval terminates,
If the value for having overbalanced the file of at least one in the first file sorting out value list of one or more file in the second file sorting out value list, one or more file in the second file sorting out value list is moved from secondary storage devices into the primary storage device;
The first file sorting out value list and the second file sorting out value list are updated.
Specifically, described moves processing module 43:It is additionally operable to be set in advance in the primary storage device and secondary storage devices and carries out the time interval that file is moved, and start the timing of the time interval, after the timing of the time interval terminates, if the space availability ratio of the primary storage device has exceeded the threshold value of setting, one or more file arranged rearward in the first file sorting out value list is moved from the primary storage device into the secondary storage devices, until the space availability ratio of the primary storage device is not above the threshold value of setting;
The first file sorting out value list and the second file sorting out value list are updated.
Realize that the detailed process of multistage storage is similar with preceding method embodiment in file system using the device of the embodiment of the present invention, here is omitted.
One of ordinary skill in the art will appreciate that realizing all or part of flow in above-described embodiment method, computer program is can be by instruct the hardware of correlation to complete, described program can be stored in a computer read/write memory medium, the program is upon execution, it may include such as the flow of the embodiment of above-mentioned each method.Wherein, described storage medium can be magnetic disc, CD, read-only memory(Read-Only Memory, ROM)Or random access memory(Random Access Memory, RAM)Deng.
In summary, the embodiment of the present invention by file system respectively using primary storage device and secondary storage devices come storage file, and value based on each file and file is carried out in the primary storage device and secondary storage devices move according to the strategy of moving of setting, it is possible to achieve costly file is stored in the high storage medium of performance(That is primary storage device)On, the file for being worth low is stored in storage medium at a slow speed(That is secondary storage devices)On, system is reached that overall performance is optimal.
The embodiment of the present invention supports the unified management to isomery storage medium, to the space sum that the global storage space that user is presented is storages at different levels;User need not distinguish storage mediums at different levels when using, and unified management is provided user by file system.So as to avoid using extra hierarchical storage management software, complexity is reduced.
The embodiment of the present invention provides flexible strategy configuration, the algorithm that can flexibly control the frequency period and file migration of file migration to be followed.
It is described above; the only present invention preferably embodiment, but protection scope of the present invention is not limited thereto, any one skilled in the art the invention discloses technical scope in; the change or replacement that can be readily occurred in, should all be included within the scope of the present invention.Therefore, protection scope of the present invention should be defined by scope of the claims.

Claims (12)

  1. A kind of method that multistage storage is realized in file system, it is characterised in that including:
    Carry out storage file using primary storage device and secondary storage devices respectively in file system, obtain the value of each file stored in the primary storage device and secondary storage devices;
    According to the first file sorting out value list of foundation and management that puts in order of the value of each file stored in the primary storage device, according to the second file sorting out value list of foundation and management that puts in order of the value of each file stored in the secondary storage devices;
    According to the first file sorting out value list and the second file sorting out value list, moved according to strategy progress file in the primary storage device and secondary storage devices of moving of setting.
  2. The method according to claim 1 that multistage storage is realized in file system, it is characterised in that the value of each file stored in the described acquisition primary storage device and secondary storage devices, including:
    Renewal time interval is worth according to the file of setting in file system, at least one in the access times in the last access time of file, setting time section, the content of file, system configuration information determines the value of each file stored in the primary storage device and secondary storage devices.
  3. The method according to claim 2 that multistage storage is realized in file system, it is characterised in that the value of each file stored in the described acquisition primary storage device and secondary storage devices, including:
    After file is accessed, after system is updated to the metadata information of the file, the value of the file is calculated using the last access time of the file recorded in the timestamp field in the metadata information of the file;
    Or,
    After file is accessed, after system is updated to the metadata information of the file, using the nearest and history access time of the file recorded in the timestamp field in the metadata information of the file, and in the information recorded in file length field, blocks of files digital section at least one of carry out the value of calculation document.
  4. The method according to claim 3 that multistage storage is realized in file system, it is characterized in that, the the first file sorting out value list of foundation and management that puts in order of the described value according to each file stored in the primary storage device, according to the second file sorting out value list of foundation and management that puts in order of the value of each file stored in the secondary storage devices, including:
    Each file stored in the primary storage device is sorted from big to small according to the size of value and sets up the first file sorting out value list, the first file sorting out value list is updated according to the renewal result of the value of each file stored in the primary storage device;
    Each file stored in the secondary storage devices is sorted from big to small according to the size of value and sets up the second file sorting out value list, the second file sorting out value list is updated according to the renewal result of the value of each file stored in the secondary storage devices.
  5. The method according to claim 1 that multistage storage is realized in file system, it is characterised in that described primary storage device includes solid state hard disc;Described secondary storage devices include mechanical disk.
  6. The method that multistage storage is realized in file system according to claim any one of 1-5, it is characterized in that, it is described according to the first file sorting out value list and the second file sorting out value list, moved according to strategy progress file in the primary storage device and secondary storage devices of moving of setting, including:
    It is set in advance in the primary storage device and secondary storage devices and carries out the time interval that file is moved, and starts the timing of the time interval, after the timing of the time interval terminates,
    If the value for having overbalanced the file of at least one in the first file sorting out value list of one or more file in the second file sorting out value list, one or more file in the second file sorting out value list is moved from secondary storage devices into the primary storage device;
    The first file sorting out value list and the second file sorting out value list are updated.
  7. The method that multistage storage is realized in file system according to claim any one of 1-6, it is characterized in that, it is described according to the first file sorting out value list and the second file sorting out value list, moved according to strategy progress file in the primary storage device and secondary storage devices of moving of setting, including:
    It is set in advance in the primary storage device and secondary storage devices and carries out the time interval that file is moved, and starts the timing of the time interval, after the timing of the time interval terminates,
    If the space availability ratio of the primary storage device has exceeded the threshold value of setting, one or more file arranged rearward in the first file sorting out value list is moved from the primary storage device into the secondary storage devices, until the space availability ratio of the primary storage device is not above the threshold value of setting;
    The first file sorting out value list and the second file sorting out value list are updated.
  8. A kind of device that multistage storage is realized in file system, it is characterised in that including:
    File storage module, for carrying out storage file using primary storage device and secondary storage devices respectively in file system;
    File is worth processing module, value for obtaining each file stored in the primary storage device and secondary storage devices, according to the first file sorting out value list of foundation and management that puts in order of the value of each file stored in the primary storage device, according to the second file sorting out value list of foundation and management that puts in order of the value of each file stored in the secondary storage devices;
    Processing module is moved, for according to the first file sorting out value list and the second file sorting out value list, being moved according to strategy progress file in the primary storage device and secondary storage devices of moving of setting.
  9. The device according to claim 8 that multistage storage is realized in file system, it is characterised in that described file value processing module includes:
    File value calculation module, for being worth renewal time interval according to the file of setting, the value of each file stored at least one described primary storage device of determination and secondary storage devices in the access times in the last access time of file, setting time section, the content of file, system configuration information;
    Module is set up in file ordering list, the first file sorting out value list is set up for each file stored in the primary storage device to be sorted from big to small according to the size of value, the first file sorting out value list is updated according to the renewal result of the value of each file stored in the primary storage device;
    Each file stored in the secondary storage devices is sorted from big to small according to the size of value and sets up the second file sorting out value list, the second file sorting out value list is updated according to the renewal result of the value of each file stored in the secondary storage devices.
  10. The device according to claim 9 that multistage storage is realized in file system, it is characterised in that:
    Described file value calculation module, it is additionally operable to after file is accessed, after system is updated to the metadata information of the file, the value of the file is calculated using the last access time of the file recorded in the timestamp field in the metadata information of the file;
    Or,
    After file is accessed, after system is updated to the metadata information of the file, using at least one in the information recorded in the nearest and history access time of the file recorded in the timestamp field in the metadata information of the file, file length field, blocks of files digital section come the value of calculation document.
  11. The device that multistage storage is realized in file system according to claim 8 or 9 or 10, it is characterised in that:
    Described moves processing module, is additionally operable to be set in advance in the primary storage device and secondary storage devices and carries out the time interval that file is moved, and starts the timing of the time interval, after the timing of the time interval terminates,
    If the value for having overbalanced the file of at least one in the first file sorting out value list of one or more file in the second file sorting out value list, one or more file in the second file sorting out value list is moved from secondary storage devices into the primary storage device;
    The first file sorting out value list and the second file sorting out value list are updated.
  12. The device that multistage storage is realized in file system according to claim 8 or 9 or 10, it is characterised in that:
    Described moves processing module, it is additionally operable to be set in advance in the primary storage device and secondary storage devices and carries out the time interval that file is moved, and start the timing of the time interval, after the timing of the time interval terminates, if the space availability ratio of the primary storage device has exceeded the threshold value of setting, one or more file arranged rearward in the first file sorting out value list is moved from the primary storage device into the secondary storage devices, until the space availability ratio of the primary storage device is not above the threshold value of setting;
    The first file sorting out value list and the second file sorting out value list are updated.
CN201180003291.4A 2011-12-28 2011-12-28 The method and apparatus of dynamic data attemper is realized in file system Active CN103548004B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2011/084830 WO2013097119A1 (en) 2011-12-28 2011-12-28 Method and device for realizing multilevel storage in file system

Publications (2)

Publication Number Publication Date
CN103548004A true CN103548004A (en) 2014-01-29
CN103548004B CN103548004B (en) 2016-03-30

Family

ID=48696205

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201180003291.4A Active CN103548004B (en) 2011-12-28 2011-12-28 The method and apparatus of dynamic data attemper is realized in file system

Country Status (2)

Country Link
CN (1) CN103548004B (en)
WO (1) WO2013097119A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107844271A (en) * 2017-10-27 2018-03-27 郑州云海信息技术有限公司 A kind of method, apparatus and computer-readable recording medium for being classified storage
CN111367469A (en) * 2020-02-16 2020-07-03 苏州浪潮智能科技有限公司 Layered storage data migration method and system
CN111917882A (en) * 2020-08-07 2020-11-10 湖南快乐阳光互动娱乐传媒有限公司 File caching method and device and electronic equipment
CN116257563A (en) * 2022-11-30 2023-06-13 荣耀终端有限公司 Data value evaluation method and electronic equipment

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104537104A (en) * 2015-01-13 2015-04-22 百度在线网络技术(北京)有限公司 Software ranking method and system
CN105653591B (en) * 2015-12-22 2019-02-05 浙江中控研究院有限公司 A kind of industrial real-time data classification storage and moving method
CN107092564A (en) * 2017-04-21 2017-08-25 深信服科技股份有限公司 A kind of data processing method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060015529A1 (en) * 2004-07-15 2006-01-19 Hitachi, Ltd. Method and apparatus of hierarchical storage management based on data value
CN101101563A (en) * 2007-07-23 2008-01-09 清华大学 Migration management based on massive data classified memory system
US20080154988A1 (en) * 2005-06-10 2008-06-26 Fujitsu Limited Hsm control program and method
CN102291450A (en) * 2011-08-08 2011-12-21 浪潮电子信息产业股份有限公司 Data online hierarchical storage method in cluster storage system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060015529A1 (en) * 2004-07-15 2006-01-19 Hitachi, Ltd. Method and apparatus of hierarchical storage management based on data value
US20080154988A1 (en) * 2005-06-10 2008-06-26 Fujitsu Limited Hsm control program and method
CN101101563A (en) * 2007-07-23 2008-01-09 清华大学 Migration management based on massive data classified memory system
CN102291450A (en) * 2011-08-08 2011-12-21 浪潮电子信息产业股份有限公司 Data online hierarchical storage method in cluster storage system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
吕帅等: "海量信息分级存储数据迁移策略研究", 《计算机工程与科学》, vol. 31, no. 11, 15 October 2009 (2009-10-15), pages 163 - 167 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107844271A (en) * 2017-10-27 2018-03-27 郑州云海信息技术有限公司 A kind of method, apparatus and computer-readable recording medium for being classified storage
CN111367469A (en) * 2020-02-16 2020-07-03 苏州浪潮智能科技有限公司 Layered storage data migration method and system
CN111367469B (en) * 2020-02-16 2022-07-08 苏州浪潮智能科技有限公司 Method and system for migrating layered storage data
CN111917882A (en) * 2020-08-07 2020-11-10 湖南快乐阳光互动娱乐传媒有限公司 File caching method and device and electronic equipment
CN111917882B (en) * 2020-08-07 2023-04-07 湖南快乐阳光互动娱乐传媒有限公司 File caching method and device and electronic equipment
CN116257563A (en) * 2022-11-30 2023-06-13 荣耀终端有限公司 Data value evaluation method and electronic equipment
CN116257563B (en) * 2022-11-30 2023-11-21 荣耀终端有限公司 Data value evaluation method and electronic equipment

Also Published As

Publication number Publication date
CN103548004B (en) 2016-03-30
WO2013097119A1 (en) 2013-07-04

Similar Documents

Publication Publication Date Title
CN103548004A (en) Method and device for realizing multilevel storage in file system
CN103425602B (en) A kind of method, device and the host computer system of data of flash memory storage equipment read-write
JP5456063B2 (en) Method and system for dynamic storage tiering using allocate-on-write snapshots
CN102789439B (en) The method of the interruption in control data transmission process and memory device
CN1251052C (en) Information processor and controlling circuit
WO2015046645A1 (en) Deduplication of parity data in ssd based raid systems
US9251072B2 (en) Cache coherence directory in multi-processor architectures
TW201319928A (en) Apparatus to manage efficient data migration between tiers
WO2012116369A2 (en) Apparatus, system, and method for managing contents of a cache
JP2003208268A5 (en)
CN103917962A (en) Reading files stored on a storage system
WO2012091234A1 (en) Memory system including a nonvolatile memory and a volatile memory, and processing method using the memory system
CN1300688C (en) Apparatus and method to adjust data transfer rate
CN103140840A (en) Data management method and device
CN104054071A (en) Method for accessing storage device and storage device
WO2013075306A1 (en) Data access method and device
CN107422989A (en) A kind of more copy read methods of Server SAN systems and storage architecture
WO2023096118A1 (en) Data input and output method using storage node-based key-value store
WO2012149815A1 (en) Method and device for managing disk cache
CN1684049A (en) Information storage apparatus, information storage method and information storage processing program product
Chen et al. ECR: Eviction‐cost‐aware cache management policy for page‐level flash‐based SSDs
CN104321754A (en) Method and device for setting working mode of Cache
WO2013075627A1 (en) Method, device and server for caching data
WO2015056818A1 (en) Counting bloom filter
JP2007323557A (en) Disk array device and load balancing method thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20220218

Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province

Patentee after: Huawei Cloud Computing Technology Co.,Ltd.

Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd.

TR01 Transfer of patent right