CN105677742A - Method and apparatus for storing files - Google Patents

Method and apparatus for storing files Download PDF

Info

Publication number
CN105677742A
CN105677742A CN201511018066.4A CN201511018066A CN105677742A CN 105677742 A CN105677742 A CN 105677742A CN 201511018066 A CN201511018066 A CN 201511018066A CN 105677742 A CN105677742 A CN 105677742A
Authority
CN
China
Prior art keywords
file
stored
copy
storage pool
copy storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201511018066.4A
Other languages
Chinese (zh)
Other versions
CN105677742B (en
Inventor
刘凯
崔登荣
周枫
张涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Virtual Clusters Information Technology Co Ltd
Original Assignee
Shenzhen Virtual Clusters Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Virtual Clusters Information Technology Co Ltd filed Critical Shenzhen Virtual Clusters Information Technology Co Ltd
Priority to CN201511018066.4A priority Critical patent/CN105677742B/en
Publication of CN105677742A publication Critical patent/CN105677742A/en
Application granted granted Critical
Publication of CN105677742B publication Critical patent/CN105677742B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/13File access structures, e.g. distributed indices

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a method and an apparatus for storing files. A storage space is divided into a copy storage pool and an erasure code storage pool. The method includes: receiving a file to be stored; determining whether the size of the file to be stored is smaller than a predetermined threshold value; if the size of the file to be stored is smaller than the threshold value, storing the file to be stored to the copy storage pool in accordance with a preset copy storage algorithm; if the size of the file to be stored is larger than or equal to the threshold value, obtaining the type of the file to be stored; determining whether the type of the file to be stored is the type designated by the pre-arranged copy storage rules; if the type of the file to be stored is the type designated by the pre-arranged copy storage rules, based on the pre-set copy storage algorithm, storing the file to be stored to the copy storage pool. By way of the method of the invention, the advantages of the copy storage and the erasure code storage can be fully displayed so as to achieve efficient storage.

Description

A kind of method storing file and device
Technical field
The present invention relates to data storage processing technical field, particularly relate to a kind of method storing file and device.
Background technology
Distributed memory system refers to the system being made up of multiple stage independent storage devices, and file can disperse to be stored in multiple stage independent storage devices. Distributed memory system its be generally adopted extendible system structure, multiple stage storage device is mainly utilized to share storage load, utilizing location server location storing device information, it not only increases the reliability of system, availability and access efficiency, is also easy to extension.
Distributed memory system of the prior art or employing copy storage, or adopt correcting and eleting codes to store, correcting and eleting codes storage refers to according to default correcting and eleting codes algorithm storage file, and copy storage refers to and stores file according to default copy storage algorithm. And copy storage has an advantage that read or write speed is fast, but it has simultaneously and takies the shortcoming that memory space is big, and two-pack originally can take the space of 2 times, and 3 copies can take the space of 3 times. Correcting and eleting codes storage has the advantage saving a large amount of memory spaces, but needs a large amount of calculating when its write and reading, and speed is slower.
Single storage mode increasingly can not meet the demand for development of distributed memory system.
Summary of the invention
The technical problem that present invention mainly solves is to provide a kind of method storing file and device, it is possible to give full play to copy storage and the advantage of correcting and eleting codes storage, to reach efficient storage.
For solving above-mentioned technical problem, the technical scheme that the present invention adopts is: provide a kind of method storing file, and memory space divides copy storage pool and correcting and eleting codes storage pool, and method includes: receive file to be stored; Judge that whether the size of described file to be stored is less than predetermined threshold; If less than threshold value, then according to presetting copy storage algorithm, described file to be stored is stored to copy storage pool; If more than or equal to threshold value, obtaining the file type of described file to be stored; Judge that whether the file type of described file to be stored is type specified in pre-configured copy storage rule; If so, then store algorithm according to described default copy, described file to be stored is stored to copy storage pool.
Wherein, described method also includes: if the file type of described file to be stored is not type specified in pre-configured copy storage rule, in file management system, obtain the file directory at described file to be stored place; Extract establishment time and the current time of described file directory; Judge that whether the interval between described current time and establishment time is less than the first intended duration; If so, then store algorithm according to described default copy, described file to be stored is stored to copy storage pool; Otherwise, then according to presetting correcting and eleting codes storage algorithm, described file to be stored is stored to correcting and eleting codes storage pool.
Wherein, storing algorithm according to described default copy, stored by described file to be stored to before copy storage pool, described method also includes: obtain the remaining space of described copy storage pool; Judge that described remaining space is whether more than the size of described file to be stored; If so, then store algorithm according to described default copy, described file to be stored is stored to before copy storage pool; If it is not, then according to preset schedule algorithm, from described copy storage pool extraction document, and algorithm will be stored according to default correcting and eleting codes, the file extracted will be transferred to correcting and eleting codes storage pool.
Wherein, described method also includes: when accessing the file of described copy storage pool, and record is accessed for access time and the access times of file; Described according to preset schedule algorithm, specifically include from the step of described copy storage pool extraction document: obtain current time; In conjunction with the described access time, from described copy storage pool extract in the second intended duration of described current time access times more than the file of predetermined value.
Wherein, described predetermined threshold is 100,000,000.
For solving above-mentioned technical problem, another technical solution used in the present invention is: provide a kind of device storing file, described device includes memory space, described memory space divides copy storage pool and correcting and eleting codes storage pool, described device also includes: receiver module, is used for receiving file to be stored; Whether first judge module, be used for the size judging described file to be stored less than predetermined threshold; First memory module, for when described first judge module determines the size of file to be stored less than threshold value, storing algorithm according to default copy, stored by described file to be stored to copy storage pool; First acquisition module, for when described first judge module determines the size of file to be stored more than or equal to threshold value, obtaining the file type of described file to be stored; Second judge module, is used for judging whether the file type of described file to be stored is the type specified by pre-configured copy storage rule; Second memory module, for described second judge module determine the file type of file to be stored be type specified in pre-configured copy storage rule time, store algorithm according to default copy, described file to be stored stored to copy storage pool.
Wherein, described device also includes: the second acquisition module, during for determining the file type of file to be stored at described second judge module for specified in pre-configured copy storage rule type, in file management system, obtain the file directory at described file to be stored place; 3rd judge module, is used for judging whether described file directory is the file directory specified by pre-configured copy storage rule; 3rd memory module, for described 3rd judge module determine described file directory be file directory specified in pre-configured copy storage rule time, store algorithm according to described default copy, described file to be stored stored to copy storage pool;Extraction module, for for when described 3rd judge module determines described file directory for specified in pre-configured copy storage rule file directory, extracting establishment time and the current time of described file directory; 4th judge module, whether the interval being used for judging between described current time and establishment time is less than the first intended duration; 4th memory module, for when described 3rd judge module determines described interval less than the first intended duration, storing algorithm according to described default copy, stored by described file to be stored to copy storage pool; 5th memory module, for described 3rd judge module determine described interval greater than or during equal to the first intended duration, store algorithm according to default correcting and eleting codes, described file to be stored stored to correcting and eleting codes storage pool.
Wherein, described device also includes: the 4th acquisition module, for storing algorithm according to described default copy, is stored by described file to be stored to before copy storage pool, obtaining the remaining space of described copy storage pool; 5th judge module, for judging that described remaining space is whether more than the size of described file to be stored, if so, then directly stores algorithm according to described default copy, is stored by described file to be stored to copy storage pool; Scheduler module, for determining the remaining space size less than described file to be stored at described 4th judge module, then according to preset schedule algorithm, from described copy storage pool extraction document, and algorithm will be stored according to default correcting and eleting codes, the file extracted is transferred to correcting and eleting codes storage pool.
Wherein, described device also includes: logging modle, and for when accessing the file of described copy storage pool, record is accessed for access time and the access times of file; Described scheduler module is specifically for obtaining current time, in conjunction with the described access time, from described copy storage pool extract in the second intended duration of described current time access times more than the file of predetermined value, and algorithm will be stored according to default correcting and eleting codes, the file extracted is transferred to correcting and eleting codes storage pool.
Wherein, described predetermined threshold is 100,000,000.
The invention has the beneficial effects as follows: be different from the situation of prior art, the present invention is for the file to be stored less than predetermined threshold, algorithm is stored according to default copy, file to be stored is stored to copy storage pool, for the file to be stored more than or equal to predetermined threshold, algorithm is stored according to default correcting and eleting codes, file to be stored is stored to correcting and eleting codes storage pool, realize small documents and carry out copy storage, big file carries out correcting and eleting codes storage, give full play to copy storage and the advantage of correcting and eleting codes storage, improve treatment effeciency; Can be also copy storage for certain types of big file configuration, so that stored file is suitable for different scene, to reach the purpose of efficient storage file.
Accompanying drawing explanation
Fig. 1 is the flow chart that the present invention stores the method embodiment of file;
Fig. 2 is the schematic diagram that the present invention stores the device embodiments of file.
Detailed description of the invention
Below in conjunction with drawings and embodiments, the present invention is carried out in detail.
The present invention stores the memory space division of file copy storage pool and correcting and eleting codes storage pool, copy storage pool is to being applied to storage according to presetting the copy storage stored file of algorithm, correcting and eleting codes storage pool is to being applied to storage according to presetting the correcting and eleting codes storage stored file of algorithm, referring to Fig. 1, the method for storage file includes:
Step S201: receive file to be stored;
Step S202: judge that whether the size of file to be stored is less than predetermined threshold, if less than threshold value, then enters step S203, otherwise enters step S204;
Step S203: store algorithm according to default copy, file to be stored is stored to copy storage pool;
Storing algorithm storage file according to default copy, it is advantageous that read or write speed is fast, shortcoming is that to take memory space big. Algorithmic approach storage file is stored according to default correcting and eleting codes, it is advantageous that and save space in a large number, but need a large amount of calculating when write and reading, therefore, when file is less than predetermined threshold, algorithm storage file is stored according to default copy, be conducive to improving storage speed, when file is more than or equal to predetermined threshold, it is suitable for storing according to default correcting and eleting codes storage algorithm, joint space, by storing in conjunction with default copy storage algorithm and default correcting and eleting codes storage algorithm, gives full play to the advantage of the two.
Step S204: obtain the file type of file to be stored;
Step S205: judge that whether the file type of file to be stored is type specified in pre-configured copy storage rule, if so, then enter and return step S203, otherwise enter step S206;
Pre-configured copy storage rule is for specifying specific file type to adopt default copy storage algorithm to store. Certainly, in other alternate embodiments, it is also possible to arrange pre-configured correcting and eleting codes storage rule, pre-configured correcting and eleting codes storage rule is used for specifying specific file type to adopt default correcting and eleting codes algorithm to store.
Although some file is more than predetermined threshold, but it is still adapted to preset correcting and eleting codes storage algorithm and stores, such as: Online Video file, Online Video file needs to ensure its fluency, therefore, the present invention also allow for user specify specific file type adopt preset copy storage algorithm store. Both give full play to correcting and eleting codes storage and copy had stored both advantage, and allow again user that particular file types is configured to copy storage, to reach the purpose of efficient storage file. In the present embodiment, predetermined threshold is preferably 100,000,000. Certainly, predetermined threshold and pre-configured copy storage rule are all configurable, and user can according to the different content of different scene configuration.
In the technical field of file storage, it is the highest that the file under latest list is accessed for probability recently, and in order to improve treatment effeciency, the file under latest list adopts default copy storage algorithm to store, then method also includes:
Step S206: in file management system, obtains the file directory at described file to be stored place;
Step S207: judge whether file directory is the literary composition specified by pre-configured copy storage rule
Part catalogue, if so, then returns step S203, otherwise enters step S208: step S208:
The establishment time of extraction document catalogue and current time;
Step S209 judges that whether the interval between current time and establishment time is less than the first intended duration; If so, return step S203, otherwise enter step S210;
Step S210: store algorithm according to default correcting and eleting codes, file to be stored is stored to correcting and eleting codes storage pool.
In order to avoid when the remaining space deficiency of copy storage pool, still storing file to copy storage pool, before storing file to copy storage pool, copy storage pool being detected, specifically, method also includes:
Step S301: obtain the remaining space of copy storage pool;
Step S302: judge that remaining space is whether more than the size of described file to be stored;If so, then enter step S203, otherwise enter step S303;
Step S303: then according to preset schedule algorithm, from copy storage pool extraction document, and will store algorithm according to default correcting and eleting codes, the file extracted will be transferred to correcting and eleting codes storage pool, subsequently into step S203.
The temperature that preset schedule algorithm is according to file is screened, correcting and eleting codes storage pool is transferred to for the file that temperature is relatively low, the file that temperature is higher is retained in copy storage pool, optimize storage, then method also includes: when accessing the file of copy storage pool, and record is accessed for access time and the access times of file. Step S303 is particularly as follows: obtain current time, the combined with access time, extract access times in the second intended duration of distance current time more than the file of predetermined value from copy storage pool, algorithm to be stored according to default correcting and eleting codes, the file extracted is transferred to correcting and eleting codes storage pool.
In embodiments of the present invention, for the file to be stored less than predetermined threshold, store algorithm according to default copy, file to be stored is stored to copy storage pool, for the file to be stored more than or equal to predetermined threshold, algorithm is stored according to default correcting and eleting codes, file to be stored is stored to correcting and eleting codes storage pool, it is achieved small documents carries out copy storage, and big file carries out correcting and eleting codes storage, give full play to copy storage and the advantage of correcting and eleting codes storage, improve treatment effeciency; Can be also copy storage for certain types of big file configuration, so that stored file is suitable for different scene, to reach the purpose of efficient storage file.
The present invention provides again the device embodiments of storage file. Refer to Fig. 2, the device 30 of storage file includes memory space (not shown), memory space divides copy storage pool 51 and correcting and eleting codes storage pool 51, and the device 30 of storage file includes receiver module the 31, first judge module the 32, first memory module the 33, first acquisition module the 34, second judge module 35 and the second memory module 36.
Receiver module 31, is used for receiving file to be stored. Whether first judge module 32, be used for the size judging file to be stored less than predetermined threshold. First memory module 33, for when described first judge module 32 determines the size of file to be stored less than threshold value, storing algorithm according to default copy, store described file to be stored to copy storage pool. First acquisition module 34, for when described first judge module 32 determines the size of file to be stored more than or equal to threshold value, obtaining the file type of described file to be stored. Second judge module 35, is used for judging whether the file type of file to be stored is the type specified by pre-configured copy storage rule. Second memory module 36, for the second judge module 35 determine the file type of file to be stored be type specified in pre-configured copy storage rule time, store algorithm according to default copy, file to be stored stored to copy storage pool.
Correcting and eleting codes storage is adopted for big file, saves memory space, copy storage is adopted for small documents, improves read-write efficiency, make full use of correcting and eleting codes storage and copy the two advantage of storage, improve treatment effeciency. It addition, allow again user that particular file types is configured to copy storage, to reach the purpose of efficient storage file. In the present embodiment, predetermined threshold is preferably 100,000,000. Certainly, predetermined threshold and pre-configured copy storage rule are all configurable, and user can according to the different content of different scene configuration.
Device 30 also includes the second acquisition module the 37, the 3rd judge module the 38, the 3rd memory module 39, extraction module the 40, the 4th judge module the 41, the 4th memory module 42 and the 5th memory module 43.
Second acquisition module 37, for when the second judge module 35 determines the file type of file to be stored for specified in pre-configured copy storage rule type, in file management system, obtaining the file directory at described file to be stored place. 3rd judge module 38, is used for judging whether file directory is the file directory specified by pre-configured copy storage rule. 3rd memory module 39, for the 3rd judge module 38 determine file directory be file directory specified in pre-configured copy storage rule time, store algorithm according to default copy, file to be stored stored to copy storage pool. Extraction module 40, for when the 3rd judge module 38 determines file directory for specified in pre-configured copy storage rule file directory, the establishment time of extraction document catalogue and current time. 4th judge module 41, whether the interval being used for judging between current time and establishment time is less than the first intended duration. 4th memory module 42, for when the 4th judge module 41 determines interval less than the first intended duration, storing algorithm according to default copy, stored by file to be stored to copy storage pool. 5th memory module 43, for when the 4th judge module 41 determines interval greater than or is equal to the first intended duration, storing algorithm according to default correcting and eleting codes, stored by file to be stored to correcting and eleting codes storage pool. It is the highest that file under latest list is accessed for probability recently, is configured to copy storage, can improve treatment effeciency.
Device 30 also includes the 4th acquisition module the 44, the 4th judge module 45 and scheduler module 46.
4th acquisition module 44, for according to presetting copy storage algorithm, storing file to be stored to before copy storage pool, obtaining the remaining space of copy storage pool. 4th judge module, for judging that remaining space is whether more than the size of file to be stored, if so, then directly according to presetting copy storage algorithm, stores file to be stored to copy storage pool. Scheduler module 45, for determining the remaining space size less than described file to be stored at the 4th judge module 46, then according to preset schedule algorithm, from copy storage pool extraction document, and algorithm will be stored according to default correcting and eleting codes, the file extracted is transferred to correcting and eleting codes storage pool.
Preset schedule algorithm is specially the algorithm that the access temperature according to file is scheduling, then device also includes logging modle (not shown).
Logging modle, for when accessing the file of described copy storage pool, record is accessed for access time and the access times of file. Scheduler module is specifically for obtaining current time, the combined with access time, in the second intended duration of copy storage pool extraction distance current time, access times are more than the file of predetermined value, and will store algorithm according to default correcting and eleting codes, and the file extracted will be transferred to correcting and eleting codes storage pool. Certainly, in other alternate embodiments, preset schedule algorithm can also be other dispatching algorithm, for instance: first in first out is dispatched, scheduling etc. first-in last-out.
In embodiments of the present invention, for the file to be stored less than predetermined threshold, store algorithm according to default copy, file to be stored is stored to copy storage pool, for the file to be stored more than or equal to predetermined threshold, algorithm is stored according to default correcting and eleting codes, file to be stored is stored to correcting and eleting codes storage pool, it is achieved small documents carries out copy storage, and big file carries out correcting and eleting codes storage, give full play to copy storage and the advantage of correcting and eleting codes storage, improve treatment effeciency;Can be also copy storage for certain types of big file configuration, so that stored file is suitable for different scene, to reach the purpose of efficient storage file.
The foregoing is only embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every equivalent structure utilizing description of the present invention and accompanying drawing content to make or equivalence flow process conversion; or directly or indirectly it is used in other relevant technical fields, all in like manner include in the scope of patent protection of the present invention.

Claims (10)

1. the method storing file, it is characterised in that memory space divides copy storage pool and correcting and eleting codes storage pool, and described method includes:
Receive file to be stored;
Judge that whether the size of described file to be stored is less than predetermined threshold;
If less than threshold value, then according to presetting copy storage algorithm, described file to be stored is stored to copy storage pool;
If more than or equal to threshold value, obtaining the file type of described file to be stored;
Judge that whether the file type of described file to be stored is type specified in pre-configured copy storage rule;
If so, then store algorithm according to described default copy, described file to be stored is stored to copy storage pool.
2. method according to claim 1, it is characterised in that described method also includes:
If the file type of described file to be stored is not type specified in pre-configured copy storage rule, in file management system, obtain the file directory at described file to be stored place;
Judge whether described file directory is the file directory specified by pre-configured copy storage rule;
If described file directory is not file directory specified in pre-configured copy storage rule, then extract establishment time and the current time of described file directory;
Judge that whether the interval between described current time and establishment time is less than the first intended duration;
If less than the first intended duration, then store algorithm according to described default copy, described file to be stored is stored to copy storage pool;
If more than or equal to the first intended duration, then according to presetting correcting and eleting codes storage algorithm, described file to be stored is stored to correcting and eleting codes storage pool;
If described file directory is file directory specified in pre-configured copy storage rule, then stores algorithm according to described default copy, described file to be stored is stored to copy storage pool.
3. method according to claim 2, it is characterised in that
Storing algorithm according to described default copy, stored by described file to be stored to before copy storage pool, described method also includes:
Obtain the remaining space of described copy storage pool;
Judge that described remaining space is whether more than the size of described file to be stored;
If so, then store algorithm according to described default copy, described file to be stored is stored to before copy storage pool;
If it is not, then according to preset schedule algorithm, from described copy storage pool extraction document, and algorithm will be stored according to default correcting and eleting codes, the file extracted will be transferred to correcting and eleting codes storage pool.
4. method according to claim 3, it is characterised in that described method also includes:
When accessing the file of described copy storage pool, record is accessed for access time and the access times of file;
Described according to preset schedule algorithm, specifically include from the step of described copy storage pool extraction document:
Obtain current time;
In conjunction with the described access time, from described copy storage pool extract in the second intended duration of described current time access times more than the file of predetermined value.
5. method according to claim 1, it is characterised in that
Described predetermined threshold is 100,000,000.
6. the device storing file, it is characterised in that described device includes memory space, described memory space divides copy storage pool and correcting and eleting codes storage pool, and described device also includes:
Receiver module, is used for receiving file to be stored;
Whether first judge module, be used for the size judging described file to be stored less than predetermined threshold;
First memory module, for when described first judge module determines the size of file to be stored less than threshold value, storing algorithm according to default copy, stored by described file to be stored to copy storage pool;
First acquisition module, for when described first judge module determines the size of file to be stored more than or equal to threshold value, obtaining the file type of described file to be stored;
Second judge module, is used for judging whether the file type of described file to be stored is the type specified by pre-configured copy storage rule;
Second memory module, for described second judge module determine the file type of file to be stored be type specified in pre-configured copy storage rule time, store algorithm according to default copy, described file to be stored stored to copy storage pool.
7. device according to claim 6, it is characterised in that described device also includes:
Second acquisition module, for when described second judge module determines the file type of file to be stored for specified in pre-configured copy storage rule type, in file management system, obtaining the file directory at described file to be stored place;
3rd judge module, is used for judging whether described file directory is the file directory specified by pre-configured copy storage rule;
3rd memory module, for described 3rd judge module determine described file directory be file directory specified in pre-configured copy storage rule time, store algorithm according to described default copy, described file to be stored stored to copy storage pool;
Extraction module, for when described 3rd judge module determines described file directory for specified in pre-configured copy storage rule file directory, extracting establishment time and the current time of described file directory;
4th judge module, whether the interval being used for judging between described current time and establishment time is less than the first intended duration;
4th memory module, for when described 3rd judge module determines described interval less than the first intended duration, storing algorithm according to described default copy, stored by described file to be stored to copy storage pool;
5th memory module, for described 3rd judge module determine described interval greater than or during equal to the first intended duration, store algorithm according to default correcting and eleting codes, described file to be stored stored to correcting and eleting codes storage pool.
8. device according to claim 7, it is characterised in that described device also includes:
4th acquisition module, for storing algorithm according to described default copy, stores described file to be stored to before copy storage pool, obtaining the remaining space of described copy storage pool;
5th judge module, for judging that described remaining space is whether more than the size of described file to be stored, if so, then directly stores algorithm according to described default copy, is stored by described file to be stored to copy storage pool;
Scheduler module, for determining the remaining space size less than described file to be stored at described 4th judge module, then according to preset schedule algorithm, from described copy storage pool extraction document, and algorithm will be stored according to default correcting and eleting codes, the file extracted is transferred to correcting and eleting codes storage pool.
9. device according to claim 8, it is characterised in that described device also includes:
Logging modle, for when accessing the file of described copy storage pool, record is accessed for access time and the access times of file;
Described scheduler module is specifically for obtaining current time, in conjunction with the described access time, from described copy storage pool extract in the second intended duration of described current time access times more than the file of predetermined value, and algorithm will be stored according to default correcting and eleting codes, the file extracted is transferred to correcting and eleting codes storage pool.
10. device according to claim 6, it is characterised in that
Described predetermined threshold is 100,000,000.
CN201511018066.4A 2015-12-30 2015-12-30 A kind of method and device of storage file Active CN105677742B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201511018066.4A CN105677742B (en) 2015-12-30 2015-12-30 A kind of method and device of storage file

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201511018066.4A CN105677742B (en) 2015-12-30 2015-12-30 A kind of method and device of storage file

Publications (2)

Publication Number Publication Date
CN105677742A true CN105677742A (en) 2016-06-15
CN105677742B CN105677742B (en) 2019-07-05

Family

ID=56297955

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201511018066.4A Active CN105677742B (en) 2015-12-30 2015-12-30 A kind of method and device of storage file

Country Status (1)

Country Link
CN (1) CN105677742B (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106227731A (en) * 2016-07-06 2016-12-14 联想(北京)有限公司 A kind of data processing method, device and distributed file system
CN107357932A (en) * 2017-07-31 2017-11-17 云城(北京)数据科技有限公司 A kind of file memory method and device
CN107784108A (en) * 2017-10-31 2018-03-09 郑州云海信息技术有限公司 A kind of data storage and management method, device and equipment
CN107797884A (en) * 2016-10-28 2018-03-13 湖南大学 A kind of cloud storage fault-tolerance approach adaptively switched based on duplication and correcting and eleting codes
CN107817947A (en) * 2016-09-14 2018-03-20 北京金山云网络技术有限公司 A kind of date storage method, apparatus and system
CN108197184A (en) * 2017-12-25 2018-06-22 深圳天珑无线科技有限公司 The method and file-storage device, storage device of file storage
CN109167740A (en) * 2018-06-21 2019-01-08 华为技术有限公司 A kind of method and apparatus of data transmission
CN110008179A (en) * 2019-04-02 2019-07-12 深圳创维汽车智能有限公司 File memory method, automobile data recorder and readable storage medium storing program for executing
CN110083482A (en) * 2019-04-30 2019-08-02 北京金山云网络技术有限公司 The method, apparatus and electronic equipment of correcting and eleting codes processing are carried out to document storage system
CN111008181A (en) * 2019-10-31 2020-04-14 苏州浪潮智能科技有限公司 Method, system, terminal and storage medium for switching storage strategies of distributed file system
CN111124282A (en) * 2019-11-29 2020-05-08 浪潮电子信息产业股份有限公司 Storage method, storage device and storage equipment in object storage system
CN112965660A (en) * 2021-02-09 2021-06-15 山东英信计算机技术有限公司 Method, system, device and medium for feeding back information of double storage pools
CN114063937A (en) * 2022-01-18 2022-02-18 苏州浪潮智能科技有限公司 Storage pool copy strategy adjusting method, device, equipment and medium
CN114442956A (en) * 2022-01-27 2022-05-06 苏州浪潮智能科技有限公司 Data write-in processing method, device, equipment and medium for double storage pools

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103118133A (en) * 2013-02-28 2013-05-22 浙江大学 Mixed cloud storage method based on file access frequency
CN103678143A (en) * 2012-09-25 2014-03-26 联想(北京)有限公司 File storage method and device and electronic equipment
CN104281533A (en) * 2014-09-18 2015-01-14 深圳市中博科创信息技术有限公司 Data storage method and device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103678143A (en) * 2012-09-25 2014-03-26 联想(北京)有限公司 File storage method and device and electronic equipment
CN103118133A (en) * 2013-02-28 2013-05-22 浙江大学 Mixed cloud storage method based on file access frequency
CN104281533A (en) * 2014-09-18 2015-01-14 深圳市中博科创信息技术有限公司 Data storage method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
聂瑞华: "一种改进的云存储系统容错机制", 《计算机应用研究》 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106227731A (en) * 2016-07-06 2016-12-14 联想(北京)有限公司 A kind of data processing method, device and distributed file system
CN106227731B (en) * 2016-07-06 2019-10-29 联想(北京)有限公司 A kind of data processing method, device and distributed file system
CN107817947A (en) * 2016-09-14 2018-03-20 北京金山云网络技术有限公司 A kind of date storage method, apparatus and system
CN107817947B (en) * 2016-09-14 2021-03-26 北京金山云网络技术有限公司 Data storage method, device and system
CN107797884A (en) * 2016-10-28 2018-03-13 湖南大学 A kind of cloud storage fault-tolerance approach adaptively switched based on duplication and correcting and eleting codes
CN107357932A (en) * 2017-07-31 2017-11-17 云城(北京)数据科技有限公司 A kind of file memory method and device
CN107784108A (en) * 2017-10-31 2018-03-09 郑州云海信息技术有限公司 A kind of data storage and management method, device and equipment
CN108197184A (en) * 2017-12-25 2018-06-22 深圳天珑无线科技有限公司 The method and file-storage device, storage device of file storage
CN109167740A (en) * 2018-06-21 2019-01-08 华为技术有限公司 A kind of method and apparatus of data transmission
CN110008179A (en) * 2019-04-02 2019-07-12 深圳创维汽车智能有限公司 File memory method, automobile data recorder and readable storage medium storing program for executing
CN110008179B (en) * 2019-04-02 2023-06-16 深圳创维汽车智能有限公司 File storage method, automobile data recorder and readable storage medium
CN110083482A (en) * 2019-04-30 2019-08-02 北京金山云网络技术有限公司 The method, apparatus and electronic equipment of correcting and eleting codes processing are carried out to document storage system
CN110083482B (en) * 2019-04-30 2023-06-02 北京金山云网络技术有限公司 Method and device for performing erasure code processing on file storage system and electronic equipment
CN111008181A (en) * 2019-10-31 2020-04-14 苏州浪潮智能科技有限公司 Method, system, terminal and storage medium for switching storage strategies of distributed file system
CN111124282A (en) * 2019-11-29 2020-05-08 浪潮电子信息产业股份有限公司 Storage method, storage device and storage equipment in object storage system
CN112965660A (en) * 2021-02-09 2021-06-15 山东英信计算机技术有限公司 Method, system, device and medium for feeding back information of double storage pools
CN112965660B (en) * 2021-02-09 2023-08-08 山东英信计算机技术有限公司 Method, system, equipment and medium for double storage pool information feedback
CN114063937A (en) * 2022-01-18 2022-02-18 苏州浪潮智能科技有限公司 Storage pool copy strategy adjusting method, device, equipment and medium
CN114442956A (en) * 2022-01-27 2022-05-06 苏州浪潮智能科技有限公司 Data write-in processing method, device, equipment and medium for double storage pools
CN114442956B (en) * 2022-01-27 2023-08-25 苏州浪潮智能科技有限公司 Double-storage-pool data writing processing method, device, equipment and medium

Also Published As

Publication number Publication date
CN105677742B (en) 2019-07-05

Similar Documents

Publication Publication Date Title
CN105677742A (en) Method and apparatus for storing files
CN102411628B (en) Android system-based file scanning method and device
CN103218224B (en) A kind of method improving memory space utilization rate and terminal
US9823945B2 (en) Method and apparatus for managing application program
CN101571850A (en) Display packing and device of text document in support of page turn function
CN105468642A (en) Data storage method and apparatus
CN103198027A (en) Method and device for storing and providing files
CN110018788A (en) It is classified storage method, device, electronic equipment and computer readable storage medium
CN102158349A (en) Log management device and method thereof
CN102999599B (en) A kind of picture display method and device
CN104778222A (en) Media library establishing and updating method on basis of USB (Universal Serial Bus) storage equipment
CN104142937A (en) Method, device and system for distributed data access
CN109947720A (en) A kind of pre-reading method of files, device, equipment and readable storage medium storing program for executing
CN103617260A (en) Index generation method and device for repeated data deletion
CN105787012A (en) Method for improving small file processing capability of storage system and storage system
CN103778120A (en) Global file identification generation method, generation device and corresponding distributed file system
CN103020127B (en) For rendering method and the device of picture
CN104199729A (en) Resource management method and system
CN103581051A (en) File buffering storage method and device and system
CN103020186B (en) A kind of document retrieval method based on embedded device, device and equipment
CN103338299B (en) A kind of image processing method and device, terminal
CN103647914A (en) Method and device for timed wake-up after television turning-off
CN103116729B (en) A kind of portable device data derives method and system automatically
CN103617177A (en) Stackable repeating data deletion file system
CN102663140B (en) Terabyte (TB)-level-based panoramic image data quick access method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant