CN104331428B - The storage of a kind of small documents and big file and access method - Google Patents
The storage of a kind of small documents and big file and access method Download PDFInfo
- Publication number
- CN104331428B CN104331428B CN201410559955.0A CN201410559955A CN104331428B CN 104331428 B CN104331428 B CN 104331428B CN 201410559955 A CN201410559955 A CN 201410559955A CN 104331428 B CN104331428 B CN 104331428B
- Authority
- CN
- China
- Prior art keywords
- file
- user
- big file
- small documents
- caching server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
Abstract
The present invention disclose storage and the access method of a kind of small documents and big file, the present invention is stored in caching server small documents and conventional big file in storing process, and access method is concretely comprised the following steps：User equipment adds identification prefix according to user's request filename before it；Caching server judges that it is big file or small documents after receiving request according to the prefix identifier of filename；If demand file is small documents, caching server searches for local small documents memory block, if demand file is big file, caching server search local cache area；User is guided to access this document if caching server has this document, user's request is sent to management server if caching server does not have this document and user's request is big file, the present invention is by small documents and conventional big file storage in caching server, filename identification prefix is introduced to judge, the efficiency that user accesses file can be effectively improved, period of reservation of number is reduced.
Description
Technical field
The present invention relates to file access field, storage and the access method of more particularly to a kind of small documents and big file.
Background technology
With the development of society, substantial amounts of data are generated in people's daily life and work, these data are with text, text
Based on the small documents such as shelves, Exce prefixes, but also including part big file such as video file, high definition picture file.According to custom
From the point of view of, people access most big files of typically small documents and part.Therefore how efficiently to store this two class file and make
User can quickly access this two class file and access the problem that field is present as current file.
Current file access mode research concentrates on mass small documents storage and quick access field, such as TFS of Taobao
Quick access for small documents can be provided, big file but cannot be quickly accessed, but such as HDFS efficiently can quickly access big text
Part, but equally stores small documents in back end as big file, slower which results in the access speed for small documents.
In practical operation, user generally often accesses multiple small documents and a small amount of big file, therefore how often to access this part
File makes a distinction with general big file and the big of often access is quickly accessed on the premise of efficient access small documents are ensured greatly
File turns into the current technical issues that need to address.
The content of the invention
Shortcoming and deficiency it is an object of the invention to overcome prior art, there is provided the storage of a kind of small documents and big file
Method.
The second object of the present invention is the access method for providing a kind of quick small documents and big file.The access method
Ensure can to the quick access of small documents again can be higher to frequency of use big file realize quick access.
The first object of the present invention is achieved through the following technical solutions：The storage method of a kind of small documents and big file, step
It is rapid as follows：
S1, user create new file by user equipment, determine that new file to be created is big text according to first threshold
Part or small documents, and filename is set, the identification prefix for recognizing big file and small documents is added on filename；
S2, user equipment are sent to caching server by new file request instruction is created, and caching server receives user and sets
After the establishment new file request instruction that preparation is sent, the filename identification prefix of new file to be created is recognized, judgement is wanted
The new file of establishment is big file or small documents；
If new file to be created is small documents, this document is created in caching server and its metadata is preserved；
If new file to be created is big file, the establishment new file request that caching server sends user equipment
Instruction is sent to management server；
S3, management server are received after coming from the establishment new file request instruction of caching server, management server wound
Build the big file and carried out piecemeal, obtain data block, and preserve the metadata of the big file；
The data block that the big file for creating is divided is sent to data server and is preserved by S4, management server, while
Caching server determines whether big file is to commonly use big file according to big file request access times, if so, then from data, services
Device end is by the big file download and is stored in caching server.
Preferably, in the step S2, if new file to be created is small documents, caching server is looked into first
Ask the currently stored small documents metadata of caching server, judge new file to be created filename whether with buffer service
The current filename for having small documents is born the same name in device；
If so, then caching server sends " file is existing " information to user equipment, and abandon the wound of user's transmission
Build new file request instruction；
If it is not, creating this document in caching server and preserving its metadata.
Preferably, in the step S3, if new file to be created is big file, management server is received and come from
After the establishment new file request instruction of caching server, judge new file to be created filename whether with management server
In the filename of current existing big file bear the same name；
If so, then management server sends " file is existing " information to user equipment, and abandon the wound of user's transmission
Build new file request instruction；
If it is not, creating this document in management server and preserving its metadata.
Preferably, the first threshold is 1M, when the size of file is more than 1M, then this document is judged as into big file,
Otherwise it is judged as small documents.
Preferably, the identification prefix of the big file and small documents is respectively L and S；I.e. user equipment is big what is created
L is added before the filename of file, user equipment adds S before the filename of the small documents for creating.
Preferably, the caching server includes memory block and buffer area；Small documents and the storage of small documents metadata are slow
The memory block of server is deposited, big file is commonly used and is commonly used the buffer area that big file metadata is stored in caching server.
The second object of the present invention is achieved through the following technical solutions：A kind of small documents realized based on above-mentioned storage method
With the access method of big file, it is characterised in that step is as follows：
Sa, user import file name in a user device, are proposed to access file request by user equipment, and user equipment is searched
Suo Zhi determines that the corresponding file of the filename of user input is big file or small documents, is then instructed in user access request
In filename in add big file or small documents identification prefix, user equipment sends user access request and instructs and taken to caching
Business device；
Sb, caching server receive the user access request instruction of user equipment transmission, are referred to according to user access request
What the identification prefix of filename judged user's request access in order is big file or small documents；
If small documents, then caching server searches for local small documents metadata, judges to whether there is in caching server
User requires the small documents for accessing；If in the presence of the access that caching server guiding user is carried out to the small documents；Otherwise cache
Server is returned and does not find information command to user equipment；
If big file, then big file metadata is locally commonly used in caching server search, judge in caching server whether
There is the big file that user requires to access；If so, the access that then caching server guiding user is carried out to the big file；If it is not,
The user access request instruction that then caching server sends user equipment is sent to management server, into step Sc, while
The request access times of the big file that caching server record is accessed by its request；
Sc, management server are received after coming from the user access request instruction of caching server, the local big text of search
Part metadata, judges the big file accessed with the presence or absence of user's requirement in management server；If in the presence of guiding user is to big text
Part is accessed；The information of not finding otherwise is returned to user equipment.
Preferably, in the step Sb, the detailed process that caching server guiding user conducts interviews to small documents is as follows：
Caching server judges that whether user requires the small documents for accessing in editable state first；
If so, then allowing user to implement read or write to the small documents；Small documents are implemented in user simultaneously to read or write
During operation, caching server locks the small documents automatically；
If it is not, caching server sends " this document is just used by other users " information terminates user to user equipment
Access request；
In the step Sb, caching server guides user as follows to commonly using the detailed process that big file conducts interviews：
Caching server judges that whether user requires the conventional big file for accessing in editable state first；
If so, then allowing user to implement read or write to the big file；File is implemented in user simultaneously to read or write behaviour
When making, caching server locks the big file automatically；After the completion of user operates, caching server sends Update log to management
Server, management server updates corresponding big file according to the Update log for receiving；
If it is not, then caching server transmission user access request is instructed to management server, subsequently into step Sc.
Preferably, in the step Sc, the detailed process that management server guiding user conducts interviews to file is as follows：
Management server judges that whether user requires the big file for accessing in editable state first；
If so, then allowing user to implement read or write to the conventional big file；Big file is implemented in user simultaneously to read
Or during write operation, management server locks the big file automatically；After the completion of user operates, management server sends Update log
To caching server, whether caching server has locally cached the big file according to the Update log inquiry for receiving；If so, then
Update the big file；If it is not, then abandoning the Update log that management server sends；
If it is not, management server sends " this document is just used by other users " information terminates user to user equipment
Access request.
Preferably, the identification prefix of the big file and small documents is respectively L and S；When being visited in the step Sa
When to ask the corresponding file of filename be big file, user equipment adds L before the filename that user access request is instructed；When wanting
When the corresponding file of Access Filename is small documents, user equipment adds S in the filename that user access request is instructed.
The present invention has the following advantages and effect relative to prior art：
Present invention introduces the filename identification prefix for judging big file and small documents, by small documents, big file
Access frequency conventional big file higher and general big file be stored separately, its small file and commonly use big file and deposit
The caching server of first search when being stored in access, when big file is stored in access after in the management server searched for, accessing
During small documents can preferentially be had access to by caching server and commonly use big file, substantially increase small documents and conventional
The access speed of big file, effectively reduces file access complexity, guarantees on the premise of efficient access small documents are ensured
Enough quick access commonly use big file, reduce user's access latency.
Brief description of the drawings
Fig. 1 is the system architecture diagram of realization storage and access method in the present invention.
Fig. 2 is the storage method flow chart of small documents of the present invention and big file.
Fig. 3 is the access method flow chart of small documents of the present invention and big file.
Specific embodiment
With reference to embodiment and accompanying drawing, the present invention is described in further detail, but embodiments of the present invention are not limited
In this.
Embodiment
Embodiment 1
The present embodiment discloses the storage method of a kind of small documents and big file, and the method is based on use as shown in Figure 1
Realized on the basis of family equipment, caching server, management server and data server；Wherein
User equipment：For establishment file, log and search daily record；Determined according to first threshold to be created
File is big file or small documents, and addition is respectively used to recognize the identification of big file and small documents on the filename for creating
Prefix L and S, wherein user equipment add L, text of the user equipment in the small documents for creating before the filename of the big file for creating
Addition S before part name, and establishment new file request instruction is sent to caching server.For determining to be accessed according to search daily record
The corresponding file of filename is big file or small documents, and then being added in the filename in user access request instruction is used for
The identification prefix of big file and small documents is recognized, when the corresponding file of wanted Access Filename is big file, user equipment
L is added before the filename of user access request instruction；When the corresponding file of wanted Access Filename is small documents, Yong Hushe
It is standby to add S in the filename of user access request instruction.For sending user access request instruction.Determine in the present embodiment
File is that the first threshold of big file or small documents is 1M, i.e., when the size of file is more than 1M, be then judged as this document
Big file, is otherwise judged as small documents.
Caching server：For storing small documents, small documents metadata, commonly using big file and commonly using big file metadata,
Wherein described conventional big file refers to big file of the access frequency more than Second Threshold；Wound for receiving user equipment transmission
Build new file request instruction；User access request instruction for receiving user equipment transmission, then according to user access request
It is big file or small documents that the identification prefix of filename judges that user needs the file for accessing in instruction；For guiding user
Access small documents and commonly use big file；For sending user's access instruction request to management server；Caching server is additionally operable to
Calculating is not held in big file access number of times therein, and access times will be asked to regard as commonly using more than the big file of Second Threshold
Big file, then from data server end is by the big file download and is stored in local cache area.
Management server, for storing big file metadata；User for being responsible for the transmission of response buffer server accesses
Request instruction；For guiding user to access big file.
Data server, for storing large file block.
As shown in Fig. 2 the storage method of the present embodiment small file and big file is comprised the following steps that：
S1, user create new file by user equipment, determine that new file to be created is big text according to first threshold
Part or small documents, and filename is set, added on filename identification prefix L for recognizing big file and small documents and
S；Determine that the first threshold that file is big file or small documents is 1M in the present embodiment, i.e., when the size of file is more than 1M
When, then this document is judged as big file, otherwise it is judged as small documents.
S2, user equipment are sent to caching server by new file request instruction is created, and caching server receives user and sets
After the establishment new file request instruction that preparation is sent, the file of new file to be created is recognized by creating new file request instruction
Name identification prefix, judges that new file to be created is big file or small documents, if caching server recognizes to be created
The filename identification prefix of the new file built is L, then judge that the new file to be created is big file, if recognizing to be created
New file filename identification prefix be S, then judge that the new file to be created is small documents；
If new file to be created is small documents, caching server inquires about currently stored small documents unit number first
According to whether the current filename for having small documents is born the same name with caching server to judge the filename of new file to be created；
If so, then caching server sends " file is existing " information to user equipment, and abandon the wound of user's transmission
Build new file request instruction；
If it is not, creating this document in caching server and preserving its metadata.
If new file to be created is big file, the establishment new file request that caching server sends user equipment
Instruction is sent to management server.
S3, management server are received after coming from the establishment new file request instruction of caching server, judge to be created
The filename of new file whether born the same name with the filename of current existing big file in management server；
If so, then management server sends " file is existing " information to user equipment, and abandon the wound of user's transmission
Build new file request instruction；
If it is not, creating the big file in server is deposited in management and being carried out piecemeal, data block is obtained, and preservation should
The metadata of big file；
The data block that the big file for creating is divided is sent to data server and is preserved by S4, management server；Simultaneously
Caching server determines whether big file is to commonly use big file according to big file request access times, if so, then from data, services
Device end is by the big file download and is stored in caching server.
Caching server includes memory block and buffer area in the present embodiment；Small documents and the storage of small documents metadata are slow
The memory block of server is deposited, small documents metadata is preserved in a permanent fashion；Commonly use big file and conventional big file metadata is protected
There is the buffer area of caching server, the conventional big file metadata for often accessing is preserved with update mode.
As shown in figure 3, the present embodiment also discloses the access method of a kind of small documents and big file, step is as follows：
Sa, user import file name in a user device, are proposed to access file request by user equipment, and user equipment is searched
Suo Zhi determines that the corresponding file of the filename of user input is big file or small documents, is then instructed in user access request
In filename in add big file or small documents identification prefix, when the corresponding file of wanted Access Filename is big file
When, user equipment adds L before the filename that user access request is instructed；When the corresponding file of wanted Access Filename is small text
During part, user equipment adds S in the filename that user access request is instructed, user equipment send user access request instruct to
Caching server；
Sb, caching server receive the user access request instruction of user equipment transmission, are referred to according to user access request
What the identification prefix of filename judged user's request access in order is big file or small documents；If user access request is instructed
When the identification prefix of middle filename is L, then what user's request was accessed is big file, if filename in user access request instruction
Identification prefix be S when, then user's request access be small documents；
If small documents, then caching server searches for the small documents metadata of local storage, in judging caching server
With the presence or absence of the small documents that user requires to access；
If not existing, caching server returns to " demand file does not exist " and does not find information command to user equipment；
If in the presence of the access that caching server guiding user is carried out to the small documents, detailed process is as follows：
Caching server judges that whether user requires the small documents for accessing in editable state first；
If so, then allowing user to implement read or write to the small documents；Small documents are implemented in user simultaneously to read or write
During operation, caching server locks the small documents automatically；
If it is not, caching server sends " this document is just used by other users " information terminates user to user equipment
Access request；
If big file, then the conventional big file metadata in caching server search local cache area, judges buffer service
The big file of access is required in device with the presence or absence of user；
If not existing, the user access request instruction that caching server sends user equipment is sent to management service
Device, subsequently into step Sc；The request access times that caching server device record passes through the big file of its request access simultaneously,
If access times are more than Second Threshold, the big file is regarded as to commonly use big file, in storing process, from data server
End is by the big file download and is stored in local cache area, and the size of Second Threshold is according to actual access wherein in the present embodiment
Demand is set；
If in the presence of the access that caching server guiding user is carried out to the big file；Detailed process is as follows：
Caching server judges that whether user requires the conventional big file for accessing in editable state first；
If so, then allowing user to implement read or write to the conventional big file；Simultaneously in user to commonly using big file reality
When applying read or write, caching server locks this and commonly uses big file automatically；After the completion of user operates, caching server sends
Update log updates corresponding big file to management server, management server according to the Update log for receiving；
If it is not, then caching server transmission user access request is instructed to management server, subsequently into step Sc.
Sc, management server are received after coming from the user access request instruction of caching server, the local big text of search
Part metadata, judges the big file accessed with the presence or absence of user's requirement in management server；
If not existing, management server returns to " demand file does not exist " and does not find information command to user equipment；
If in the presence of user is to big file access for guiding；Detailed process is as follows：
Management server judges that whether user requires the big file for accessing in editable state first；
If so, then allowing user to implement read or write to the conventional big file；Big file is implemented in user simultaneously to read
Or during write operation, management server locks the big file automatically；After the completion of user operates, management server sends Update log
To caching server, whether caching server has locally cached the big file according to the Update log inquiry for receiving；If so, then
Update the big file；If it is not, then abandoning the Update log that management server sends；
If it is not, management server sends " this document is just used by other users " information terminates user to user equipment
Access request.
Above-described embodiment is the present invention preferably implementation method, but embodiments of the present invention are not by above-described embodiment
Limitation, it is other it is any without departing from Spirit Essence of the invention and the change, modification, replacement made under principle, combine, simplification,
Equivalent substitute mode is should be, is included within protection scope of the present invention.
Claims (10)
1. the storage method of a kind of small documents and big file, it is characterised in that step is as follows：
S1, user by user equipment create new file, according to first threshold determine new file to be created be big file also
It is small documents, and filename is set, the identification prefix for recognizing big file and small documents is added on filename；
S2, user equipment will create new file request instruction and be sent to caching server, and caching server receives user equipment hair
After the establishment new file request instruction for sending, the filename identification prefix of new file to be created is recognized, judge to be created
New file be big file or small documents；
If new file to be created is small documents, this document is created in caching server and its metadata is preserved；
If new file to be created is big file, the establishment new file request instruction that caching server sends user equipment
It is sent to management server；
S3, management server are received after coming from the establishment new file request instruction of caching server, and management server is created should
Big file is simultaneously carried out piecemeal, obtains data block, and preserve the metadata of the big file；
The data block that the big file for creating is divided is sent to data server and is preserved by S4, management server, while caching
Server determines whether big file is to commonly use big file according to big file request access times, if so, then from data server end
By the big file download and it is stored in caching server；It refers to that request access times are more than Second Threshold wherein to commonly use big file
Big file, the size of Second Threshold set according to actual access demand.
2. the storage method of small documents according to claim 1 and big file, it is characterised in that
In the step S2, if new file to be created is small documents, caching server query caching service first
The currently stored small documents metadata of device, judge new file to be created filename whether with caching server it is current
The filename for having small documents is born the same name；
If so, then caching server sends " file is existing " information to user equipment, and it is new to abandon the establishment of user's transmission
File request is instructed；
If it is not, creating this document in caching server and preserving its metadata.
3. the storage method of small documents according to claim 1 and big file, it is characterised in that
In the step S3, if new file to be created is big file, management server is received and comes from caching server
Establishment new file request instruction after, judge whether the filename of new file to be created currently existing with management server
The filename of big file is born the same name；
If so, then management server sends " file is existing " information to user equipment, and it is new to abandon the establishment of user's transmission
File request is instructed；
If it is not, creating this document in management server and preserving its metadata.
4. the storage method of small documents according to claim 1 and big file, it is characterised in that the first threshold is
1M, when the size of file is more than 1M, is then judged as big file by this document, is otherwise judged as small documents.
5. the storage method of small documents according to claim 1 and big file, it is characterised in that the big file and small text
The identification prefix of part is respectively L and S；I.e. user equipment adds L before the filename of the big file for creating, and user equipment is in wound
S is added before the filename of the small documents built.
6. the storage method of small documents according to claim 1 and big file, it is characterised in that the caching server bag
Include memory block and buffer area；Small documents and small documents metadata storage in the memory block of caching server, commonly use big file and
Commonly use the buffer area that big file metadata is stored in caching server.
7. it is a kind of based on any one of claim 1 to 6 storage method realize small documents and big file access method,
Characterized in that, step is as follows：
Sa, user import file name in a user device, propose to access file request, user equipment searches day by user equipment
Will determines that the corresponding file of the filename of user input is big file or small documents, then in user access request instruction
Big file or small documents identification prefix are added in filename, user equipment sends user access request and instructs to buffer service
Device；
Sb, caching server receive the user access request instruction of user equipment transmission, according in user access request instruction
What the identification prefix of filename judged user's request access is big file or small documents；
If small documents, then caching server searches for local small documents metadata, judges to whether there is user in caching server
It is required that the small documents for accessing；If in the presence of the access that caching server guiding user is carried out to the small documents；Otherwise buffer service
Device is returned and does not find information command to user equipment；
If big file metadata is locally commonly used in big file, then caching server search, judge to whether there is in caching server
User requires the big file for accessing；If so, the access that then caching server guiding user is carried out to the big file；If it is not, then delaying
Deposit the user access request instruction that server sends user equipment and be sent to management server, into step Sc, while caching
The request access times of the big file that server record is accessed by its request；
Sc, management server are received after coming from the user access request instruction of caching server, the local big file unit of search
Data, judge the big file accessed with the presence or absence of user's requirement in management server；If in the presence of guiding user is visited big file
Ask；The information of not finding otherwise is returned to user equipment.
8. the access method of small documents according to claim 7 and big file, it is characterised in that
In the step Sb, the detailed process that caching server guiding user conducts interviews to small documents is as follows：
Caching server judges that whether user requires the small documents for accessing in editable state first；
If so, then allowing user to implement read or write to the small documents；Read or write is implemented to small documents in user simultaneously
When, caching server locks the small documents automatically；
If it is not, caching server sends " this document is just used by other users " information to user equipment, and terminate the visit of user
Ask request；
In the step Sb, caching server guides user as follows to commonly using the detailed process that big file conducts interviews：
Caching server judges that whether user requires the conventional big file for accessing in editable state first；
If so, then allowing user to implement read or write to the big file；Simultaneously when user implements read or write to file,
Caching server locks the big file automatically；After the completion of user operates, caching server sends Update log to management service
Device, management server updates corresponding big file according to the Update log for receiving；
If it is not, then caching server transmission user access request is instructed to management server, subsequently into step Sc.
9. the access method of small documents according to claim 7 and big file, it is characterised in that
In the step Sc, the detailed process that management server guiding user conducts interviews to file is as follows：
Management server judges that whether user requires the big file for accessing in editable state first；
If so, then allowing user to implement read or write to the conventional big file；Big file is implemented in user simultaneously to read or write
During operation, management server locks the big file automatically；After the completion of user operates, management server sends Update log to slow
Server is deposited, whether caching server has locally cached the big file according to the Update log inquiry for receiving；If so, then updating
The big file；If it is not, then abandoning the Update log that management server sends；
If it is not, management server sends " this document is just used by other users " information to user equipment, and terminate the visit of user
Ask request.
10. the access method of small documents according to claim 7 and big file, it is characterised in that the big file and small
The identification prefix of file is respectively L and S；In the step Sa when the corresponding file of wanted Access Filename is big file,
User equipment adds L before the filename that user access request is instructed；When the corresponding file of wanted Access Filename is small documents
When, user equipment is added in the filename that user access request is instructed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410559955.0A CN104331428B (en) | 2014-10-20 | 2014-10-20 | The storage of a kind of small documents and big file and access method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410559955.0A CN104331428B (en) | 2014-10-20 | 2014-10-20 | The storage of a kind of small documents and big file and access method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104331428A CN104331428A (en) | 2015-02-04 |
| CN104331428B true CN104331428B (en) | 2017-07-04 |
Family
ID=52406155
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410559955.0A Active CN104331428B (en) | 2014-10-20 | 2014-10-20 | The storage of a kind of small documents and big file and access method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104331428B (en) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10033794B2 (en) * | 2015-07-17 | 2018-07-24 | Bio-Rad Laboratories, Inc. | Network transfer of large files in unstable network environments |
| CN106469150B (en) | 2015-08-14 | 2019-10-08 | 阿里巴巴集团控股有限公司 | File read/write method, device and system |
| CN106020713A (en) * | 2015-09-16 | 2016-10-12 | 展视网（北京）科技有限公司 | File storage method based on buffer area |
| CN105404645A (en) * | 2015-10-27 | 2016-03-16 | 北京乐动卓越科技有限公司 | File management method in file server system and file server system |
| CN105608193B (en) * | 2015-12-23 | 2019-03-26 | 深信服科技股份有限公司 | The data managing method and device of distributed file system |
| CN106230971B (en) * | 2016-08-29 | 2019-03-01 | 无锡华云数据技术服务有限公司 | Big document distribution method based on CDN |
| CN107341267A (en) * | 2017-07-24 | 2017-11-10 | 郑州云海信息技术有限公司 | A kind of distributed file system access method and platform |
| CN108174136B (en) * | 2018-03-14 | 2021-03-02 | 成都创信特电子技术有限公司 | Cloud disk video coding storage method |
| CN108491167B (en) * | 2018-03-29 | 2020-12-04 | 重庆大学 | Industrial process working condition data rapid random distribution storage method |
| CN108667939B (en) * | 2018-05-21 | 2021-09-28 | 北京五八信息技术有限公司 | File downloading method, device, terminal and storage medium |
| CN109002260B (en) * | 2018-07-02 | 2021-08-13 | 深圳市茁壮网络股份有限公司 | Processing method and processing system for cache data |
| CN110750505A (en) * | 2019-08-31 | 2020-02-04 | 苏州浪潮智能科技有限公司 | Large file reading optimization method, device, equipment and storage medium |
| CN111324581A (en) * | 2020-02-14 | 2020-06-23 | 苏州浪潮智能科技有限公司 | File writing method, device, equipment and storage medium |
| CN113590550B (en) * | 2021-07-30 | 2023-06-16 | 展讯通信(天津)有限公司 | File creation method and device and electronic equipment |
| CN116800733B (en) * | 2023-08-18 | 2023-11-17 | 荣耀终端有限公司 | Downloading method of differential packet and server |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101075241A (en) * | 2006-12-26 | 2007-11-21 | 腾讯科技（深圳）有限公司 | Method and system for processing buffer |
| CN102855239A (en) * | 2011-06-28 | 2013-01-02 | 清华大学 | Distributed geographical file system |
| CN103500089A (en) * | 2013-09-18 | 2014-01-08 | 北京航空航天大学 | Small file storage system suitable for Mapreduce calculation model |
| CN104079600A (en) * | 2013-03-27 | 2014-10-01 | 中兴通讯股份有限公司 | File storage method, file storage device, file access client and metadata server system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070078914A1 (en) * | 2005-09-30 | 2007-04-05 | International Business Machines Corporation | Method, apparatus and program storage device for providing a centralized policy based preallocation in a distributed file system |
-
2014
- 2014-10-20 CN CN201410559955.0A patent/CN104331428B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101075241A (en) * | 2006-12-26 | 2007-11-21 | 腾讯科技（深圳）有限公司 | Method and system for processing buffer |
| CN102855239A (en) * | 2011-06-28 | 2013-01-02 | 清华大学 | Distributed geographical file system |
| CN104079600A (en) * | 2013-03-27 | 2014-10-01 | 中兴通讯股份有限公司 | File storage method, file storage device, file access client and metadata server system |
| CN103500089A (en) * | 2013-09-18 | 2014-01-08 | 北京航空航天大学 | Small file storage system suitable for Mapreduce calculation model |
Non-Patent Citations (1)
| Title |
|---|
| "基于网络存储的异构集群文件系统研究与实现";贾瑞勇 等;《西北工业大学学报》;20050228;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104331428A (en) | 2015-02-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104331428B (en) | The storage of a kind of small documents and big file and access method | |
| KR102072203B1 (en) | A node and a method for generating shortened name increasing adaptability of hierarchical name in a content centric network | |
| US9798774B1 (en) | Graph data search method and apparatus | |
| US10198363B2 (en) | Reducing data I/O using in-memory data structures | |
| CN108920600B (en) | Distributed file system metadata prefetching method based on data relevance | |
| CN101236569B (en) | Highly effective dynamic path analysis method based on ContextFS | |
| CN110399348A (en) | File deletes method, apparatus, system and computer readable storage medium again | |
| CN105635196B (en) | A kind of method, system and application server obtaining file data | |
| CN100437590C (en) | Method for prefetching object | |
| CN104679898A (en) | Big data access method | |
| CN104778270A (en) | Storage method for multiple files | |
| CN102148870B (en) | Cloud storage system and implementation method thereof | |
| CN106294365A (en) | The page data processing method of a kind of single page web application and equipment | |
| US20150334043A1 (en) | Differential cache for representational state transfer (rest) api | |
| KR20160067289A (en) | Cache Management System for Enhancing the Accessibility of Small Files in Distributed File System | |
| RU2005124131A (en) | INFORMATION PROCESSING DEVICE, CONTENT MANAGEMENT METHOD, CONTENT INFORMATION MANAGEMENT METHOD AND COMPUTER PROGRAM | |
| CN105683928B (en) | For the method for data cache policies, server and memory devices | |
| US20080071992A1 (en) | Method and Apparatus for Space Efficient Identification of Candidate Objects for Eviction from a Large Cache | |
| CN105915619B (en) | Take the cyberspace information service high-performance memory cache method of access temperature into account | |
| US8914436B2 (en) | Data processing device and data retriever | |
| US7240150B1 (en) | Methods and apparatus for processing access requests in a content addressable computer system | |
| CN106227679B (en) | A kind of data buffer storage replacement method and device | |
| WO2019019382A1 (en) | Cache handling method and device, computer device and storage medium | |
| JP2009187394A (en) | Predictive cache method for caching related information in advance, system and program thereof | |
| CN107181773A (en) | Data storage and data managing method, the equipment of distributed memory system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |