CN107562915A - Read the method, apparatus and equipment and computer-readable recording medium of small documents - Google Patents
Read the method, apparatus and equipment and computer-readable recording medium of small documents Download PDFInfo
- Publication number
- CN107562915A CN107562915A CN201710817696.0A CN201710817696A CN107562915A CN 107562915 A CN107562915 A CN 107562915A CN 201710817696 A CN201710817696 A CN 201710817696A CN 107562915 A CN107562915 A CN 107562915A
- Authority
- CN
- China
- Prior art keywords
- small documents
- target small
- read
- reading
- caching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a kind of method for reading small documents, including the index node according to target small documents, judges to whether there is the target small documents in caching；If in the presence of directly reading the target small documents；If being not present, the aggregate file for including the target small documents is obtained, the target small documents in the aggregate file are read to the caching, the target small documents are read in the caching.This method reads target small documents into caching, when needing a large amount of reading small documents, can obtain higher cache hit rate, shorten the reading I/O path of small documents, improve the reading efficiency of small documents.The invention also discloses a kind of device and equipment for reading small documents, above-mentioned beneficial effect is respectively provided with.The invention also discloses a kind of computer-readable recording medium for being stored with computer program, it may have above-mentioned beneficial effect.
Description
Technical field
The present invention relates to distributed memory system field, more particularly to a kind of method for reading small documents, further relates to one
Kind reads the device and equipment of small documents, is directed to a kind of computer-readable recording medium for being stored with computer program.
Background technology
Distributed memory system, it is to disperse to be stored in more independent equipment by data, to reduce network pressure, has
Higher reliability and security.Within the storage system, small documents scene is then one of core scenario that needs consider, for example,
In some social shopping website, broadcasting and TV, Internet videos, the substantial amounts of small documents scene such as text, picture, music can be all produced.
Therefore the performance issue of small documents is one of key issue that file system needs consider.
Under small documents scene, quantity of documents is numerous, and disk occupancy is higher；Write-once is needed in operation, repeatedly
Read-write, therefore file operation is more frequent.In the prior art, when each small documents are read out, it is required for calling a number
According to interface is read, a full-time course flow is performed, it is larger that disk reads data pressure.When needing a large amount of reading small documents, then need
The digital independent interface is frequently called, small documents reading I/O path is longer, and analysis of metadata, reading data are time-consuming longer,
In such cases, the reading efficiency of small documents substantially reduces.
Therefore, how to shorten the reading I/O path of small documents, improve the reading efficiency of small documents, be those skilled in the art
The technical issues that need to address.
The content of the invention
It is an object of the invention to provide a kind of method for reading small documents, this method can shorten the reading IO roads of small documents
Footpath, improve the reading efficiency of small documents；It is a further object of the present invention to provide a kind of device and equipment for reading small documents, have
There is above-mentioned beneficial effect；It is a further object of the present invention to provide a kind of computer-readable storage medium for being stored with computer program
Matter, it may have above-mentioned beneficial effect.
In order to solve the above technical problems, the present invention provides a kind of method for reading small documents, including：
According to the index node of target small documents, judge to whether there is the target small documents in caching；
If in the presence of directly reading the target small documents；
If being not present, the aggregate file for including the target small documents is obtained, the target in the aggregate file is small
File is read to the caching, and the target small documents are read in the caching.
Preferably, the acquisition includes the aggregate file of the target small documents, and the target in the aggregate file is small
File is read to the caching, and the target small documents are read in the caching to be included：
According to the index node of the target small documents, skew of the target small documents in the aggregate file is obtained
Amount, aggregate objects are calculated according to the offset；
Digital independent interface is called, the aggregate objects are read to the caching；
Original position and data of the target small documents in the aggregate objects are calculated according to the offset
Length, the target small documents are taken according to the original position and data length read.
Preferably, this method also includes：
Before reading the target small documents, the read lock of read-write mutual exclusion is set for the target small documents；
After reading the target small documents, the read lock is released.
Preferably, this method also includes：
The target small documents of reading are sent to user.
In order to solve the above technical problems, the present invention also provides a kind of device for reading small documents, including：
Judge module, for the index node according to target small documents, judge to whether there is the small text of the target in caching
Part；
First read module, in the presence of the target small documents, directly reading the target small documents；
Second read module, it is poly- comprising the target small documents for when the target small documents are not present, obtaining
File is closed, the target small documents in the aggregate file are read to the caching, it is small that the target is read in the caching
File.
Preferably, second read module includes：
Acquisition submodule, for obtaining the aggregate objects for including the target small documents from the aggregate file；
First reading submodule, for the aggregate objects to be read to the caching；
Second reading submodule, for reading the target small documents from the aggregate objects.
Preferably, the device also includes：
Upper lock module, for before the target small documents are read, read-write mutual exclusion to be set for the target small documents
Read lock；
Unlocked state, for after the target small documents are read, releasing the read lock.
Preferably, the device also includes：
Sending module, for the target small documents of reading to be sent into user.
In order to solve the above technical problems, the present invention also provides a kind of device for reading small documents, including：
Memory, for storing computer program；
Processor, the step of method of any of the above-described kind of reading small documents is realized during for performing the computer program.
In order to solve the above technical problems, the present invention also provides a kind of computer-readable recording medium, it is described computer-readable
Computer program is stored with storage medium, the computer program realizes that any of the above-described kind is read small text when being executed by processor
The step of method of part.
A kind of method for reading small documents provided by the present invention, including the index node according to target small documents, judge
It whether there is the target small documents in caching；If in the presence of directly reading the target small documents；If being not present, obtain
The aggregate file of the target small documents is included, the target small documents in the aggregate file are read to the caching, in institute
State in caching and read the target small documents.
It can be seen that this method uses polymerizable functional, small documents disk occupancy is effectively reduced, improves disk utilization.Will
Small documents are read into the caching, will be changed into the data for reading aggregate file corresponding region to the reading of small documents, when need
When largely reading small documents, higher cache hit rate can be obtained, especially in order reads scene, small documents to be read can be straight
Hit client-cache is connect, now, without repeatedly calling digital independent interface, the reading I/O path of small documents is shortened, improves
The reading efficiencies of small documents.
Present invention also offers a kind of device and equipment for reading small documents, above-mentioned beneficial effect is respectively provided with.
Present invention also offers a kind of computer-readable recording medium for being stored with computer program, it may have above-mentioned beneficial
Effect.
Brief description of the drawings
, below will be to embodiment or existing for the clearer explanation embodiment of the present invention or the technical scheme of prior art
The required accompanying drawing used is briefly described in technology description, it should be apparent that, drawings in the following description are only this hair
Some bright embodiments, for those of ordinary skill in the art, on the premise of not paying creative work, can be with root
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is a kind of schematic flow sheet of method for reading small documents provided by the invention；
Fig. 2 is a kind of schematic diagram of device for reading small documents provided by the invention；
Fig. 3 is a kind of schematic diagram of equipment for reading small documents provided by the invention.
Embodiment
The core of the present invention is to provide a kind of method for reading small documents, and this method can shorten the reading IO roads of small documents
Footpath, improve the reading efficiency of small documents；Another core of the present invention is to provide a kind of device and equipment for reading small documents, has
There is above-mentioned beneficial effect；Another core of the present invention is to provide a kind of computer-readable storage for being stored with computer reading program
Medium, it may have above-mentioned beneficial effect.
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
Part of the embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art
The every other embodiment obtained under the premise of creative work is not made, belongs to the scope of protection of the invention.
Fig. 1 is refer to, Fig. 1 is a kind of schematic flow sheet of method for reading small documents provided by the invention, and this method can
With including：
S101：According to the index node of target small documents, judge to whether there is the target small documents in caching；If deposit
Then responding S102；If being not present, S103 is responded.
Specifically, when system creation during one small documents, system will give the small documents to distribute index node,
Each index node saves the metamessage data of corresponding small documents, such as creates, modification time.Target small documents are
User's small documents to be read, when reading target small documents, the index node of target small documents can be first obtained, according to index
Node is judged in caching with the presence or absence of corresponding target small documents.
S102：In the presence of the target small documents, the target small documents are directly read；
S103：When the target small documents are not present, the aggregate file for including the target small documents is obtained, by described in
Target small documents in aggregate file are read to the caching, and the target small documents are read in the caching.
Specifically, using polymerizable functional, multiple small documents are aggregated in one big file, i.e. aggregate file.Work as caching
In when target small documents be present, the target small documents can be directly read from caching, without calling small documents to read interface；
When target small documents are not present in caching, the small text of target can be found according to the aggregate file information recorded in target small documents
Aggregate file corresponding to part, the data of reading aggregate file corresponding region will be changed into the reading of small documents.The polymerization text
The data of part corresponding region can be stored in disk or object storage device, when reading small documents, call digital independent
Interface, by the digital independent of aggregate file corresponding region into caching, the reading to target small documents is completed in the buffer.
Specifically, when reading small documents, aggregate file corresponding region can be judged first according to the index node of small documents
Whether data have been stored in disk or object storage device, if not being stored in, data can be directly read from caching；If
Deposit, then whether can be empty according to the index node of the aggregate file recorded in the index node, to judge that small documents are
No is source file, if not source file, then can read flow processing according to ordinary file；If source file, then polymerization text is obtained
The data of part corresponding region, judge that whether effectively the data, can directly read number in local cache from caching when effective
According to if invalid, digital independent interface can be called, by the data of aggregate file corresponding region from disk or object storage device
Read into caching, complete the reading to target small documents in the buffer.
In addition, in order to ensure the security of small documents, can be before target small documents be read, to the target small documents
The read lock of read-write mutual exclusion is set, it is allowed to which user reads target small documents；After the completion of the reading of target small documents, institute can also be released
State read lock.Further, after read lock is released, the target small documents read can also be sent to user, specifically, will be slow
The data copy of middle aggregate file corresponding region is deposited to small documents digital independent interface, the small documents number read is returned to user
According to.
A kind of method for reading small documents provided by the present invention, including the index node according to target small documents, judge
It whether there is the target small documents in caching；If in the presence of directly reading the target small documents；If being not present, obtain
The aggregate file of the target small documents is included, the target small documents in the aggregate file are read to the caching, in institute
State in caching and read the target small documents.It can be seen that using polymerizable functional, small documents disk occupancy is effectively reduced, improves magnetic
Disk utilization rate, small documents are read into the caching, when needing a large amount of reading small documents, higher cache hit can be obtained
Rate, without repeatedly calling digital independent interface, the reading I/O path of small documents is shortened, improves the reading efficiency of small documents.
On the basis of above-described embodiment：
As a kind of preferred embodiment, the aggregate file for including the target small documents is obtained, by the aggregate file
In target small documents read to the caching, the process that the target small documents are read in the caching is specially：
According to the index node of the target small documents, skew of the target small documents in the aggregate file is obtained
Amount, aggregate objects are calculated according to the offset；Digital independent interface is called, the aggregate objects are read to described slow
Deposit；Original position and data length of the target small documents in the aggregate objects are calculated according to the offset,
The target small documents are taken according to the original position and data length read.
Specifically, using polymerizable functional, multiple small documents are polymerize in units of aggregate objects, aggregate objects conduct
The data of aggregate file are deposited into disk or object storage device, the reading to small documents, are actually converted to polymerization text
The reading of number of packages evidence, when reading small documents, it is not necessary to find storage location corresponding to small documents further according to small documents metadata information.
Specifically, offset that can be by the target small documents of acquisition in aggregate file, is calculated aggregate objects.
It can first judge whether the aggregate objects in caching are effective, if effectively, target small documents can be read directly from caching, if
It is invalid, then digital independent interface can be called, whole aggregate objects are read into client from disk or object storage device
Caching, target small documents are read from aggregate objects.
Wherein, using polymerizable functional, multiple small documents are polymerize in units of aggregate objects, can be first to small documents
Space-consuming preset a upper limit, such as 512KB, when the small documents of write-in are less than 512KB, small documents can be with
The mode of 4KB alignment is written in aggregate objects caching；A upper limit can also be preset to the space-consuming of aggregate objects,
Such as 4MB, when the space-consuming of aggregate objects reaches 4MB, aggregate objects are cached in write-in disk or object storage device.
In addition, in order to ensure the security of small documents, can be before target small documents be read, to the target small documents
The read lock of read-write mutual exclusion is set, it is allowed to which user reads target small documents；After the completion of the reading of target small documents, institute can also be released
State read lock.
Further, after read lock is released, the target small documents read can also be sent to user.Specifically, can
To small documents digital independent interface, to return to and read the data copy of client conglomerate object relevant position in the buffer to user
The small documents data got.
The application uses polymerizable functional, and multiple small documents are polymerize in units of aggregate objects, aggregate objects are made
It is deposited into for the data of aggregate file in object storage device.When reading small documents, not in units of single file, but
An aggregate objects are read every time into caching.When needing a large amount of reading small documents, higher cache hit rate can be obtained,
Without repeatedly calling digital independent interface.Especially in order reads scene, when reading adjacent file, due to small documents category to be read
In same aggregate objects, client-cache can be directly hit, without calling digital independent interface to read data again, is shortened small
File reads I/O path, improves the reading efficiency of small documents.
Fig. 2 is refer to, Fig. 2 is a kind of schematic diagram of device for reading small documents provided by the invention, and the device includes：
Judge module 1, for the index node according to target small documents, judge to whether there is the small text of the target in caching
Part；
First read module 2, in the presence of the target small documents, directly reading the target small documents；
Second read module 3, it is poly- comprising the target small documents for when the target small documents are not present, obtaining
File is closed, the target small documents in the aggregate file are read to the caching, it is small that the target is read in the caching
File.
As a kind of preferred embodiment, second read module 3 can include：
Acquisition submodule 31, for obtaining the aggregate objects for including the target small documents from the aggregate file；
First reading submodule 32, for the aggregate objects to be read to the caching；
Second reading submodule 33, for reading the target small documents from the aggregate objects.
As a kind of preferred embodiment, the device also includes：
Upper lock module, for before the target small documents are read, read-write mutual exclusion to be set for the target small documents
Read lock；
Unlocked state, for after the target small documents are read, releasing the read lock.
Sending module, for the target small documents of reading to be sent into user.
Introduction for device provided by the invention refer to above method embodiment, and the present invention will not be described here.
Fig. 3 is refer to, Fig. 3 is a kind of schematic diagram of equipment for reading small documents provided by the invention, and the equipment includes：
Memory 10, for storing computer program；
Processor 20, following steps are realized during for performing the computer program：
According to the index node of target small documents, judge to whether there is the target small documents in caching；If in the presence of directly
Connect and read the target small documents；If being not present, the aggregate file for including the target small documents is obtained, by the polymerization text
Target small documents in part are read to the caching, and the target small documents are read in the caching.
Introduction for equipment provided by the invention refer to above method embodiment, and the present invention will not be described here.
In order to solve the above technical problems, the present invention also provides a kind of computer-readable recording medium, it is described computer-readable
Computer program is stored with storage medium, the computer program realizes following steps when being executed by processor：
According to the index node of target small documents, judge to whether there is the target small documents in caching；If in the presence of directly
Connect and read the target small documents；If being not present, the aggregate file for including the target small documents is obtained, by the polymerization text
Target small documents in part are read to the caching, and the target small documents are read in the caching.
Introduction for equipment provided by the invention refer to above method embodiment, and the present invention will not be described here.
Each embodiment is described by the way of progressive in specification, and what each embodiment stressed is and other realities
Apply the difference of example, between each embodiment identical similar portion mutually referring to.For device disclosed in embodiment
Speech, because it is corresponded to the method disclosed in Example, so description is fairly simple, related part is referring to method part illustration
.
Professional further appreciates that, with reference to the unit of each example of the embodiments described herein description
And algorithm steps, can be realized with electronic hardware, computer software or the combination of the two, in order to clearly demonstrate hardware and
The interchangeability of software, the composition and step of each example are generally described according to function in the above description.These
Function is performed with hardware or software mode actually, application-specific and design constraint depending on technical scheme.Specialty
Technical staff can realize described function using distinct methods to each specific application, but this realization should not
Think beyond the scope of this invention.
Directly it can be held with reference to the step of method or algorithm that the embodiments described herein describes with hardware, processor
Capable software module, or the two combination are implemented.Software module can be placed in random access memory (RAM), internal memory, read-only deposit
Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology
In any other form of storage medium well known in field.
The method of reading small documents provided by the present invention is described in detail above.It is used herein specifically individual
Example is set forth to the principle and embodiment of the present invention, and the explanation of above example is only intended to help to understand the present invention's
Method and its core concept.It should be pointed out that for those skilled in the art, the principle of the invention is not being departed from
On the premise of, some improvement and modification can also be carried out to the present invention, these are improved and modification also falls into the claims in the present invention
Protection domain in.
Claims (10)
- A kind of 1. method for reading small documents, it is characterised in that including：According to the index node of target small documents, judge to whether there is the target small documents in caching；If in the presence of directly reading the target small documents；If being not present, the aggregate file for including the target small documents is obtained, by the target small documents in the aggregate file Read to the caching, the target small documents are read in the caching.
- 2. the method as described in claim 1, it is characterised in that it is described to obtain the aggregate file for including the target small documents, Target small documents in the aggregate file are read to the caching, the target small documents bag is read in the caching Include：According to the index node of the target small documents, offset of the target small documents in the aggregate file is obtained, Aggregate objects are calculated according to the offset；Digital independent interface is called, the aggregate objects are read to the caching；Original position and data length of the target small documents in the aggregate objects are calculated according to the offset, The target small documents are taken according to the original position and data length read.
- 3. method as claimed in claim 2, it is characterised in that also include：Before reading the target small documents, the read lock of read-write mutual exclusion is set for the target small documents；After reading the target small documents, the read lock is released.
- 4. method as claimed in claim 3, it is characterised in that also include：The target small documents of reading are sent to user.
- A kind of 5. device for reading small documents, it is characterised in that including：Judge module, for the index node according to target small documents, judge to whether there is the target small documents in caching；First read module, in the presence of the target small documents, directly reading the target small documents；Second read module, for when the target small documents are not present, obtaining the polymerization text comprising the target small documents Part, the target small documents in the aggregate file are read to the caching, the target small documents are read in the caching.
- 6. device as claimed in claim 5, it is characterised in that second read module includes：Acquisition submodule, for obtaining the aggregate objects for including the target small documents from the aggregate file；First reading submodule, for the aggregate objects to be read to the caching；Second reading submodule, for reading the target small documents from the aggregate objects.
- 7. device as claimed in claim 6, it is characterised in that also include：Upper lock module, for before the target small documents are read, the read lock of read-write mutual exclusion to be set for the target small documents；Unlocked state, for after the target small documents are read, releasing the read lock.
- 8. device as claimed in claim 7, it is characterised in that also include：Sending module, for the target small documents of reading to be sent into user.
- A kind of 9. equipment for reading small documents, it is characterised in that including：Memory, for storing computer program；Processor, realize during for performing the computer program such as the method for any one of Claims 1-4 reading small documents Step.
- 10. a kind of computer-readable recording medium, it is characterised in that be stored with computer on the computer-readable recording medium Program, realize that any one of Claims 1-4 such as reads the step of the method for small documents when the computer program is executed by processor Suddenly.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710817696.0A CN107562915A (en) | 2017-09-12 | 2017-09-12 | Read the method, apparatus and equipment and computer-readable recording medium of small documents |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710817696.0A CN107562915A (en) | 2017-09-12 | 2017-09-12 | Read the method, apparatus and equipment and computer-readable recording medium of small documents |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107562915A true CN107562915A (en) | 2018-01-09 |
Family
ID=60980594
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710817696.0A Pending CN107562915A (en) | 2017-09-12 | 2017-09-12 | Read the method, apparatus and equipment and computer-readable recording medium of small documents |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107562915A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108089825A (en) * | 2018-01-11 | 2018-05-29 | 郑州云海信息技术有限公司 | A kind of storage system based on distributed type assemblies |
| CN108958653A (en) * | 2018-06-26 | 2018-12-07 | 郑州云海信息技术有限公司 | A kind of space reclamation method, system and relevant apparatus based on bottom aggregate file |
| CN109101197A (en) * | 2018-08-15 | 2018-12-28 | 郑州云海信息技术有限公司 | A kind of file stores and accesses method, apparatus, file memory and system |
| CN109240607A (en) * | 2018-08-21 | 2019-01-18 | 郑州云海信息技术有限公司 | A kind of file reading and device |
| CN109391787A (en) * | 2018-09-30 | 2019-02-26 | 武汉中科通达高新技术股份有限公司 | File format, image polymerization and read method |
| CN110196841A (en) * | 2018-06-21 | 2019-09-03 | 腾讯科技（深圳）有限公司 | The storage method and device of file, querying method and device and server |
| CN110908968A (en) * | 2019-11-14 | 2020-03-24 | 浪潮电子信息产业股份有限公司 | Method, device, equipment and storage medium for avoiding frightened groups during file lock unlocking |
| CN111104063A (en) * | 2019-12-06 | 2020-05-05 | 浪潮电子信息产业股份有限公司 | Data storage method and device, electronic equipment and storage medium |
| CN111104166A (en) * | 2019-12-13 | 2020-05-05 | 北京新忆科技有限公司 | Register writing method and device |
| CN111258956A (en) * | 2019-03-22 | 2020-06-09 | 深圳市远行科技股份有限公司 | Method and equipment for pre-reading mass data files facing far end |
| CN113110801A (en) * | 2021-04-15 | 2021-07-13 | 山东英信计算机技术有限公司 | Method, system, equipment and storage medium for accelerating small file reading speed |
| CN113986838A (en) * | 2021-12-28 | 2022-01-28 | 成都云祺科技有限公司 | Mass small file processing method and system based on file system and storage medium |
| WO2023246651A1 (en) * | 2022-06-23 | 2023-12-28 | 华为技术有限公司 | Data processing method, and processor, computing device, and apparatus |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070219948A1 (en) * | 2004-07-21 | 2007-09-20 | Jozsef Bugovics | Rapid archivable worm memory system based on a hard disc |
| CN103605726A (en) * | 2013-11-15 | 2014-02-26 | 中安消技术有限公司 | Method and system for accessing small files, control node and storage node |
| CN106709025A (en) * | 2016-12-28 | 2017-05-24 | 郑州云海信息技术有限公司 | Method and device for updating aggregation objects |
| CN106776759A (en) * | 2016-11-17 | 2017-05-31 | 郑州云海信息技术有限公司 | The small documents pre-head method and system of distributed file system |
-
2017
- 2017-09-12 CN CN201710817696.0A patent/CN107562915A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070219948A1 (en) * | 2004-07-21 | 2007-09-20 | Jozsef Bugovics | Rapid archivable worm memory system based on a hard disc |
| CN103605726A (en) * | 2013-11-15 | 2014-02-26 | 中安消技术有限公司 | Method and system for accessing small files, control node and storage node |
| CN106776759A (en) * | 2016-11-17 | 2017-05-31 | 郑州云海信息技术有限公司 | The small documents pre-head method and system of distributed file system |
| CN106709025A (en) * | 2016-12-28 | 2017-05-24 | 郑州云海信息技术有限公司 | Method and device for updating aggregation objects |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108089825A (en) * | 2018-01-11 | 2018-05-29 | 郑州云海信息技术有限公司 | A kind of storage system based on distributed type assemblies |
| CN108089825B (en) * | 2018-01-11 | 2020-07-07 | 郑州云海信息技术有限公司 | Storage system based on distributed cluster |
| CN110196841A (en) * | 2018-06-21 | 2019-09-03 | 腾讯科技（深圳）有限公司 | The storage method and device of file, querying method and device and server |
| CN110196841B (en) * | 2018-06-21 | 2023-12-05 | 腾讯科技（深圳）有限公司 | File storage method and device, query method and device and server |
| CN108958653A (en) * | 2018-06-26 | 2018-12-07 | 郑州云海信息技术有限公司 | A kind of space reclamation method, system and relevant apparatus based on bottom aggregate file |
| CN109101197A (en) * | 2018-08-15 | 2018-12-28 | 郑州云海信息技术有限公司 | A kind of file stores and accesses method, apparatus, file memory and system |
| CN109240607B (en) * | 2018-08-21 | 2022-02-18 | 郑州云海信息技术有限公司 | File reading method and device |
| CN109240607A (en) * | 2018-08-21 | 2019-01-18 | 郑州云海信息技术有限公司 | A kind of file reading and device |
| CN109391787A (en) * | 2018-09-30 | 2019-02-26 | 武汉中科通达高新技术股份有限公司 | File format, image polymerization and read method |
| CN111258956A (en) * | 2019-03-22 | 2020-06-09 | 深圳市远行科技股份有限公司 | Method and equipment for pre-reading mass data files facing far end |
| CN111258956B (en) * | 2019-03-22 | 2023-11-24 | 深圳市远行科技股份有限公司 | Method and device for prereading far-end mass data files |
| CN110908968A (en) * | 2019-11-14 | 2020-03-24 | 浪潮电子信息产业股份有限公司 | Method, device, equipment and storage medium for avoiding frightened groups during file lock unlocking |
| CN110908968B (en) * | 2019-11-14 | 2022-05-27 | 浪潮电子信息产业股份有限公司 | Method, device, equipment and storage medium for avoiding frightened groups during file lock unlocking |
| CN111104063A (en) * | 2019-12-06 | 2020-05-05 | 浪潮电子信息产业股份有限公司 | Data storage method and device, electronic equipment and storage medium |
| WO2021109590A1 (en) * | 2019-12-06 | 2021-06-10 | 浪潮电子信息产业股份有限公司 | Data storage method and apparatus, electronic device, and storage medium |
| CN111104166B (en) * | 2019-12-13 | 2022-09-06 | 北京新忆科技有限公司 | Register writing method and device |
| CN111104166A (en) * | 2019-12-13 | 2020-05-05 | 北京新忆科技有限公司 | Register writing method and device |
| CN113110801A (en) * | 2021-04-15 | 2021-07-13 | 山东英信计算机技术有限公司 | Method, system, equipment and storage medium for accelerating small file reading speed |
| CN113986838A (en) * | 2021-12-28 | 2022-01-28 | 成都云祺科技有限公司 | Mass small file processing method and system based on file system and storage medium |
| WO2023246651A1 (en) * | 2022-06-23 | 2023-12-28 | 华为技术有限公司 | Data processing method, and processor, computing device, and apparatus |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107562915A (en) | Read the method, apparatus and equipment and computer-readable recording medium of small documents | |
| US11853549B2 (en) | Index storage in shingled magnetic recording (SMR) storage system with non-shingled region | |
| CN103136243B (en) | File system duplicate removal method based on cloud storage and device | |
| CN102629247B (en) | Method, device and system for data processing | |
| CN104506647B (en) | A kind of data-storage system and storage and access method | |
| CN103399823B (en) | The storage means of business datum, equipment and system | |
| KR102449585B1 (en) | Versioning storage devices and methods | |
| CN106446159B (en) | A kind of method of storage file, the first virtual machine and name node | |
| CN109614377A (en) | File delet method, device, equipment and the storage medium of distributed file system | |
| CN105117351A (en) | Method and apparatus for writing data into cache | |
| CN107766374B (en) | Optimization method and system for storage and reading of massive small files | |
| CN105787037B (en) | A kind of delet method and device of repeated data | |
| CN103577513A (en) | Systems and/or methods for caching xml information sets with delayed node instantiation | |
| CN109144406A (en) | Metadata storing method, system and storage medium in distributed memory system | |
| CN106776759A (en) | The small documents pre-head method and system of distributed file system | |
| CN109213420A (en) | Date storage method, apparatus and system | |
| CN106527973A (en) | A method and device for data deduplication | |
| CN107168651A (en) | A kind of small documents polymerize storage processing method | |
| CN109471843A (en) | A kind of metadata cache method, system and relevant apparatus | |
| CN107506154A (en) | A kind of read method of metadata, device and computer-readable recording medium | |
| CN104079600B (en) | File memory method, device, access client and meta data server system | |
| CN110147203A (en) | A kind of file management method, device, electronic equipment and storage medium | |
| CN107506466A (en) | A kind of small documents storage method and system | |
| CN105493080A (en) | Method and apparatus for context aware based data de-duplication | |
| CN106528703A (en) | Deduplication mode switching method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180109 |