CN107944010A - The method and apparatus of reading and writing of files in a kind of distributed file system - Google Patents
The method and apparatus of reading and writing of files in a kind of distributed file system Download PDFInfo
- Publication number
- CN107944010A CN107944010A CN201711296507.6A CN201711296507A CN107944010A CN 107944010 A CN107944010 A CN 107944010A CN 201711296507 A CN201711296507 A CN 201711296507A CN 107944010 A CN107944010 A CN 107944010A
- Authority
- CN
- China
- Prior art keywords
- file
- read
- write
- store path
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
An embodiment of the present invention provides a kind of method and device of reading and writing of files in distributed file system, this method includes：The first file store path, and second file store path of the carry based on predetermined file access interface are created in each server of server cluster；When receiving the file read-write request for each server, the file read-write request is kidnapped, and determines the read-write type of the file read-write request；The read-write type asked according to the fixed file read-write, performs reading file operation corresponding with file read-write request by the first file store path or is performed and the corresponding operating writing-file of file read-write request by the second file store path.By the present invention, realize and ask to separate by file read-write, meanwhile, when reading file, realize need not by network can direct read/write local file system, so as to drastically increase the performance of file read-write.
Description
Technical field
The present invention relates to reading and writing of files in field of computer technology, more particularly to a kind of distributed file system method and
Device.
Background technology
Distributed file system mainly includes object storage at present, and block stores two macrotaxonomies, and wherein this two macrotaxonomy is usual
Some POSIX (Portable Operating System Interface, portable operating system interface) interfaces can be provided,
And the POSIX interfaces provided are mounted in operating system, to facilitate user to access operating system, such as distributed file system
GlusterFS (Gluster File System) and distributed file system CephFS (Ceph File System) etc..But
It is current all similar file system, when by POSIX interface reading and writing of files, it is necessary to could be accessed by network
To the server of actual storage file, so as to read corresponding file.
In process of the present invention is realized, inventor has found that at least there are the following problems in the prior art：In practical applications,
It is that can reach 1000 considerably beyond to file write request number, ratio to the read request number of file:1, when for a large amount of
Small documents situation when, the distributed file system reading and writing of files mode of the prior art is inefficient, and speed is also relatively slow.
It would therefore be highly desirable to a kind of file read/write method of distributed file system, efficiently, is quickly and accurately carried out with realizing
The read-write of file.
The content of the invention
The embodiment of the present invention provides a kind of method and device of reading and writing of files in distributed file system, drastically increases
File read-write performance in the presence of heap file.
On the one hand, an embodiment of the present invention provides a kind of method of reading and writing of files in distributed file system, the distribution
Formula file system is deployed in server cluster, including：
The first file store path is created in each server of server cluster, and carry is accessed based on predetermined file
Second file store path of interface；
When receiving the file read-write request for each server, the file read-write request is kidnapped, and really
The read-write type of the fixed file read-write request；
The read-write type asked according to the fixed file read-write, by the first file store path perform with
The file read-write request is corresponding to read file operation or is performed and the file read-write by the second file store path
Ask corresponding operating writing-file.
On the other hand, an embodiment of the present invention provides a kind of device of reading and writing of files in distributed file system, described point
Cloth file system is deployed in server cluster, including：
Establishment and carry unit, for creating the first file store path in each server of server cluster, and
Second file store path of the carry based on predetermined file access interface；
Unit is kidnapped, for when receiving the file read-write request for each server, kidnapping the file
Read-write requests, and determine the read-write type of the file read-write request；
Execution unit, for the read-write type asked according to the fixed file read-write, passes through first file
Store path performs reading file operation corresponding with file read-write request or is performed by the second file store path
With the corresponding operating writing-file of file read-write request.
Above-mentioned technical proposal has the advantages that：The first file is created in each server of server cluster to deposit
Path, and second file store path of the carry based on predetermined file access interface are stored up, to realize that the read-write of separate file provides
Necessary premise guarantee；The read-write type asked according to the fixed file read-write, is stored by first file
Path performs reading file operation corresponding with file read-write request or by the second file store path execution and institute
State file read-write and ask corresponding operating writing-file, realize and ask to separate by file read-write, meanwhile, when reading file, realize
Without by network can direct read/write local file system, so as to drastically increase the performance of file read-write, avoid
In the case of heap file, reading and writing of files inefficiency, slow-paced situation occur, and further, improve user
Usage experience.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is attached drawing needed in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, without creative efforts, can be with
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is a kind of method flow diagram of reading and writing of files in distributed file system in one embodiment of the invention；
Fig. 2 is a kind of apparatus structure schematic diagram of reading and writing of files in distributed file system in another embodiment of the present invention；
Fig. 3 is the configuration diagram of the server cluster of distributed file system in one embodiment of the present invention；
Fig. 4 is the file read-write flow diagram in the server of server cluster in another preferred embodiment of the present invention.
Embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other without making creative work
Embodiment, belongs to the scope of protection of the invention.
As shown in Figure 1, be the method flow diagram of reading and writing of files in a kind of distributed file system in one embodiment of the invention,
The distributed file system is deployed in server cluster, including：
101st, the first file store path is created in each server of server cluster, and carry is based on predetermined file
Second file store path of access interface；
102nd, when receiving the file read-write request for each server, the file read-write request is kidnapped,
And determine the read-write type of the file read-write request；
103rd, the read-write type asked according to the fixed file read-write, is held by the first file store path
Row reading file operation corresponding with file read-write request is performed and the file by the second file store path
The corresponding operating writing-file of read-write requests.
Preferably, it is described in each server of server cluster, the first file store path is created, and carry is based on
Second file store path of predetermined file access interface, including：
The replication mode provided by the file storage service of distributed file system, in each service of server cluster
Create the first file store path, and second file store path of the carry based on predetermined file access interface in device, described point
Cloth file system includes distributed file system GlusterFS.
Alternatively, further include：
In the multiple servers of the server cluster, pass through any two services between any two-server
The respective file storage service of device communicates.
Preferably, the read-write type asked according to the fixed file read-write, is deposited by first file
Store up path perform it is corresponding with file read-write request read file operation or by the second file store path execution and
The file read-write asks corresponding operating writing-file, including：
When determining the read-write type of the file read-write request to read type, held by the first file store path
Row reading file operation corresponding with file read-write request.
Preferably, the read-write type asked according to the fixed file read-write, is deposited by first file
Store up path perform it is corresponding with file read-write request read file operation or by the second file store path execution and
The file read-write asks corresponding operating writing-file, including：
When determining the read-write type of the file read-write request to write type, asking in the file read-write request is judged
Ask whether path is the first file store path；
If so, the request path during the file read-write is asked replaces with the second file store path；
Performed and the corresponding operating writing-file of file read-write request by the second file store path.
As shown in Fig. 2, the apparatus structure for reading and writing of files in a kind of distributed file system in another embodiment of the present invention
Schematic diagram, the distributed file system are deployed in server cluster, including：
Establishment and carry unit, for creating the first file store path in each server of server cluster, and
Second file store path of the carry based on predetermined file access interface；
Unit is kidnapped, for when receiving the file read-write request for each server, kidnapping the file
Read-write requests, and determine the read-write type of the file read-write request；
Execution unit, for the read-write type asked according to the fixed file read-write, passes through first file
Store path performs reading file operation corresponding with file read-write request or is performed by the second file store path
With the corresponding operating writing-file of file read-write request.
Preferably, the establishment and carry unit, are specifically used for
The replication mode provided by the file storage service of distributed file system, in each service of server cluster
Create the first file store path, and second file store path of the carry based on predetermined file access interface in device, described point
Cloth file system includes distributed file system GlusterFS.
Preferably, the execution unit, including：
First execution module, the read-write type for being asked when the definite file read-write are when reading type, by described
First file store path performs reading file operation corresponding with file read-write request.
Preferably, the execution unit, including：
Judgment module, for when determining the read-write type of the file read-write request to write type, judging the file
Whether the request path in read-write requests is the first file store path；
Replacement module, for if so, the request path during the file read-write is asked replaces with second file and deposits
Store up path；
Second execution module, it is corresponding with file read-write request for being performed by the second file store path
Operating writing-file.
Above-mentioned technical proposal of the embodiment of the present invention has the advantages that：Created in each server of server cluster
The first file store path, and second file store path of the carry based on predetermined file access interface are built, to realize separation text
The read-write of part provides necessary premise guarantee；The read-write type asked according to the fixed file read-write, by described
First file store path performs reading file operation corresponding with file read-write request or is stored by second file
Path execution and the corresponding operating writing-file of file read-write request, realize and ask to separate by file read-write, meanwhile, reading
During file, realize without by network can direct read/write local file system, so as to drastically increase file read-write
Performance, avoid in the case of heap file, reading and writing of files inefficiency, slow-paced situation occur, further,
Improve the usage experience of user.
Above-mentioned technical proposal of the embodiment of the present invention is described in detail below in conjunction with application example：
Application example of the present invention is intended to be greatly enhanced the file read-write performance in the presence of heap file.
As shown in Figure 1, for example, in server cluster A, including application server Service1, application server
Service2 and application server Service3；In application server Service1, the application server of server cluster A
The first file store path is created in Service2 and application server Service3, and such as "/realpath ", and carry is based in advance
Determine file access interface, such as POSIX interfaces, the second file store path, such as "/hookpath "；Serviced when receiving to be directed to
When the file read-write of each application server is asked in device cluster A, pass through the LD_PRELOAD rings provided under (SuSE) Linux OS
The function of border variable, this document read-write requests are kidnapped by the abduction to file read-write function, and determine that this document read-write please
The read-write type asked；If the read-write type of this document read-write requests for read type, by the first file store path "/
Realpath " performs file read operation corresponding with this document read-write requests；If the read-write type of this document read-write requests is to write
During type, by the second file store path, "/hookpath " performs file write operation corresponding with this document read-write requests.Clothes
The Organization Chart of business device cluster is with reference to figure 3.
It should be noted that those skilled in the art are it can be appreciated that the mode for kidnapping file read-write request has a variety of, sheet
Though in invention can in a particular manner exemplified by illustrate, do not limit herein.
In a preferred embodiment, described in step 101 in each server of server cluster, create the first file and deposit
Path, and second file store path of the carry based on predetermined file access interface are stored up, including：Pass through distributed file system
The replication mode that file storage service provides, creates the first file store path in each server of server cluster, and
Second file store path of the carry based on predetermined file access interface, the distributed file system include distributed field system
Unite GlusterFS.
For example, in each application server of server cluster A, by distributed file system, such as GlusterFS,
File storage service provide replication mode, created in each quote server of server cluster A the first file storage
Path, such as "/realpath ", and carry is based on predetermined file access interface, such as POSIX interfaces, the second file store path,
Such as "/hookpath ".
It should be noted that those skilled in the art are it can be appreciated that distributed file system GlusterFS is one opens
The distributed file system in source, has powerful ability extending transversely, can support that (petabyte, claps word to number PB by extension
Section) memory capacity and processing thousands of customers end, GlusterFS can replicate file automatically, such as mirror image or multiple copies,
So that it is guaranteed that data can always access, even also can normally it access in the case of a hardware failure, GlusterFS backed stampers
The characteristic of formula, additionally it is possible to realize the multiple write-in become write-once on all machines.POSIX standard defines operating system
It should be the interface standard that application program provides, be that IEEE is the software to be run in various UNIX operating systems and defines
A series of general name of API (Application Programming Interface, application programming interface) standards, it is just
Formula address is IEEE 1003, and the entitled ISO/IEC 9945 of international standard, POSIX standard are intended to it is expected to obtain source code level
Other software portability, is the program that the operating system of a POSIX compatibility is write, it should can be any in other words
Complied executing on other POSIX operating systems (even from another manufacturer).
In a preferred embodiment, this method further includes：In the multiple servers of the server cluster, any two
Communicated between server by any respective file storage service of two-server.
For example, in each application server of server cluster A, stored by the file of application server Service1
Service and the file storage service of application server Service2 carry out application server Service1 and application server
Communication between Service2；By the file storage service of application server Service1 with application server Service3's
File storage service carries out the communication between application server Service1 and application server Service3；Pass through application service
The file storage service of device Service3 carries out application server with the file storage service of application server Service2
Communication between Service3 and application server Service2.
Through this embodiment, being in communication with each other between every server in server cluster is realized, to ensure every clothes
Same file on business device is consistent, so as to evade when certain server loses the danger of data when something goes wrong.
In a preferred embodiment, the read-write type that the step 103 is asked according to the fixed file read-write, leads to
Cross the first file store path and perform reading file operation corresponding with file read-write request or by the described second text
The execution of part store path and the corresponding operating writing-file of file read-write request, including：When the definite file read-write is asked
Read-write type to read type when, passing through the first file store path, to perform reading corresponding with file read-write request literary
Part operates.
For example, in each application server of server cluster A, it is directed to when receiving in server cluster A using clothes
During the file read-write request of business device Service1, this document read-write requests are kidnapped, and determine the read-write class of this document read-write requests
Type is reads type, and then, by the first file store path, "/realpath " performs reading corresponding with this document read-write requests should
With the operation of the file of server S ervice1.With reference to the file read-write flow diagram of application server Service1 in figure 4.
In a preferred embodiment, the read-write type that the step 103 is asked according to the fixed file read-write, leads to
Cross the first file store path and perform reading file operation corresponding with file read-write request or by the described second text
The execution of part store path and the corresponding operating writing-file of file read-write request, including：When the definite file read-write is asked
Read-write type when writing type, to judge whether the request path in file read-write request is the first file storage road
Footpath；If so, the request path during the file read-write is asked replaces with the second file store path；Pass through described second
File store path performs and the corresponding operating writing-file of file read-write request.
For example, in each application server of server cluster A, it is directed to when receiving in server cluster A using clothes
During the file read-write request of business device Service1, this document read-write requests are kidnapped, and determine the read-write class of this document read-write requests
Type is writes type, then, judge the request path in this document read-write requests whether be the first file store path "/
realpath”；If so, the request path in this document read-write requests is replaced with into the second file store path "/hookpath "；
By the second file store path, "/hookpath " execution is corresponding with this document read-write requests to write application server Service1
File operation.Wherein, POSIX interfaces can be mounted on any one application server in server cluster A
"/hookpath ", after carry is completed, such as works as and passes through the POSIX interfaces toward application for some catalogue, such as the second file store path
" written document in/hookpath ", the file of write-in can be all replicated is written to whole system to the catalogue of server S ervice1
Other every machine include application server Service2 and application server Service3 the first file store path "/
In realpath ", to ensure that the same file on every server is consistent, so as to evade when certain server goes wrong
When lose data danger.With reference to the file read-write flow diagram of application server Service1 in figure 4.
An embodiment of the present invention provides a kind of device of reading and writing of files in distributed file system, it is possible to achieve above-mentioned offer
Embodiment of the method, concrete function, which is realized, refers to explanation in embodiment of the method, and details are not described herein.
It should be understood that the particular order or level of the step of during disclosed are the examples of illustrative methods.Based on setting
Count preference, it should be appreciated that during the step of particular order or level can be in the feelings for the protection domain for not departing from the disclosure
Rearranged under condition.Appended claim to a method gives the key element of various steps with exemplary order, and not
It is to be limited to the particular order or level.
In above-mentioned detailed description, various features combine in single embodiment together, to simplify the disclosure.No
This open method should be construed to reflect such intention, i.e. the embodiment of theme claimed needs to compare
The more features of feature clearly stated in each claim.On the contrary, as appended claims is reflected
Like that, the present invention is in the state fewer than whole features of disclosed single embodiment.Therefore, appended claims
It is hereby expressly incorporated into detailed description, wherein each claim is alone as the single preferred embodiment of the present invention.
To enable any technical staff in the art to realize or using the present invention, above to disclosed embodiment into
Description is gone.To those skilled in the art；The various modifications mode of these embodiments will be apparent from, and this
The General Principle of text definition can also be suitable for other embodiments on the basis of the spirit and scope of the disclosure is not departed from.
Therefore, the disclosure is not limited to embodiments set forth herein, but most wide with principle disclosed in the present application and novel features
Scope is consistent.
Described above includes the citing of one or more embodiments.Certainly, in order to above-described embodiment is described and description portion
The all possible combination of part or method is impossible, but it will be appreciated by one of ordinary skill in the art that each implementation
Example can do further combinations and permutations.Therefore, embodiment described herein is intended to fall into the appended claims
Protection domain in all such changes, modifications and variations.In addition, with regard to the term used in specification or claims
"comprising", the mode that covers of the word are similar to term " comprising ", just as " including " solved in the claims as link word
As releasing.In addition, the use of any one term "or" in the specification of claims is to represent " non-exclusionism
Or ".
Those skilled in the art will also be appreciated that the various illustrative components, blocks that the embodiment of the present invention is listed
(illustrative logical block), unit, and step can pass through the knot of electronic hardware, computer software, or both
Conjunction is realized.To clearly show that the replaceability of hardware and software (interchangeability), above-mentioned various explanations
Property component (illustrative components), unit and step universally describe their function.Such work(
Can be that specific application and the design requirement of whole system are depended on to realize by hardware or software.Those skilled in the art
Various methods can be used to realize the function, but this realization is understood not to for every kind of specific application
Beyond the scope of protection of the embodiment of the present invention.
Various illustrative logical blocks described in the embodiment of the present invention, or unit can by general processor,
Digital signal processor, application-specific integrated circuit (ASIC), field programmable gate array or other programmable logic devices, discrete gate
Or described function is realized or operated in transistor logic, discrete hardware components, or the design of any of the above described combination.General place
It can be microprocessor to manage device, and alternatively, which can also be any traditional processor, controller, microcontroller
Device or state machine.Processor can also be realized by the combination of computing device, such as digital signal processor and microprocessor,
Multi-microprocessor, one or more microprocessors combine a digital signal processor core, or any other like configuration
To realize.
The step of method or algorithm described in the embodiment of the present invention can be directly embedded into hardware, processor perform it is soft
Part module or the combination of both.Software module can be stored in RAM memory, flash memory, ROM memory, EPROM storages
Other any form of storaging mediums in device, eeprom memory, register, hard disk, moveable magnetic disc, CD-ROM or this area
In.Exemplarily, storaging medium can be connected with processor, so that processor can read information from storaging medium, and
Can be to storaging medium stored and written information.Alternatively, storaging medium can also be integrated into processor.Processor and storaging medium can
To be arranged in ASIC, ASIC can be arranged in user terminal.Alternatively, processor and storaging medium can also be arranged at use
In different components in the terminal of family.
In one or more exemplary designs, the described above-mentioned function of the embodiment of the present invention can be in hardware, soft
Part, firmware or any combination of this three are realized.If realized in software, these functions can store and computer-readable
On medium, or with one or more instruction or code form be transmitted on the medium of computer-readable.Computer readable medium includes electricity
Brain storaging medium and easy to allow computer program to be transferred to other local telecommunication medias from a place.Storaging medium can be with
It is that any general or special computer can be with the useable medium of access.For example, such computer readable media can include but
It is not limited to RAM, ROM, EEPROM, CD-ROM or other optical disc storage, disk storage or other magnetic storage devices, or other
What can be used for carrying or store with instruct or data structure and it is other can be by general or special computer or general or specially treated
The medium of the program code of device reading form.In addition, any connection can be properly termed computer readable medium, example
Such as, if software is to pass through a coaxial cable, fiber optic cables, double from a web-site, server or other remote resources
Twisted wire, Digital Subscriber Line (DSL) or with defined in being also contained in of the wireless way for transmitting such as infrared, wireless and microwave
In computer readable medium.The disk (disk) and disk (disc) include Zip disk, radium-shine disk, CD, DVD, floppy disk
And Blu-ray Disc, disk is usually with magnetic duplication data, and disk usually carries out optical reproduction data with laser.Combinations of the above
It can also be included in computer readable medium.
Above-described embodiment, has carried out the purpose of the present invention, technical solution and beneficial effect further
Describe in detail, it should be understood that the foregoing is merely the embodiment of the present invention, be not intended to limit the present invention
Protection domain, within the spirit and principles of the invention, any modification, equivalent substitution, improvement and etc. done, should all include
Within protection scope of the present invention.
Claims (10)
1. a kind of method of reading and writing of files in distributed file system, it is characterised in that the distributed file system is deployed in
In server cluster, including：
The first file store path is created in each server of server cluster, and carry is based on predetermined file access interface
The second file store path；
When receiving the file read-write request for each server, the file read-write request is kidnapped, and determine institute
State the read-write type of file read-write request；
The read-write type asked according to the fixed file read-write, by the first file store path perform with it is described
File read-write request is corresponding to read file operation or performs by the second file store path to ask with the file read-write
Corresponding operating writing-file.
2. according to the method described in claim 1, it is characterized in that, described in each server of server cluster, establishment
First file store path, and second file store path of the carry based on predetermined file access interface, including：
The replication mode provided by the file storage service of distributed file system, in each server of server cluster
Create the first file store path, and second file store path of the carry based on predetermined file access interface, the distribution
File system includes distributed file system GlusterFS.
3. according to the method described in claim 2, it is characterized in that,
It is each by any two-server between any two-server in the multiple servers of the server cluster
From file storage service communicate.
4. the according to the method described in claim 1, it is characterized in that, reading asked according to the fixed file read-write
Type is write, reading file operation corresponding with file read-write request is performed by the first file store path or passes through institute
The execution of the second file store path and the corresponding operating writing-file of file read-write request are stated, including：
When determining the read-write type of file read-write request to read type, by the first file store path perform with
The file read-write request is corresponding to read file operation.
5. the according to the method described in claim 1, it is characterized in that, reading asked according to the fixed file read-write
Type is write, reading file operation corresponding with file read-write request is performed by the first file store path or passes through institute
The execution of the second file store path and the corresponding operating writing-file of file read-write request are stated, including：
When determining the read-write type of the file read-write request to write type, the request road in the file read-write request is judged
Whether footpath is the first file store path；
If so, the request path during the file read-write is asked replaces with the second file store path；
Performed and the corresponding operating writing-file of file read-write request by the second file store path.
6. the device of reading and writing of files in a kind of distributed file system, it is characterised in that the distributed file system is deployed in
In server cluster, including：
Establishment and carry unit, for creating the first file store path, and carry in each server of server cluster
The second file store path based on predetermined file access interface；
Unit is kidnapped, for when receiving the file read-write request for each server, kidnapping the file read-write
Request, and determine the read-write type of the file read-write request；
Execution unit, for the read-write type asked according to the fixed file read-write, is stored by first file
Path performs reading file operation corresponding with file read-write request or by the second file store path execution and institute
State file read-write and ask corresponding operating writing-file.
7. device according to claim 6, it is characterised in that the establishment and carry unit, are specifically used for
The replication mode provided by the file storage service of distributed file system, in each server of server cluster
Create the first file store path, and second file store path of the carry based on predetermined file access interface, the distribution
File system includes distributed file system GlusterFS.
8. device according to claim 7, it is characterised in that in the multiple servers of the server cluster, arbitrarily
Communicated between two-server by any respective file storage service of two-server.
9. device according to claim 6, it is characterised in that the execution unit, including：
First execution module, for when determining the read-write type of the file read-write request to read type, passing through described first
File store path performs reading file operation corresponding with file read-write request.
10. device according to claim 6, it is characterised in that the execution unit, including：
Judgment module, for when determining the read-write type of the file read-write request to write type, judging the file read-write
Whether the request path in request is the first file store path；
Replacement module, for if so, the request path during the file read-write is asked, which replaces with second file, stores road
Footpath；
Second execution module, for writing text by the way that the second file store path execution is corresponding with file read-write request
Part operates.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711296507.6A CN107944010B (en) | 2017-12-08 | 2017-12-08 | Method and device for reading and writing files in distributed file system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711296507.6A CN107944010B (en) | 2017-12-08 | 2017-12-08 | Method and device for reading and writing files in distributed file system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107944010A true CN107944010A (en) | 2018-04-20 |
| CN107944010B CN107944010B (en) | 2020-11-17 |
Family
ID=61946285
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711296507.6A Active CN107944010B (en) | 2017-12-08 | 2017-12-08 | Method and device for reading and writing files in distributed file system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107944010B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111767263A (en) * | 2020-07-04 | 2020-10-13 | 武汉空心科技有限公司 | Working platform file storage method and system |
| CN112187875A (en) * | 2020-09-09 | 2021-01-05 | 苏州浪潮智能科技有限公司 | Automatic matching method and system for multi-target cluster mounting strategy of distributed system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103248656A (en) * | 2012-02-10 | 2013-08-14 | 联想(北京)有限公司 | Method for achieving data reading and writing as well as DSF (distributed file system) and client side |
| US9542310B2 (en) * | 2002-11-01 | 2017-01-10 | Hitachi Data Systems Engineering UK Limited | File server node with non-volatile memory processing module coupled to cluster file server node |
| CN106709048A (en) * | 2017-01-05 | 2017-05-24 | 无锡江南计算技术研究所 | High-performance computing-oriented distributed data organization method |
-
2017
- 2017-12-08 CN CN201711296507.6A patent/CN107944010B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9542310B2 (en) * | 2002-11-01 | 2017-01-10 | Hitachi Data Systems Engineering UK Limited | File server node with non-volatile memory processing module coupled to cluster file server node |
| CN103248656A (en) * | 2012-02-10 | 2013-08-14 | 联想(北京)有限公司 | Method for achieving data reading and writing as well as DSF (distributed file system) and client side |
| CN106709048A (en) * | 2017-01-05 | 2017-05-24 | 无锡江南计算技术研究所 | High-performance computing-oriented distributed data organization method |
Non-Patent Citations (1)
| Title |
|---|
| YIKAYI: "GlusterFS集群文件系统基础与实践", 《HTTPS://BLOG.51CTO.COM/DAISYWEI/1842465》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111767263A (en) * | 2020-07-04 | 2020-10-13 | 武汉空心科技有限公司 | Working platform file storage method and system |
| CN112187875A (en) * | 2020-09-09 | 2021-01-05 | 苏州浪潮智能科技有限公司 | Automatic matching method and system for multi-target cluster mounting strategy of distributed system |
| CN112187875B (en) * | 2020-09-09 | 2022-05-13 | 苏州浪潮智能科技有限公司 | Automatic matching method and system for multi-target cluster mounting strategy of distributed system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107944010B (en) | 2020-11-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11609884B2 (en) | Intelligent file system with transparent storage tiering | |
| US7818515B1 (en) | System and method for enforcing device grouping rules for storage virtualization | |
| US10467246B2 (en) | Content-based replication of data in scale out system | |
| US7689803B2 (en) | System and method for communication using emulated LUN blocks in storage virtualization environments | |
| CN111338854B (en) | Kubernetes cluster-based method and system for quickly recovering data | |
| US20060047926A1 (en) | Managing multiple snapshot copies of data | |
| US10158579B2 (en) | Resource silos at network-accessible services | |
| US8639898B2 (en) | Storage apparatus and data copy method | |
| JP2019101703A (en) | Storage system and control software arrangement method | |
| CN104615606B (en) | A kind of Hadoop distributed file systems and its management method | |
| US9176853B2 (en) | Managing copy-on-writes to snapshots | |
| US8341119B1 (en) | Flexible copies having different sub-types | |
| US9262087B2 (en) | Non-disruptive configuration of a virtualization controller in a data storage system | |
| CN106407040A (en) | Remote data copy method and system | |
| CN102685194B (en) | Memory device migration and the method and system be redirected | |
| US11093387B1 (en) | Garbage collection based on transmission object models | |
| CN106446159B (en) | A kind of method of storage file, the first virtual machine and name node | |
| US10628298B1 (en) | Resumable garbage collection | |
| CN102611745A (en) | On-line file moving method, device and system | |
| US11431798B2 (en) | Data storage system | |
| CN107704206B (en) | Method, device, equipment and storage medium for online migration of heterogeneous system data | |
| CN107944010A (en) | The method and apparatus of reading and writing of files in a kind of distributed file system | |
| US10969989B2 (en) | Techniques for capturing virtual machine snapshots using data storage system snapshots | |
| WO2024124912A1 (en) | Data synchronization method and apparatus for redundant firmware, and non-volatile readable storage medium | |
| WO2022151856A1 (en) | Online takeover method and system for heterogeneous storage volumes, device, and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230412 Address after: Room 501-502, 5/F, Sina Headquarters Scientific Research Building, Block N-1 and N-2, Zhongguancun Software Park, Dongbei Wangxi Road, Haidian District, Beijing, 100193 Patentee after: Sina Technology (China) Co.,Ltd. Address before: 100193 7th floor, scientific research building, Sina headquarters, plot n-1, n-2, Zhongguancun Software Park, Dongbei Wangxi Road, Haidian District, Beijing, 100193 Patentee before: Sina.com Technology (China) Co.,Ltd. |
|
| TR01 | Transfer of patent right |