CN104092758B - A kind of read method of distributed type high speed cloud storage service device group system - Google Patents
A kind of read method of distributed type high speed cloud storage service device group system Download PDFInfo
- Publication number
- CN104092758B CN104092758B CN201410332549.0A CN201410332549A CN104092758B CN 104092758 B CN104092758 B CN 104092758B CN 201410332549 A CN201410332549 A CN 201410332549A CN 104092758 B CN104092758 B CN 104092758B
- Authority
- CN
- China
- Prior art keywords
- operating system
- value
- client terminal
- file
- memory block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
A kind of read method of distributed type high speed cloud storage service device group system, the cloud storage service device cluster formed including more than two storage servers, described storage server is also passed through the gateway with protocol translation module by InfiniBand_RDMA networks and is connected with the client terminal of the operating system platform based on Windows, the operating system platform based on UNIX or the operating system based on MaCOS by InfiniBand_RDMA network connections to the more than one client terminal based on linux operating system platforms, in addition described storage server.Such structure is avoided when cloud storage service device aggregated structure generally existing reads file in the prior art with reference to its read method has the defects of poor poor autgmentability, poor availability, concurrency, poor compatibility.
Description
Technical field
The invention belongs to cloud storage service device technical field, and in particular to a kind of distributed type high speed cloud storage service device cluster
The read method of system.
Background technology
Along with a large amount of uses of cloud storage service device, existing cloud storage service device forms clustering frame gradually
Structure system, but existing cloud storage service device aggregated structure generally existing read file when have poor autgmentability, poor availability,
The problem of concurrency is poor, poor compatibility.
The content of the invention
It is an object of the invention to provide a kind of distributed type high speed cloud storage service device group system and read method, including two
The cloud storage service device cluster that storage server above is formed, described storage server pass through InfiniBand_RDMA nets
Network is connected to the more than one client terminal based on linux operating system platforms, and described storage server is also passed through in addition
InfiniBand_RDMA networks pass through with protocol translation module gateway with the operating system platform based on Windows, be based on
The client terminal of UNIX operating system platform or operating system based on MaCOS is connected.Such structure is read with reference to it
Taking method to avoid when cloud storage service device aggregated structure generally existing reads file in the prior art has autgmentability poor, available
The defects of property is poor, concurrency is poor, poor compatibility.
In order to overcome deficiency of the prior art, the invention provides a kind of distributed type high speed cloud storage service device cluster system
The solution of the read method of system, it is specific as follows：
A kind of read method of distributed type high speed cloud storage service device group system, it is characterised in that：It is distributed including one kind
Formula high-velocity cloud storage server group system, a kind of described distributed type high speed cloud storage service device group system include two with
On the cloud storage service device cluster that forms of storage server based on linux operating system platforms, described storage server warp
Cross InfiniBand_RDMA networks and be connected to the more than one client terminal based on linux operating system platforms, it is described in addition
Storage server also passes through the gateway with protocol translation module with based on Windows's by InfiniBand_RDMA networks
The client terminal of operating system platform, the operating system platform based on UNIX or the operating system based on MaCOS is connected, institute
Backstage read module is set in the storage server stated, before being set in the client terminal based on linux operating system platforms
Platform read module, described protocol translation module include CIFS submodules or NFS submodules；
A kind of read method of described distributed type high speed cloud storage service device group system comprises the following steps that：
Step 1：The foreground read module of client terminal each based on linux operating system platforms first sends request communication
Connection packet is sent to all storage services based on linux operating system platforms by InfiniBand_RDMA networks
Device, after the storage server based on linux operating system platforms receives request communication connection packet, backstage read module warp
It is whole to the client based on linux operating system platforms for sending request communication connection packet to cross InfiniBand_RDMA networks
End transmission includes the response communication connection data of the IP address information of the storage server based on linux operating system platforms
Bag, and communication connection is established with the client terminal based on linux operating system platforms for sending request communication connection packet, should
The foreground read module of client terminal based on linux operating system platforms communicates to connect response in packet and is based on linux
The IP address information of the storage server of operating system platform is preserved；
Step 2：Storage server based on linux operating system platforms after a catalogue is established, then comprising
There is the information packet of directory path and directory name information to be sent to being somebody's turn to do the storage server based on linux operating system platforms
Communicate the client terminal and gateway based on linux operating system platforms of connection, the client based on linux operating system platforms
The foreground read module of terminal is put down according to the directory path in the packet received and directory name based on linux operating systems
The catalogue of the same directory name under same directory path is constructed on the client terminal of platform, and in the protocol translation module of gateway
Directory path in the packet received and directory name are converted into same Windows's by CIFS submodules or NFS submodules
The directory path and catalogue of operating system platform, UNIX operating system platform or the operating system phase compatibility based on MaCOS
Name, then the same Windows operating system platform after conversion, UNIX operating system platform or behaviour based on MaCOS
Making system, mutually the directory path of compatibility and directory name are separately sent to the operating system platform based on Windows, based on UNIX's
In the client terminal of operating system platform or operating system based on MaCOS, so the operating system based on Windows is put down
The client terminal of platform, the operating system platform based on UNIX or the operating system based on MaCOS is according to the catalogue road received
Footpath and directory name are respectively in the operating system platform based on Windows, the operating system platform based on UNIX or based on MaCOS
Operating system client terminal on construct the catalogue of same directory name under same directory path；
Step 3：Then when the storage server based on linux operating system platforms constructs file under the catalogue of foundation
Afterwards, the integer value that the address of the filename of the file of structure forces to be converted into 4 bytes is just stored in the one 4 byte memory block
In, then the length value of the filename of the file of structure is stored in the 2nd 4 byte memory block, and the text of the file structure
Quotient after the length value of part name divided by 4 is stored in the 3rd 4 byte memory block, the length value of the filename of the file of structure
Divided by the quotient after 16 is stored in the 4th 4 byte memory block, thus into circulation second circulation body, institute in first circulation body
The second circulation body stated to circulate the loop body of four times, deposits the one 4 byte to perform successively by the n-th circulation of second circulation body
The address of storage area is stored in the 5th 4 byte memory block, the value in the 5th 4 byte memory block is stored in includes four 4 words
Save and add one in n-th of 4 byte memory blocks in the array of memory block, the value of the one 4 byte memory block, the 3rd 4 byte is deposited
The value of storage area subtracts one and the value of the 2nd 4 byte memory block is subtracted 4, and wherein n span is 1 to 4 integer, and described the
After each circulation of one loop body is first carries out second circulation body, into the 3rd loop body, the circulation of the 3rd described loop body
Number is 100 times, each circulation of the 3rd loop body for successively the value of the 6th 4 byte memory block that initial value is 0 plus 100,
The value for the 7th 4 byte memory block that initial value is 1412307604 is included four 4 bytes by after lt 4 plus described
Obtained by the value of the 1st 4 byte memory blocks in the array of memory block and value adds the 6th with the value of the 7th 4 byte memory block
The value of gained is the same as the 7th 4 byte memory block after obtained by the value of 4 byte memory blocks and value progress XOR, progress XOR
Value move to right after five add the described array for including four 4 byte memory blocks in the 2nd 4 byte memory blocks value institute
Carried out again with value after XOR obtained by value be added with value of the initial value for 2489623685 the 8th 4 byte memory block,
The value for the 8th 4 byte memory block that initial value is 2489623685 is included four 4 bytes by after lt 4 plus described
Obtained by the value of the 3rd 4 byte memory blocks in the array of memory block and value adds the 6th with the value of the 8th 4 byte memory block
The value of gained is the same as the 8th 4 byte memory block after obtained by the value of 4 byte memory blocks and value progress XOR, progress XOR
Value move to right after five add the described array for including four 4 byte memory blocks in the 4th 4 byte memory blocks value institute
Carried out again with value after XOR obtained by value be added with value of the initial value for 1412307604 the 7th 4 byte memory block,
So after the 3rd loop body terminates, the value in the 9th 4 byte memory block for being 1412307604 initial value adds the 7th 4 byte
The value in the 10th byte memory block that the value of memory block is 2489623685 initial value adds the value of the 8th 4 byte memory block,
This completes the one cycle of first circulation body；
Step 4：After first circulation body circulation terminates, the value in the 9th 4 byte memory block with the 10th byte memory block
The index value of 4 bytes of the file of described structure is obtained after interior value progress XOR, and should be based on linux operations
The positive integer scope that 4 bytes can be expressed intactly is randomly assigned to institute by the backstage read module of the storage server of system platform
The client terminal based on linux operating system platforms stated, the operating system platform based on Windows, the operation based on UNIX
The client terminal of system platform or operating system based on MaCOS；
Step 5：Then the backstage read module for being somebody's turn to do the storage server based on linux operating system platforms will be resulting
The index value of 4 bytes of the file of described structure is described based on linux operating system platforms with being randomly assigned to one by one
Client terminal, the operating system platform based on Windows, the operating system platform based on UNIX or the operation based on MaCOS
The positive integer scope of the client terminal of system compares, if one of them client terminal based on linux operating system platforms
The positive integer scope being randomly assigned contain described structure file 4 bytes index value, then backstage read module
Just using the IP address of the client terminal based on linux operating system platforms as destination address, and pass through InfiniBand_
The file of described structure and its directory path at place are sent to the visitor based on linux operating system platforms by RDMA networks
Family terminal, the foreground read module of the client terminal based on linux operating system platforms is somebody's turn to do just the described structure received
File be stored in the directory path received；
Step 6：If being randomly assigned for the client terminal of one of them operating system platform based on Windows is just whole
Number scope contains the index value of 4 bytes of the file of described structure, then backstage read module is just described structure
File and its directory path at place are sent to gateway, and CIFS submodules in the protocol translation module of gateway are just receiving
The file of described structure and its directory path at place are converted into the compatible file of the operating system platform phase of the Windows
And its directory path at place, then again using the IP address of the client terminal of the operating system platform based on Windows as
Destination address, the file after conversion and its directory path at place are sent to the operating system platform based on Windows
In client terminal, the client terminal of the operating system platform based on Windows is somebody's turn to do just the file of the described structure received
It is stored in the directory path received；
Step 7：If the positive integer being randomly assigned of the client terminal of one of them operating system platform based on MaCOS
Scope contains the index value of 4 bytes of the file of described structure, then backstage read module is just the text of described structure
Part and its directory path at place are sent to gateway, and the CIFS submodules in the protocol translation module of gateway are just the institute received
The file for the structure stated and its directory path at place be converted into the MaCOS operating system platform mutually compatible file and its
The directory path at place, then again using the IP address of the client terminal of the operating system platform based on MaCOS as destination
Location, the file after conversion and its directory path at place are sent to the client terminal of the operating system platform based on MaCOS
In, the file of the described structure received is just stored in reception by the client terminal for being somebody's turn to do the operating system platform based on MaCOS
To directory path in；
Step 8：If the positive integer being randomly assigned of the client terminal of one of them operating system platform based on UNIX
Scope contains the index value of 4 bytes of the file of described structure, then backstage read module is just the text of described structure
Part and its directory path at place are sent to gateway, and the NFS submodules in the protocol translation module of gateway are just the institute received
The file for the structure stated and its directory path at place be converted into the UNIX operating system platform mutually compatible file and its
The directory path at place, then again using the IP address of the client terminal of the operating system platform based on UNIX as destination
Location, the file after conversion and its directory path at place are sent to the client terminal of the operating system platform based on UNIX
In, the client terminal of the operating system platform based on UNIX, which is just stored in the file of the described structure received, to be received
Directory path in.
Using such scheme of the present invention, there is powerful ability extending transversely, by extension hundreds of PB can be supported to store
Capacity and processing thousands of customers end, distributed type high speed cloud storage service device group system can be by TCP/IP or InfiniBand
RDMA networks flock together the storage resource of physical distribution, and data are managed using single global name space.
Brief description of the drawings
Fig. 1 is the structural representation of the present invention.
Embodiment
The content of the invention is described further below in conjunction with the accompanying drawings：
Shown in reference picture 1, distributed type high speed cloud storage service device group system, including two or more are operated based on linux
The cloud storage service device cluster that the storage server 1 of system bay is formed, described storage server 1 pass through InfiniBand_
RDMA networks 2 are connected to the more than one client terminal 3 based on linux operating system platforms, in addition described storage service
Device 1 is also by InfiniBand_RDMA networks 2 by the gateway 5 with protocol translation module 4 with the operation based on Windows
The client terminal 6 of system platform, the operating system platform based on UNIX or the operating system based on MaCOS is connected, described
Storage server 1 in backstage read module 7 is set, before being set in the client terminal 3 based on linux operating system platforms
Platform read module 8, just can be special in the protocol translation module of gateway 5 due to InfiniBand_RDMA networks 2 rapidly and efficiently
Be not web database technology and visit capacity greatly under multiplication protocol translation and caused time delay to effective compensation, so as to reach
The effect of real-time Transmission.Described protocol translation module 4 includes CIFS submodules or NFS submodules, can thus carry out
Protocol conversion under different operating system platform, realize autgmentability and the purpose of compatibility enhancing.
The read method of described distributed type high speed cloud storage service device group system comprises the following steps that：
Step 1：The foreground read module of client terminal each based on linux operating system platforms first sends request communication
Connection packet is sent to all storage services based on linux operating system platforms by InfiniBand_RDMA networks
Device, after the storage server based on linux operating system platforms receives request communication connection packet, backstage read module warp
It is whole to the client based on linux operating system platforms for sending request communication connection packet to cross InfiniBand_RDMA networks
End transmission includes the response communication connection data of the IP address information of the storage server based on linux operating system platforms
Bag, and communication connection is established with the client terminal based on linux operating system platforms for sending request communication connection packet, should
The foreground read module of client terminal based on linux operating system platforms communicates to connect response in packet and is based on linux
The IP address information of the storage server of operating system platform is preserved；
Step 2：Storage server based on linux operating system platforms after a catalogue is established, then comprising
There is the information packet of directory path and directory name information to be sent to being somebody's turn to do the storage server based on linux operating system platforms
Communicate the client terminal and gateway based on linux operating system platforms of connection, the client based on linux operating system platforms
The foreground read module of terminal is put down according to the directory path in the packet received and directory name based on linux operating systems
The catalogue of the same directory name under same directory path is constructed on the client terminal of platform, and in the protocol translation module of gateway
Directory path in the packet received and directory name are converted into same Windows's by CIFS submodules or NFS submodules
The directory path and catalogue of operating system platform, UNIX operating system platform or the operating system phase compatibility based on MaCOS
Name, then the same Windows operating system platform after conversion, UNIX operating system platform or behaviour based on MaCOS
Making system, mutually the directory path of compatibility and directory name are separately sent to the operating system platform based on Windows, based on UNIX's
In the client terminal of operating system platform or operating system based on MaCOS, so the operating system based on Windows is put down
The client terminal of platform, the operating system platform based on UNIX or the operating system based on MaCOS is according to the catalogue road received
Footpath and directory name are respectively in the operating system platform based on Windows, the operating system platform based on UNIX or based on MaCOS
Operating system client terminal on construct the catalogue of same directory name under same directory path；
Step 3：Then when the storage server based on linux operating system platforms constructs file under the catalogue of foundation
Afterwards, the integer value that the address of the filename of the file of structure forces to be converted into 4 bytes is just stored in the one 4 byte memory block
In, then the length value of the filename of the file of structure is stored in the 2nd 4 byte memory block, and the text of the file structure
Quotient after the length value of part name divided by 4 is stored in the 3rd 4 byte memory block, the length value of the filename of the file of structure
Divided by the quotient after 16 is stored in the 4th 4 byte memory block, thus into circulation second circulation body, institute in first circulation body
The second circulation body stated to circulate the loop body of four times, deposits the one 4 byte to perform successively by the n-th circulation of second circulation body
The address of storage area is stored in the 5th 4 byte memory block, the value in the 5th 4 byte memory block is stored in includes four 4 words
Save and add one in n-th of 4 byte memory blocks in the array of memory block, the value of the one 4 byte memory block, the 3rd 4 byte is deposited
The value of storage area subtracts one and the value of the 2nd 4 byte memory block is subtracted 4, and wherein n span is 1 to 4 integer, and described the
After each circulation of one loop body is first carries out second circulation body, into the 3rd loop body, the circulation of the 3rd described loop body
Number is 100 times, each circulation of the 3rd loop body for successively the value of the 6th 4 byte memory block that initial value is 0 plus 100,
The value for the 7th 4 byte memory block that initial value is 1412307604 is included four 4 bytes by after lt 4 plus described
Obtained by the value of the 1st 4 byte memory blocks in the array of memory block and value adds the 6th with the value of the 7th 4 byte memory block
The value of gained is the same as the 7th 4 byte memory block after obtained by the value of 4 byte memory blocks and value progress XOR, progress XOR
Value move to right after five add the described array for including four 4 byte memory blocks in the 2nd 4 byte memory blocks value institute
Carried out again with value after XOR obtained by value be added with value of the initial value for 2489623685 the 8th 4 byte memory block,
The value for the 8th 4 byte memory block that initial value is 2489623685 is included four 4 bytes by after lt 4 plus described
Obtained by the value of the 3rd 4 byte memory blocks in the array of memory block and value adds the 6th with the value of the 8th 4 byte memory block
The value of gained is the same as the 8th 4 byte memory block after obtained by the value of 4 byte memory blocks and value progress XOR, progress XOR
Value move to right after five add the described array for including four 4 byte memory blocks in the 4th 4 byte memory blocks value institute
Carried out again with value after XOR obtained by value be added with value of the initial value for 1412307604 the 7th 4 byte memory block,
So after the 3rd loop body terminates, the value in the 9th 4 byte memory block for being 1412307604 initial value adds the 7th 4 byte
The value in the 10th byte memory block that the value of memory block is 2489623685 initial value adds the value of the 8th 4 byte memory block,
This completes the one cycle of first circulation body；
Step 4：After first circulation body circulation terminates, the value in the 9th 4 byte memory block with the 10th byte memory block
The index value of 4 bytes of the file of described structure is obtained after interior value progress XOR, and should be based on linux operations
The positive integer scope that 4 bytes can be expressed intactly is randomly assigned to institute by the backstage read module of the storage server of system platform
The client terminal based on linux operating system platforms stated, the operating system platform based on Windows, the operation based on UNIX
The client terminal of system platform or operating system based on MaCOS；
Step 5：Then the backstage read module for being somebody's turn to do the storage server based on linux operating system platforms will be resulting
The index value of 4 bytes of the file of described structure is described based on linux operating system platforms with being randomly assigned to one by one
Client terminal, the operating system platform based on Windows, the operating system platform based on UNIX or the operation based on MaCOS
The positive integer scope of the client terminal of system compares, if one of them client terminal based on linux operating system platforms
The positive integer scope being randomly assigned contain described structure file 4 bytes index value, then backstage read module
Just using the IP address of the client terminal based on linux operating system platforms as destination address, and pass through InfiniBand_
The file of described structure and its directory path at place are sent to the visitor based on linux operating system platforms by RDMA networks
Family terminal, the foreground read module of the client terminal based on linux operating system platforms is somebody's turn to do just the described structure received
File be stored in the directory path received；
Step 6：If being randomly assigned for the client terminal of one of them operating system platform based on Windows is just whole
Number scope contains the index value of 4 bytes of the file of described structure, then backstage read module is just described structure
File and its directory path at place are sent to gateway, and CIFS submodules in the protocol translation module of gateway are just receiving
The file of described structure and its directory path at place are converted into the compatible file of the operating system platform phase of the Windows
And its directory path at place, then again using the IP address of the client terminal of the operating system platform based on Windows as
Destination address, the file after conversion and its directory path at place are sent to the operating system platform based on Windows
In client terminal, the client terminal of the operating system platform based on Windows is somebody's turn to do just the file of the described structure received
It is stored in the directory path received；
Step 7：If the positive integer being randomly assigned of the client terminal of one of them operating system platform based on MaCOS
Scope contains the index value of 4 bytes of the file of described structure, then backstage read module is just the text of described structure
Part and its directory path at place are sent to gateway, and the CIFS submodules in the protocol translation module of gateway are just the institute received
The file for the structure stated and its directory path at place be converted into the MaCOS operating system platform mutually compatible file and its
The directory path at place, then again using the IP address of the client terminal of the operating system platform based on MaCOS as destination
Location, the file after conversion and its directory path at place are sent to the client terminal of the operating system platform based on MaCOS
In, the file of the described structure received is just stored in reception by the client terminal for being somebody's turn to do the operating system platform based on MaCOS
To directory path in；
Step 8：If the positive integer being randomly assigned of the client terminal of one of them operating system platform based on UNIX
Scope contains the index value of 4 bytes of the file of described structure, then backstage read module is just the text of described structure
Part and its directory path at place are sent to gateway, and the NFS submodules in the protocol translation module of gateway are just the institute received
The file for the structure stated and its directory path at place be converted into the UNIX operating system platform mutually compatible file and its
The directory path at place, then again using the IP address of the client terminal of the operating system platform based on UNIX as destination
Location, the file after conversion and its directory path at place are sent to the client terminal of the operating system platform based on UNIX
In, the client terminal of the operating system platform based on UNIX, which is just stored in the file of the described structure received, to be received
Directory path in.
The present invention also has the following advantages that：
1. high scalability：Support extending transversely, memory node at most can be extended to more than 500；
2. availability：User can customize the copy amount of file in storage；
3. high concurrent：Support multi-client to access one or more files simultaneously, can at most support 1000 clients；
4. highly compatible：It can support NFS, CIFS (SAMBA), FTP, HTTP and primary agreement simultaneously, and completely and POSIX
Standard is compatible, and user need not change any application and can be used；
5. vast capacity：Maximum extendible capacity is to more than 20PB；
6. big bandwidth：Using InfiniBand technologies, single memory node maximum can support more than 20Gb/s aggregate bandwidths；
7. superelevation reuses：All x86 IA frame serverPCs are supported, make full use of the original hardware resource of client.
The above described is only a preferred embodiment of the present invention, any formal limitation not is made to the present invention, though
So the present invention is disclosed above with preferred embodiment, but is not limited to the present invention, any to be familiar with this professional technology people
Member, without departing from the scope of the present invention, when the technology contents using the disclosure above make a little change or modification
For the equivalent embodiment of equivalent variations, as long as be without departing from technical solution of the present invention content, according to the technical spirit of the present invention,
Within the spirit and principles in the present invention, any simple modification, equivalent substitution and improvement for being made to above example etc., still
Belong within the protection domain of technical solution of the present invention.
Claims (1)
- A kind of 1. read method of distributed type high speed cloud storage service device group system, it is characterised in that：A kind of described distribution Formula high-velocity cloud storage server group system includes what storage server of the two or more based on linux operating system platforms was formed Cloud storage service device cluster, described storage server are based on by InfiniBand_RDMA network connections to more than one The client terminal of linux operating system platforms, in addition described storage server also pass through InfiniBand_RDMA networks and band There is the gateway of protocol translation module with the operating system platform based on Windows, the operating system platform based on UNIX or base It is connected in the client terminal of MaCOS operating system, backstage read module is set in described storage server, is based on Foreground read module is set in the client terminal of linux operating system platforms, and described protocol translation module includes CIFS Submodule or NFS submodules；A kind of read method of described distributed type high speed cloud storage service device group system comprises the following steps that：Step 1：The foreground read module of client terminal each based on linux operating system platforms first sends request communication connection Packet is sent to all storage servers based on linux operating system platforms, base by InfiniBand_RDMA networks After the storage server of linux operating system platforms receives request communication connection packet, backstage read module passes through InfiniBand_RDMA networks ask the client terminal based on linux operating system platforms of communication connection packet to sending Transmission includes the response communication connection data of the IP address information of the storage server based on linux operating system platforms Bag, and communication connection is established with the client terminal based on linux operating system platforms for sending request communication connection packet, should The foreground read module of client terminal based on linux operating system platforms communicates to connect response in packet and is based on linux The IP address information of the storage server of operating system platform is preserved；Step 2：Storage server based on linux operating system platforms is after a catalogue is established, then including mesh The information packet of record path and directory name information is sent to be communicated with being somebody's turn to do the storage server based on linux operating system platforms Believe the client terminal and gateway based on linux operating system platforms of connection, the client terminal based on linux operating system platforms Foreground read module according to the directory path in the packet received and directory name based on linux operating system platforms Construct the catalogue of the same directory name under same directory path on client terminal, and the CIFS in the protocol translation module of gateway Submodule or NFS submodules are converted into the directory path in the packet received and directory name same Windows operation The directory path and directory name of system platform, UNIX operating system platform or the operating system phase compatibility based on MaCOS, so Afterwards the same Windows operating system platform after conversion, UNIX operating system platform or operating system based on MaCOS Mutually compatible directory path and directory name are separately sent to the operating system platform based on Windows, the operation system based on UNIX In the client terminal for platform or the operating system based on MaCOS of uniting, so the operating system platform based on Windows, be based on The client terminal of UNIX operating system platform or operating system based on MaCOS is according to the directory path and catalogue received Name is respectively in the operating system platform based on Windows, the operating system platform based on UNIX or the operation system based on MaCOS The catalogue of the same directory name under same directory path is constructed on the client terminal of system；Step 3：Then after the storage server based on linux operating system platforms constructs file under the catalogue of foundation, Just the integer value that the address of the filename of the file of structure forces to be converted into 4 bytes is stored in the one 4 byte memory block, Then the length value of the filename of the file of structure is stored in the 2nd 4 byte memory block, and the file of the file structure Quotient after the length value divided by 4 of name is stored in the 3rd 4 byte memory block, and the length value of the filename of the file of structure is removed It is stored in the quotient after 16 in the 4th 4 byte memory block, it is described thus into circulation second circulation body in first circulation body Second circulation body be the circulation loop body of four times, the n-th circulation of second circulation body is performs the storage of the one 4 byte successively The address in area is stored in the 5th 4 byte memory block, the value in the 5th 4 byte memory block is stored in includes four 4 bytes Add one in n-th of 4 byte memory blocks in the array of memory block, the value of the one 4 byte memory block, the 3rd 4 byte is stored The value in area subtracts one and the value of the 2nd 4 byte memory block is subtracted 4, wherein n span be 1 to 4 integer, described first After each circulation of loop body is first carries out second circulation body, into the 3rd loop body, the circulation time of the 3rd described loop body Number is 100 times, each circulation of the 3rd loop body for successively the value of the 6th 4 byte memory block that initial value is 0 plus 100, Initial value is that the value of 1412307604 the 7th 4 byte memory block is deposited as after lt 4 plus described four 4 bytes that include Obtained by the value of the 1st 4 byte memory blocks in the array of storage area and value adds the 6th 4 with the value of the 7th 4 byte memory block The value of gained is the same as the 7th 4 byte memory block after obtained by the value of byte memory block and value progress XOR, progress XOR Value move to right after five add the described array for including four 4 byte memory blocks in the 2nd 4 byte memory blocks value institute Carried out again with value after XOR obtained by value be added with value of the initial value for 2489623685 the 8th 4 byte memory block, The value for the 8th 4 byte memory block that initial value is 2489623685 is included four 4 bytes by after lt 4 plus described Obtained by the value of the 3rd 4 byte memory blocks in the array of memory block and value adds the 6th with the value of the 8th 4 byte memory block The value of gained is the same as the 8th 4 byte memory block after obtained by the value of 4 byte memory blocks and value progress XOR, progress XOR Value move to right after five add the described array for including four 4 byte memory blocks in the 4th 4 byte memory blocks value institute Carried out again with value after XOR obtained by value be added with value of the initial value for 1412307604 the 7th 4 byte memory block, So after the 3rd loop body terminates, the value in the 9th 4 byte memory block for being 1412307604 initial value adds the 7th 4 byte The value in the 10th byte memory block that the value of memory block is 2489623685 initial value adds the value of the 8th 4 byte memory block, This completes the one cycle of first circulation body；Step 4：After first circulation body circulation terminates, the value in the 9th 4 byte memory block with the 10th byte memory block The index value of 4 bytes of the file of described structure is obtained after value progress XOR, and should be put down based on linux operating systems The backstage read module of the storage server of platform is intactly randomly assigned to the positive integer scope that 4 bytes can be expressed described Client terminal based on linux operating system platforms, the operating system platform based on Windows, the operating system based on UNIX The client terminal of platform or operating system based on MaCOS；Step 5：Then should storage server based on linux operating system platforms backstage read module will be resulting described in Structure file 4 bytes index value one by one with being randomly assigned to the described client based on linux operating system platforms Terminal, the operating system platform based on Windows, the operating system platform based on UNIX or the operating system based on MaCOS The positive integer scope of client terminal compare, if one of them client terminal based on linux operating system platforms with The positive integer scope of machine distribution contains the index value of 4 bytes of the file of described structure, then backstage read module just The IP address of the client terminal based on linux operating system platforms passes through InfiniBand_RDMA nets as destination address The file of described structure and its directory path at place are sent to client's end based on linux operating system platforms by network End, the foreground read module of the client terminal based on linux operating system platforms is somebody's turn to do just the text of the described structure received Part is stored in the directory path received；Step 6：If the positive integer model being randomly assigned of the client terminal of one of them operating system platform based on Windows Enclose the index value of 4 bytes of the file for containing described structure, then backstage read module is just the file of described structure And its directory path at place is sent to gateway, CIFS submodules in the protocol translation module of gateway are just described in receiving The file of structure and its directory path at place be converted into the Windows operating system platform mutually compatible file and its The directory path at place, then again using the IP address of the client terminal of the operating system platform based on Windows as purpose Address, the file after conversion and its directory path at place are sent to the client of the operating system platform based on Windows In terminal, the client terminal for being somebody's turn to do the operating system platform based on Windows just deposits the file of the described structure received Into the directory path received；Step 7：If the positive integer scope being randomly assigned of the client terminal of one of them operating system platform based on MaCOS Contain the index value of 4 bytes of the file of described structure, then backstage read module just the file of described structure and Directory path where it is sent to gateway, and the CIFS submodules in the protocol translation module of gateway are just described what is received The file of structure and its directory path at place are converted into the compatible file of the operating system platform phase of the MaCOS and its place Directory path, then again using the IP address of the client terminal of the operating system platform based on MaCOS as destination address, The directory path of file and its place after conversion is sent in the client terminal of the operating system platform based on MaCOS, should The client terminal of operating system platform based on MaCOS is just stored in the file of the described structure received in the mesh received Record in path；Step 8：If the positive integer scope being randomly assigned of the client terminal of one of them operating system platform based on UNIX Contain the index value of 4 bytes of the file of described structure, then backstage read module just the file of described structure and Directory path where it is sent to gateway, and the NFS submodules in the protocol translation module of gateway are just described what is received The file of structure and its directory path at place are converted into the compatible file of the operating system platform phase of the UNIX and its place Directory path, then again using the IP address of the client terminal of the operating system platform based on UNIX as destination address, The directory path of file and its place after conversion is sent in the client terminal of the operating system platform based on UNIX, the base Just the file of the described structure received is stored in the client terminal of UNIX operating system platform the catalogue received In path.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410332549.0A CN104092758B (en) | 2014-07-14 | 2014-07-14 | A kind of read method of distributed type high speed cloud storage service device group system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410332549.0A CN104092758B (en) | 2014-07-14 | 2014-07-14 | A kind of read method of distributed type high speed cloud storage service device group system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104092758A CN104092758A (en) | 2014-10-08 |
| CN104092758B true CN104092758B (en) | 2018-01-12 |
Family
ID=51640438
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410332549.0A Active CN104092758B (en) | 2014-07-14 | 2014-07-14 | A kind of read method of distributed type high speed cloud storage service device group system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104092758B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105900068B (en) * | 2014-11-24 | 2019-01-15 | 华为技术有限公司 | The systems, devices and methods of path management |
| CN105407044B (en) * | 2015-12-11 | 2019-03-01 | 西安交通大学 | A kind of implementation method of the cloud storage gateway system based on NFS |
| CN105549912A (en) * | 2015-12-21 | 2016-05-04 | 浪潮电子信息产业股份有限公司 | Storage method of server cluster capable of simultaneously containing various types of operating systems |
| CN106302660A (en) * | 2016-08-01 | 2017-01-04 | 成都鼎智汇科技有限公司 | Medicine information distributed storage method |
| CN106302757A (en) * | 2016-08-19 | 2017-01-04 | 成都全码特时代科技有限公司 | A kind of server cluster system based on cloud storage |
| CN107124714B (en) * | 2017-04-13 | 2021-02-23 | 北京珠穆朗玛移动通信有限公司 | Data transmission method and data transmission terminal |
| CN109343801B (en) * | 2018-10-23 | 2021-11-09 | 深圳前海微众银行股份有限公司 | Data storage method, device and computer readable storage medium |
| CN109377778B (en) * | 2018-11-15 | 2021-04-06 | 浪潮集团有限公司 | Collaborative automatic driving system and method based on multipath RDMA and V2X |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102833237A (en) * | 2012-08-14 | 2012-12-19 | 南京斯坦德通信股份有限公司 | InfiniBand protocol conversion method and system based on bridging |
| CN102882864A (en) * | 2012-09-21 | 2013-01-16 | 南京斯坦德通信股份有限公司 | Virtualization system based on InfiniBand cloud computing network |
| CN202798790U (en) * | 2012-09-21 | 2013-03-13 | 南京斯坦德通信股份有限公司 | Virtual system based on InfiniBand cloud computing network |
| CN103873559A (en) * | 2014-02-13 | 2014-06-18 | 南京斯坦德通信股份有限公司 | Database all-in-one machine capable of realizing high-speed storage |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8856460B2 (en) * | 2010-09-15 | 2014-10-07 | Oracle International Corporation | System and method for zero buffer copying in a middleware environment |
-
2014
- 2014-07-14 CN CN201410332549.0A patent/CN104092758B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102833237A (en) * | 2012-08-14 | 2012-12-19 | 南京斯坦德通信股份有限公司 | InfiniBand protocol conversion method and system based on bridging |
| CN102882864A (en) * | 2012-09-21 | 2013-01-16 | 南京斯坦德通信股份有限公司 | Virtualization system based on InfiniBand cloud computing network |
| CN202798790U (en) * | 2012-09-21 | 2013-03-13 | 南京斯坦德通信股份有限公司 | Virtual system based on InfiniBand cloud computing network |
| CN103873559A (en) * | 2014-02-13 | 2014-06-18 | 南京斯坦德通信股份有限公司 | Database all-in-one machine capable of realizing high-speed storage |
Non-Patent Citations (1)
| Title |
|---|
| 基于InfiniBand协议的云存储关键技术研究;杨东日等;《高技术通讯》;20140131;第24卷(第1期);正文第2节 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104092758A (en) | 2014-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104092758B (en) | A kind of read method of distributed type high speed cloud storage service device group system | |
| US9330156B2 (en) | System and method for software defined network aware data replication | |
| CN101873358B (en) | Method and device for balancing link load on basis of domain name resolution | |
| CN106484322A (en) | A kind of method of carry file system, device and equipment | |
| EP3449617A1 (en) | Network slinghop via tapestry slingshot | |
| CN103297447B (en) | A kind of resource share method and its equipment | |
| CN108733821A (en) | A kind of distribution of monitor video sectional drawing and methods of exhibiting and system | |
| CN104219298B (en) | Group system and its method for data backup | |
| CN109194502A (en) | The management method of multi-tenant container cloud computing system | |
| CN106878457B (en) | The attached storage method of distributed network and system | |
| CN103731487A (en) | Download method, device, system and router for resource file | |
| CN106506701A (en) | A kind of server load balancing method and load equalizer | |
| CN103117947A (en) | Load sharing method and device | |
| TW201405324A (en) | Cloud storage system and data storage and sharing method based on the system | |
| US9300758B2 (en) | Efficient name management for named data networking in datacenter networks | |
| CN103078944A (en) | Distributed symmetrical file system-based data center architecture | |
| CN105656964B (en) | The implementation method and device of data-pushing | |
| CN104320488A (en) | Proxy server system and proxy service method | |
| Aazam et al. | Towards media inter-cloud standardization–evaluating impact of cloud storage heterogeneity | |
| CN109962961A (en) | A kind of reorientation method and system of content distribution network CDN service node | |
| CN104092759B (en) | A kind of distributed cloud storage service device group system and storage method | |
| CN108418871A (en) | A kind of cloud storage performance optimization method and system | |
| CN106790689A (en) | Nodes recommendations method based on peer-to-peer network, server and client side | |
| Islam et al. | Achieving robust global bandwidth along with bypassing geo-restriction for internet users | |
| CN103685367A (en) | Offline download system and offline download method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |