CN109587185A - Object processing method in cloud storage system and cloud storage system - Google Patents
Object processing method in cloud storage system and cloud storage system Download PDFInfo
- Publication number
- CN109587185A CN109587185A CN201710896038.5A CN201710896038A CN109587185A CN 109587185 A CN109587185 A CN 109587185A CN 201710896038 A CN201710896038 A CN 201710896038A CN 109587185 A CN109587185 A CN 109587185A
- Authority
- CN
- China
- Prior art keywords
- server
- information
- sent
- barrel
- ktcpvs
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/543—User-generated data transfer, e.g. clipboards, dynamic data exchange [DDE], object linking and embedding [OLE]
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This application provides the object processing methods in a kind of cloud storage system and the cloud storage system.The object processing method includes: that first server receives the first write command that client is sent, and the first object is written in first barrel for requesting for the first write command;First server the first object is written in first barrel of the first memory node set according to the first write command, and the first object is sent to second server;Second server receives the second write command that client is sent, and the second object is written in first barrel for requesting for the second write command;Second server the second object is written in first barrel of the second memory node set according to the second write command, and sends the second object to first server.Object processing method in cloud storage system provided by the present application and the cloud storage system helps to save resource.
Description
Technical field
This application involves cloud storage fields, and more particularly, to the object in cloud storage system and cloud storage system
Processing method.
Background technique
In public cloud field of storage, storage can be provided the user with using active and standby (active-passive, AP) mode
Service.
In existing ap mode, a region is divided into two and provides the region (access zone, AZ) of service, and one is known as
Main AZ, another is known as standby AZ.It is deployed with cluster (cluster) in main AZ, is also deployed with cluster in standby AZ.Cluster in main AZ
A cluster group (cluster group, CG) is formed with the cluster in standby AZ.The duplication direction of object (object) is from main AZ
In cluster copy to the cluster in standby AZ.The request of object is written all by the cluster in main AZ in user in the region
Reason.
Specifically, when client will write cluster that object requests are sent in main AZ, this is right for cluster-based storage in main AZ
As, and the cluster into standby AZ replicates the object;It is standby when client just likes that writes the cluster that object requests are sent in standby AZ
Cluster in AZ needs that object is first sent to the cluster in main AZ, the collection after the cluster-based storage object in main AZ, in main AZ
Object is copied to the cluster in standby AZ by group again.
This processing method in existing ap mode, it is big to will lead to data forwarding amount, consumes more resource.
Summary of the invention
This application provides the object processing method in a kind of cloud storage system and the cloud storage system, help to save money
Source.
In a first aspect, this application provides the object processing methods in a kind of cloud storage system.Include in cloud storage system
First server, the first memory node set, second server and the second memory node set, first server and the first storage
Node set is located in the first service region of cloud storage system, and second server and the second memory node are located at cloud storage system
Second service region in, in the first memory node set and the second memory node set include first barrel.
The object processing method includes:
First server receives the first write command that client is sent, and the first object is written for requesting for the first write command
In first barrel;
First server the first object is written in first barrel of the first memory node set according to the first write command, and
First object is sent to second server, in order to which the first object is written the of the second memory node set by second server
In one barrel;
Second server receives the second write command that client is sent, and the second object is written for requesting for the second write command
In first barrel;
Second server the second object is written in first barrel of the second memory node set according to the second write command, and
The second object is sent to first server, in order to which the second object is written the first of the first memory node set by first server
In bucket.
In the object processing method, first server and second server are received when requesting to write the write command of object,
It oneself can store, and replicate object to other side.Compared in the prior art, reduce the forwarding process of object, so as to
Save resource.
With reference to first aspect, in the first possible implementation, cloud storage system further includes the first KTCPVS.
In this case, first server receives the first write command that client is sent, comprising:
First KTCPVS receives the first write command that client is sent, and is determined according to the first write command and sends out the first write command
First server is given, and sends the first write command to first server;
First server receives the first write command that the first KTCPVS is sent.
Second server receives the second write command that client is sent, comprising:
First KTCPVS receives the second write command that client is sent, and is determined according to the second write command and sends out the second write command
Second server is given, and sends the second write command to second server;
Second server receives second write command that the first KTCPVS is sent.
In conjunction with the first possible implementation, in the second possible implementation, object processing method further include:
First KTCPVS receives the first reading instruction that client is sent, and the first reading instruction is read in first barrel for requesting
First object determines to first server according to the first reading instruction and sends the first reading instruction, and sends first to first server
Reading instruction;
First server receives the first reading instruction that the first KTCPVS is sent, and reads the first storage according to the first reading instruction
The first object in first barrel of node set;
First KTCPVS receives the second reading instruction that client is sent, and the second reading instruction is read in first barrel for requesting
Second object determines to second server according to the second reading instruction and sends the second reading instruction, and sends second to second server
Reading instruction;
Second server receives the second reading instruction that the first KTCPVS is sent, and reads the second storage according to the second reading instruction
The second object in first barrel of node set.
In the implementation, the first write command is sent to first server by the first KTCPVS, by first server conduct
After primary server stores the first object, and the first reading instruction is sent to first server, is stored by first server from first
The first object is read in node set, so as to keep the strong consistency of the first object.
Similarly, the strong consistency of the second object can be kept.
In conjunction with second of possible implementation, in the third possible implementation, have first on the first KTCPVS
Information, the first information include: first barrel and are corresponding in turn to first server and second server.
In this case, the first KTCPVS is determined according to the first write command is sent to first server for the first write command,
Include: the first KTCPVS according to the first write command, calculates Kazakhstan of first object relative to number of servers corresponding to first barrel
Uncommon value, obtains the first cryptographic Hash;According to the first information with the first cryptographic Hash, determine to first barrel of first corresponding first service
Device sends the first write command.
First KTCPVS is determined according to the second write command is sent to second server for the second write command, comprising: first
KTCPVS calculates cryptographic Hash of second object relative to number of servers corresponding to first barrel, obtains according to the second write command
Second cryptographic Hash;According to the first information with the second cryptographic Hash, determines to first barrel second corresponding second server and send the
Two write commands.
First KTCPVS is determined according to the first reading instruction is sent to first server for the first reading instruction, comprising: first
KTCPVS calculates cryptographic Hash of first object relative to number of servers corresponding to first barrel, obtains according to the first reading instruction
First Hash meeting;According to the first information with the first cryptographic Hash, determines to first barrel first corresponding first server and send the
One reading instruction.
First KTCPVS is determined according to the second reading instruction is sent to second server for the second reading instruction, comprising: first
KTCPVS calculates cryptographic Hash of second object relative to number of servers corresponding to first barrel, obtains according to the second reading instruction
Second cryptographic Hash;According to the first information with the second cryptographic Hash, determines to first barrel second corresponding second server and send the
Two reading instructions.
In conjunction with the third possible implementation, in the fourth possible implementation, the first information includes the first son
Information, the second sub-information and third sub-information, the first sub-information are as follows: first barrel successively includes the first sub- bucket and the second sub- bucket, and the
Two sub-informations are as follows: the corresponding primary server of the first sub- bucket is first server, third sub-information are as follows: the corresponding main clothes of the second sub- bucket
Business device is second server.
In this case, the first KTCPVS is determined according to the first information with the first cryptographic Hash to first barrel of first correspondence
First server send the first write command, comprising: the first KTCPVS is determined the according to the first sub-information and the first cryptographic Hash
An object is written in first barrel first corresponding first sub- bucket;According to the second sub-information and the first sub- bucket, determine to the first clothes
Business device sends the first write command.
First KTCPVS with the second cryptographic Hash, is determined to first barrel of second corresponding second server according to the first information
Send the second write command, comprising: the first KTCPVS is determined the second object write-in the according to the first sub-information and the second cryptographic Hash
In one barrel second corresponding second sub- bucket;According to third sub-information and the second sub- bucket, determines to second server and send second
Write command.
First KTCPVS with the first cryptographic Hash, is determined to first barrel of first corresponding first server according to the first information
Send the first reading instruction, comprising: the first KTCPVS is determined according to the first sub-information and the first cryptographic Hash and read first barrel first
The first object in corresponding first sub- bucket;According to the second sub-information and the first sub- bucket, determines to first server and send first
Reading instruction.
First KTCPVS with the second cryptographic Hash, is determined to first barrel of second corresponding second server according to the first information
Send the second reading instruction, comprising: the first KTCPVS is determined according to the first sub-information and the second cryptographic Hash and read first barrel second
The second object in corresponding second sub- bucket;According to third sub-information and the second sub- bucket, determines to second server and send second
Reading instruction.
In conjunction with the third or the 4th kind of possible implementation, in a fifth possible implementation, cloud storage system
Further include location server, is configured with the first information on location server.
In this case, object processing method further include: the first KTCPVS obtains the first information from location server.
It is also configured on location server in a sixth possible implementation in conjunction with the 5th kind of possible implementation
There is the second information, the second information includes stating first barrel of corresponding KTCPVS as the first KTCPVS, and cloud storage system further includes domain
Name system equipment.
In this case, the first KTCPVS receives the first write command that client is sent, comprising:
Domain name system equipment receives the first uniform resource locator that client is sent, and wraps in the first uniform resource locator
Include the first write command;First barrel of information is sent to location server according to the first uniform resource locator;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter
It ceases to domain name system and sends the first instruction information, the first information is used to indicate the first KTCPVS;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first
Send the first write command;
First KTCPVS receives the first write command that client is sent according to the first instruction information.
First KTCPVS receives the second write command that client is sent, comprising:
Domain name system equipment receives the second uniform resource locator that client is sent, and wraps in the second uniform resource locator
Include the second write command;First barrel of information is sent to location server according to the second uniform resource locator;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter
It ceases to domain name system and sends the first instruction information;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first
Send the second write command;
First KTCPVS receives the second write command that client is sent according to the first instruction information.
First KTCPVS receives the first reading instruction that client is sent, comprising:
Domain name system equipment receives the third uniform resource locator that client is sent, and wraps in third uniform resource locator
Include the first reading instruction;First barrel of information is sent to location server according to third uniform resource locator;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter
It ceases to domain name system and sends the first instruction information;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first
Send the first reading instruction;
First KTCPVS receives the first reading instruction that client is sent according to the first instruction information.
First KTCPVS receives the second reading instruction that client is sent, comprising:
Domain name system equipment receives the 4th uniform resource locator that client is sent, and wraps in the 4th uniform resource locator
Include the second reading instruction;First barrel of information is sent to location server according to the 4th uniform resource locator;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter
It ceases to domain name system and sends the first instruction information;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first
Send second reading instruction;
First KTCPVS receives the second reading instruction that client is sent according to the first instruction information.
In the implementation, client can be corresponding from first barrel of location server acquisition by domain name system equipment
The instruction information of KTCPVS, so that the cloud storage system can arrange multiple KTCPVS, so as to balanced KTCPVS's
Load pressure.
Second aspect includes for realizing first party in the cloud storage system this application provides a kind of cloud storage system
The first server of object processing method in the possible implementation of any one in face or first aspect, the first memory node
Set, second server, the second memory node set, the first KTCPVS, location server and domain name system equipment.
The third aspect, this application provides a kind of computer program products comprising instruction.When the computer program product
When being run in cloud storage system, so that cloud storage system executes any one possible realization in first aspect or first aspect
Object processing method in mode.
Fourth aspect, this application provides a kind of computer readable storage mediums.It is deposited in the computer readable storage medium
The program code that storage is executed for cloud storage system.The program code includes any in first aspect or first aspect for executing
A kind of instruction of object processing method in possible implementation.
Detailed description of the invention
Fig. 1 is the schematic architectural diagram of the application scenarios of the application one embodiment;
Fig. 2 is the schematic flow chart of the object processing method 200 of the application one embodiment;
Fig. 3 is the detailed maps of the S210 and S230 in object processing method 200;
Fig. 4 is the schematic architectural diagram of the application scenarios of the application another embodiment;
Fig. 5 is the schematic flow chart that can also include the steps that in object processing method 200;
Fig. 6 is the schematic architectural diagram of the application scenarios of the application another embodiment;
Fig. 7 is the schematic architectural diagram of the application scenarios of the application another embodiment;
Fig. 8 is the schematic flow chart of the application scenarios of the application another embodiment;
Fig. 9 is the schematic flow chart of the cloud storage system of the application another embodiment.
Specific embodiment
Below in conjunction with attached drawing, the technical solution in the application is described.
Fig. 1 is the schematic diagram of the cloud storage system of the application one embodiment.It should be understood that the embodiment of the present application
It can also include more or less device in cloud storage system.In addition, the device in Fig. 1 can be hardware, it is also possible to
The software that functionally divides or more than both combination.
Cloud storage system shown in FIG. 1 includes the first cluster and the second cluster.First cluster can be referred to as cluster 1, the
Two clusters can be referred to as cluster 2.
It include physical server and N number of memory node in cluster 1.Memory node can be located in physical server, can also
To be communicated independently of physical server and with physical server.Physical server runs virtual machine, such as Linux virtual server
(linux virtual server, LVS).Wherein, N number of memory node include node 1 to node N, N be the integer not less than 2.
First server can be in communication with each other with N number of memory node.
It include physical server and M memory node in cluster 2.Memory node can be located in physical server, can also
To be communicated independently of physical server and with physical server.Physical server runs virtual machine, such as second server.Its
In, M is positive integer, and M memory node includes node 1 to node M, and M is the integer not less than 2.Second server can be with M
Memory node is in communication with each other.
Memory node in the embodiment of the present application can be hard disk, such as mechanical hard disk, solid state hard disk etc., or external
Equipment is stored, such as storage array, Direct Attached Storage (direct access storage, DAS) etc., the embodiment of the present application pair
This is not construed as limiting.
It should be understood that the LVS in the embodiment of the present application is a kind of example, it is also possible to other types virtual server.
Physical server in cluster 1 is properly termed as first server, and the physical server in cluster 2 is properly termed as second
Server, N number of memory node in cluster 1 are properly termed as the first memory node set, and M memory node in cluster 2 can be with
Referred to as the second memory node set,
It can be in communication with each other between first server and second server.First server and second server and client
Between can communicate.It should be understood that described herein be in communication with each other both includes direct communication, it also include passing through other equipment or device
Communication.
The region of cloud storage system service shown in FIG. 1 is known as region (region) 1.Region 1 is divided into AZ1 and AZ2.Collection
Group 1 is located in AZ1, and cluster 2 is located in AZ2.
Cluster 1 and cluster 2 may be constructed two cluster groups, and one is properly termed as the first cluster group, referred to as CG1;It is another
It is a to be properly termed as the second cluster group, referred to as CG2.
In first cluster group, the replication relation of object is from the first cluster to the second cluster.In second cluster group, object
Replication relation is from the second cluster to the first cluster.
The replication relation of object refers to from the first cluster to the second cluster, the first clothes when object is written, in the first cluster
Business device stores object into the first memory node set of the first cluster, and object is sent to the second clothes in the second cluster
Business device, in order to which second server stores object in the second memory node set into the second cluster;When reading object, by
The first server of first cluster reading object from the first memory node set of the first cluster.That is, belonging to the first cluster
AZ1 is main AZ, and AZ2 belonging to the second cluster is standby AZ.
The replication relation of object refers to from the second cluster to the first cluster, the second clothes when object is written, in the second cluster
Business device stores object in the second memory node set into the second cluster, and object is sent to first in the first cluster
Server, in order to which first server stores object in the first memory node set into the first cluster;When reading object,
By the second server of the second cluster from the second memory node set of the second cluster reading object.That is, belonging to the second cluster
AZ2 be main AZ, AZ1 belonging to the first cluster is standby AZ.
One schematic flow chart of the object processing method 200 in cloud storage system shown in FIG. 1 as shown in Fig. 2,
It should be understood that the step of Fig. 2 shows object processing method 200 or operation, but these steps or operation are only examples,
The deformation of other operations or each operation in Fig. 2 can also be performed in the embodiment of the present application.In addition, each step in Fig. 2
It can be executed according to the different sequences presented from Fig. 2, and it is possible to not really want to execute all operationss in Fig. 2.
Object processing method 200 may include to include S210, S220, S230 and S240.
S210, first server receive the first write command that client is sent, and the first write command is for requesting first pair
As in first barrel of write-in.
The step can be accomplished in several ways, and possible implementation will be described in detail in subsequent content.
S220, first server are written first barrel of the first memory node set according to the first write command, by the first object
In, and the first object is sent to second server, in order to which the second memory node collection is written in the first object by second server
In first barrel closed.
Further, after second server receives the first object that first server is sent, the first object can be stored
Into first barrel of the second memory node set.
S230, second server receive the second write command that client is sent, and the second write command is for requesting second pair
As in first barrel of write-in.
The step can be accomplished in several ways, and possible implementation will be described in detail in subsequent content.
Second object and the first object are different objects.For example, the title of the title of the first object and the second object
It is different.
S240, second server are written first barrel of the second memory node set according to the second write command, by the second object
In, and the second object is sent to first server, in order to which the first memory node set is written in the second object by first server
First barrel in.
Further, after first server receives the second object, the second object is stored to the first memory node set
In first barrel.
In the object processing method, first server and second server are received when requesting to write the write command of object,
It oneself can store, and replicate object to other side.Compared in the prior art, reduce the forwarding process of object, so as to
Save resource.
In addition, after first server and second server receive write command, can direct storage object, can to work as
Any one cluster in first server and second server cannot provide service, and when not carrying out the operation such as active-standby switch,
Another server still can provide service, influence so as to reduce.
From the perspective of from another angle, first server stores the first object and replicates the first object to second server, quite
In the cluster that first server and the first memory node collection are combined into be main cluster, second server and the second memory node set
The cluster of composition is standby cluster;Second server stores the second object and simultaneously replicates the second object to first server, is equivalent to the
The cluster that two servers and the second memory node collection are combined into is main cluster, and first server and the first memory node collection are combined into
Cluster be standby cluster.
A kind of possible implementation of S210 and S220 is introduced below with reference to Fig. 3.In the case where using the implementation,
As shown in figure 4, further including kernel transmission control protocol virtual server (kernel in cloud storage system system
Transmission control protocol virtual server, KTCPVS).In order to which subsequent descriptions are convenient, by this
KTCPVS is known as the first LTCPVS.
As shown in figure 3, S210 may include S211 and S212, S230 may include S231 and S232.
S211, the first KTCPVS receive the first write command that client is sent, and are determined according to the first write command and are write first
Instruction is sent to first server, and sends the first write command to first server.
S212, first server receive the first write command that the first KTCPVS is sent.
That is, client sends the first write command to first server by the first KTCPVS.Correspondingly, the first clothes
Device reception client of being engaged in passes through the first write command that the first KTCPVS is sent.
S231, the first KTCPVS receive the second write command that client is sent, and are determined according to the second write command and are write second
Instruction is sent to second server, and sends the second write command to second server.
S232, second server receive second write command that the first KTCPVS is sent.
That is, second server, which receives client, passes through the second write command that the first KTCPVS is sent.Correspondingly,
Two servers receive client and pass through the second write command that the first KTCPVS is sent.
Optionally, object processing method 200 can also include Fig. 5 in shown in S250, S260, S270 and S280.
S250, the first KTCPVS receive the first reading instruction that client is sent, and the first reading instruction reads first for requesting
The first object in bucket determines to first server according to the first reading instruction and sends the first reading instruction, and sends out to first server
Send the first reading instruction.
S260, first server receives the first reading instruction that the first KTCPVS is sent, and reads the according to the first reading instruction
The first object in first barrel of one memory node set.
S270, the first KTCPVS receive the second reading instruction that client is sent, and the second reading instruction reads first for requesting
The second object in bucket determines to second server according to the second reading instruction and sends the second reading instruction, and sends out to second server
Send the second reading instruction.
S280, second server receives the second reading instruction that the first KTCPVS is sent, and reads the according to the second reading instruction
The second object in first barrel of two memory node set.
In S260 and S270, the first reading instruction is sent to first server by the first KTCPVS, so as to keep reading
The first object strong consistency.
In S260 and S270, the second reading instruction is sent to second server by the first KTCPVS, so as to keep reading
The second object strong consistency.
In object processing method 200, the first information can store on the first KTCPVS, the first information includes: first barrel
It is corresponding in turn to first server and second server.
First barrel is corresponding in turn to first server and second server refers to, first barrel of corresponding first server is the
One server, first barrel of corresponding second server are second server.
In this case, in S250, one kind that the first reading instruction is sent to first server is determined according to the first reading instruction
Possible implementation may include:
First KTCPVS calculates the first object relative to number of servers corresponding to first barrel according to the first write command
Cryptographic Hash obtains the first cryptographic Hash;
According to the first information with the first cryptographic Hash, determine that sending first to first barrel first corresponding first server writes
Instruction.
For example, after the title of the first object in the first KTCPVS the first write command of acquisition, it can be by the name of the first object
Claim numeralization.Due to first barrel of corresponding first server and second server the two servers, the first KTCPVS can be with
Obtained numerical value after the title numeralization of the first object is calculated relative to 2 cryptographic Hash.
For example, the numerical value obtained after the title numeralization of the first object is 143, then 143 pair of 2 modulus can be breathed out
Uncommon value 1.
Then the first KTCPVS, which can be determined to first barrel of corresponding first server (first server), sends first
Write command.
In S260, the first KTCPVS determines one kind that the second write command is sent to second server according to the second write command
Possible implementation may include:
First KTCPVS calculates the second object relative to number of servers corresponding to first barrel according to the second write command
Cryptographic Hash obtains the second cryptographic Hash;
According to the first information with the second cryptographic Hash, determine that sending second to first barrel second corresponding second server writes
Instruction.
For example, after the title of the second object in the first KTCPVS the second write command of acquisition, it can be by the name of the second object
Claim numeralization.Due to first barrel of corresponding first server and second server the two servers, the first KTCPVS can be with
Obtained numerical value after the title numeralization of the second object is calculated relative to 2 cryptographic Hash.
For example, the numerical value obtained after the title numeralization of the second object is 158, then 158 pair of 2 modulus can be breathed out
Uncommon value 2.
In S270, the first KTCPVS determines one kind that the first reading instruction is sent to first server according to the first reading instruction
Possible implementation may include:
First KTCPVS calculates the first object relative to number of servers corresponding to first barrel according to the first reading instruction
Cryptographic Hash obtains the first cryptographic Hash;
According to the first information with the first cryptographic Hash, determine that sending first to first barrel first corresponding first server reads
Instruction.
Specific embodiment is similar with the related content of the first write command of front, and for brief introduction, details are not described herein again.
In S280, the first KTCPVS determines one kind that the second reading instruction is sent to second server according to the second reading instruction
Possible implementation may include:
First KTCPVS calculates the second object relative to number of servers corresponding to first barrel according to the second reading instruction
Cryptographic Hash obtains the second cryptographic Hash;
According to the first information with the second cryptographic Hash, determine that sending second to first barrel second corresponding second server reads
Instruction.
Specific embodiment is similar with the related content of the first write command of front, and for brief introduction, details are not described herein again.
Optionally, the first information stored on the first KTCPVS may include the first sub-information, the second sub-information and third
Sub-information.
First sub-information are as follows: first barrel successively includes the first sub- bucket and the second sub- bucket;Second sub-information are as follows: the first sub- bucket is right
The primary server answered is first server;Third sub-information are as follows: the corresponding primary server of the second sub- bucket is second server.
Correspondingly, first barrel in the first memory node set includes the first sub- bucket and the second sub- bucket, the second memory node
First barrel in set also includes the first sub- bucket and the second sub- bucket.
The first information is it is to be understood that therefore first barrel is divided into the first sub- bucket and the second sub- bucket;First sub- bucket is corresponding
Object replication relation is from the first cluster to the second cluster, i.e. the first cluster and the second cluster form CG1;Second sub- bucket is corresponding
Replication relation is from the second cluster to the first cluster, i.e. the first cluster and the second cluster form CG2.
First barrel is indicated with bucket1, bucket1_1 indicates that the first sub- bucket, bucket1_2 indicate the second sub- bucket,
Cluster1 indicates that the first cluster, cluster2 indicate the second cluster, then the first information can indicate are as follows: bucket1
{ bucket1_1, bucket1_2 }, bucket1_1 { CG1:cluster1- > cluster2 }, bucket1_2 CG2:
cluster2->cluster1}。
In this case, in S250, one kind that the first write command is sent to first server is determined according to the first write command
Possible implementation may include:
First KTCPVS calculates Kazakhstan of first object relative to sub- barrelage amount corresponding to first barrel according to the first write command
Uncommon value, obtains the first cryptographic Hash;According to the first sub-information and the first cryptographic Hash, determines and the first object is written first barrel first
In corresponding first sub- bucket;According to the second sub-information and the first sub- bucket, determines to first server and send the first write command.
At this point, first server the first object is written in the first sub- bucket of the first memory node set.Second server
After receiving the first object that first server is sent, the first object is written in the first sub- bucket of the second memory node set.
In S260, the first KTCPVS determines one kind that the second write command is sent to second server according to the second write command
Possible implementation may include:
First KTCPVS calculates the second object relative to number of servers corresponding to first barrel according to the second write command
Cryptographic Hash obtains the second cryptographic Hash;First KTCPVS is determined and the second object is written according to the first sub-information and the second cryptographic Hash
In first barrel second corresponding second sub- bucket;According to third sub-information and the second sub- bucket, determines to second server and send the
Two write commands.
At this point, second server the second object is written in the second sub- bucket of the second memory node set.First server
After receiving the second object that second server is sent, the second object is written in the second sub- bucket of the first memory node set.
In S270, the first KTCPVS determines one kind that the first reading instruction is sent to first server according to the first reading instruction
Possible implementation may include:
First KTCPVS calculates the first object relative to number of servers corresponding to first barrel according to the first reading instruction
Cryptographic Hash obtains the first cryptographic Hash;According to the first sub-information and the first cryptographic Hash, determines and read first barrel first corresponding the
The first object in one sub- bucket;According to the second sub-information and the first sub- bucket, determines to first server and send the first reading instruction.
At this point, first server reads the first object in the first sub- bucket of the first memory node set.
In S280, the first KTCPVS determines one kind that the second reading instruction is sent to second server according to the second reading instruction
Possible implementation may include:
First KTCPVS calculates the second object relative to number of servers corresponding to first barrel according to the second reading instruction
Cryptographic Hash obtains the second cryptographic Hash;According to the first sub-information and the second cryptographic Hash, determines and read first barrel second corresponding the
The second object in two sub- buckets;According to third sub-information and the second sub- bucket, determines to second server and send the second reading instruction.
At this point, first server reads the first object in the first sub- bucket of the first memory node set.
Optionally, as shown in fig. 6, in cloud storage system can also include location server (location server,
LS).The first information is configured on location server.
In this case, the first information that stores on the first KTCPVS can be to be obtained from location server.
It in other words, may include: first before the first KTCPVS is using the first information in object processing method 200
KTCPVS obtains the first information from location server.
Optionally, as shown in fig. 7, cloud storage system can also include domain name system (domain name system, DNS)
Equipment.In this case, it can be configured with the second information on location server, the second information is corresponding including stating first barrel
KTCPVS is the first KTCPVS.
Correspondingly, the first KTCPVS receives the first write command that client is sent, and may include:
Domain name system equipment receives the first uniform resource locator (uniform resource that client is sent
Locator, URL), it include the first write command in the first uniform resource locator;According to the first uniform resource locator to position
Server sends first barrel of information;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter
It ceases to domain name system and sends the first instruction information, the first information is used to indicate the first KTCPVS;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first
Send the first write command;
First KTCPVS receives the first write command that client is sent according to the first instruction information.
First KTCPVS receives the second write command that client is sent, and may include:
Domain name system equipment receives the second uniform resource locator that client is sent, and wraps in the second uniform resource locator
Include the second write command;First barrel of information is sent to location server according to the second uniform resource locator;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter
It ceases to domain name system and sends the first instruction information;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first
Send the second write command
First KTCPVS receives the second write command that client is sent according to the first instruction information.
First KTCPVS receives the first reading instruction that client is sent, and may include:
Domain name system equipment receives the third uniform resource locator that client is sent, and wraps in third uniform resource locator
Include the first reading instruction;First barrel of information is sent to location server according to third uniform resource locator;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter
It ceases to domain name system and sends the first instruction information;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first
Send the first reading instruction
First KTCPVS receives the first reading instruction that client is sent according to the first instruction information.
First KTCPVS receives the second reading instruction that client is sent, and may include:
Domain name system equipment receives the 4th uniform resource locator that client is sent, and wraps in the 4th uniform resource locator
Include the second reading instruction;First barrel of information is sent to location server according to the 4th uniform resource locator;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter
It ceases to domain name system and sends the first instruction information;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first
Send second reading instruction;
First KTCPVS receives the second reading instruction that client is sent according to the first instruction information.
In the implementation, client can be corresponding from first barrel of location server acquisition by domain name system equipment
The instruction information of KTCPVS, so that the cloud storage system can arrange multiple KTCPVS, so as to balanced KTCPVS's
Load pressure.
In the cloud storage system of the embodiment of the present application, optionally, more clusters can be disposed in each AZ, these clusters
More cluster groups can be formed, the bucket in these clusters can be divided into more sub- buckets, this little bucket and these cluster groups
It is corresponding.
For example, cloud storage system as shown in Figure 8, wherein there are two clusters, respectively cluster 1 and cluster for deployment in AZ1
3;There are two clusters, respectively cluster 2 and cluster 4 for deployment in AZ2.
Include physical server and S memory node in cluster 3, includes physical server and T storage section in cluster 4
Point.S and T is positive integer.
Physical server in cluster 3 is properly termed as third physical server, and S memory node is properly termed as third storage
Node set;Physical server in cluster 4 is properly termed as the 4th physical server, and T memory node is properly termed as the 4th and deposits
Store up node set.
Bucket in cloud storage system can be divided into 4 sub- buckets, respectively sub- bucket 1, sub- bucket 2, sub- bucket 3 and sub- bucket 4.Cluster
1, cluster 2, cluster 3 and cluster 4 can be divided into 4 logical set groups, respectively cluster group 1, cluster group 2,3 sum aggregate of cluster group
Group 4.
It include cluster 1 and cluster 2 in cluster group 1, the replication relation of object is from cluster 1 to cluster 2;It is wrapped in cluster group 2
Cluster 2 and cluster 1 are included, the replication relation of object is from cluster 2 to cluster 1;It include cluster 3 and cluster 4, object in cluster group 3
Replication relation be from cluster 3 to cluster 4;It include cluster 4 and cluster 3 in cluster group 4, the replication relation of object is from cluster 4
To cluster 3.
Sub- bucket 1 maps to cluster group 1, and sub- bucket 2 maps to cluster group 2, and sub- bucket 3 maps to cluster group 3, and sub- bucket 4 maps to
Cluster group 4.
First barrel is indicated with bucket1, bucket1_1 indicates that the first sub- bucket, bucket1_2 indicate the second sub- bucket,
Bucket1_3 indicates that third bucket, bucket1_4 indicate that the 4th sub- bucket, cluster1 indicate that the first cluster, cluster2 indicate
Second cluster, cluster1 indicate that third cluster, cluster2 indicate that the 4th cluster, CG3 indicate cluster group 3, and CG4 indicates cluster
Group 4, then the first information can indicate are as follows:
Bucket1 { bucket1_1, bucket1_2, bucket1_3, bucket1_4 }, bucket1_1 CG1:
Cluster1- > cluster2 }, bucket1_2 { CG2:cluster2- > cluster1 }, bucket1_3 { CG3:cluster3-
> cluster4 }, bucket1_4 { CG4:cluster4- > cluster3 }.
If LS is that the target cluster group that object determines is cluster group 1, cluster 1 handles object, and processing is tied
Fruit copies to cluster 2;If LS is that the target cluster group that object determines is cluster group 2, cluster 2 handles object, and will
Processing result copies to cluster 1;If LS is that the target cluster group that object determines is cluster group 3,3 object of cluster is handled,
And processing result is copied into cluster 4;If LS is that the target cluster group that object determines is cluster group 4, cluster 4 carries out object
Processing, and processing result is copied into cluster 3.
It should be understood that the quantity of the quantity of above-mentioned sub- bucket, the quantity of cluster and cluster group is example, the embodiment of the present application
It can also include more clusters in cloud storage system, more clusters can divide more cluster groups, and bucket can also divide
For more sub- buckets.
Cluster in cloud storage system is more, and the cluster group that can be divided is also more, can be with the cluster of carry load
It is more.This can enable load pressures that can for greater flexibility on balanced each cluster.In addition, if there is cluster failure,
When service cannot be normally provided, impacted number of users can be reduced.
In the case where including more cluster groups in cloud storage system, the method read or write of object can be referring to figs. 1 to
Object processing method shown in Fig. 8, for sake of simplicity, details are not described herein again.
The schematic architectural diagram of the cloud storage system 900 of the application one embodiment is as shown in Figure 9.It should be understood that Fig. 9 is shown
Cloud storage system 900 be only example, the cloud storage system of the embodiment of the present application may also include other modules or unit, or packet
Intimate equipment with each equipment in Fig. 9 is included, or does not really want to include all devices in Fig. 9.
It is deposited in the cloud storage system 900 including first server, the first memory node set, second server and second
Node set is stored up, the first server and the first memory node set are located at the first service area of the cloud storage system
In domain, the second server and second memory node are located in the second service region of the cloud storage system, described
It include first barrel in first memory node set and the second memory node set.
Wherein, the first server is used for: receiving the first write command that client is sent, first write command is used for
Request will be in described first barrel of the first object write-in;According to the first write command, by first object write-in, first storage
In described first barrel of node set, and first object is sent to the second server, in order to second clothes
First object is written in described first barrel of the second memory node set business device.
The second server is used for: receiving the second write command that the client is sent, second write command is used for
Second object, according to second write command, is written described second in described first barrel of the second object write-in by request
In described first barrel of memory node set, and second object is sent to the first server, in order to described first
Second object is written in described first barrel of the first memory node set server.
Optionally, the cloud storage system 900 can also include the first KTCPVS.
First KTCPVS is used for: receiving first write command that the client is sent;It is write according to described first
Instruction, which is determined, is sent to the first server for first write command;Described first, which is sent, to the first server writes finger
It enables;Receive second write command that the client is sent;It is determined according to second write command by second write command
It is sent to the second server;Second write command is sent to the second server.
The first server is specifically used for: receiving the client and passes through the first KTCPVS is sent described first
Write command.
The second server is specifically used for: receiving the client and passes through the first KTCPVS is sent described second
Write command.
Optionally, the first KTCPVS is also used to: receiving the first reading instruction that the client is sent, described first reads
Instruction reads first object in described first barrel for requesting;It is determined according to first reading instruction and is taken described first
Business device sends first reading instruction;First reading instruction is sent to the first server;The client is received to send
The second reading instruction, second reading instruction is used to request reading second object in first barrel;It is read according to second
Instruction, which is determined to the second server, sends second reading instruction;Described second is sent to the second server to read to refer to
It enables.
The first server is also used to: receiving first reading instruction that the first KTCPVS is sent;According to described
First reading instruction reads first object in described first barrel of the first memory node set.
The second server is also used to: receiving second reading instruction that the first KTCPVS is sent;According to described
Second reading instruction reads second object in described first barrel of the second memory node set.
Optionally, have the first information on the first KTCPVS, the first information: described first barrel be corresponding in turn to it is described
First server and the second server.
First KTCPVS is specifically used for: according to first write command, calculating first object relative to described
The cryptographic Hash of first barrel of mapped number of servers obtains the first cryptographic Hash;According to the first information and the first cryptographic Hash,
It determines to the described first barrel first corresponding first server and sends first write command.
First KTCPVS is specifically used for: according to second write command, calculating second object relative to described
The cryptographic Hash of first barrel of mapped number of servers obtains the second cryptographic Hash;According to the first information and the second cryptographic Hash,
It determines to the described first barrel second corresponding second server and sends second write command.
First KTCPVS is specifically used for: according to first reading instruction, calculating first object relative to described
The cryptographic Hash of first barrel of mapped number of servers obtains the first cryptographic Hash;According to the first information and the first cryptographic Hash,
It determines to the described first barrel first corresponding first server and sends first reading instruction.
First KTCPVS is specifically used for: according to second reading instruction, calculating second object relative to described
The cryptographic Hash of first barrel of mapped number of servers obtains the second cryptographic Hash;According to the first information and the second cryptographic Hash,
It determines to the described first barrel second corresponding second server and sends second reading instruction.
Optionally, the first information includes the first sub-information, the second sub-information and third sub-information, the first son letter
Breath are as follows: described first barrel successively includes the first sub- bucket and the second sub- bucket, second sub-information are as follows: the first sub- bucket is corresponding
Primary server is the first server, the third sub-information are as follows: the corresponding primary server of the second sub- bucket is described the
Two servers.
First KTCPVS is specifically used for: according to first write command, calculating first object relative to described
The cryptographic Hash of first barrel of corresponding sub- barrelage amount, obtains the first cryptographic Hash;According to first sub-information and the first cryptographic Hash, really
Surely first object is written in the first barrel first corresponding first sub- bucket;According to second sub-information and
The first sub- bucket determines to the first server and sends first write command.
First KTCPVS is specifically used for: according to second write command, calculating second object relative to described
The cryptographic Hash of first barrel of corresponding sub- barrelage amount, obtains the second cryptographic Hash;It is true according to first sub-information and the second cryptographic Hash
Surely second object is written in the first barrel second corresponding second sub- bucket;According to the third sub-information and
The second sub- bucket determines to the second server and sends second write command.
First KTCPVS is specifically used for: according to first reading instruction, calculating first object relative to described
The cryptographic Hash of first barrel of corresponding sub- barrelage amount, obtains the first cryptographic Hash;According to first sub-information and the first cryptographic Hash, really
Surely first object in the described first barrel first corresponding first sub- bucket is read;According to second sub-information and
The first sub- bucket determines to the first server and sends first reading instruction.
First KTCPVS is specifically used for: according to second reading instruction, calculating second object relative to described
The cryptographic Hash of first barrel of corresponding sub- barrelage amount, obtains the second cryptographic Hash;It is true according to first sub-information and the second cryptographic Hash
Surely second object in the described first barrel second corresponding second sub- bucket is read;According to the third sub-information and
The second sub- bucket determines to the second server and sends second reading instruction.
Optionally, cloud storage system 900 can also include location server, configured with described the on the location server
One information.
Correspondingly, the first KTCPVS is also used to: obtaining the first information from the location server.
Optionally, 900 domain name system equipment of cloud storage system is correspondingly also configured with second on the location server
Information, second information include: that first barrel of corresponding KTCPVS is the first KTCPVS.
Domain name system equipment is used for: receive the first uniform resource locator that the client is sent, described first
It include first write command in uniform resource locator;According to first uniform resource locator to the location server
Send first barrel of the information;Receive the second uniform resource locator that the client is sent, second unified resource
It include second write command in finger URL;According to second uniform resource locator to described in location server transmission
First barrel of information;The third uniform resource locator that the client is sent is received, in the third uniform resource locator
Including first reading instruction;Described first barrel is sent to the location server according to the third uniform resource locator
Information;The 4th uniform resource locator that the client is sent is received, includes described in the 4th uniform resource locator
Second reading instruction;First barrel of the information is sent to the location server according to the 4th uniform resource locator.
The location server is used for: receiving first barrel of the information that domain name system equipment is sent;According to institute
It states the second information and first barrel of the information and sends the first instruction information to domain name system, the first information is for referring to
Show the first KTCPVS.
Domain name system is also used to: receiving the first instruction information that the location server is sent;To the visitor
Family end sends the first instruction information, in order to which the client is sent according to the first instruction information to the client
First write command, in order to which the client sends described the to the first KTCPVS according to the first instruction information
Two write commands are read to refer in order to which the client sends described first to the first KTCPVS according to the first instruction information
It enables, in order to which the client sends second reading instruction to the first KTCPVS according to the first instruction information.
Each equipment in cloud storage system shown in Fig. 9 can be used for executing object processing method 200 shown in Fig. 2,
Details are not described herein again.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician
Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed
Scope of the present application.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, it can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit
It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components
It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or
The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit
It closes or communicates to connect, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product
It is stored in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially in other words
The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, server or network equipment etc.) execute each embodiment the method for the application all or part of the steps.
And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, read-only memory (read-only memory, ROM), arbitrary access are deposited
The various media that can store program code such as reservoir (random access memory, RAM), magnetic or disk.
The above, the only specific embodiment of the application, but the protection scope of the application is not limited thereto, it is any
Those familiar with the art within the technical scope of the present application, can easily think of the change or the replacement, and should all contain
Lid is within the scope of protection of this application.Therefore, the protection scope of the application should be based on the protection scope of the described claims.
Claims (14)
1. the object processing method in a kind of cloud storage system, which is characterized in that include first service in the cloud storage system
Device, the first memory node set, second server and the second memory node set, the first server and first storage
Node set is located in the first service region of the cloud storage system, the second server and second memory node position
In in the second service region of the cloud storage system, in the first memory node set and the second memory node set
It include first barrel;
The object processing method includes:
The first server receives the first write command that client is sent, and first write command is for requesting the first object
It is written in described first barrel;
First object is written described in the first memory node set according to the first write command for the first server
In first barrel, and first object is sent to the second server, in order to which the second server is by described first
Object is written in described first barrel of the second memory node set;
The second server receives the second write command that the client is sent, and second write command is for requesting second
In described first barrel of object write-in;
The second memory node set is written according to second write command, by second object in the second server
In described first barrel, and second object is sent to the first server, in order to which the first server is by described the
Two objects are written in described first barrel of the first memory node set.
2. object processing method according to claim 1, which is characterized in that the cloud storage system further includes the first kernel
Transmission control protocol virtual server KTCPVS;
The first server receives the first write command that client is sent, comprising:
First KTCPVS receives first write command that the client is sent, and being determined according to first write command will
First write command is sent to the first server, and sends first write command to the first server;
The first server receives first write command that the first KTCPVS is sent;
The second server receives the second write command that the client is sent, comprising:
First KTCPVS receives second write command that the client is sent, and being determined according to second write command will
Second write command is sent to the second server, and sends second write command to the second server;
The second server receives second write command that the first KTCPVS is sent.
3. object processing method according to claim 2, which is characterized in that the object processing method further include:
First KTCPVS receives the first reading instruction that the client is sent, and first reading instruction reads institute for requesting
First object in first barrel is stated, determines that sending described first to the first server reads according to first reading instruction
Instruction, and first reading instruction is sent to the first server;
The first server receives first reading instruction that the first KTCPVS is sent, and according to first reading instruction
Read first object in described first barrel of the first memory node set;
First KTCPVS receives the second reading instruction that the client is sent, and second reading instruction reads institute for requesting
Second object in first barrel is stated, determines that sending described second to the second server reads to refer to according to the second reading instruction
It enables, and sends second reading instruction to the second server;
The second server receives second reading instruction that the first KTCPVS is sent, and according to second reading instruction
Read second object in described first barrel of the second memory node set.
4. object processing method according to claim 3, which is characterized in that there is the first information on the first KTCPVS,
The first information includes: described first barrel and is corresponding in turn to the first server and the second server;
First KTCPVS is determined according to first write command is sent to the first server for first write command,
Include:
First KTCPVS calculates first object relative to corresponding to described first barrel according to first write command
First cryptographic Hash of number of servers;According to the first information and first cryptographic Hash, determine to described first barrel first
A corresponding first server sends first write command;
First KTCPVS is determined according to second write command is sent to the second server for second write command,
Include:
First KTCPVS calculates second object relative to corresponding to described first barrel according to second write command
Second cryptographic Hash of number of servers;According to the first information and second cryptographic Hash, determine to described first barrel second
A corresponding second server sends second write command;
First KTCPVS is determined according to first reading instruction is sent to the first server for first reading instruction,
Include:
First KTCPVS calculates first object relative to corresponding to described first barrel according to first reading instruction
First cryptographic Hash of number of servers;According to the first information and first cryptographic Hash, determine to described first barrel
First corresponding first server sends first reading instruction;
First KTCPVS is determined according to second reading instruction is sent to the second server for second reading instruction,
Include:
First KTCPVS calculates second object relative to corresponding to described first barrel according to second reading instruction
Second cryptographic Hash of number of servers;According to the first information and second cryptographic Hash, determine to described first barrel
Second corresponding second server sends second reading instruction.
5. object processing method according to claim 4, which is characterized in that the first information includes the first sub-information,
Second sub-information and third sub-information, first sub-information are as follows: described first barrel successively include the first sub- bucket and the second sub- bucket,
Second sub-information are as follows: the corresponding primary server of the first sub- bucket is the first server, the third sub-information are as follows:
The corresponding primary server of the second sub- bucket is the second server;
First KTCPVS is determined according to the first information and first cryptographic Hash to described first barrel of first correspondence
The first server send first write command, comprising:
First KTCPVS is determined first object institute is written according to first sub-information and first cryptographic Hash
It states in the first barrel first corresponding first sub- bucket;According to second sub-information and the first sub- bucket, determine to institute
It states first server and sends first write command;
First KTCPVS is determined according to the first information and second cryptographic Hash to described first barrel of second correspondence
The second server send second write command, comprising:
First KTCPVS is determined second object institute is written according to first sub-information and second cryptographic Hash
It states in the first barrel second corresponding second sub- bucket;According to the third sub-information and the second sub- bucket, determine to institute
It states second server and sends second write command;
First KTCPVS is determined according to the first information and first cryptographic Hash to described first barrel of first correspondence
The first server send first reading instruction, comprising:
First KTCPVS is determined according to first sub-information and first cryptographic Hash and is read described first barrel first
First object in the corresponding first sub- bucket;According to second sub-information and the first sub- bucket, determine to institute
It states first server and sends first reading instruction;
First KTCPVS is determined according to the first information and second cryptographic Hash to described first barrel of second correspondence
The second server send second reading instruction, comprising:
First KTCPVS is determined according to first sub-information and second cryptographic Hash and is read described first barrel second
Second object in the corresponding second sub- bucket;According to the third sub-information and the second sub- bucket, determine to institute
It states second server and sends second reading instruction.
6. object processing method according to claim 4 or 5, which is characterized in that the cloud storage system further includes position
Server is configured with the first information on the location server;
The object processing method further include:
First KTCPVS obtains the first information from the location server.
7. object processing method according to claim 6, which is characterized in that be also configured with second on the location server
Information, second information include: that first barrel of corresponding KTCPVS is the first KTCPVS;The cloud storage system is also
Including domain name system equipment;
First KTCPVS receives the first write command that the client is sent, comprising:
Domain name system equipment receives the first uniform resource locator that the client is sent, and first unified resource is fixed
It include first write command in the symbol of position;Described the is sent to the location server according to first uniform resource locator
One barrel of information;
The location server receives first barrel of the information that domain name system equipment is sent;According to second information
The first instruction information is sent to domain name system with first barrel of the information, the first information is used to indicate described first
KTCPVS;
Domain name system receives the first instruction information that the location server is sent;To described in client transmission
First instruction information;
The client receives the first instruction information that domain name system equipment is sent, according to the first instruction information
First write command is sent to the first KTCPVS;
First KTCPVS receives first write command that the client is sent according to the first instruction information;
First KTCPVS receives the second write command that the client is sent, comprising:
Domain name system equipment receives the second uniform resource locator that the client is sent, and second unified resource is fixed
It include second write command in the symbol of position;Described the is sent to the location server according to second uniform resource locator
One barrel of information;
The location server receives first barrel of the information that domain name system equipment is sent;According to second information
The first instruction information is sent to domain name system with first barrel of the information;
Domain name system receives the first instruction information that the location server is sent;To described in client transmission
First instruction information;
The client receives the first instruction information that domain name system equipment is sent, according to the first instruction information
Second write command is sent to the first KTCPVS;
First KTCPVS receives second write command that the client is sent according to the first instruction information;
First KTCPVS receives the first reading instruction that the client is sent, comprising:
Domain name system equipment receives the third uniform resource locator that the client is sent, and the third unified resource is fixed
It include first reading instruction in the symbol of position;Described the is sent to the location server according to the third uniform resource locator
One barrel of information;
The location server receives first barrel of the information that domain name system equipment is sent;According to second information
The first instruction information is sent to domain name system with first barrel of the information;
Domain name system receives the first instruction information that the location server is sent;To described in client transmission
First instruction information;
The client receives the first instruction information that domain name system equipment is sent, according to the first instruction information
First reading instruction is sent to the first KTCPVS;
First KTCPVS receives first reading instruction that the client is sent according to the first instruction information;
First KTCPVS receives the second reading instruction that the client is sent, comprising:
Domain name system equipment receives the 4th uniform resource locator that the client is sent, and the 4th unified resource is fixed
It include second reading instruction in the symbol of position;Described the is sent to the location server according to the 4th uniform resource locator
One barrel of information;
The location server receives first barrel of the information that domain name system equipment is sent;According to second information
The first instruction information is sent to domain name system with first barrel of the information;
Domain name system receives the first instruction information that the location server is sent;To described in client transmission
First instruction information;
The client receives the first instruction information that domain name system equipment is sent, according to the first instruction information
Second reading instruction is sent to the first KTCPVS;
First KTCPVS receives second reading instruction that the client is sent according to the first instruction information.
8. a kind of cloud storage system, which is characterized in that include first server, the first memory node collection in the cloud storage system
It closes, second server and the second memory node set, the first server and the first memory node set are positioned at described
In the first service region of cloud storage system, the second server and second memory node are located at the cloud storage system
Second service region in, in the first memory node set and the second memory node set include first barrel;
The first server is used for: receiving the first write command that client is sent, first write command is for requesting the
In described first barrel of an object write-in;According to the first write command, the first memory node set is written into first object
Described first barrel in, and first object is sent to the second server, in order to which the second server is by institute
The first object is stated to be written in described first barrel of the second memory node set;
The second server is used for: receiving the second write command that the client is sent, second write command is for requesting
By in described first barrel of the second object write-in, according to second write command, second object write-in described second is stored
In described first barrel of node set, and second object is sent to the first server, in order to the first service
Second object is written in described first barrel of the first memory node set device.
9. cloud storage system according to claim 8, which is characterized in that the cloud storage system further includes that the first kernel passes
Transport control protocol discusses virtual server KTCPVS;
First KTCPVS is used for: receiving first write command that the client is sent;According to first write command
It determines and first write command is sent to the first server;First write command is sent to the first server;
Receive second write command that the client is sent;It is determined according to second write command and sends second write command
To the second server;Second write command is sent to the second server;
The first server is specifically used for: receiving the client by what the first KTCPVS was sent and described first writes finger
It enables;
The second server is specifically used for: receiving the client by what the first KTCPVS was sent and described second writes finger
It enables.
10. cloud storage system according to claim 9, which is characterized in that the first KTCPVS is also used to: described in reception
The first reading instruction that client is sent, first reading instruction are used to request to read first object in described first barrel;
It is determined according to first reading instruction and the first server is sent into first reading instruction;It is sent to the first server
First reading instruction;The second reading instruction that the client is sent is received, second reading instruction is for requesting described in reading
Second object in first barrel;It is determined according to the second reading instruction to the second server and sends second reading instruction;
Second reading instruction is sent to the second server;
The first server is also used to: receiving first reading instruction that the first KTCPVS is sent;According to described first
Reading instruction reads first object in described first barrel of the first memory node set;
The second server is also used to: receiving second reading instruction that the first KTCPVS is sent;According to described second
Reading instruction reads second object in described first barrel of the second memory node set.
11. cloud storage system according to claim 10, which is characterized in that there is the first information on the first KTCPVS,
The first information: described first barrel is corresponding in turn to the first server and the second server;
First KTCPVS is specifically used for: according to first write command, calculating first object relative to described first
First cryptographic Hash of bucket mapped number of servers;According to the first information and first cryptographic Hash, determine to described
The first barrel first corresponding first server sends first write command;
First KTCPVS is specifically used for: according to second write command, calculating second object relative to described first
Second cryptographic Hash of bucket mapped number of servers;According to the first information and second cryptographic Hash, determine to described
The first barrel second corresponding second server sends second write command;
First KTCPVS is specifically used for: according to first reading instruction, calculating first object relative to described first
First cryptographic Hash of bucket mapped number of servers;According to the first information and first cryptographic Hash, determine to
The first barrel first corresponding first server sends first reading instruction;
First KTCPVS is specifically used for: according to second reading instruction, calculating second object relative to described first
Second cryptographic Hash of bucket mapped number of servers;According to the first information and second cryptographic Hash, determine to
The first barrel second corresponding second server sends second reading instruction.
12. cloud storage system according to claim 11, which is characterized in that the first information includes the first sub-information,
Second sub-information and third sub-information, first sub-information are as follows: described first barrel successively include the first sub- bucket and the second sub- bucket,
Second sub-information are as follows: the corresponding primary server of the first sub- bucket is the first server, the third sub-information are as follows:
The corresponding primary server of the second sub- bucket is the second server;
First KTCPVS is specifically used for: according to first write command, calculating first object relative to described first
First cryptographic Hash of the corresponding sub- barrelage amount of bucket;According to first sub-information and first cryptographic Hash, determine institute
The first object is stated to be written in the first barrel first corresponding first sub- bucket;According to second sub-information and described
One sub- bucket determines to the first server and sends first write command;
First KTCPVS is specifically used for: according to second write command, calculating second object relative to described first
Second cryptographic Hash of the corresponding sub- barrelage amount of bucket;It will be described according to first sub-information and the second cryptographic Hash determination
Second object is written in the first barrel second corresponding second sub- bucket;According to the third sub-information and described second
Sub- bucket determines to the second server and sends second write command;
First KTCPVS is specifically used for: according to first reading instruction, calculating first object relative to described first
First cryptographic Hash of the corresponding sub- barrelage amount of bucket;According to first sub-information and first cryptographic Hash, determines and read
First object in the first barrel first corresponding first sub- bucket;According to second sub-information and described
One sub- bucket determines to the first server and sends first reading instruction;
First KTCPVS is specifically used for: according to second reading instruction, calculating second object relative to described first
Second cryptographic Hash of the corresponding sub- barrelage amount of bucket;It is determined according to first sub-information and second cryptographic Hash and reads institute
State second object in the first barrel second corresponding second sub- bucket;According to the third sub-information and described second
Sub- bucket determines to the second server and sends second reading instruction.
13. cloud storage system according to claim 11 or 12, which is characterized in that the cloud storage service device further includes position
Server is set, is configured with the first information on the location server;
First KTCPVS is also used to: obtaining the first information from the location server.
14. cloud storage system according to claim 13, which is characterized in that be also configured with second on the location server
Information, second information include: that first barrel of corresponding KTCPVS is the first KTCPVS;The cloud storage system is also
Including domain name system equipment;
Domain name system equipment is used for: receiving the first uniform resource locator that the client is sent, first unification
It include first write command in Resource Locator;It is sent according to first uniform resource locator to the location server
First barrel of the information;Receive the second uniform resource locator that the client is sent, the second unified resource positioning
It include second write command in symbol;Described first is sent to the location server according to second uniform resource locator
The information of bucket;The third uniform resource locator that the client is sent is received, includes in the third uniform resource locator
First reading instruction;First barrel of the letter is sent to the location server according to the third uniform resource locator
Breath;The 4th uniform resource locator that the client is sent is received, includes described the in the 4th uniform resource locator
Two reading instructions;First barrel of the information is sent to the location server according to the 4th uniform resource locator;
The location server is used for: receiving first barrel of the information that domain name system equipment is sent;According to described
Two information and first barrel of the information send first to domain name system and indicate information, and the first information is used to indicate institute
State the first KTCPVS;
Domain name system is also used to: receiving the first instruction information that the location server is sent;To the client
The first instruction information is sent, in order to which the client indicates information to described in client transmission according to described first
First write command is write in order to which the client sends described second to the first KTCPVS according to the first instruction information
Instruction, in order to which the client sends first reading instruction to the first KTCPVS according to the first instruction information,
In order to which the client sends second reading instruction to the first KTCPVS according to the first instruction information.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710896038.5A CN109587185B (en) | 2017-09-28 | 2017-09-28 | Cloud storage system and object processing method in cloud storage system |
CN202011127481.4A CN112422630A (en) | 2017-09-28 | 2017-09-28 | Cloud storage system and object processing method in cloud storage system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710896038.5A CN109587185B (en) | 2017-09-28 | 2017-09-28 | Cloud storage system and object processing method in cloud storage system |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011127481.4A Division CN112422630A (en) | 2017-09-28 | 2017-09-28 | Cloud storage system and object processing method in cloud storage system |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109587185A true CN109587185A (en) | 2019-04-05 |
CN109587185B CN109587185B (en) | 2020-11-03 |
Family
ID=65912961
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011127481.4A Pending CN112422630A (en) | 2017-09-28 | 2017-09-28 | Cloud storage system and object processing method in cloud storage system |
CN201710896038.5A Active CN109587185B (en) | 2017-09-28 | 2017-09-28 | Cloud storage system and object processing method in cloud storage system |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011127481.4A Pending CN112422630A (en) | 2017-09-28 | 2017-09-28 | Cloud storage system and object processing method in cloud storage system |
Country Status (1)
Country | Link |
---|---|
CN (2) | CN112422630A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111309522A (en) * | 2020-02-14 | 2020-06-19 | 星辰天合(北京)数据科技有限公司 | Object storage data protection method and device based on snapshot technology |
WO2022073458A1 (en) * | 2020-10-10 | 2022-04-14 | 华为云计算技术有限公司 | Data modification method for object storage service, service node, client and device |
CN114448781A (en) * | 2021-12-22 | 2022-05-06 | 天翼云科技有限公司 | Data processing system |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120150930A1 (en) * | 2010-12-10 | 2012-06-14 | Electronics And Telecommunications Research Institute | Cloud storage and method for managing the same |
CN102880715A (en) * | 2012-10-09 | 2013-01-16 | 南京市测绘勘察研究院有限公司 | Data pool management method and data pool management system on basis of cloud storage |
CN103067525A (en) * | 2013-01-18 | 2013-04-24 | 广东工业大学 | Cloud storage data backup method based on characteristic codes |
CN103226483A (en) * | 2013-03-25 | 2013-07-31 | 成都瑞科电气有限公司 | DHBS (dual hot-backup system) and method thereof based on SOA (service-oriented architecture) and cloud storage |
CN103763383A (en) * | 2014-01-27 | 2014-04-30 | 西安雷迪维护系统设备有限公司 | Integrated cloud storage system and storage method thereof |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104202375B (en) * | 2014-08-22 | 2017-10-24 | 广州华多网络科技有限公司 | The method and system of synchrodata |
-
2017
- 2017-09-28 CN CN202011127481.4A patent/CN112422630A/en active Pending
- 2017-09-28 CN CN201710896038.5A patent/CN109587185B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120150930A1 (en) * | 2010-12-10 | 2012-06-14 | Electronics And Telecommunications Research Institute | Cloud storage and method for managing the same |
CN102880715A (en) * | 2012-10-09 | 2013-01-16 | 南京市测绘勘察研究院有限公司 | Data pool management method and data pool management system on basis of cloud storage |
CN103067525A (en) * | 2013-01-18 | 2013-04-24 | 广东工业大学 | Cloud storage data backup method based on characteristic codes |
CN103226483A (en) * | 2013-03-25 | 2013-07-31 | 成都瑞科电气有限公司 | DHBS (dual hot-backup system) and method thereof based on SOA (service-oriented architecture) and cloud storage |
CN103763383A (en) * | 2014-01-27 | 2014-04-30 | 西安雷迪维护系统设备有限公司 | Integrated cloud storage system and storage method thereof |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111309522A (en) * | 2020-02-14 | 2020-06-19 | 星辰天合(北京)数据科技有限公司 | Object storage data protection method and device based on snapshot technology |
WO2022073458A1 (en) * | 2020-10-10 | 2022-04-14 | 华为云计算技术有限公司 | Data modification method for object storage service, service node, client and device |
CN114448781A (en) * | 2021-12-22 | 2022-05-06 | 天翼云科技有限公司 | Data processing system |
CN114448781B (en) * | 2021-12-22 | 2024-06-07 | 天翼云科技有限公司 | Data processing system |
Also Published As
Publication number | Publication date |
---|---|
CN109587185B (en) | 2020-11-03 |
CN112422630A (en) | 2021-02-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10754575B2 (en) | Storage system with replication process utilizing simulated target responses | |
US10866760B2 (en) | Storage system with efficient detection and clean-up of stale data for sparsely-allocated storage in replication | |
US11550819B2 (en) | Synchronization cache seeding | |
US20200364106A1 (en) | Storage system with coordinated recovery across multiple input-output journals of different types | |
US11308223B2 (en) | Blockchain-based file handling | |
US11880280B2 (en) | Variable number and size of put operations for storage backup | |
CN110351363A (en) | Data back up method, equipment and computer readable storage medium | |
CN101924693A (en) | Be used for method and system in migrating processes between virtual machines | |
CN108076090A (en) | Data processing method and storage management system | |
CN109587185A (en) | Object processing method in cloud storage system and cloud storage system | |
CN105740469B (en) | Storage server and metadata access method | |
CN108023953A (en) | The high availability implementation method and device of FTP service | |
CN110069346A (en) | Resource share method, device, electronic equipment between multi-process | |
CN106776146A (en) | A kind of data verification method, apparatus and system | |
CN107038092B (en) | Data copying method and device | |
US11099767B2 (en) | Storage system with throughput-based timing of synchronous replication recovery | |
CN109873839A (en) | Method, server and the distributed system of data access | |
CN108830093A (en) | Management method, server and the terminal device of terminal device operating right | |
CN109691065B (en) | Distributed storage system and data read-write method thereof, storage terminal and storage medium | |
CN109597903A (en) | Image file processing apparatus and method, document storage system and storage medium | |
CN108200211A (en) | Method, node and the inquiry server that image file is downloaded in cluster | |
KR20130045159A (en) | Apparatus and method for client's participating in data storage of distributed file system | |
US20170063972A1 (en) | System and method for avoiding proxy connection latency | |
CN106210162B (en) | Communication control method and device | |
CN107967165A (en) | The offline moving method of virtual machine based on LVM |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |